2023-10-16T12:46:33.006 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-16T12:46:33.007 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --verbose --archive /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428996 --owner scheduled_rishabh@teuthology --name rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi -- /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428996/orig.config.yaml 2023-10-16T12:46:33.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:46:33.147 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428996 branch: rishabh-2023oct13 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7428996' kernel: client: sha1: distro flavor: default kdb: true sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: rishabh-2023oct13 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2023oct13-b2 sha1: 33be745ec4531df08cd1bb70b4c9c1f89be58078 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6006 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 sleep_before_teardown: 0 subset: 402/512 suite: fs suite_branch: rishabh-2023oct13-b2 suite_path: /home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa suite_relpath: qa suite_repo: https://github.com/rishabh-d-dave/ceph suite_sha1: 33be745ec4531df08cd1bb70b4c9c1f89be58078 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi124.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi192.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-16_12:17:50 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-16T12:46:33.148 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa; will attempt to use it 2023-10-16T12:46:33.149 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks 2023-10-16T12:46:33.149 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-16T12:46:33.151 INFO:teuthology.task.internal:Checking packages... 2023-10-16T12:46:33.212 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0' 2023-10-16T12:46:33.212 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-16T12:46:33.213 INFO:teuthology.packaging:ref: None 2023-10-16T12:46:33.213 INFO:teuthology.packaging:tag: None 2023-10-16T12:46:33.213 INFO:teuthology.packaging:branch: rishabh-2023oct13 2023-10-16T12:46:33.214 INFO:teuthology.packaging:sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T12:46:33.214 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=rishabh-2023oct13 2023-10-16T12:46:33.455 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6730.g4ba8a190 2023-10-16T12:46:33.455 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-16T12:46:33.462 INFO:teuthology.task.internal:no buildpackages task found 2023-10-16T12:46:33.462 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-16T12:46:33.498 INFO:teuthology.task.internal:Saving configuration 2023-10-16T12:46:33.514 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-16T12:46:33.531 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T12:46:33.556 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428996', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 12:41:27.610722', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T12:46:33.581 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428996', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 12:41:27.612364', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T12:46:33.581 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-16T12:46:33.589 INFO:teuthology.task.internal:roles: ubuntu@smithi124.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-16T12:46:33.589 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-16T12:46:33.589 INFO:teuthology.run_tasks:Running task console_log... 2023-10-16T12:46:33.687 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f72a226ba60>, signals=[15]) 2023-10-16T12:46:33.688 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-16T12:46:33.694 INFO:teuthology.task.internal:Opening connections... 2023-10-16T12:46:33.694 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi124.front.sepia.ceph.com 2023-10-16T12:46:33.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T12:46:33.764 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi192.front.sepia.ceph.com 2023-10-16T12:46:33.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T12:46:33.833 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-16T12:46:33.839 DEBUG:teuthology.orchestra.run.smithi124:> uname -m 2023-10-16T12:46:33.860 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2023-10-16T12:46:33.861 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-10-16T12:46:33.920 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T12:46:33.920 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T12:46:33.921 INFO:teuthology.orchestra.run.smithi124.stdout:ID="rhel" 2023-10-16T12:46:33.921 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="fedora" 2023-10-16T12:46:33.921 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8.6" 2023-10-16T12:46:33.921 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2023-10-16T12:46:33.921 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T12:46:33.922 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-10-16T12:46:33.922 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T12:46:33.922 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T12:46:33.922 INFO:teuthology.orchestra.run.smithi124.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T12:46:33.923 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T12:46:33.923 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:46:33.923 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T12:46:33.923 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T12:46:33.923 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T12:46:33.924 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T12:46:33.924 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-10-16T12:46:33.946 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2023-10-16T12:46:33.966 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2023-10-16T12:46:33.966 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-10-16T12:46:34.025 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T12:46:34.026 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T12:46:34.026 INFO:teuthology.orchestra.run.smithi192.stdout:ID="rhel" 2023-10-16T12:46:34.026 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="fedora" 2023-10-16T12:46:34.026 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8.6" 2023-10-16T12:46:34.026 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2023-10-16T12:46:34.027 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T12:46:34.027 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-10-16T12:46:34.027 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T12:46:34.027 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T12:46:34.027 INFO:teuthology.orchestra.run.smithi192.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T12:46:34.028 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T12:46:34.028 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:46:34.028 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T12:46:34.028 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T12:46:34.028 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T12:46:34.029 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T12:46:34.029 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-10-16T12:46:34.054 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-16T12:46:34.063 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-16T12:46:34.132 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-16T12:46:34.132 DEBUG:teuthology.orchestra.run.smithi124:> test '!' -e /home/ubuntu/cephtest 2023-10-16T12:46:34.135 DEBUG:teuthology.orchestra.run.smithi192:> test '!' -e /home/ubuntu/cephtest 2023-10-16T12:46:34.154 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-16T12:46:34.164 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-16T12:46:34.165 DEBUG:teuthology.orchestra.run.smithi124:> test -z $(ls -A /var/lib/ceph) 2023-10-16T12:46:34.191 DEBUG:teuthology.orchestra.run.smithi192:> test -z $(ls -A /var/lib/ceph) 2023-10-16T12:46:34.218 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-16T12:46:34.317 INFO:teuthology.run_tasks:Running task kernel... 2023-10-16T12:46:34.331 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'} 2023-10-16T12:46:34.332 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-16T12:46:34.333 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-16T12:46:34.333 DEBUG:teuthology.orchestra.run.smithi124:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-16T12:46:34.334 DEBUG:teuthology.orchestra.run.smithi192:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-16T12:46:34.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:46:34.353 DEBUG:teuthology.orchestra.run.smithi124:> uname -r 2023-10-16T12:46:34.353 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:46:34.354 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2023-10-16T12:46:34.409 INFO:teuthology.orchestra.run.smithi124.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-16T12:46:34.410 INFO:teuthology.task.kernel:Running kernel on smithi124: 4.18.0-372.9.1.el8.x86_64 2023-10-16T12:46:34.410 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum install -y kernel 2023-10-16T12:46:34.413 INFO:teuthology.orchestra.run.smithi192.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-16T12:46:34.413 INFO:teuthology.task.kernel:Running kernel on smithi192: 4.18.0-372.9.1.el8.x86_64 2023-10-16T12:46:34.413 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum install -y kernel 2023-10-16T12:46:35.614 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2023-10-16T12:46:35.615 INFO:teuthology.orchestra.run.smithi192.stdout:Unable to read consumer identity 2023-10-16T12:46:35.684 INFO:teuthology.orchestra.run.smithi124.stdout:Updating Subscription Management repositories. 2023-10-16T12:46:35.684 INFO:teuthology.orchestra.run.smithi124.stdout:Unable to read consumer identity 2023-10-16T12:46:37.104 INFO:teuthology.orchestra.run.smithi192.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2023-10-16T12:46:37.133 INFO:teuthology.orchestra.run.smithi124.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-10-16T12:46:37.875 INFO:teuthology.orchestra.run.smithi124.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2023-10-16T12:46:38.047 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:00 2023-10-16T12:46:41.450 INFO:teuthology.orchestra.run.smithi124.stdout:lab-extras 373 kB/s | 24 kB 00:00 2023-10-16T12:46:41.547 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 452 kB/s | 24 kB 00:00 2023-10-16T12:46:42.153 INFO:teuthology.orchestra.run.smithi124.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-16T12:46:42.201 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-10-16T12:46:42.202 INFO:teuthology.orchestra.run.smithi124.stdout:Nothing to do. 2023-10-16T12:46:42.203 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-10-16T12:46:42.266 INFO:teuthology.orchestra.run.smithi192.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-16T12:46:42.316 DEBUG:teuthology.orchestra.run.smithi124:> echo no | sudo yum reinstall kernel || true 2023-10-16T12:46:42.317 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-10-16T12:46:42.317 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2023-10-16T12:46:42.317 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-10-16T12:46:42.440 DEBUG:teuthology.orchestra.run.smithi192:> echo no | sudo yum reinstall kernel || true 2023-10-16T12:46:42.647 INFO:teuthology.orchestra.run.smithi124.stdout:Updating Subscription Management repositories. 2023-10-16T12:46:42.647 INFO:teuthology.orchestra.run.smithi124.stdout:Unable to read consumer identity 2023-10-16T12:46:42.771 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2023-10-16T12:46:42.771 INFO:teuthology.orchestra.run.smithi192.stdout:Unable to read consumer identity 2023-10-16T12:46:42.906 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:00:01 ago on Mon 16 Oct 2023 12:46:41 PM UTC. 2023-10-16T12:46:42.947 INFO:teuthology.orchestra.run.smithi124.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-16T12:46:42.976 INFO:teuthology.orchestra.run.smithi124.stderr:Error: No packages marked for reinstall. 2023-10-16T12:46:43.022 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum reinstall -y kernel || true 2023-10-16T12:46:43.033 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:02 ago on Mon 16 Oct 2023 12:46:41 PM UTC. 2023-10-16T12:46:43.074 INFO:teuthology.orchestra.run.smithi192.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-16T12:46:43.107 INFO:teuthology.orchestra.run.smithi192.stderr:Error: No packages marked for reinstall. 2023-10-16T12:46:43.154 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum reinstall -y kernel || true 2023-10-16T12:46:43.351 INFO:teuthology.orchestra.run.smithi124.stdout:Updating Subscription Management repositories. 2023-10-16T12:46:43.351 INFO:teuthology.orchestra.run.smithi124.stdout:Unable to read consumer identity 2023-10-16T12:46:43.483 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2023-10-16T12:46:43.483 INFO:teuthology.orchestra.run.smithi192.stdout:Unable to read consumer identity 2023-10-16T12:46:43.616 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:00:02 ago on Mon 16 Oct 2023 12:46:41 PM UTC. 2023-10-16T12:46:43.659 INFO:teuthology.orchestra.run.smithi124.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-16T12:46:43.683 INFO:teuthology.orchestra.run.smithi124.stderr:Error: No packages marked for reinstall. 2023-10-16T12:46:43.730 DEBUG:teuthology.orchestra.run.smithi124:> rpm -q kernel | sort -rV | head -n 1 2023-10-16T12:46:43.745 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:02 ago on Mon 16 Oct 2023 12:46:41 PM UTC. 2023-10-16T12:46:43.785 INFO:teuthology.orchestra.run.smithi192.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-16T12:46:43.810 INFO:teuthology.orchestra.run.smithi124.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-16T12:46:43.811 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-16T12:46:43.811 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-16T12:46:43.811 DEBUG:teuthology.parallel:result is None 2023-10-16T12:46:43.812 INFO:teuthology.orchestra.run.smithi192.stderr:Error: No packages marked for reinstall. 2023-10-16T12:46:43.858 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q kernel | sort -rV | head -n 1 2023-10-16T12:46:43.940 INFO:teuthology.orchestra.run.smithi192.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-16T12:46:43.940 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-16T12:46:43.941 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-16T12:46:43.941 DEBUG:teuthology.parallel:result is None 2023-10-16T12:46:43.941 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-16T12:46:43.948 INFO:teuthology.task.internal:Creating test directory... 2023-10-16T12:46:43.948 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-16T12:46:43.950 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-16T12:46:43.967 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-16T12:46:43.997 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-16T12:46:44.031 INFO:teuthology.task.internal:Creating archive directory... 2023-10-16T12:46:44.031 DEBUG:teuthology.orchestra.run.smithi124:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-16T12:46:44.034 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-16T12:46:44.056 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-16T12:46:44.063 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-16T12:46:44.063 DEBUG:teuthology.orchestra.run.smithi124:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-16T12:46:44.091 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-16T12:46:44.125 INFO:teuthology.orchestra.run.smithi124.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T12:46:44.138 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T12:46:44.146 INFO:teuthology.orchestra.run.smithi124.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T12:46:44.150 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T12:46:44.151 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-16T12:46:44.158 INFO:teuthology.task.internal:Configuring sudo... 2023-10-16T12:46:44.159 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-16T12:46:44.190 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-16T12:46:44.217 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-16T12:46:44.226 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-16T12:46:44.226 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-16T12:46:44.257 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-16T12:46:44.274 DEBUG:teuthology.orchestra.run.smithi124:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T12:46:44.354 DEBUG:teuthology.orchestra.run.smithi124:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T12:46:44.412 DEBUG:teuthology.orchestra.run.smithi124:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T12:46:44.497 DEBUG:teuthology.orchestra.run.smithi124:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T12:46:44.536 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:46:44.537 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-16T12:46:44.608 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T12:46:44.646 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T12:46:44.704 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T12:46:44.787 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T12:46:44.829 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:46:44.830 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-16T12:46:44.896 DEBUG:teuthology.orchestra.run.smithi124:> sudo service rsyslog restart 2023-10-16T12:46:44.899 DEBUG:teuthology.orchestra.run.smithi192:> sudo service rsyslog restart 2023-10-16T12:46:44.959 INFO:teuthology.orchestra.run.smithi124.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T12:46:44.994 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T12:46:45.263 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-16T12:46:45.270 INFO:teuthology.task.internal:Starting timer... 2023-10-16T12:46:45.271 INFO:teuthology.run_tasks:Running task pcp... 2023-10-16T12:46:45.309 INFO:teuthology.run_tasks:Running task selinux... 2023-10-16T12:46:45.341 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-16T12:46:45.342 DEBUG:teuthology.orchestra.run.smithi124:> sudo service auditd rotate 2023-10-16T12:46:45.402 INFO:teuthology.orchestra.run.smithi124.stdout:Rotating logs: 2023-10-16T12:46:45.404 DEBUG:teuthology.orchestra.run.smithi192:> sudo service auditd rotate 2023-10-16T12:46:45.466 INFO:teuthology.orchestra.run.smithi192.stdout:Rotating logs: 2023-10-16T12:46:45.468 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-16T12:46:45.468 DEBUG:teuthology.orchestra.run.smithi124:> /usr/sbin/getenforce 2023-10-16T12:46:45.494 INFO:teuthology.orchestra.run.smithi124.stdout:Permissive 2023-10-16T12:46:45.494 DEBUG:teuthology.orchestra.run.smithi192:> /usr/sbin/getenforce 2023-10-16T12:46:45.515 INFO:teuthology.orchestra.run.smithi192.stdout:Permissive 2023-10-16T12:46:45.516 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi124.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi192.front.sepia.ceph.com': 'permissive'} 2023-10-16T12:46:45.516 DEBUG:teuthology.orchestra.run.smithi124:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T12:46:45.560 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:46:45.561 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T12:46:45.587 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:46:45.588 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-16T12:46:45.588 DEBUG:teuthology.orchestra.run.smithi124:> sudo /usr/sbin/setenforce permissive 2023-10-16T12:46:45.627 DEBUG:teuthology.orchestra.run.smithi192:> sudo /usr/sbin/setenforce permissive 2023-10-16T12:46:45.656 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-16T12:46:45.666 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-16T12:46:45.671 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-16T12:46:46.395 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-16T12:46:46.413 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-16T12:46:46.415 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi124.front.sepia.ceph.com,smithi192.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-16T12:55:32.166 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi124.front.sepia.ceph.com'), Remote(name='ubuntu@smithi192.front.sepia.ceph.com')] 2023-10-16T12:55:32.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T12:55:32.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T12:55:32.237 DEBUG:teuthology.orchestra.run.smithi124:> true 2023-10-16T12:55:32.303 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T12:55:32.304 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-16T12:55:32.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T12:55:32.372 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-10-16T12:55:32.439 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-16T12:55:32.440 INFO:teuthology.run_tasks:Running task clock... 2023-10-16T12:55:32.453 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-16T12:55:32.454 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-16T12:55:32.455 DEBUG:teuthology.orchestra.run.smithi124:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T12:55:32.457 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-16T12:55:32.458 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T12:55:32.486 INFO:teuthology.orchestra.run.smithi124.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-16T12:55:32.501 INFO:teuthology.orchestra.run.smithi124.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-16T12:55:32.512 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-16T12:55:32.526 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-16T12:55:32.579 INFO:teuthology.orchestra.run.smithi124.stderr:sudo: ntpd: command not found 2023-10-16T12:55:32.590 INFO:teuthology.orchestra.run.smithi124.stdout:506 Cannot talk to daemon 2023-10-16T12:55:32.594 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: ntpd: command not found 2023-10-16T12:55:32.604 INFO:teuthology.orchestra.run.smithi124.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-16T12:55:32.606 INFO:teuthology.orchestra.run.smithi192.stdout:506 Cannot talk to daemon 2023-10-16T12:55:32.618 INFO:teuthology.orchestra.run.smithi124.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-16T12:55:32.621 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-16T12:55:32.635 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-16T12:55:32.696 INFO:teuthology.orchestra.run.smithi124.stderr:bash: ntpq: command not found 2023-10-16T12:55:32.699 INFO:teuthology.orchestra.run.smithi124.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T12:55:32.699 INFO:teuthology.orchestra.run.smithi124.stdout:=============================================================================== 2023-10-16T12:55:32.700 INFO:teuthology.orchestra.run.smithi124.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T12:55:32.700 INFO:teuthology.orchestra.run.smithi124.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T12:55:32.700 INFO:teuthology.orchestra.run.smithi124.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T12:55:32.700 INFO:teuthology.orchestra.run.smithi124.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T12:55:32.708 INFO:teuthology.orchestra.run.smithi192.stderr:bash: ntpq: command not found 2023-10-16T12:55:32.711 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T12:55:32.711 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2023-10-16T12:55:32.711 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T12:55:32.712 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T12:55:32.712 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T12:55:32.712 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T12:55:32.713 INFO:teuthology.run_tasks:Running task install... 2023-10-16T12:55:32.721 DEBUG:teuthology.task.install:project ceph 2023-10-16T12:55:32.722 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}} 2023-10-16T12:55:32.722 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'} 2023-10-16T12:55:32.722 INFO:teuthology.task.install:Using flavor: default 2023-10-16T12:55:32.728 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-16T12:55:32.728 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-16T12:55:32.729 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-16T12:55:32.730 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T12:55:32.731 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-16T12:55:32.732 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T12:55:32.872 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/ 2023-10-16T12:55:32.872 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-16T12:55:33.119 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/ 2023-10-16T12:55:33.120 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-16T12:55:33.280 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-16T12:55:33.280 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:55:33.281 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-16T12:55:33.314 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-16T12:55:33.314 DEBUG:teuthology.orchestra.run.smithi192:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-16T12:55:33.387 DEBUG:teuthology.orchestra.run.smithi192:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-16T12:55:33.468 DEBUG:teuthology.orchestra.run.smithi192:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-16T12:55:33.508 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-16T12:55:33.508 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:55:33.508 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-16T12:55:33.536 INFO:teuthology.orchestra.run.smithi192.stdout:check_obsoletes = 1 2023-10-16T12:55:33.537 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum clean all 2023-10-16T12:55:33.540 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-16T12:55:33.540 DEBUG:teuthology.orchestra.run.smithi124:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-16T12:55:33.610 DEBUG:teuthology.orchestra.run.smithi124:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-16T12:55:33.689 DEBUG:teuthology.orchestra.run.smithi124:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-16T12:55:33.756 INFO:teuthology.orchestra.run.smithi124.stdout:check_obsoletes = 1 2023-10-16T12:55:33.757 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum clean all 2023-10-16T12:55:33.910 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2023-10-16T12:55:34.129 INFO:teuthology.orchestra.run.smithi124.stdout:Updating Subscription Management repositories. 2023-10-16T12:55:34.130 INFO:teuthology.orchestra.run.smithi192.stdout:44 files removed 2023-10-16T12:55:34.178 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-16T12:55:34.354 INFO:teuthology.orchestra.run.smithi124.stdout:44 files removed 2023-10-16T12:55:34.401 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-16T12:55:34.510 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2023-10-16T12:55:34.731 INFO:teuthology.orchestra.run.smithi124.stdout:Updating Subscription Management repositories. 2023-10-16T12:55:35.240 INFO:teuthology.orchestra.run.smithi192.stdout:ceph packages for x86_64 207 kB/s | 81 kB 00:00 2023-10-16T12:55:35.607 INFO:teuthology.orchestra.run.smithi192.stdout:ceph noarch packages 28 kB/s | 9.4 kB 00:00 2023-10-16T12:55:35.637 INFO:teuthology.orchestra.run.smithi124.stdout:ceph packages for x86_64 144 kB/s | 81 kB 00:00 2023-10-16T12:55:35.974 INFO:teuthology.orchestra.run.smithi192.stdout:ceph source packages 4.3 kB/s | 1.5 kB 00:00 2023-10-16T12:55:36.163 INFO:teuthology.orchestra.run.smithi124.stdout:ceph noarch packages 19 kB/s | 9.4 kB 00:00 2023-10-16T12:55:36.342 INFO:teuthology.orchestra.run.smithi192.stdout:Copr repo for python3-asyncssh owned by ceph 10 kB/s | 3.5 kB 00:00 2023-10-16T12:55:36.681 INFO:teuthology.orchestra.run.smithi124.stdout:ceph source packages 3.0 kB/s | 1.5 kB 00:00 2023-10-16T12:55:36.961 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 27 MB/s | 16 MB 00:00 2023-10-16T12:55:37.182 INFO:teuthology.orchestra.run.smithi124.stdout:Copr repo for python3-asyncssh owned by ceph 7.2 kB/s | 3.5 kB 00:00 2023-10-16T12:55:39.577 INFO:teuthology.orchestra.run.smithi124.stdout:Extra Packages for Enterprise Linux 6.7 MB/s | 16 MB 00:02 2023-10-16T12:55:40.477 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 411 kB/s | 24 kB 00:00 2023-10-16T12:55:41.353 INFO:teuthology.orchestra.run.smithi192.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 59 MB/s | 47 MB 00:00 2023-10-16T12:55:43.109 INFO:teuthology.orchestra.run.smithi124.stdout:lab-extras 333 kB/s | 24 kB 00:00 2023-10-16T12:55:44.027 INFO:teuthology.orchestra.run.smithi124.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 63 MB/s | 53 MB 00:00 2023-10-16T12:55:49.271 INFO:teuthology.orchestra.run.smithi192.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 MB/s | 53 MB 00:00 2023-10-16T12:55:52.237 INFO:teuthology.orchestra.run.smithi124.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 54 MB/s | 47 MB 00:00 2023-10-16T12:56:00.461 INFO:teuthology.orchestra.run.smithi192.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T12:56:00.462 INFO:teuthology.orchestra.run.smithi192.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T12:56:00.476 INFO:teuthology.orchestra.run.smithi192.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-16T12:56:00.477 INFO:teuthology.orchestra.run.smithi192.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-16T12:56:00.478 INFO:teuthology.orchestra.run.smithi192.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-16T12:56:00.479 INFO:teuthology.orchestra.run.smithi192.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-16T12:56:00.482 INFO:teuthology.orchestra.run.smithi192.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-16T12:56:00.485 INFO:teuthology.orchestra.run.smithi192.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-16T12:56:00.486 INFO:teuthology.orchestra.run.smithi192.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-16T12:56:00.622 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-10-16T12:56:00.634 INFO:teuthology.orchestra.run.smithi192.stdout:=========================================================================================================================== 2023-10-16T12:56:00.635 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2023-10-16T12:56:00.635 INFO:teuthology.orchestra.run.smithi192.stdout:=========================================================================================================================== 2023-10-16T12:56:00.635 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-10-16T12:56:00.635 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-16T12:56:00.635 INFO:teuthology.orchestra.run.smithi192.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-16T12:56:00.635 INFO:teuthology.orchestra.run.smithi192.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.4 k 2023-10-16T12:56:00.636 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 5.4 M 2023-10-16T12:56:00.636 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 918 k 2023-10-16T12:56:00.636 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 167 k 2023-10-16T12:56:00.636 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 1.6 M 2023-10-16T12:56:00.636 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 132 k 2023-10-16T12:56:00.637 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 1.8 M 2023-10-16T12:56:00.637 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 7.4 M 2023-10-16T12:56:00.637 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 47 k 2023-10-16T12:56:00.637 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 14 M 2023-10-16T12:56:00.637 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 49 M 2023-10-16T12:56:00.638 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 261 k 2023-10-16T12:56:00.638 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 192 k 2023-10-16T12:56:00.638 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 261 k 2023-10-16T12:56:00.638 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 18 k 2023-10-16T12:56:00.638 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-16T12:56:00.638 INFO:teuthology.orchestra.run.smithi192.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-16T12:56:00.639 INFO:teuthology.orchestra.run.smithi192.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-16T12:56:00.639 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 31 k 2023-10-16T12:56:00.639 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 839 k 2023-10-16T12:56:00.639 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 139 k 2023-10-16T12:56:00.639 INFO:teuthology.orchestra.run.smithi192.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-16T12:56:00.640 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-16T12:56:00.640 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-16T12:56:00.640 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-16T12:56:00.640 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-16T12:56:00.640 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-16T12:56:00.641 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 197 k 2023-10-16T12:56:00.641 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 371 k 2023-10-16T12:56:00.641 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 365 k 2023-10-16T12:56:00.641 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 107 k 2023-10-16T12:56:00.641 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 94 k 2023-10-16T12:56:00.641 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.6 M 2023-10-16T12:56:00.642 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 179 k 2023-10-16T12:56:00.642 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-16T12:56:00.642 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrading: 2023-10-16T12:56:00.642 INFO:teuthology.orchestra.run.smithi192.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-16T12:56:00.642 INFO:teuthology.orchestra.run.smithi192.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T12:56:00.643 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T12:56:00.643 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2023-10-16T12:56:00.643 INFO:teuthology.orchestra.run.smithi192.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-16T12:56:00.643 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 23 M 2023-10-16T12:56:00.643 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 23 k 2023-10-16T12:56:00.644 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 2.3 M 2023-10-16T12:56:00.644 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 242 k 2023-10-16T12:56:00.644 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 4.6 M 2023-10-16T12:56:00.644 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 18 M 2023-10-16T12:56:00.644 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 15 k 2023-10-16T12:56:00.644 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 24 k 2023-10-16T12:56:00.645 INFO:teuthology.orchestra.run.smithi192.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-16T12:56:00.645 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-16T12:56:00.645 INFO:teuthology.orchestra.run.smithi192.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-16T12:56:00.645 INFO:teuthology.orchestra.run.smithi192.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-16T12:56:00.645 INFO:teuthology.orchestra.run.smithi192.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-16T12:56:00.646 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 184 k 2023-10-16T12:56:00.646 INFO:teuthology.orchestra.run.smithi192.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-16T12:56:00.646 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-16T12:56:00.646 INFO:teuthology.orchestra.run.smithi192.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-16T12:56:00.646 INFO:teuthology.orchestra.run.smithi192.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-16T12:56:00.646 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-16T12:56:00.647 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-16T12:56:00.647 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 518 k 2023-10-16T12:56:00.647 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-16T12:56:00.647 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.9 M 2023-10-16T12:56:00.647 INFO:teuthology.orchestra.run.smithi192.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-16T12:56:00.648 INFO:teuthology.orchestra.run.smithi192.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-16T12:56:00.648 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-16T12:56:00.648 INFO:teuthology.orchestra.run.smithi192.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-16T12:56:00.648 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-16T12:56:00.648 INFO:teuthology.orchestra.run.smithi192.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-16T12:56:00.648 INFO:teuthology.orchestra.run.smithi192.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-16T12:56:00.649 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-16T12:56:00.649 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-16T12:56:00.649 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-16T12:56:00.649 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-16T12:56:00.649 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-16T12:56:00.650 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-16T12:56:00.650 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-16T12:56:00.650 INFO:teuthology.orchestra.run.smithi192.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-16T12:56:00.650 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-16T12:56:00.650 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 45 k 2023-10-16T12:56:00.650 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 126 k 2023-10-16T12:56:00.651 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-16T12:56:00.651 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-16T12:56:00.651 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-16T12:56:00.651 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-16T12:56:00.651 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-16T12:56:00.652 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-16T12:56:00.652 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-16T12:56:00.652 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-16T12:56:00.652 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-16T12:56:00.652 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-16T12:56:00.652 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-16T12:56:00.653 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T12:56:00.653 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-16T12:56:00.653 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-16T12:56:00.653 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-16T12:56:00.653 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-16T12:56:00.653 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-16T12:56:00.654 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-16T12:56:00.654 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-16T12:56:00.654 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-16T12:56:00.654 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-16T12:56:00.654 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-16T12:56:00.655 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-16T12:56:00.655 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-16T12:56:00.655 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-16T12:56:00.655 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-16T12:56:00.655 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-16T12:56:00.655 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-16T12:56:00.656 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-16T12:56:00.656 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-16T12:56:00.656 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T12:56:00.656 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-16T12:56:00.656 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-16T12:56:00.657 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-16T12:56:00.657 INFO:teuthology.orchestra.run.smithi192.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-16T12:56:00.657 INFO:teuthology.orchestra.run.smithi192.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-16T12:56:00.657 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-16T12:56:00.657 INFO:teuthology.orchestra.run.smithi192.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-16T12:56:00.657 INFO:teuthology.orchestra.run.smithi192.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-16T12:56:00.658 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-16T12:56:00.658 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-16T12:56:00.658 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-16T12:56:00.658 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-16T12:56:00.658 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-16T12:56:00.659 INFO:teuthology.orchestra.run.smithi192.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-16T12:56:00.659 INFO:teuthology.orchestra.run.smithi192.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-16T12:56:00.659 INFO:teuthology.orchestra.run.smithi192.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-16T12:56:00.659 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-16T12:56:00.659 INFO:teuthology.orchestra.run.smithi192.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-16T12:56:00.659 INFO:teuthology.orchestra.run.smithi192.stdout:Enabling module streams: 2023-10-16T12:56:00.660 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql 10 2023-10-16T12:56:00.660 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:56:00.660 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-10-16T12:56:00.660 INFO:teuthology.orchestra.run.smithi192.stdout:=========================================================================================================================== 2023-10-16T12:56:00.660 INFO:teuthology.orchestra.run.smithi192.stdout:Install 128 Packages 2023-10-16T12:56:00.661 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrade 3 Packages 2023-10-16T12:56:00.661 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:56:00.661 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 209 M 2023-10-16T12:56:00.661 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-10-16T12:56:00.988 INFO:teuthology.orchestra.run.smithi192.stdout:(1/131): ceph-18.0.0-6730.g4ba8a190.el8.x86_64. 56 kB/s | 6.4 kB 00:00 2023-10-16T12:56:01.263 INFO:teuthology.orchestra.run.smithi192.stdout:(2/131): ceph-fuse-18.0.0-6730.g4ba8a190.el8.x8 3.3 MB/s | 918 kB 00:00 2023-10-16T12:56:01.347 INFO:teuthology.orchestra.run.smithi192.stdout:(3/131): ceph-immutable-object-cache-18.0.0-673 2.0 MB/s | 167 kB 00:00 2023-10-16T12:56:01.464 INFO:teuthology.orchestra.run.smithi192.stdout:(4/131): ceph-base-18.0.0-6730.g4ba8a190.el8.x8 9.2 MB/s | 5.4 MB 00:00 2023-10-16T12:56:01.689 INFO:teuthology.orchestra.run.smithi192.stdout:(5/131): ceph-mds-18.0.0-6730.g4ba8a190.el8.x86 6.8 MB/s | 2.3 MB 00:00 2023-10-16T12:56:01.731 INFO:teuthology.orchestra.run.smithi192.stdout:(6/131): ceph-mgr-18.0.0-6730.g4ba8a190.el8.x86 6.1 MB/s | 1.6 MB 00:00 2023-10-16T12:56:02.473 INFO:teuthology.orchestra.run.smithi192.stdout:(7/131): ceph-mon-18.0.0-6730.g4ba8a190.el8.x86 5.9 MB/s | 4.6 MB 00:00 2023-10-16T12:56:03.165 INFO:teuthology.orchestra.run.smithi192.stdout:(8/131): ceph-common-18.0.0-6730.g4ba8a190.el8. 9.9 MB/s | 23 MB 00:02 2023-10-16T12:56:03.255 INFO:teuthology.orchestra.run.smithi124.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T12:56:03.256 INFO:teuthology.orchestra.run.smithi124.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T12:56:03.271 INFO:teuthology.orchestra.run.smithi124.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-16T12:56:03.272 INFO:teuthology.orchestra.run.smithi124.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-16T12:56:03.273 INFO:teuthology.orchestra.run.smithi124.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-16T12:56:03.274 INFO:teuthology.orchestra.run.smithi124.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-16T12:56:03.276 INFO:teuthology.orchestra.run.smithi124.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-16T12:56:03.279 INFO:teuthology.orchestra.run.smithi124.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-16T12:56:03.280 INFO:teuthology.orchestra.run.smithi124.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-16T12:56:03.382 INFO:teuthology.orchestra.run.smithi192.stdout:(9/131): ceph-osd-18.0.0-6730.g4ba8a190.el8.x86 11 MB/s | 18 MB 00:01 2023-10-16T12:56:03.407 INFO:teuthology.orchestra.run.smithi192.stdout:(10/131): ceph-selinux-18.0.0-6730.g4ba8a190.el 100 kB/s | 24 kB 00:00 2023-10-16T12:56:03.412 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-10-16T12:56:03.425 INFO:teuthology.orchestra.run.smithi124.stdout:=========================================================================================================================== 2023-10-16T12:56:03.425 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2023-10-16T12:56:03.425 INFO:teuthology.orchestra.run.smithi124.stdout:=========================================================================================================================== 2023-10-16T12:56:03.425 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2023-10-16T12:56:03.426 INFO:teuthology.orchestra.run.smithi124.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-16T12:56:03.426 INFO:teuthology.orchestra.run.smithi124.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-16T12:56:03.426 INFO:teuthology.orchestra.run.smithi124.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.4 k 2023-10-16T12:56:03.426 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 5.4 M 2023-10-16T12:56:03.426 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 918 k 2023-10-16T12:56:03.427 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 167 k 2023-10-16T12:56:03.427 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 1.6 M 2023-10-16T12:56:03.427 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 132 k 2023-10-16T12:56:03.427 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 1.8 M 2023-10-16T12:56:03.427 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 7.4 M 2023-10-16T12:56:03.428 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 47 k 2023-10-16T12:56:03.428 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 14 M 2023-10-16T12:56:03.428 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 49 M 2023-10-16T12:56:03.428 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 261 k 2023-10-16T12:56:03.428 INFO:teuthology.orchestra.run.smithi124.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 192 k 2023-10-16T12:56:03.428 INFO:teuthology.orchestra.run.smithi124.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 261 k 2023-10-16T12:56:03.429 INFO:teuthology.orchestra.run.smithi124.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 18 k 2023-10-16T12:56:03.429 INFO:teuthology.orchestra.run.smithi124.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-16T12:56:03.429 INFO:teuthology.orchestra.run.smithi124.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-16T12:56:03.429 INFO:teuthology.orchestra.run.smithi124.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-16T12:56:03.429 INFO:teuthology.orchestra.run.smithi124.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 31 k 2023-10-16T12:56:03.429 INFO:teuthology.orchestra.run.smithi124.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 839 k 2023-10-16T12:56:03.430 INFO:teuthology.orchestra.run.smithi124.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 139 k 2023-10-16T12:56:03.430 INFO:teuthology.orchestra.run.smithi124.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-16T12:56:03.430 INFO:teuthology.orchestra.run.smithi124.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-16T12:56:03.430 INFO:teuthology.orchestra.run.smithi124.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-16T12:56:03.430 INFO:teuthology.orchestra.run.smithi124.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-16T12:56:03.431 INFO:teuthology.orchestra.run.smithi124.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-16T12:56:03.431 INFO:teuthology.orchestra.run.smithi124.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-16T12:56:03.431 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 197 k 2023-10-16T12:56:03.431 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 371 k 2023-10-16T12:56:03.431 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 365 k 2023-10-16T12:56:03.432 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 107 k 2023-10-16T12:56:03.432 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 94 k 2023-10-16T12:56:03.432 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.6 M 2023-10-16T12:56:03.432 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 179 k 2023-10-16T12:56:03.432 INFO:teuthology.orchestra.run.smithi124.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-16T12:56:03.432 INFO:teuthology.orchestra.run.smithi124.stdout:Upgrading: 2023-10-16T12:56:03.433 INFO:teuthology.orchestra.run.smithi124.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-16T12:56:03.433 INFO:teuthology.orchestra.run.smithi124.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T12:56:03.433 INFO:teuthology.orchestra.run.smithi124.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T12:56:03.433 INFO:teuthology.orchestra.run.smithi124.stdout:Installing dependencies: 2023-10-16T12:56:03.433 INFO:teuthology.orchestra.run.smithi124.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-16T12:56:03.433 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 23 M 2023-10-16T12:56:03.434 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 23 k 2023-10-16T12:56:03.434 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 2.3 M 2023-10-16T12:56:03.434 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 242 k 2023-10-16T12:56:03.434 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 4.6 M 2023-10-16T12:56:03.434 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 18 M 2023-10-16T12:56:03.434 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 15 k 2023-10-16T12:56:03.435 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 24 k 2023-10-16T12:56:03.435 INFO:teuthology.orchestra.run.smithi124.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-16T12:56:03.435 INFO:teuthology.orchestra.run.smithi124.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-16T12:56:03.435 INFO:teuthology.orchestra.run.smithi124.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-16T12:56:03.435 INFO:teuthology.orchestra.run.smithi124.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-16T12:56:03.436 INFO:teuthology.orchestra.run.smithi124.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-16T12:56:03.436 INFO:teuthology.orchestra.run.smithi124.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 184 k 2023-10-16T12:56:03.436 INFO:teuthology.orchestra.run.smithi124.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-16T12:56:03.436 INFO:teuthology.orchestra.run.smithi124.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-16T12:56:03.436 INFO:teuthology.orchestra.run.smithi124.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-16T12:56:03.436 INFO:teuthology.orchestra.run.smithi124.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-16T12:56:03.437 INFO:teuthology.orchestra.run.smithi124.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-16T12:56:03.437 INFO:teuthology.orchestra.run.smithi124.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-16T12:56:03.437 INFO:teuthology.orchestra.run.smithi124.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 518 k 2023-10-16T12:56:03.437 INFO:teuthology.orchestra.run.smithi124.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-16T12:56:03.437 INFO:teuthology.orchestra.run.smithi124.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.9 M 2023-10-16T12:56:03.437 INFO:teuthology.orchestra.run.smithi124.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-16T12:56:03.438 INFO:teuthology.orchestra.run.smithi124.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-16T12:56:03.438 INFO:teuthology.orchestra.run.smithi124.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-16T12:56:03.438 INFO:teuthology.orchestra.run.smithi124.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-16T12:56:03.438 INFO:teuthology.orchestra.run.smithi124.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-16T12:56:03.438 INFO:teuthology.orchestra.run.smithi124.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-16T12:56:03.438 INFO:teuthology.orchestra.run.smithi124.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-16T12:56:03.439 INFO:teuthology.orchestra.run.smithi124.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-16T12:56:03.439 INFO:teuthology.orchestra.run.smithi124.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-16T12:56:03.439 INFO:teuthology.orchestra.run.smithi124.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-16T12:56:03.439 INFO:teuthology.orchestra.run.smithi124.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-16T12:56:03.439 INFO:teuthology.orchestra.run.smithi124.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-16T12:56:03.440 INFO:teuthology.orchestra.run.smithi124.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-16T12:56:03.440 INFO:teuthology.orchestra.run.smithi124.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-16T12:56:03.440 INFO:teuthology.orchestra.run.smithi124.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-16T12:56:03.440 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-16T12:56:03.440 INFO:teuthology.orchestra.run.smithi124.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 45 k 2023-10-16T12:56:03.440 INFO:teuthology.orchestra.run.smithi124.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 126 k 2023-10-16T12:56:03.441 INFO:teuthology.orchestra.run.smithi124.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-16T12:56:03.441 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-16T12:56:03.441 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-16T12:56:03.441 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-16T12:56:03.441 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-16T12:56:03.441 INFO:teuthology.orchestra.run.smithi124.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-16T12:56:03.442 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-16T12:56:03.442 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-16T12:56:03.442 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-16T12:56:03.442 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-16T12:56:03.442 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-16T12:56:03.443 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T12:56:03.443 INFO:teuthology.orchestra.run.smithi124.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-16T12:56:03.443 INFO:teuthology.orchestra.run.smithi124.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-16T12:56:03.443 INFO:teuthology.orchestra.run.smithi124.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-16T12:56:03.443 INFO:teuthology.orchestra.run.smithi124.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-16T12:56:03.443 INFO:teuthology.orchestra.run.smithi124.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-16T12:56:03.444 INFO:teuthology.orchestra.run.smithi124.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-16T12:56:03.444 INFO:teuthology.orchestra.run.smithi124.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-16T12:56:03.444 INFO:teuthology.orchestra.run.smithi124.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-16T12:56:03.444 INFO:teuthology.orchestra.run.smithi124.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-16T12:56:03.444 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-16T12:56:03.444 INFO:teuthology.orchestra.run.smithi124.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-16T12:56:03.445 INFO:teuthology.orchestra.run.smithi124.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-16T12:56:03.445 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-16T12:56:03.445 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-16T12:56:03.445 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-16T12:56:03.445 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-16T12:56:03.445 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-16T12:56:03.446 INFO:teuthology.orchestra.run.smithi124.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-16T12:56:03.446 INFO:teuthology.orchestra.run.smithi124.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T12:56:03.446 INFO:teuthology.orchestra.run.smithi124.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-16T12:56:03.446 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-16T12:56:03.446 INFO:teuthology.orchestra.run.smithi124.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-16T12:56:03.447 INFO:teuthology.orchestra.run.smithi124.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-16T12:56:03.447 INFO:teuthology.orchestra.run.smithi124.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-16T12:56:03.447 INFO:teuthology.orchestra.run.smithi124.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-16T12:56:03.447 INFO:teuthology.orchestra.run.smithi124.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-16T12:56:03.447 INFO:teuthology.orchestra.run.smithi124.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-16T12:56:03.447 INFO:teuthology.orchestra.run.smithi124.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-16T12:56:03.448 INFO:teuthology.orchestra.run.smithi124.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-16T12:56:03.448 INFO:teuthology.orchestra.run.smithi124.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-16T12:56:03.448 INFO:teuthology.orchestra.run.smithi124.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-16T12:56:03.448 INFO:teuthology.orchestra.run.smithi124.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-16T12:56:03.448 INFO:teuthology.orchestra.run.smithi124.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-16T12:56:03.448 INFO:teuthology.orchestra.run.smithi124.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-16T12:56:03.449 INFO:teuthology.orchestra.run.smithi124.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-16T12:56:03.449 INFO:teuthology.orchestra.run.smithi124.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-16T12:56:03.449 INFO:teuthology.orchestra.run.smithi124.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-16T12:56:03.449 INFO:teuthology.orchestra.run.smithi124.stdout:Enabling module streams: 2023-10-16T12:56:03.449 INFO:teuthology.orchestra.run.smithi124.stdout: postgresql 10 2023-10-16T12:56:03.449 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:56:03.450 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2023-10-16T12:56:03.450 INFO:teuthology.orchestra.run.smithi124.stdout:=========================================================================================================================== 2023-10-16T12:56:03.450 INFO:teuthology.orchestra.run.smithi124.stdout:Install 128 Packages 2023-10-16T12:56:03.450 INFO:teuthology.orchestra.run.smithi124.stdout:Upgrade 3 Packages 2023-10-16T12:56:03.450 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:56:03.451 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 209 M 2023-10-16T12:56:03.451 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading Packages: 2023-10-16T12:56:03.474 INFO:teuthology.orchestra.run.smithi192.stdout:(11/131): cephfs-mirror-18.0.0-6730.g4ba8a190.e 3.8 MB/s | 261 kB 00:00 2023-10-16T12:56:03.549 INFO:teuthology.orchestra.run.smithi192.stdout:(12/131): libcephfs-devel-18.0.0-6730.g4ba8a190 414 kB/s | 31 kB 00:00 2023-10-16T12:56:03.716 INFO:teuthology.orchestra.run.smithi192.stdout:(13/131): libcephfs2-18.0.0-6730.g4ba8a190.el8. 4.9 MB/s | 839 kB 00:00 2023-10-16T12:56:03.808 INFO:teuthology.orchestra.run.smithi192.stdout:(14/131): libcephsqlite-18.0.0-6730.g4ba8a190.e 2.0 MB/s | 184 kB 00:00 2023-10-16T12:56:03.892 INFO:teuthology.orchestra.run.smithi192.stdout:(15/131): librados-devel-18.0.0-6730.g4ba8a190. 1.6 MB/s | 139 kB 00:00 2023-10-16T12:56:03.963 INFO:teuthology.orchestra.run.smithi124.stdout:(1/131): ceph-18.0.0-6730.g4ba8a190.el8.x86_64. 19 kB/s | 6.4 kB 00:00 2023-10-16T12:56:04.000 INFO:teuthology.orchestra.run.smithi192.stdout:(16/131): libradosstriper1-18.0.0-6730.g4ba8a19 4.7 MB/s | 518 kB 00:00 2023-10-16T12:56:04.143 INFO:teuthology.orchestra.run.smithi192.stdout:(17/131): ceph-radosgw-18.0.0-6730.g4ba8a190.el 8.3 MB/s | 14 MB 00:01 2023-10-16T12:56:04.243 INFO:teuthology.orchestra.run.smithi192.stdout:(18/131): python3-ceph-argparse-18.0.0-6730.g4b 448 kB/s | 45 kB 00:00 2023-10-16T12:56:04.343 INFO:teuthology.orchestra.run.smithi192.stdout:(19/131): python3-ceph-common-18.0.0-6730.g4ba8 1.2 MB/s | 126 kB 00:00 2023-10-16T12:56:04.452 INFO:teuthology.orchestra.run.smithi192.stdout:(20/131): python3-cephfs-18.0.0-6730.g4ba8a190. 1.8 MB/s | 197 kB 00:00 2023-10-16T12:56:04.720 INFO:teuthology.orchestra.run.smithi192.stdout:(21/131): librgw2-18.0.0-6730.g4ba8a190.el8.x86 9.6 MB/s | 6.9 MB 00:00 2023-10-16T12:56:04.786 INFO:teuthology.orchestra.run.smithi192.stdout:(22/131): python3-rbd-18.0.0-6730.g4ba8a190.el8 5.4 MB/s | 365 kB 00:00 2023-10-16T12:56:04.811 INFO:teuthology.orchestra.run.smithi192.stdout:(23/131): python3-rados-18.0.0-6730.g4ba8a190.e 1.0 MB/s | 371 kB 00:00 2023-10-16T12:56:04.847 INFO:teuthology.orchestra.run.smithi192.stdout:(24/131): python3-rgw-18.0.0-6730.g4ba8a190.el8 1.8 MB/s | 107 kB 00:00 2023-10-16T12:56:04.862 INFO:teuthology.orchestra.run.smithi192.stdout:(25/131): rbd-fuse-18.0.0-6730.g4ba8a190.el8.x8 1.8 MB/s | 94 kB 00:00 2023-10-16T12:56:04.945 INFO:teuthology.orchestra.run.smithi192.stdout:(26/131): rbd-nbd-18.0.0-6730.g4ba8a190.el8.x86 2.1 MB/s | 179 kB 00:00 2023-10-16T12:56:04.988 INFO:teuthology.orchestra.run.smithi124.stdout:(2/131): ceph-fuse-18.0.0-6730.g4ba8a190.el8.x8 896 kB/s | 918 kB 00:01 2023-10-16T12:56:05.037 INFO:teuthology.orchestra.run.smithi192.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6730.g 252 kB/s | 23 kB 00:00 2023-10-16T12:56:05.138 INFO:teuthology.orchestra.run.smithi192.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 1.3 MB/s | 132 kB 00:00 2023-10-16T12:56:05.197 INFO:teuthology.orchestra.run.smithi124.stdout:(3/131): ceph-immutable-object-cache-18.0.0-673 802 kB/s | 167 kB 00:00 2023-10-16T12:56:05.205 INFO:teuthology.orchestra.run.smithi192.stdout:(29/131): rbd-mirror-18.0.0-6730.g4ba8a190.el8. 10 MB/s | 3.6 MB 00:00 2023-10-16T12:56:05.505 INFO:teuthology.orchestra.run.smithi192.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 4.8 MB/s | 1.8 MB 00:00 2023-10-16T12:56:05.605 INFO:teuthology.orchestra.run.smithi192.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6730.g4b 2.4 MB/s | 242 kB 00:00 2023-10-16T12:56:05.689 INFO:teuthology.orchestra.run.smithi192.stdout:(32/131): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 570 kB/s | 47 kB 00:00 2023-10-16T12:56:05.772 INFO:teuthology.orchestra.run.smithi192.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6730.g4 180 kB/s | 15 kB 00:00 2023-10-16T12:56:05.931 INFO:teuthology.orchestra.run.smithi192.stdout:(34/131): ceph-mgr-diskprediction-local-18.0.0- 10 MB/s | 7.4 MB 00:00 2023-10-16T12:56:05.956 INFO:teuthology.orchestra.run.smithi192.stdout:(35/131): ceph-volume-18.0.0-6730.g4ba8a190.el8 1.4 MB/s | 261 kB 00:00 2023-10-16T12:56:05.998 INFO:teuthology.orchestra.run.smithi192.stdout:(36/131): cephadm-18.0.0-6730.g4ba8a190.el8.noa 2.8 MB/s | 192 kB 00:00 2023-10-16T12:56:06.032 INFO:teuthology.orchestra.run.smithi192.stdout:(37/131): cephfs-top-18.0.0-6730.g4ba8a190.el8. 241 kB/s | 18 kB 00:00 2023-10-16T12:56:06.374 INFO:teuthology.orchestra.run.smithi192.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 172 kB/s | 59 kB 00:00 2023-10-16T12:56:06.538 INFO:teuthology.orchestra.run.smithi192.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 568 kB/s | 306 kB 00:00 2023-10-16T12:56:06.566 INFO:teuthology.orchestra.run.smithi192.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 391 kB/s | 75 kB 00:00 2023-10-16T12:56:06.683 INFO:teuthology.orchestra.run.smithi192.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 374 kB/s | 44 kB 00:00 2023-10-16T12:56:06.733 INFO:teuthology.orchestra.run.smithi192.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.4 MB/s | 476 kB 00:00 2023-10-16T12:56:06.842 INFO:teuthology.orchestra.run.smithi192.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 305 kB/s | 33 kB 00:00 2023-10-16T12:56:06.867 INFO:teuthology.orchestra.run.smithi192.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.0 MB/s | 185 kB 00:00 2023-10-16T12:56:06.951 INFO:teuthology.orchestra.run.smithi192.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 150 kB/s | 16 kB 00:00 2023-10-16T12:56:06.993 INFO:teuthology.orchestra.run.smithi192.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.3 MB/s | 173 kB 00:00 2023-10-16T12:56:07.076 INFO:teuthology.orchestra.run.smithi192.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.0 MB/s | 384 kB 00:00 2023-10-16T12:56:07.131 INFO:teuthology.orchestra.run.smithi124.stdout:(4/131): ceph-common-18.0.0-6730.g4ba8a190.el8. 6.4 MB/s | 23 MB 00:03 2023-10-16T12:56:07.135 INFO:teuthology.orchestra.run.smithi192.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 573 kB/s | 81 kB 00:00 2023-10-16T12:56:07.193 INFO:teuthology.orchestra.run.smithi192.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2023-10-16T12:56:07.236 INFO:teuthology.orchestra.run.smithi192.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 175 kB/s | 18 kB 00:00 2023-10-16T12:56:07.289 INFO:teuthology.orchestra.run.smithi124.stdout:(5/131): ceph-mgr-18.0.0-6730.g4ba8a190.el8.x86 10 MB/s | 1.6 MB 00:00 2023-10-16T12:56:07.364 INFO:teuthology.orchestra.run.smithi124.stdout:(6/131): ceph-mds-18.0.0-6730.g4ba8a190.el8.x86 1.1 MB/s | 2.3 MB 00:02 2023-10-16T12:56:07.539 INFO:teuthology.orchestra.run.smithi124.stdout:(7/131): ceph-mon-18.0.0-6730.g4ba8a190.el8.x86 18 MB/s | 4.6 MB 00:00 2023-10-16T12:56:07.703 INFO:teuthology.orchestra.run.smithi192.stdout:(51/131): ceph-test-18.0.0-6730.g4ba8a190.el8.x 11 MB/s | 49 MB 00:04 2023-10-16T12:56:07.728 INFO:teuthology.orchestra.run.smithi192.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 99 kB/s | 49 kB 00:00 2023-10-16T12:56:07.762 INFO:teuthology.orchestra.run.smithi192.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 2.1 MB/s | 1.2 MB 00:00 2023-10-16T12:56:07.862 INFO:teuthology.orchestra.run.smithi192.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 451 kB/s | 60 kB 00:00 2023-10-16T12:56:07.895 INFO:teuthology.orchestra.run.smithi192.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2023-10-16T12:56:07.987 INFO:teuthology.orchestra.run.smithi192.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 124 kB/s | 16 kB 00:00 2023-10-16T12:56:08.054 INFO:teuthology.orchestra.run.smithi192.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 212 kB/s | 34 kB 00:00 2023-10-16T12:56:08.155 INFO:teuthology.orchestra.run.smithi192.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.1 MB/s | 196 kB 00:00 2023-10-16T12:56:08.180 INFO:teuthology.orchestra.run.smithi192.stdout:(59/131): python3-more-itertools-7.2.0-3.el8.no 123 kB/s | 59 kB 00:00 2023-10-16T12:56:08.205 INFO:teuthology.orchestra.run.smithi192.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 427 kB/s | 64 kB 00:00 2023-10-16T12:56:08.280 INFO:teuthology.orchestra.run.smithi192.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 149 kB/s | 19 kB 00:00 2023-10-16T12:56:08.281 INFO:teuthology.orchestra.run.smithi124.stdout:(8/131): ceph-radosgw-18.0.0-6730.g4ba8a190.el8 19 MB/s | 14 MB 00:00 2023-10-16T12:56:08.314 INFO:teuthology.orchestra.run.smithi192.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 269 kB/s | 29 kB 00:00 2023-10-16T12:56:08.339 INFO:teuthology.orchestra.run.smithi192.stdout:(63/131): python3-singledispatch-3.4.0.3-18.el8 150 kB/s | 24 kB 00:00 2023-10-16T12:56:08.365 INFO:teuthology.orchestra.run.smithi124.stdout:(9/131): ceph-selinux-18.0.0-6730.g4ba8a190.el8 290 kB/s | 24 kB 00:00 2023-10-16T12:56:08.381 INFO:teuthology.orchestra.run.smithi192.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 273 kB/s | 27 kB 00:00 2023-10-16T12:56:08.454 INFO:teuthology.orchestra.run.smithi192.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 1.8 MB/s | 255 kB 00:00 2023-10-16T12:56:08.499 INFO:teuthology.orchestra.run.smithi192.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 524 kB/s | 61 kB 00:00 2023-10-16T12:56:08.540 INFO:teuthology.orchestra.run.smithi124.stdout:(10/131): ceph-base-18.0.0-6730.g4ba8a190.el8.x 1.1 MB/s | 5.4 MB 00:04 2023-10-16T12:56:08.565 INFO:teuthology.orchestra.run.smithi192.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 766 kB/s | 85 kB 00:00 2023-10-16T12:56:08.599 INFO:teuthology.orchestra.run.smithi192.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 229 kB/s | 23 kB 00:00 2023-10-16T12:56:08.624 INFO:teuthology.orchestra.run.smithi192.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-10-16T12:56:08.674 INFO:teuthology.orchestra.run.smithi192.stdout:(70/131): python3-webob-1.8.5-1.el8.1.noarch.rp 750 kB/s | 251 kB 00:00 2023-10-16T12:56:08.725 INFO:teuthology.orchestra.run.smithi192.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.2 MB/s | 110 kB 00:00 2023-10-16T12:56:08.807 INFO:teuthology.orchestra.run.smithi124.stdout:(11/131): cephfs-mirror-18.0.0-6730.g4ba8a190.e 978 kB/s | 261 kB 00:00 2023-10-16T12:56:08.842 INFO:teuthology.orchestra.run.smithi192.stdout:(72/131): thrift-0.13.0-2.el8.x86_64.rpm 6.3 MB/s | 1.7 MB 00:00 2023-10-16T12:56:08.859 INFO:teuthology.orchestra.run.smithi192.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 405 kB/s | 54 kB 00:00 2023-10-16T12:56:08.909 INFO:teuthology.orchestra.run.smithi192.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.8 MB/s | 259 kB 00:00 2023-10-16T12:56:08.916 INFO:teuthology.orchestra.run.smithi124.stdout:(12/131): libcephfs-devel-18.0.0-6730.g4ba8a190 286 kB/s | 31 kB 00:00 2023-10-16T12:56:08.943 INFO:teuthology.orchestra.run.smithi192.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.0 MB/s | 323 kB 00:00 2023-10-16T12:56:08.960 INFO:teuthology.orchestra.run.smithi192.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 773 kB/s | 39 kB 00:00 2023-10-16T12:56:09.010 INFO:teuthology.orchestra.run.smithi192.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-10-16T12:56:09.044 INFO:teuthology.orchestra.run.smithi192.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 6.3 MB/s | 538 kB 00:00 2023-10-16T12:56:09.098 INFO:teuthology.orchestra.run.smithi192.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.8 MB/s | 157 kB 00:00 2023-10-16T12:56:09.128 INFO:teuthology.orchestra.run.smithi192.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2023-10-16T12:56:09.170 INFO:teuthology.orchestra.run.smithi192.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 9.8 MB/s | 713 kB 00:00 2023-10-16T12:56:09.203 INFO:teuthology.orchestra.run.smithi192.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 801 kB/s | 27 kB 00:00 2023-10-16T12:56:09.254 INFO:teuthology.orchestra.run.smithi192.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-10-16T12:56:09.287 INFO:teuthology.orchestra.run.smithi192.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-10-16T12:56:09.379 INFO:teuthology.orchestra.run.smithi192.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2023-10-16T12:56:09.421 INFO:teuthology.orchestra.run.smithi192.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 11 MB/s | 457 kB 00:00 2023-10-16T12:56:09.463 INFO:teuthology.orchestra.run.smithi192.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-10-16T12:56:09.522 INFO:teuthology.orchestra.run.smithi192.stdout:(88/131): python3-numpy-1.14.3-10.el8.x86_64.rp 16 MB/s | 3.7 MB 00:00 2023-10-16T12:56:09.547 INFO:teuthology.orchestra.run.smithi192.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 767 kB/s | 64 kB 00:00 2023-10-16T12:56:09.572 INFO:teuthology.orchestra.run.smithi192.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-10-16T12:56:09.583 INFO:teuthology.orchestra.run.smithi124.stdout:(13/131): libcephfs2-18.0.0-6730.g4ba8a190.el8. 1.2 MB/s | 839 kB 00:00 2023-10-16T12:56:09.597 INFO:teuthology.orchestra.run.smithi192.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 399 kB/s | 20 kB 00:00 2023-10-16T12:56:09.623 INFO:teuthology.orchestra.run.smithi192.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-10-16T12:56:09.767 INFO:teuthology.orchestra.run.smithi124.stdout:(14/131): libcephsqlite-18.0.0-6730.g4ba8a190.e 1.0 MB/s | 184 kB 00:00 2023-10-16T12:56:09.798 INFO:teuthology.orchestra.run.smithi192.stdout:(93/131): python3-scipy-1.0.0-21.module+el8.5.0 12 MB/s | 14 MB 00:01 2023-10-16T12:56:09.823 INFO:teuthology.orchestra.run.smithi192.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 3.1 MB/s | 709 kB 00:00 2023-10-16T12:56:09.848 INFO:teuthology.orchestra.run.smithi192.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2023-10-16T12:56:09.891 INFO:teuthology.orchestra.run.smithi192.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-10-16T12:56:09.933 INFO:teuthology.orchestra.run.smithi192.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-10-16T12:56:09.950 INFO:teuthology.orchestra.run.smithi124.stdout:(15/131): librados-devel-18.0.0-6730.g4ba8a190. 759 kB/s | 139 kB 00:00 2023-10-16T12:56:10.033 INFO:teuthology.orchestra.run.smithi192.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 12 MB/s | 4.9 MB 00:00 2023-10-16T12:56:10.100 INFO:teuthology.orchestra.run.smithi192.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-10-16T12:56:10.141 INFO:teuthology.orchestra.run.smithi192.stdout:(100/131): postgresql-contrib-10.21-2.module+el 7.3 MB/s | 808 kB 00:00 2023-10-16T12:56:10.200 INFO:teuthology.orchestra.run.smithi192.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 15 MB/s | 1.5 MB 00:00 2023-10-16T12:56:10.226 INFO:teuthology.orchestra.run.smithi192.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 559 kB/s | 47 kB 00:00 2023-10-16T12:56:10.251 INFO:teuthology.orchestra.run.smithi192.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 3.9 MB/s | 200 kB 00:00 2023-10-16T12:56:10.268 INFO:teuthology.orchestra.run.smithi192.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-10-16T12:56:10.301 INFO:teuthology.orchestra.run.smithi192.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-16T12:56:10.368 INFO:teuthology.orchestra.run.smithi192.stdout:(106/131): postgresql-server-10.21-2.module+el8 12 MB/s | 5.1 MB 00:00 2023-10-16T12:56:10.385 INFO:teuthology.orchestra.run.smithi192.stdout:(107/131): keyutils-libs-devel-1.5.10-9.el8.x86 410 kB/s | 48 kB 00:00 2023-10-16T12:56:10.428 INFO:teuthology.orchestra.run.smithi192.stdout:(108/131): libsepol-devel-2.9-3.el8.x86_64.rpm 690 kB/s | 87 kB 00:00 2023-10-16T12:56:10.452 INFO:teuthology.orchestra.run.smithi192.stdout:(109/131): python3-requests-oauthlib-1.0.0-1.el 508 kB/s | 43 kB 00:00 2023-10-16T12:56:10.478 INFO:teuthology.orchestra.run.smithi192.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 1.2 MB/s | 109 kB 00:00 2023-10-16T12:56:10.503 INFO:teuthology.orchestra.run.smithi192.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-10-16T12:56:10.520 INFO:teuthology.orchestra.run.smithi192.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 445 kB/s | 19 kB 00:00 2023-10-16T12:56:10.545 INFO:teuthology.orchestra.run.smithi192.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.6 MB/s | 155 kB 00:00 2023-10-16T12:56:10.579 INFO:teuthology.orchestra.run.smithi192.stdout:(114/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.3 MB/s | 560 kB 00:00 2023-10-16T12:56:10.604 INFO:teuthology.orchestra.run.smithi192.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 305 kB/s | 18 kB 00:00 2023-10-16T12:56:10.630 INFO:teuthology.orchestra.run.smithi192.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 5.0 MB/s | 559 kB 00:00 2023-10-16T12:56:10.642 INFO:teuthology.orchestra.run.smithi124.stdout:(16/131): ceph-test-18.0.0-6730.g4ba8a190.el8.x 22 MB/s | 49 MB 00:02 2023-10-16T12:56:10.646 INFO:teuthology.orchestra.run.smithi192.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 5.5 MB/s | 238 kB 00:00 2023-10-16T12:56:10.676 INFO:teuthology.orchestra.run.smithi124.stdout:(17/131): libradosstriper1-18.0.0-6730.g4ba8a19 714 kB/s | 518 kB 00:00 2023-10-16T12:56:10.680 INFO:teuthology.orchestra.run.smithi192.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.9 MB/s | 605 kB 00:00 2023-10-16T12:56:10.705 INFO:teuthology.orchestra.run.smithi192.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.2 MB/s | 72 kB 00:00 2023-10-16T12:56:10.731 INFO:teuthology.orchestra.run.smithi192.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-16T12:56:10.756 INFO:teuthology.orchestra.run.smithi192.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-10-16T12:56:10.777 INFO:teuthology.orchestra.run.smithi124.stdout:(18/131): python3-ceph-argparse-18.0.0-6730.g4b 448 kB/s | 45 kB 00:00 2023-10-16T12:56:10.781 INFO:teuthology.orchestra.run.smithi192.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-10-16T12:56:10.806 INFO:teuthology.orchestra.run.smithi192.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-10-16T12:56:10.832 INFO:teuthology.orchestra.run.smithi192.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 767 kB/s | 39 kB 00:00 2023-10-16T12:56:10.865 INFO:teuthology.orchestra.run.smithi192.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-10-16T12:56:10.891 INFO:teuthology.orchestra.run.smithi192.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.9 MB/s | 171 kB 00:00 2023-10-16T12:56:10.916 INFO:teuthology.orchestra.run.smithi192.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-10-16T12:56:10.966 INFO:teuthology.orchestra.run.smithi192.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.9 MB/s | 2.3 MB 00:00 2023-10-16T12:56:11.019 INFO:teuthology.orchestra.run.smithi124.stdout:(19/131): librgw2-18.0.0-6730.g4ba8a190.el8.x86 18 MB/s | 6.9 MB 00:00 2023-10-16T12:56:11.025 INFO:teuthology.orchestra.run.smithi192.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-10-16T12:56:11.044 INFO:teuthology.orchestra.run.smithi124.stdout:(20/131): python3-ceph-common-18.0.0-6730.g4ba8 470 kB/s | 126 kB 00:00 2023-10-16T12:56:11.069 INFO:teuthology.orchestra.run.smithi124.stdout:(21/131): python3-cephfs-18.0.0-6730.g4ba8a190. 3.8 MB/s | 197 kB 00:00 2023-10-16T12:56:11.136 INFO:teuthology.orchestra.run.smithi124.stdout:(22/131): python3-rbd-18.0.0-6730.g4ba8a190.el8 5.4 MB/s | 365 kB 00:00 2023-10-16T12:56:11.204 INFO:teuthology.orchestra.run.smithi124.stdout:(23/131): python3-rgw-18.0.0-6730.g4ba8a190.el8 1.6 MB/s | 107 kB 00:00 2023-10-16T12:56:11.237 INFO:teuthology.orchestra.run.smithi124.stdout:(24/131): python3-rados-18.0.0-6730.g4ba8a190.e 1.9 MB/s | 371 kB 00:00 2023-10-16T12:56:11.271 INFO:teuthology.orchestra.run.smithi124.stdout:(25/131): rbd-fuse-18.0.0-6730.g4ba8a190.el8.x8 1.4 MB/s | 94 kB 00:00 2023-10-16T12:56:11.338 INFO:teuthology.orchestra.run.smithi124.stdout:(26/131): rbd-nbd-18.0.0-6730.g4ba8a190.el8.x86 2.6 MB/s | 179 kB 00:00 2023-10-16T12:56:11.358 INFO:teuthology.orchestra.run.smithi192.stdout:(130/131): librbd1-18.0.0-6730.g4ba8a190.el8.x8 8.4 MB/s | 3.7 MB 00:00 2023-10-16T12:56:11.388 INFO:teuthology.orchestra.run.smithi124.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6730.g 462 kB/s | 23 kB 00:00 2023-10-16T12:56:11.434 INFO:teuthology.orchestra.run.smithi192.stdout:(131/131): librados2-18.0.0-6730.g4ba8a190.el8. 6.9 MB/s | 3.7 MB 00:00 2023-10-16T12:56:11.436 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-10-16T12:56:11.437 INFO:teuthology.orchestra.run.smithi192.stdout:Total 19 MB/s | 209 MB 00:10 2023-10-16T12:56:11.438 INFO:teuthology.orchestra.run.smithi124.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 2.6 MB/s | 132 kB 00:00 2023-10-16T12:56:11.555 INFO:teuthology.orchestra.run.smithi124.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 15 MB/s | 1.8 MB 00:00 2023-10-16T12:56:11.948 INFO:teuthology.orchestra.run.smithi124.stdout:(30/131): ceph-mgr-diskprediction-local-18.0.0- 19 MB/s | 7.4 MB 00:00 2023-10-16T12:56:11.998 INFO:teuthology.orchestra.run.smithi124.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6730.g4b 4.8 MB/s | 242 kB 00:00 2023-10-16T12:56:12.040 INFO:teuthology.orchestra.run.smithi124.stdout:(32/131): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 1.1 MB/s | 47 kB 00:00 2023-10-16T12:56:12.082 INFO:teuthology.orchestra.run.smithi124.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6730.g4 361 kB/s | 15 kB 00:00 2023-10-16T12:56:12.132 INFO:teuthology.orchestra.run.smithi124.stdout:(34/131): ceph-volume-18.0.0-6730.g4ba8a190.el8 5.1 MB/s | 261 kB 00:00 2023-10-16T12:56:12.182 INFO:teuthology.orchestra.run.smithi124.stdout:(35/131): cephadm-18.0.0-6730.g4ba8a190.el8.noa 3.8 MB/s | 192 kB 00:00 2023-10-16T12:56:12.225 INFO:teuthology.orchestra.run.smithi124.stdout:(36/131): cephfs-top-18.0.0-6730.g4ba8a190.el8. 433 kB/s | 18 kB 00:00 2023-10-16T12:56:12.270 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-10-16T12:56:12.392 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-10-16T12:56:12.392 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-10-16T12:56:12.458 INFO:teuthology.orchestra.run.smithi124.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.3 MB/s | 306 kB 00:00 2023-10-16T12:56:12.533 INFO:teuthology.orchestra.run.smithi124.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 786 kB/s | 59 kB 00:00 2023-10-16T12:56:12.592 INFO:teuthology.orchestra.run.smithi124.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2023-10-16T12:56:12.693 INFO:teuthology.orchestra.run.smithi124.stdout:(40/131): rbd-mirror-18.0.0-6730.g4ba8a190.el8. 2.5 MB/s | 3.6 MB 00:01 2023-10-16T12:56:12.810 INFO:teuthology.orchestra.run.smithi124.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2023-10-16T12:56:12.836 INFO:teuthology.orchestra.run.smithi124.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 307 kB/s | 44 kB 00:00 2023-10-16T12:56:12.877 INFO:teuthology.orchestra.run.smithi124.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 793 kB/s | 33 kB 00:00 2023-10-16T12:56:12.919 INFO:teuthology.orchestra.run.smithi124.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.7 MB/s | 185 kB 00:00 2023-10-16T12:56:12.970 INFO:teuthology.orchestra.run.smithi124.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 177 kB/s | 16 kB 00:00 2023-10-16T12:56:13.502 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-10-16T12:56:13.506 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-10-16T12:56:13.545 INFO:teuthology.orchestra.run.smithi124.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 276 kB/s | 173 kB 00:00 2023-10-16T12:56:13.612 INFO:teuthology.orchestra.run.smithi124.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2023-10-16T12:56:13.670 INFO:teuthology.orchestra.run.smithi124.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 549 kB/s | 384 kB 00:00 2023-10-16T12:56:13.696 INFO:teuthology.orchestra.run.smithi124.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2023-10-16T12:56:13.980 INFO:teuthology.orchestra.run.smithi124.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 57 kB/s | 18 kB 00:00 2023-10-16T12:56:14.122 INFO:teuthology.orchestra.run.smithi124.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 344 kB/s | 49 kB 00:00 2023-10-16T12:56:14.305 INFO:teuthology.orchestra.run.smithi124.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 320 kB/s | 59 kB 00:00 2023-10-16T12:56:14.481 INFO:teuthology.orchestra.run.smithi124.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 1.5 MB/s | 1.2 MB 00:00 2023-10-16T12:56:14.539 INFO:teuthology.orchestra.run.smithi124.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 258 kB/s | 60 kB 00:00 2023-10-16T12:56:14.581 INFO:teuthology.orchestra.run.smithi124.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 375 kB/s | 16 kB 00:00 2023-10-16T12:56:14.623 INFO:teuthology.orchestra.run.smithi124.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.9 MB/s | 283 kB 00:00 2023-10-16T12:56:14.649 INFO:teuthology.orchestra.run.smithi124.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 502 kB/s | 34 kB 00:00 2023-10-16T12:56:14.766 INFO:teuthology.orchestra.run.smithi124.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.3 MB/s | 196 kB 00:00 2023-10-16T12:56:14.800 INFO:teuthology.orchestra.run.smithi124.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 427 kB/s | 64 kB 00:00 2023-10-16T12:56:14.833 INFO:teuthology.orchestra.run.smithi124.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 280 kB/s | 19 kB 00:00 2023-10-16T12:56:14.900 INFO:teuthology.orchestra.run.smithi124.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 439 kB/s | 29 kB 00:00 2023-10-16T12:56:14.967 INFO:teuthology.orchestra.run.smithi124.stdout:(62/131): python3-trustme-0.6.0-4.el8.noarch.rp 412 kB/s | 27 kB 00:00 2023-10-16T12:56:15.026 INFO:teuthology.orchestra.run.smithi124.stdout:(63/131): python3-singledispatch-3.4.0.3-18.el8 106 kB/s | 24 kB 00:00 2023-10-16T12:56:15.151 INFO:teuthology.orchestra.run.smithi124.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 1.4 MB/s | 255 kB 00:00 2023-10-16T12:56:15.210 INFO:teuthology.orchestra.run.smithi124.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 1.0 MB/s | 61 kB 00:00 2023-10-16T12:56:15.352 INFO:teuthology.orchestra.run.smithi124.stdout:(66/131): python3-webtest-2.0.33-1.el8.noarch.r 603 kB/s | 85 kB 00:00 2023-10-16T12:56:15.402 INFO:teuthology.orchestra.run.smithi124.stdout:(67/131): python3-zc-lockfile-2.0-2.el8.noarch. 459 kB/s | 23 kB 00:00 2023-10-16T12:56:15.528 INFO:teuthology.orchestra.run.smithi124.stdout:(68/131): python3-webob-1.8.5-1.el8.1.noarch.rp 501 kB/s | 251 kB 00:00 2023-10-16T12:56:15.720 INFO:teuthology.orchestra.run.smithi124.stdout:(69/131): ceph-osd-18.0.0-6730.g4ba8a190.el8.x8 2.1 MB/s | 18 MB 00:08 2023-10-16T12:56:15.745 INFO:teuthology.orchestra.run.smithi124.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 321 kB/s | 70 kB 00:00 2023-10-16T12:56:15.804 INFO:teuthology.orchestra.run.smithi124.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 561 kB/s | 47 kB 00:00 2023-10-16T12:56:15.829 INFO:teuthology.orchestra.run.smithi124.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 2.3 MB/s | 200 kB 00:00 2023-10-16T12:56:15.854 INFO:teuthology.orchestra.run.smithi124.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 848 kB/s | 43 kB 00:00 2023-10-16T12:56:15.880 INFO:teuthology.orchestra.run.smithi124.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-16T12:56:15.905 INFO:teuthology.orchestra.run.smithi124.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 959 kB/s | 48 kB 00:00 2023-10-16T12:56:15.930 INFO:teuthology.orchestra.run.smithi124.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-10-16T12:56:15.955 INFO:teuthology.orchestra.run.smithi124.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 849 kB/s | 43 kB 00:00 2023-10-16T12:56:15.981 INFO:teuthology.orchestra.run.smithi124.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-10-16T12:56:16.006 INFO:teuthology.orchestra.run.smithi124.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-10-16T12:56:16.040 INFO:teuthology.orchestra.run.smithi124.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.4 MB/s | 560 kB 00:00 2023-10-16T12:56:16.065 INFO:teuthology.orchestra.run.smithi124.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 318 kB/s | 19 kB 00:00 2023-10-16T12:56:16.090 INFO:teuthology.orchestra.run.smithi124.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-10-16T12:56:16.124 INFO:teuthology.orchestra.run.smithi124.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 9.3 MB/s | 559 kB 00:00 2023-10-16T12:56:16.175 INFO:teuthology.orchestra.run.smithi124.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 214 kB/s | 18 kB 00:00 2023-10-16T12:56:16.208 INFO:teuthology.orchestra.run.smithi124.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 7.1 MB/s | 605 kB 00:00 2023-10-16T12:56:16.242 INFO:teuthology.orchestra.run.smithi124.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-10-16T12:56:16.284 INFO:teuthology.orchestra.run.smithi124.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.7 MB/s | 72 kB 00:00 2023-10-16T12:56:16.343 INFO:teuthology.orchestra.run.smithi124.stdout:(88/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 17 MB/s | 2.3 MB 00:00 2023-10-16T12:56:16.368 INFO:teuthology.orchestra.run.smithi124.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 985 kB/s | 83 kB 00:00 2023-10-16T12:56:16.393 INFO:teuthology.orchestra.run.smithi124.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-10-16T12:56:16.419 INFO:teuthology.orchestra.run.smithi124.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-10-16T12:56:16.461 INFO:teuthology.orchestra.run.smithi124.stdout:(92/131): thrift-0.13.0-2.el8.x86_64.rpm 1.6 MB/s | 1.7 MB 00:01 2023-10-16T12:56:16.478 INFO:teuthology.orchestra.run.smithi124.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 660 kB/s | 39 kB 00:00 2023-10-16T12:56:16.511 INFO:teuthology.orchestra.run.smithi124.stdout:(94/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 491 kB/s | 58 kB 00:00 2023-10-16T12:56:16.537 INFO:teuthology.orchestra.run.smithi124.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 3.1 MB/s | 171 kB 00:00 2023-10-16T12:56:16.562 INFO:teuthology.orchestra.run.smithi124.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-10-16T12:56:16.596 INFO:teuthology.orchestra.run.smithi124.stdout:(97/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 4.7 MB/s | 644 kB 00:00 2023-10-16T12:56:16.621 INFO:teuthology.orchestra.run.smithi124.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-10-16T12:56:16.646 INFO:teuthology.orchestra.run.smithi124.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-10-16T12:56:16.672 INFO:teuthology.orchestra.run.smithi124.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.0 MB/s | 259 kB 00:00 2023-10-16T12:56:16.705 INFO:teuthology.orchestra.run.smithi124.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-10-16T12:56:16.731 INFO:teuthology.orchestra.run.smithi124.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 664 kB/s | 39 kB 00:00 2023-10-16T12:56:16.764 INFO:teuthology.orchestra.run.smithi124.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 11 MB/s | 688 kB 00:00 2023-10-16T12:56:16.815 INFO:teuthology.orchestra.run.smithi124.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 6.3 MB/s | 538 kB 00:00 2023-10-16T12:56:16.840 INFO:teuthology.orchestra.run.smithi124.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.0 MB/s | 157 kB 00:00 2023-10-16T12:56:16.865 INFO:teuthology.orchestra.run.smithi124.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-10-16T12:56:16.907 INFO:teuthology.orchestra.run.smithi124.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-10-16T12:56:16.949 INFO:teuthology.orchestra.run.smithi124.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 634 kB/s | 27 kB 00:00 2023-10-16T12:56:17.000 INFO:teuthology.orchestra.run.smithi124.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-10-16T12:56:17.041 INFO:teuthology.orchestra.run.smithi124.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.0 MB/s | 44 kB 00:00 2023-10-16T12:56:17.109 INFO:teuthology.orchestra.run.smithi124.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-10-16T12:56:17.159 INFO:teuthology.orchestra.run.smithi124.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 9.0 MB/s | 457 kB 00:00 2023-10-16T12:56:17.201 INFO:teuthology.orchestra.run.smithi124.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-10-16T12:56:17.268 INFO:teuthology.orchestra.run.smithi124.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 17 MB/s | 3.7 MB 00:00 2023-10-16T12:56:17.293 INFO:teuthology.orchestra.run.smithi124.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 693 kB/s | 64 kB 00:00 2023-10-16T12:56:17.319 INFO:teuthology.orchestra.run.smithi124.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-10-16T12:56:17.335 INFO:teuthology.orchestra.run.smithi124.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 477 kB/s | 20 kB 00:00 2023-10-16T12:56:17.361 INFO:teuthology.orchestra.run.smithi124.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.4 MB/s | 103 kB 00:00 2023-10-16T12:56:17.394 INFO:teuthology.orchestra.run.smithi124.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-10-16T12:56:17.545 INFO:teuthology.orchestra.run.smithi124.stdout:(120/131): python3-scipy-1.0.0-21.module+el8.5. 14 MB/s | 14 MB 00:01 2023-10-16T12:56:17.570 INFO:teuthology.orchestra.run.smithi124.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 1.1 MB/s | 198 kB 00:00 2023-10-16T12:56:17.612 INFO:teuthology.orchestra.run.smithi124.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-10-16T12:56:17.654 INFO:teuthology.orchestra.run.smithi124.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-10-16T12:56:17.730 INFO:teuthology.orchestra.run.smithi124.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 13 MB/s | 4.9 MB 00:00 2023-10-16T12:56:17.805 INFO:teuthology.orchestra.run.smithi124.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-10-16T12:56:17.838 INFO:teuthology.orchestra.run.smithi124.stdout:(126/131): postgresql-contrib-10.21-2.module+el 7.3 MB/s | 808 kB 00:00 2023-10-16T12:56:17.889 INFO:teuthology.orchestra.run.smithi124.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 18 MB/s | 1.5 MB 00:00 2023-10-16T12:56:17.972 INFO:teuthology.orchestra.run.smithi124.stdout:(128/131): postgresql-server-10.21-2.module+el8 16 MB/s | 5.1 MB 00:00 2023-10-16T12:56:18.023 INFO:teuthology.orchestra.run.smithi124.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-10-16T12:56:18.710 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-10-16T12:56:18.910 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-16T12:56:19.015 INFO:teuthology.orchestra.run.smithi124.stdout:(130/131): librados2-18.0.0-6730.g4ba8a190.el8. 3.2 MB/s | 3.7 MB 00:01 2023-10-16T12:56:19.048 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-16T12:56:19.230 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-16T12:56:19.412 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-16T12:56:19.693 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-16T12:56:19.798 INFO:teuthology.orchestra.run.smithi124.stdout:(131/131): librbd1-18.0.0-6730.g4ba8a190.el8.x8 1.9 MB/s | 3.7 MB 00:01 2023-10-16T12:56:19.802 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2023-10-16T12:56:19.802 INFO:teuthology.orchestra.run.smithi124.stdout:Total 13 MB/s | 209 MB 00:16 2023-10-16T12:56:19.995 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-16T12:56:20.440 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-16T12:56:20.625 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2023-10-16T12:56:20.679 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T12:56:20.745 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction check succeeded. 2023-10-16T12:56:20.745 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2023-10-16T12:56:21.102 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T12:56:21.287 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T12:56:21.439 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T12:56:21.620 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T12:56:21.714 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T12:56:21.864 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded. 2023-10-16T12:56:21.868 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2023-10-16T12:56:21.894 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-16T12:56:22.173 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-16T12:56:22.389 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-16T12:56:22.819 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-16T12:56:23.061 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-16T12:56:23.270 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T12:56:23.367 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T12:56:23.520 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T12:56:23.584 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T12:56:23.711 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-16T12:56:23.857 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-16T12:56:24.020 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-16T12:56:24.620 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-16T12:56:24.779 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-16T12:56:25.379 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-16T12:56:25.578 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-16T12:56:26.285 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-16T12:56:26.579 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-16T12:56:26.796 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-16T12:56:26.998 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-16T12:56:27.072 INFO:teuthology.orchestra.run.smithi124.stdout: Preparing : 1/1 2023-10-16T12:56:27.192 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-16T12:56:27.260 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-16T12:56:27.383 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-16T12:56:27.477 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-16T12:56:27.629 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-16T12:56:27.646 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-16T12:56:27.784 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-16T12:56:27.825 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 26/134 2023-10-16T12:56:27.955 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 27/134 2023-10-16T12:56:27.971 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-16T12:56:28.378 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-16T12:56:28.587 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 5/134 2023-10-16T12:56:28.872 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 28/134 2023-10-16T12:56:28.997 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 5/134 2023-10-16T12:56:29.204 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T12:56:29.217 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-16T12:56:29.339 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T12:56:29.480 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-16T12:56:29.537 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T12:56:29.663 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T12:56:29.759 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-16T12:56:29.837 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T12:56:29.961 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-16T12:56:30.021 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-16T12:56:30.570 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-16T12:56:30.749 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-16T12:56:31.168 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-16T12:56:31.411 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-16T12:56:31.603 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T12:56:31.701 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T12:56:31.722 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-16T12:56:31.862 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T12:56:31.990 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T12:56:32.028 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-16T12:56:32.165 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-16T12:56:32.271 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-16T12:56:32.384 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-16T12:56:32.437 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-16T12:56:32.553 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-16T12:56:32.616 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 36/134 2023-10-16T12:56:32.703 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-16T12:56:32.755 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 37/134 2023-10-16T12:56:32.848 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-16T12:56:32.959 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-16T12:56:33.012 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-16T12:56:33.136 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-16T12:56:33.338 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-16T12:56:33.514 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-16T12:56:33.631 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-16T12:56:33.726 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-16T12:56:33.795 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-16T12:56:33.925 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-16T12:56:34.327 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-16T12:56:34.381 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-16T12:56:34.545 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-16T12:56:34.588 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-16T12:56:34.794 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-16T12:56:35.013 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-16T12:56:35.239 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-16T12:56:35.242 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-16T12:56:35.517 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-16T12:56:35.558 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-16T12:56:35.702 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-16T12:56:35.809 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-16T12:56:35.913 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-16T12:56:36.076 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 26/134 2023-10-16T12:56:36.092 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-16T12:56:36.238 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 27/134 2023-10-16T12:56:36.325 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-16T12:56:36.457 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 28/134 2023-10-16T12:56:36.500 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-16T12:56:36.653 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-16T12:56:36.655 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-16T12:56:36.968 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-16T12:56:37.233 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-16T12:56:37.490 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-16T12:56:37.716 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-16T12:56:37.875 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-16T12:56:38.069 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-16T12:56:38.226 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-16T12:56:38.284 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-16T12:56:38.418 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-16T12:56:38.497 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-16T12:56:38.729 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-16T12:56:38.868 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-16T12:56:38.945 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-16T12:56:39.147 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-16T12:56:39.335 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-16T12:56:39.488 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-16T12:56:39.492 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-16T12:56:39.679 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-16T12:56:39.801 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-16T12:56:39.996 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-16T12:56:40.096 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-16T12:56:40.199 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-16T12:56:40.308 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-16T12:56:40.346 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-16T12:56:40.495 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-16T12:56:40.555 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-16T12:56:40.719 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-16T12:56:40.771 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-16T12:56:40.938 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-16T12:56:41.088 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 36/134 2023-10-16T12:56:41.130 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-16T12:56:41.320 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-16T12:56:41.425 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 37/134 2023-10-16T12:56:41.465 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-16T12:56:41.584 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-16T12:56:41.672 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-16T12:56:41.720 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-16T12:56:41.894 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-16T12:56:41.921 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-16T12:56:41.997 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-16T12:56:42.123 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-16T12:56:42.223 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-16T12:56:42.373 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-16T12:56:42.447 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-16T12:56:42.627 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-16T12:56:42.634 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-16T12:56:42.709 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-16T12:56:42.800 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-16T12:56:42.914 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-16T12:56:43.014 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-16T12:56:43.089 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-16T12:56:43.252 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-16T12:56:43.453 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-16T12:56:43.621 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-16T12:56:43.763 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-16T12:56:43.999 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-16T12:56:44.107 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-16T12:56:44.206 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-16T12:56:44.395 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-16T12:56:44.544 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-16T12:56:44.650 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-16T12:56:44.820 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-16T12:56:44.961 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-16T12:56:45.030 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-16T12:56:45.243 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-16T12:56:45.305 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-16T12:56:45.429 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-16T12:56:45.506 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-16T12:56:45.809 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-16T12:56:46.043 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-16T12:56:46.231 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-16T12:56:46.276 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-16T12:56:46.423 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-16T12:56:46.466 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T12:56:46.539 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T12:56:46.628 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-16T12:56:46.717 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 93/134 2023-10-16T12:56:46.780 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-16T12:56:47.078 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-16T12:56:47.380 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-16T12:56:47.623 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-16T12:56:47.870 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-16T12:56:48.026 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-16T12:56:48.204 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-16T12:56:48.460 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-16T12:56:48.733 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-16T12:56:48.889 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-16T12:56:49.036 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-16T12:56:49.266 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-16T12:56:49.461 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-16T12:56:49.652 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-16T12:56:49.827 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-16T12:56:49.973 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-16T12:56:50.175 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-16T12:56:50.362 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-16T12:56:50.456 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T12:56:50.564 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-16T12:56:50.675 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T12:56:50.799 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-16T12:56:51.024 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-16T12:56:51.215 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-16T12:56:51.266 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T12:56:51.426 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-16T12:56:52.010 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T12:56:52.097 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T12:56:52.282 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T12:56:52.513 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-16T12:56:52.762 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-16T12:56:52.992 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-16T12:56:53.301 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-16T12:56:53.632 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-16T12:56:53.858 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-16T12:56:54.675 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-16T12:56:54.850 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T12:56:54.906 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T12:56:55.084 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 93/134 2023-10-16T12:56:58.849 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T12:56:59.101 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T12:56:59.686 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T12:56:59.964 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T12:57:00.050 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T12:57:00.208 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T12:57:11.085 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T12:57:11.085 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /sys 2023-10-16T12:57:11.086 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /proc 2023-10-16T12:57:11.086 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /dev 2023-10-16T12:57:11.086 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /run 2023-10-16T12:57:11.086 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /mnt 2023-10-16T12:57:11.086 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /var/tmp 2023-10-16T12:57:11.087 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /home 2023-10-16T12:57:11.087 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /tmp 2023-10-16T12:57:11.087 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /dev 2023-10-16T12:57:11.087 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:11.446 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T12:57:13.040 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T12:57:13.223 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T12:57:13.444 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T12:57:13.604 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T12:57:14.068 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T12:57:14.263 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T12:57:14.280 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T12:57:16.004 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T12:57:16.217 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T12:57:16.343 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 102/134 2023-10-16T12:57:16.527 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 103/134 2023-10-16T12:57:16.762 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T12:57:16.979 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T12:57:17.297 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T12:57:18.258 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T12:57:18.411 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T12:57:18.502 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T12:57:18.894 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 107/134 2023-10-16T12:57:19.101 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T12:57:19.101 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /sys 2023-10-16T12:57:19.101 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /proc 2023-10-16T12:57:19.101 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /dev 2023-10-16T12:57:19.102 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /run 2023-10-16T12:57:19.102 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /mnt 2023-10-16T12:57:19.102 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /var/tmp 2023-10-16T12:57:19.102 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /home 2023-10-16T12:57:19.102 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /tmp 2023-10-16T12:57:19.103 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /dev 2023-10-16T12:57:19.103 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:19.112 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T12:57:19.146 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T12:57:19.319 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T12:57:19.331 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T12:57:19.453 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T12:57:20.654 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 110/134 2023-10-16T12:57:20.886 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T12:57:20.920 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T12:57:21.043 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T12:57:21.112 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T12:57:21.153 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T12:57:21.202 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T12:57:21.320 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T12:57:21.422 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T12:57:21.547 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T12:57:21.686 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T12:57:21.845 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T12:57:22.024 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T12:57:22.197 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T12:57:22.214 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T12:57:23.862 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T12:57:24.071 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T12:57:24.186 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 102/134 2023-10-16T12:57:24.362 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 103/134 2023-10-16T12:57:24.530 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T12:57:24.748 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T12:57:25.035 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T12:57:25.993 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T12:57:26.163 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T12:57:26.253 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T12:57:26.492 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T12:57:26.659 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 107/134 2023-10-16T12:57:26.780 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 115/134 2023-10-16T12:57:26.827 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T12:57:26.861 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T12:57:26.952 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-16T12:57:27.038 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T12:57:27.049 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T12:57:27.144 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-16T12:57:28.050 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-16T12:57:28.372 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-16T12:57:28.419 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 110/134 2023-10-16T12:57:28.548 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 119/134 2023-10-16T12:57:28.647 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T12:57:28.680 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T12:57:28.747 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-16T12:57:28.821 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T12:57:28.863 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T12:57:28.906 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 121/134 2023-10-16T12:57:28.997 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T12:57:29.044 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-16T12:57:29.359 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T12:57:29.513 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T12:57:31.279 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T12:57:31.510 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T12:57:31.527 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T12:57:31.685 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 124/134 2023-10-16T12:57:31.993 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 125/134 2023-10-16T12:57:32.298 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 126/134 2023-10-16T12:57:32.645 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-16T12:57:32.818 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-16T12:57:32.827 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-16T12:57:33.004 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-16T12:57:33.209 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-16T12:57:33.293 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-16T12:57:33.501 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-16T12:57:33.513 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-16T12:57:33.514 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T12:57:33.713 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T12:57:33.713 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T12:57:33.973 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T12:57:34.141 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T12:57:34.150 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T12:57:34.635 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T12:57:34.636 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 1/134 2023-10-16T12:57:34.636 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2/134 2023-10-16T12:57:34.636 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 3/134 2023-10-16T12:57:34.637 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 4/134 2023-10-16T12:57:34.637 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/134 2023-10-16T12:57:34.637 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T12:57:34.637 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T12:57:34.637 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T12:57:34.638 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-16T12:57:34.638 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 10/134 2023-10-16T12:57:34.638 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 11/134 2023-10-16T12:57:34.638 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 12/134 2023-10-16T12:57:34.638 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 13/134 2023-10-16T12:57:34.639 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 14/134 2023-10-16T12:57:34.639 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 15/134 2023-10-16T12:57:34.639 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 16/134 2023-10-16T12:57:34.639 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 17/134 2023-10-16T12:57:34.639 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 18/134 2023-10-16T12:57:34.640 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 19/134 2023-10-16T12:57:34.640 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/134 2023-10-16T12:57:34.640 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 21/134 2023-10-16T12:57:34.640 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 22/134 2023-10-16T12:57:34.640 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 23/134 2023-10-16T12:57:34.640 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 24/134 2023-10-16T12:57:34.641 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 25/134 2023-10-16T12:57:34.641 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 26/134 2023-10-16T12:57:34.641 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 27/134 2023-10-16T12:57:34.641 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 28/134 2023-10-16T12:57:34.641 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/134 2023-10-16T12:57:34.642 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 30/134 2023-10-16T12:57:34.651 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 31/134 2023-10-16T12:57:34.651 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/134 2023-10-16T12:57:34.651 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/134 2023-10-16T12:57:34.651 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 34/134 2023-10-16T12:57:34.651 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/134 2023-10-16T12:57:34.652 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 36/134 2023-10-16T12:57:34.652 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 37/134 2023-10-16T12:57:34.652 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 38/134 2023-10-16T12:57:34.652 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-16T12:57:34.652 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-16T12:57:34.653 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-16T12:57:34.653 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-16T12:57:34.653 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-16T12:57:34.653 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-16T12:57:34.653 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-16T12:57:34.654 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-16T12:57:34.654 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-16T12:57:34.654 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-16T12:57:34.654 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-16T12:57:34.654 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-16T12:57:34.655 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-16T12:57:34.655 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-16T12:57:34.655 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-16T12:57:34.655 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-16T12:57:34.655 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-16T12:57:34.656 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-16T12:57:34.656 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-16T12:57:34.656 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-16T12:57:34.656 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-16T12:57:34.656 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-16T12:57:34.657 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-16T12:57:34.657 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-16T12:57:34.657 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-16T12:57:34.657 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-16T12:57:34.657 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-16T12:57:34.657 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-16T12:57:34.658 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-16T12:57:34.658 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-16T12:57:34.658 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-16T12:57:34.658 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-16T12:57:34.658 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-16T12:57:34.659 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-16T12:57:34.659 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-16T12:57:34.659 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-16T12:57:34.659 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-16T12:57:34.660 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-16T12:57:34.660 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-16T12:57:34.660 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-16T12:57:34.660 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-16T12:57:34.660 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-16T12:57:34.661 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-16T12:57:34.661 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-16T12:57:34.661 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-16T12:57:34.661 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-16T12:57:34.661 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-16T12:57:34.662 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-16T12:57:34.662 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-16T12:57:34.662 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-16T12:57:34.662 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-16T12:57:34.662 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-16T12:57:34.663 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-16T12:57:34.663 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-16T12:57:34.663 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-16T12:57:34.663 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-16T12:57:34.663 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-16T12:57:34.664 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-16T12:57:34.664 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-16T12:57:34.664 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-16T12:57:34.664 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-16T12:57:34.665 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-16T12:57:34.665 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-16T12:57:34.665 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-16T12:57:34.665 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-16T12:57:34.665 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-16T12:57:34.666 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-16T12:57:34.666 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-16T12:57:34.666 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-16T12:57:34.666 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-16T12:57:34.666 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-16T12:57:34.667 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-16T12:57:34.667 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-16T12:57:34.667 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-16T12:57:34.667 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-16T12:57:34.668 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-16T12:57:34.668 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-16T12:57:34.668 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-16T12:57:34.668 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-16T12:57:34.668 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-16T12:57:34.669 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-16T12:57:34.669 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-16T12:57:34.669 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-16T12:57:34.669 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-16T12:57:34.669 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-16T12:57:34.670 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-16T12:57:34.670 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-16T12:57:34.670 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-16T12:57:34.670 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-16T12:57:34.670 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-16T12:57:34.671 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 129/134 2023-10-16T12:57:34.671 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-16T12:57:34.671 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 131/134 2023-10-16T12:57:34.671 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T12:57:34.672 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-16T12:57:35.033 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 115/134 2023-10-16T12:57:35.315 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-16T12:57:35.528 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 117/134 2023-10-16T12:57:35.767 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-16T12:57:35.912 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-16T12:57:36.104 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-16T12:57:36.333 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-16T12:57:36.499 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 121/134 2023-10-16T12:57:36.646 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-16T12:57:37.397 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T12:57:37.397 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:49 ago on Mon 16 Oct 2023 12:55:48 PM UTC. 2023-10-16T12:57:38.884 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T12:57:39.128 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T12:57:39.146 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T12:57:39.354 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 124/134 2023-10-16T12:57:39.603 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 125/134 2023-10-16T12:57:39.884 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 126/134 2023-10-16T12:57:40.189 INFO:teuthology.orchestra.run.smithi192.stdout:Installed products updated. 2023-10-16T12:57:40.245 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-16T12:57:40.419 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-16T12:57:40.421 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:40.421 INFO:teuthology.orchestra.run.smithi192.stdout:Upgraded: 2023-10-16T12:57:40.421 INFO:teuthology.orchestra.run.smithi192.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-16T12:57:40.422 INFO:teuthology.orchestra.run.smithi192.stdout: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.422 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.422 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-10-16T12:57:40.422 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-16T12:57:40.423 INFO:teuthology.orchestra.run.smithi192.stdout: automake-1.16.1-7.el8.noarch 2023-10-16T12:57:40.423 INFO:teuthology.orchestra.run.smithi192.stdout: bison-3.0.4-10.el8.x86_64 2023-10-16T12:57:40.423 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.423 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.423 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.424 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.424 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T12:57:40.424 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.424 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.424 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.425 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T12:57:40.425 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T12:57:40.425 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T12:57:40.425 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T12:57:40.425 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T12:57:40.426 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.426 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.426 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T12:57:40.426 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.426 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.427 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.427 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T12:57:40.427 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T12:57:40.427 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.427 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T12:57:40.428 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-16T12:57:40.428 INFO:teuthology.orchestra.run.smithi192.stdout: flex-2.6.1-9.el8.x86_64 2023-10-16T12:57:40.428 INFO:teuthology.orchestra.run.smithi192.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-16T12:57:40.428 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-16T12:57:40.428 INFO:teuthology.orchestra.run.smithi192.stdout: jq-1.6-3.el8.x86_64 2023-10-16T12:57:40.429 INFO:teuthology.orchestra.run.smithi192.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-16T12:57:40.429 INFO:teuthology.orchestra.run.smithi192.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-16T12:57:40.429 INFO:teuthology.orchestra.run.smithi192.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-16T12:57:40.429 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.429 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.429 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.430 INFO:teuthology.orchestra.run.smithi192.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-16T12:57:40.430 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-16T12:57:40.430 INFO:teuthology.orchestra.run.smithi192.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-16T12:57:40.430 INFO:teuthology.orchestra.run.smithi192.stdout: libpq-13.5-1.el8.x86_64 2023-10-16T12:57:40.430 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-16T12:57:40.431 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-16T12:57:40.431 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.431 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.431 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-16T12:57:40.431 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.432 INFO:teuthology.orchestra.run.smithi192.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-16T12:57:40.432 INFO:teuthology.orchestra.run.smithi192.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-16T12:57:40.432 INFO:teuthology.orchestra.run.smithi192.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-16T12:57:40.432 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-16T12:57:40.432 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-16T12:57:40.432 INFO:teuthology.orchestra.run.smithi192.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-16T12:57:40.433 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-16T12:57:40.433 INFO:teuthology.orchestra.run.smithi192.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-16T12:57:40.433 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-16T12:57:40.433 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-16T12:57:40.433 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-16T12:57:40.433 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-16T12:57:40.434 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-16T12:57:40.434 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-16T12:57:40.434 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T12:57:40.434 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T12:57:40.435 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T12:57:40.435 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-16T12:57:40.435 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-16T12:57:40.435 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-16T12:57:40.435 INFO:teuthology.orchestra.run.smithi192.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-16T12:57:40.435 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-16T12:57:40.436 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.436 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.436 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.436 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-16T12:57:40.436 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-16T12:57:40.436 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-16T12:57:40.437 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-16T12:57:40.437 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-16T12:57:40.437 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-16T12:57:40.437 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-16T12:57:40.437 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-16T12:57:40.438 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-16T12:57:40.438 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-16T12:57:40.438 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-16T12:57:40.438 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-16T12:57:40.438 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-16T12:57:40.439 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-16T12:57:40.439 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-16T12:57:40.439 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-16T12:57:40.439 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-16T12:57:40.439 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-16T12:57:40.440 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-16T12:57:40.440 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-16T12:57:40.440 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-16T12:57:40.440 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-16T12:57:40.440 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend-2.6-1.el8.noarch 2023-10-16T12:57:40.441 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-16T12:57:40.441 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-16T12:57:40.441 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-16T12:57:40.441 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-16T12:57:40.441 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-16T12:57:40.441 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-16T12:57:40.442 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.442 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.442 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-16T12:57:40.442 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-16T12:57:40.442 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.443 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-16T12:57:40.443 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-16T12:57:40.443 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-16T12:57:40.443 INFO:teuthology.orchestra.run.smithi192.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-16T12:57:40.443 INFO:teuthology.orchestra.run.smithi192.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-16T12:57:40.444 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-16T12:57:40.444 INFO:teuthology.orchestra.run.smithi192.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-16T12:57:40.444 INFO:teuthology.orchestra.run.smithi192.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-16T12:57:40.444 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-16T12:57:40.444 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-16T12:57:40.445 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-16T12:57:40.445 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-16T12:57:40.445 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-16T12:57:40.445 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.445 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.445 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:40.446 INFO:teuthology.orchestra.run.smithi192.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-16T12:57:40.446 INFO:teuthology.orchestra.run.smithi192.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-16T12:57:40.446 INFO:teuthology.orchestra.run.smithi192.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-16T12:57:40.446 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-16T12:57:40.446 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-16T12:57:40.447 INFO:teuthology.orchestra.run.smithi192.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-16T12:57:40.447 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:40.447 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-10-16T12:57:40.503 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-16T12:57:40.613 DEBUG:teuthology.parallel:result is None 2023-10-16T12:57:40.720 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-16T12:57:40.732 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-16T12:57:40.886 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-16T12:57:40.894 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-16T12:57:41.039 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-16T12:57:41.039 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T12:57:41.222 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T12:57:41.223 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T12:57:41.508 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T12:57:41.685 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T12:57:42.191 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T12:57:42.191 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 1/134 2023-10-16T12:57:42.191 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2/134 2023-10-16T12:57:42.191 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 3/134 2023-10-16T12:57:42.191 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 4/134 2023-10-16T12:57:42.192 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/134 2023-10-16T12:57:42.192 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T12:57:42.192 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T12:57:42.192 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T12:57:42.192 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-16T12:57:42.193 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 10/134 2023-10-16T12:57:42.193 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 11/134 2023-10-16T12:57:42.193 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 12/134 2023-10-16T12:57:42.193 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 13/134 2023-10-16T12:57:42.193 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 14/134 2023-10-16T12:57:42.194 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 15/134 2023-10-16T12:57:42.194 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 16/134 2023-10-16T12:57:42.194 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 17/134 2023-10-16T12:57:42.194 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 18/134 2023-10-16T12:57:42.194 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 19/134 2023-10-16T12:57:42.194 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/134 2023-10-16T12:57:42.195 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 21/134 2023-10-16T12:57:42.195 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 22/134 2023-10-16T12:57:42.195 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 23/134 2023-10-16T12:57:42.195 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 24/134 2023-10-16T12:57:42.195 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 25/134 2023-10-16T12:57:42.196 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 26/134 2023-10-16T12:57:42.196 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 27/134 2023-10-16T12:57:42.196 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 28/134 2023-10-16T12:57:42.196 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/134 2023-10-16T12:57:42.196 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 30/134 2023-10-16T12:57:42.205 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 31/134 2023-10-16T12:57:42.205 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/134 2023-10-16T12:57:42.205 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/134 2023-10-16T12:57:42.206 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 34/134 2023-10-16T12:57:42.206 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/134 2023-10-16T12:57:42.206 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 36/134 2023-10-16T12:57:42.206 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 37/134 2023-10-16T12:57:42.206 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 38/134 2023-10-16T12:57:42.207 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-16T12:57:42.207 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-16T12:57:42.207 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-16T12:57:42.207 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-16T12:57:42.207 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-16T12:57:42.208 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-16T12:57:42.208 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-16T12:57:42.208 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-16T12:57:42.208 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-16T12:57:42.208 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-16T12:57:42.209 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-16T12:57:42.209 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-16T12:57:42.209 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-16T12:57:42.209 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-16T12:57:42.209 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-16T12:57:42.209 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-16T12:57:42.210 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-16T12:57:42.210 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-16T12:57:42.210 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-16T12:57:42.210 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-16T12:57:42.210 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-16T12:57:42.211 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-16T12:57:42.211 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-16T12:57:42.211 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-16T12:57:42.211 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-16T12:57:42.211 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-16T12:57:42.212 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-16T12:57:42.212 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-16T12:57:42.212 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-16T12:57:42.212 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-16T12:57:42.212 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-16T12:57:42.212 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-16T12:57:42.213 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-16T12:57:42.213 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-16T12:57:42.213 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-16T12:57:42.213 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-16T12:57:42.213 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-16T12:57:42.214 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-16T12:57:42.214 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-16T12:57:42.214 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-16T12:57:42.214 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-16T12:57:42.214 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-16T12:57:42.215 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-16T12:57:42.215 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-16T12:57:42.215 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-16T12:57:42.215 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-16T12:57:42.215 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-16T12:57:42.216 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-16T12:57:42.216 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-16T12:57:42.216 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-16T12:57:42.216 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-16T12:57:42.216 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-16T12:57:42.217 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-16T12:57:42.217 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-16T12:57:42.217 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-16T12:57:42.217 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-16T12:57:42.217 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-16T12:57:42.218 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-16T12:57:42.218 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-16T12:57:42.218 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-16T12:57:42.218 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-16T12:57:42.218 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-16T12:57:42.219 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-16T12:57:42.219 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-16T12:57:42.219 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-16T12:57:42.219 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-16T12:57:42.219 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-16T12:57:42.220 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-16T12:57:42.220 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-16T12:57:42.220 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-16T12:57:42.220 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-16T12:57:42.220 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-16T12:57:42.220 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-16T12:57:42.221 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-16T12:57:42.221 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-16T12:57:42.221 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-16T12:57:42.221 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-16T12:57:42.221 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-16T12:57:42.222 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-16T12:57:42.222 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-16T12:57:42.222 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-16T12:57:42.222 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-16T12:57:42.222 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-16T12:57:42.223 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-16T12:57:42.223 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-16T12:57:42.223 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-16T12:57:42.223 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-16T12:57:42.223 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-16T12:57:42.223 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-16T12:57:42.224 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-16T12:57:42.224 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 129/134 2023-10-16T12:57:42.224 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-16T12:57:42.224 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 131/134 2023-10-16T12:57:42.224 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T12:57:42.225 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-16T12:57:44.843 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T12:57:44.843 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:01:53 ago on Mon 16 Oct 2023 12:55:51 PM UTC. 2023-10-16T12:57:47.734 INFO:teuthology.orchestra.run.smithi124.stdout:Installed products updated. 2023-10-16T12:57:47.958 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:47.958 INFO:teuthology.orchestra.run.smithi124.stdout:Upgraded: 2023-10-16T12:57:47.958 INFO:teuthology.orchestra.run.smithi124.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-16T12:57:47.959 INFO:teuthology.orchestra.run.smithi124.stdout: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.959 INFO:teuthology.orchestra.run.smithi124.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.959 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2023-10-16T12:57:47.959 INFO:teuthology.orchestra.run.smithi124.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-16T12:57:47.960 INFO:teuthology.orchestra.run.smithi124.stdout: automake-1.16.1-7.el8.noarch 2023-10-16T12:57:47.960 INFO:teuthology.orchestra.run.smithi124.stdout: bison-3.0.4-10.el8.x86_64 2023-10-16T12:57:47.960 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.960 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.960 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.961 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.961 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T12:57:47.961 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.961 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.961 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.961 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T12:57:47.962 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T12:57:47.962 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T12:57:47.962 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T12:57:47.962 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T12:57:47.962 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.963 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.963 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T12:57:47.963 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.963 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.963 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.964 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T12:57:47.964 INFO:teuthology.orchestra.run.smithi124.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T12:57:47.964 INFO:teuthology.orchestra.run.smithi124.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.964 INFO:teuthology.orchestra.run.smithi124.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T12:57:47.964 INFO:teuthology.orchestra.run.smithi124.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-16T12:57:47.965 INFO:teuthology.orchestra.run.smithi124.stdout: flex-2.6.1-9.el8.x86_64 2023-10-16T12:57:47.965 INFO:teuthology.orchestra.run.smithi124.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-16T12:57:47.965 INFO:teuthology.orchestra.run.smithi124.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-16T12:57:47.965 INFO:teuthology.orchestra.run.smithi124.stdout: jq-1.6-3.el8.x86_64 2023-10-16T12:57:47.965 INFO:teuthology.orchestra.run.smithi124.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-16T12:57:47.966 INFO:teuthology.orchestra.run.smithi124.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-16T12:57:47.966 INFO:teuthology.orchestra.run.smithi124.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-16T12:57:47.966 INFO:teuthology.orchestra.run.smithi124.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.966 INFO:teuthology.orchestra.run.smithi124.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.966 INFO:teuthology.orchestra.run.smithi124.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.967 INFO:teuthology.orchestra.run.smithi124.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-16T12:57:47.967 INFO:teuthology.orchestra.run.smithi124.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-16T12:57:47.967 INFO:teuthology.orchestra.run.smithi124.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-16T12:57:47.967 INFO:teuthology.orchestra.run.smithi124.stdout: libpq-13.5-1.el8.x86_64 2023-10-16T12:57:47.967 INFO:teuthology.orchestra.run.smithi124.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-16T12:57:47.968 INFO:teuthology.orchestra.run.smithi124.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-16T12:57:47.968 INFO:teuthology.orchestra.run.smithi124.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.968 INFO:teuthology.orchestra.run.smithi124.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.968 INFO:teuthology.orchestra.run.smithi124.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-16T12:57:47.968 INFO:teuthology.orchestra.run.smithi124.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.969 INFO:teuthology.orchestra.run.smithi124.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-16T12:57:47.969 INFO:teuthology.orchestra.run.smithi124.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-16T12:57:47.969 INFO:teuthology.orchestra.run.smithi124.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-16T12:57:47.969 INFO:teuthology.orchestra.run.smithi124.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-16T12:57:47.969 INFO:teuthology.orchestra.run.smithi124.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-16T12:57:47.969 INFO:teuthology.orchestra.run.smithi124.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-16T12:57:47.970 INFO:teuthology.orchestra.run.smithi124.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-16T12:57:47.970 INFO:teuthology.orchestra.run.smithi124.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-16T12:57:47.970 INFO:teuthology.orchestra.run.smithi124.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-16T12:57:47.970 INFO:teuthology.orchestra.run.smithi124.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-16T12:57:47.970 INFO:teuthology.orchestra.run.smithi124.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-16T12:57:47.971 INFO:teuthology.orchestra.run.smithi124.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-16T12:57:47.971 INFO:teuthology.orchestra.run.smithi124.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-16T12:57:47.971 INFO:teuthology.orchestra.run.smithi124.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-16T12:57:47.971 INFO:teuthology.orchestra.run.smithi124.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T12:57:47.971 INFO:teuthology.orchestra.run.smithi124.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T12:57:47.972 INFO:teuthology.orchestra.run.smithi124.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T12:57:47.972 INFO:teuthology.orchestra.run.smithi124.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-16T12:57:47.972 INFO:teuthology.orchestra.run.smithi124.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-16T12:57:47.972 INFO:teuthology.orchestra.run.smithi124.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-16T12:57:47.972 INFO:teuthology.orchestra.run.smithi124.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-16T12:57:47.973 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-16T12:57:47.973 INFO:teuthology.orchestra.run.smithi124.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.973 INFO:teuthology.orchestra.run.smithi124.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.973 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.973 INFO:teuthology.orchestra.run.smithi124.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-16T12:57:47.973 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-16T12:57:47.974 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-16T12:57:47.974 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-16T12:57:47.974 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-16T12:57:47.974 INFO:teuthology.orchestra.run.smithi124.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-16T12:57:47.974 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-16T12:57:47.975 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-16T12:57:47.975 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-16T12:57:47.975 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-16T12:57:47.975 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-16T12:57:47.975 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-16T12:57:47.975 INFO:teuthology.orchestra.run.smithi124.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-16T12:57:47.976 INFO:teuthology.orchestra.run.smithi124.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-16T12:57:47.976 INFO:teuthology.orchestra.run.smithi124.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-16T12:57:47.976 INFO:teuthology.orchestra.run.smithi124.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-16T12:57:47.976 INFO:teuthology.orchestra.run.smithi124.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-16T12:57:47.976 INFO:teuthology.orchestra.run.smithi124.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-16T12:57:47.976 INFO:teuthology.orchestra.run.smithi124.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-16T12:57:47.977 INFO:teuthology.orchestra.run.smithi124.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-16T12:57:47.977 INFO:teuthology.orchestra.run.smithi124.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-16T12:57:47.977 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-16T12:57:47.977 INFO:teuthology.orchestra.run.smithi124.stdout: python3-portend-2.6-1.el8.noarch 2023-10-16T12:57:47.977 INFO:teuthology.orchestra.run.smithi124.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-16T12:57:47.978 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-16T12:57:47.978 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-16T12:57:47.978 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-16T12:57:47.978 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-16T12:57:47.978 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-16T12:57:47.979 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.979 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.979 INFO:teuthology.orchestra.run.smithi124.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-16T12:57:47.979 INFO:teuthology.orchestra.run.smithi124.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-16T12:57:47.979 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.980 INFO:teuthology.orchestra.run.smithi124.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-16T12:57:47.980 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-16T12:57:47.980 INFO:teuthology.orchestra.run.smithi124.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-16T12:57:47.980 INFO:teuthology.orchestra.run.smithi124.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-16T12:57:47.980 INFO:teuthology.orchestra.run.smithi124.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-16T12:57:47.980 INFO:teuthology.orchestra.run.smithi124.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-16T12:57:47.981 INFO:teuthology.orchestra.run.smithi124.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-16T12:57:47.981 INFO:teuthology.orchestra.run.smithi124.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-16T12:57:47.981 INFO:teuthology.orchestra.run.smithi124.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-16T12:57:47.981 INFO:teuthology.orchestra.run.smithi124.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-16T12:57:47.981 INFO:teuthology.orchestra.run.smithi124.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-16T12:57:47.982 INFO:teuthology.orchestra.run.smithi124.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-16T12:57:47.982 INFO:teuthology.orchestra.run.smithi124.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-16T12:57:47.982 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.982 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.982 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T12:57:47.983 INFO:teuthology.orchestra.run.smithi124.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-16T12:57:47.983 INFO:teuthology.orchestra.run.smithi124.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-16T12:57:47.983 INFO:teuthology.orchestra.run.smithi124.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-16T12:57:47.983 INFO:teuthology.orchestra.run.smithi124.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-16T12:57:47.983 INFO:teuthology.orchestra.run.smithi124.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-16T12:57:47.984 INFO:teuthology.orchestra.run.smithi124.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-16T12:57:47.984 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:47.984 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-10-16T12:57:48.141 DEBUG:teuthology.parallel:result is None 2023-10-16T12:57:48.142 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T12:57:48.401 DEBUG:teuthology.orchestra.run.smithi124:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-16T12:57:48.425 INFO:teuthology.orchestra.run.smithi124.stdout:18.0.0-6730.g4ba8a190.el8 2023-10-16T12:57:48.426 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el8 2023-10-16T12:57:48.427 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-16T12:57:48.427 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T12:57:48.743 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-16T12:57:48.772 INFO:teuthology.orchestra.run.smithi192.stdout:18.0.0-6730.g4ba8a190.el8 2023-10-16T12:57:48.773 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el8 2023-10-16T12:57:48.773 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-16T12:57:48.773 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-16T12:57:48.774 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:57:48.774 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-16T12:57:48.815 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:57:48.816 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-16T12:57:48.863 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-16T12:57:48.864 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:57:48.865 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/usr/bin/daemon-helper 2023-10-16T12:57:48.892 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-16T12:57:48.959 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:57:48.960 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/daemon-helper 2023-10-16T12:57:48.990 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-16T12:57:49.058 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-16T12:57:49.059 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:57:49.059 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-16T12:57:49.085 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-16T12:57:49.151 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:57:49.151 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-16T12:57:49.179 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-16T12:57:49.246 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-16T12:57:49.247 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:57:49.247 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/usr/bin/stdin-killer 2023-10-16T12:57:49.273 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-16T12:57:49.339 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:57:49.339 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/stdin-killer 2023-10-16T12:57:49.366 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-16T12:57:49.433 INFO:teuthology.run_tasks:Running task ceph... 2023-10-16T12:57:49.495 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-16T12:57:49.495 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 777 /var/log/ceph 2023-10-16T12:57:49.498 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 777 /var/log/ceph 2023-10-16T12:57:49.524 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-16T12:57:49.524 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-16T12:57:49.564 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-16T12:57:49.590 INFO:tasks.ceph:Creating extra log directories... 2023-10-16T12:57:49.591 DEBUG:teuthology.orchestra.run.smithi124:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-16T12:57:49.630 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-16T12:57:49.662 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-16T12:57:49.663 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-16T12:57:49.663 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-16T12:57:49.663 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:57:49.664 DEBUG:teuthology.orchestra.run.smithi124:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-16T12:57:49.710 DEBUG:teuthology.orchestra.run.smithi124:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-16T12:57:49.837 DEBUG:teuthology.orchestra.run.smithi124:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-16T12:57:49.864 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:57:49.864 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-16T12:57:49.881 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-16T12:57:50.006 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-16T12:57:50.038 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-16T12:57:50.039 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-16T12:57:50.039 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428996', 'branch': 'rishabh-2023oct13', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7428996', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'rishabh-2023oct13'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-2023oct13-b2', 'sha1': '33be745ec4531df08cd1bb70b4c9c1f89be58078'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6006, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'sleep_before_teardown': 0, 'subset': '402/512', 'suite': 'fs', 'suite_branch': 'rishabh-2023oct13-b2', 'suite_path': '/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/rishabh-d-dave/ceph', 'suite_sha1': '33be745ec4531df08cd1bb70b4c9c1f89be58078', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi124.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi192.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-16_12:17:50', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-16T12:57:50.040 DEBUG:teuthology.orchestra.run.smithi124:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-16T12:57:50.042 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-16T12:57:50.089 DEBUG:teuthology.orchestra.run.smithi124:> sudo install -d -m0777 -- /var/run/ceph 2023-10-16T12:57:50.099 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/run/ceph 2023-10-16T12:57:50.156 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:57:50.156 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/scratch_devs of=/dev/stdout 2023-10-16T12:57:50.180 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-16T12:57:50.180 DEBUG:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_1 2023-10-16T12:57:50.236 INFO:teuthology.orchestra.run.smithi124.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-16T12:57:50.237 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T12:57:50.237 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 6h/6d Inode: 380803 Links: 1 2023-10-16T12:57:50.237 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T12:57:50.237 INFO:teuthology.orchestra.run.smithi124.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T12:57:50.237 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2023-10-16 12:57:41.874797130 +0000 2023-10-16T12:57:50.238 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2023-10-16 12:55:03.010666152 +0000 2023-10-16T12:57:50.238 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2023-10-16 12:55:03.010666152 +0000 2023-10-16T12:57:50.238 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: - 2023-10-16T12:57:50.238 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-16T12:57:50.302 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2023-10-16T12:57:50.302 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2023-10-16T12:57:50.302 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes copied, 0.000253439 s, 2.0 MB/s 2023-10-16T12:57:50.303 DEBUG:teuthology.orchestra.run.smithi124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-16T12:57:50.361 DEBUG:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_2 2023-10-16T12:57:50.418 INFO:teuthology.orchestra.run.smithi124.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-16T12:57:50.419 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T12:57:50.419 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 6h/6d Inode: 380830 Links: 1 2023-10-16T12:57:50.419 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T12:57:50.419 INFO:teuthology.orchestra.run.smithi124.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T12:57:50.420 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2023-10-16 12:57:41.874797130 +0000 2023-10-16T12:57:50.420 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2023-10-16 12:55:03.515657490 +0000 2023-10-16T12:57:50.420 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2023-10-16 12:55:03.515657490 +0000 2023-10-16T12:57:50.420 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: - 2023-10-16T12:57:50.421 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-16T12:57:50.483 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2023-10-16T12:57:50.483 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2023-10-16T12:57:50.483 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes copied, 0.00024235 s, 2.1 MB/s 2023-10-16T12:57:50.484 DEBUG:teuthology.orchestra.run.smithi124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-16T12:57:50.542 DEBUG:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_3 2023-10-16T12:57:50.599 INFO:teuthology.orchestra.run.smithi124.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-16T12:57:50.599 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T12:57:50.599 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 6h/6d Inode: 387980 Links: 1 2023-10-16T12:57:50.600 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T12:57:50.600 INFO:teuthology.orchestra.run.smithi124.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T12:57:50.600 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2023-10-16 12:57:41.875797114 +0000 2023-10-16T12:57:50.600 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2023-10-16 12:55:04.016648897 +0000 2023-10-16T12:57:50.600 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2023-10-16 12:55:04.016648897 +0000 2023-10-16T12:57:50.601 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: - 2023-10-16T12:57:50.601 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-16T12:57:50.664 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2023-10-16T12:57:50.664 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2023-10-16T12:57:50.665 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes copied, 0.000224253 s, 2.3 MB/s 2023-10-16T12:57:50.666 DEBUG:teuthology.orchestra.run.smithi124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-16T12:57:50.724 DEBUG:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_4 2023-10-16T12:57:50.781 INFO:teuthology.orchestra.run.smithi124.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-16T12:57:50.781 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T12:57:50.781 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 6h/6d Inode: 395730 Links: 1 2023-10-16T12:57:50.781 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T12:57:50.782 INFO:teuthology.orchestra.run.smithi124.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T12:57:50.782 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2023-10-16 12:57:41.875797114 +0000 2023-10-16T12:57:50.782 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2023-10-16 12:55:04.524640183 +0000 2023-10-16T12:57:50.782 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2023-10-16 12:55:04.524640183 +0000 2023-10-16T12:57:50.783 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: - 2023-10-16T12:57:50.783 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-16T12:57:50.846 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2023-10-16T12:57:50.846 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2023-10-16T12:57:50.846 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes copied, 0.000192206 s, 2.7 MB/s 2023-10-16T12:57:50.847 DEBUG:teuthology.orchestra.run.smithi124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-16T12:57:50.904 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T12:57:50.905 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:57:50.905 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/scratch_devs of=/dev/stdout 2023-10-16T12:57:50.926 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-16T12:57:50.927 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_1 2023-10-16T12:57:50.986 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-16T12:57:50.986 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T12:57:50.987 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 389692 Links: 1 2023-10-16T12:57:50.987 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T12:57:50.987 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T12:57:50.987 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2023-10-16 12:57:34.340499782 +0000 2023-10-16T12:57:50.987 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2023-10-16 12:55:03.756247197 +0000 2023-10-16T12:57:50.988 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2023-10-16 12:55:03.756247197 +0000 2023-10-16T12:57:50.988 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2023-10-16T12:57:50.988 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-16T12:57:51.054 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2023-10-16T12:57:51.055 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2023-10-16T12:57:51.055 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000267066 s, 1.9 MB/s 2023-10-16T12:57:51.056 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-16T12:57:51.115 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_2 2023-10-16T12:57:51.175 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-16T12:57:51.175 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T12:57:51.175 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 396361 Links: 1 2023-10-16T12:57:51.175 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T12:57:51.176 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T12:57:51.176 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2023-10-16 12:57:34.340499782 +0000 2023-10-16T12:57:51.176 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2023-10-16 12:55:04.267237136 +0000 2023-10-16T12:57:51.176 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2023-10-16 12:55:04.267237136 +0000 2023-10-16T12:57:51.176 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2023-10-16T12:57:51.177 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-16T12:57:51.242 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2023-10-16T12:57:51.243 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2023-10-16T12:57:51.243 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000256132 s, 2.0 MB/s 2023-10-16T12:57:51.244 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-16T12:57:51.303 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_3 2023-10-16T12:57:51.361 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-16T12:57:51.362 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T12:57:51.362 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 396473 Links: 1 2023-10-16T12:57:51.362 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T12:57:51.362 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T12:57:51.363 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2023-10-16 12:57:34.340499782 +0000 2023-10-16T12:57:51.363 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2023-10-16 12:55:04.754227546 +0000 2023-10-16T12:57:51.363 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2023-10-16 12:55:04.754227546 +0000 2023-10-16T12:57:51.363 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2023-10-16T12:57:51.363 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-16T12:57:51.428 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2023-10-16T12:57:51.428 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2023-10-16T12:57:51.429 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000248123 s, 2.1 MB/s 2023-10-16T12:57:51.430 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-16T12:57:51.488 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_4 2023-10-16T12:57:51.545 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-16T12:57:51.546 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T12:57:51.546 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 392503 Links: 1 2023-10-16T12:57:51.546 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T12:57:51.546 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T12:57:51.546 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2023-10-16 12:57:34.340499782 +0000 2023-10-16T12:57:51.547 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2023-10-16 12:55:05.248217819 +0000 2023-10-16T12:57:51.547 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2023-10-16 12:55:05.248217819 +0000 2023-10-16T12:57:51.547 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2023-10-16T12:57:51.547 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-16T12:57:51.611 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2023-10-16T12:57:51.611 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2023-10-16T12:57:51.611 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000233629 s, 2.2 MB/s 2023-10-16T12:57:51.612 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-16T12:57:51.669 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T12:57:51.670 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi124.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi192.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-16T12:57:51.670 INFO:tasks.ceph:Generating config... 2023-10-16T12:57:51.671 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-16T12:57:51.671 INFO:tasks.ceph:[client] debug client = 20 2023-10-16T12:57:51.672 INFO:tasks.ceph:[client] debug ms = 1 2023-10-16T12:57:51.672 INFO:tasks.ceph:[client] pid file = 2023-10-16T12:57:51.672 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-16T12:57:51.672 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-16T12:57:51.673 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-16T12:57:51.673 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-16T12:57:51.673 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-16T12:57:51.673 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-16T12:57:51.674 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-16T12:57:51.674 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-16T12:57:51.674 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-16T12:57:51.674 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-16T12:57:51.675 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-16T12:57:51.675 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-16T12:57:51.675 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-16T12:57:51.675 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-16T12:57:51.676 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-16T12:57:51.676 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-16T12:57:51.676 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-16T12:57:51.676 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-16T12:57:51.677 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-16T12:57:51.677 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-16T12:57:51.677 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-16T12:57:51.677 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-16T12:57:51.678 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-16T12:57:51.678 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-16T12:57:51.678 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-16T12:57:51.678 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-16T12:57:51.679 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-16T12:57:51.679 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-16T12:57:51.679 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-16T12:57:51.679 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-16T12:57:51.680 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-16T12:57:51.680 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-16T12:57:51.680 INFO:tasks.ceph:Setting up mon.a... 2023-10-16T12:57:51.681 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-16T12:57:51.756 INFO:teuthology.orchestra.run.smithi124.stdout:creating /etc/ceph/ceph.keyring 2023-10-16T12:57:51.759 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-16T12:57:51.803 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T12:57:51.828 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.124'), ('mon.b', '172.21.15.192'), ('mon.c', '[v2:172.21.15.192:3301,v1:172.21.15.192:6790]')] 2023-10-16T12:57:51.829 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.124,172.21.15.192,[v2:172.21.15.192:3301,v1:172.21.15.192:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-16T12:57:51.830 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:57:51.830 DEBUG:teuthology.orchestra.run.smithi124:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-16T12:57:51.885 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.124 --add b 172.21.15.192 --addv c '[v2:172.21.15.192:3301,v1:172.21.15.192:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-16T12:57:51.972 INFO:teuthology.orchestra.run.smithi124.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-16T12:57:51.972 INFO:teuthology.orchestra.run.smithi124.stdout:monmaptool: generated fsid 4cfd077b-2400-4ae1-a7e8-14265fee7113 2023-10-16T12:57:51.972 INFO:teuthology.orchestra.run.smithi124.stdout:setting min_mon_release = pacific 2023-10-16T12:57:51.973 INFO:teuthology.orchestra.run.smithi124.stdout:epoch 0 2023-10-16T12:57:51.973 INFO:teuthology.orchestra.run.smithi124.stdout:fsid 4cfd077b-2400-4ae1-a7e8-14265fee7113 2023-10-16T12:57:51.973 INFO:teuthology.orchestra.run.smithi124.stdout:last_changed 2023-10-16T12:57:51.971210+0000 2023-10-16T12:57:51.973 INFO:teuthology.orchestra.run.smithi124.stdout:created 2023-10-16T12:57:51.971210+0000 2023-10-16T12:57:51.973 INFO:teuthology.orchestra.run.smithi124.stdout:min_mon_release 16 (pacific) 2023-10-16T12:57:51.973 INFO:teuthology.orchestra.run.smithi124.stdout:election_strategy: 1 2023-10-16T12:57:51.974 INFO:teuthology.orchestra.run.smithi124.stdout:0: [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] mon.a 2023-10-16T12:57:51.974 INFO:teuthology.orchestra.run.smithi124.stdout:1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.b 2023-10-16T12:57:51.974 INFO:teuthology.orchestra.run.smithi124.stdout:2: [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] mon.c 2023-10-16T12:57:51.974 INFO:teuthology.orchestra.run.smithi124.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-16T12:57:51.975 DEBUG:teuthology.orchestra.run.smithi124:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-16T12:57:51.991 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4cfd077b-2400-4ae1-a7e8-14265fee7113... 2023-10-16T12:57:51.992 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-16T12:57:52.033 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-16T12:57:52.075 INFO:teuthology.orchestra.run.smithi124.stdout:[global] 2023-10-16T12:57:52.076 INFO:teuthology.orchestra.run.smithi124.stdout: chdir = "" 2023-10-16T12:57:52.076 INFO:teuthology.orchestra.run.smithi124.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-16T12:57:52.076 INFO:teuthology.orchestra.run.smithi124.stdout: auth supported = cephx 2023-10-16T12:57:52.076 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.076 INFO:teuthology.orchestra.run.smithi124.stdout: filestore xattr use omap = true 2023-10-16T12:57:52.076 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.077 INFO:teuthology.orchestra.run.smithi124.stdout: mon clock drift allowed = 1.000 2023-10-16T12:57:52.077 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.077 INFO:teuthology.orchestra.run.smithi124.stdout: osd crush chooseleaf type = 0 2023-10-16T12:57:52.077 INFO:teuthology.orchestra.run.smithi124.stdout: auth debug = true 2023-10-16T12:57:52.077 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.078 INFO:teuthology.orchestra.run.smithi124.stdout: ms die on old message = true 2023-10-16T12:57:52.078 INFO:teuthology.orchestra.run.smithi124.stdout: ms die on bug = true 2023-10-16T12:57:52.078 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.078 INFO:teuthology.orchestra.run.smithi124.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-16T12:57:52.078 INFO:teuthology.orchestra.run.smithi124.stdout: mon pg warn max object skew = 0 2023-10-16T12:57:52.078 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.079 INFO:teuthology.orchestra.run.smithi124.stdout: # disable pg_autoscaler by default for new pools 2023-10-16T12:57:52.079 INFO:teuthology.orchestra.run.smithi124.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-16T12:57:52.079 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.079 INFO:teuthology.orchestra.run.smithi124.stdout: osd pool default size = 2 2023-10-16T12:57:52.079 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.080 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd allow primary affinity = true 2023-10-16T12:57:52.080 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd allow pg remap = true 2023-10-16T12:57:52.080 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on legacy crush tunables = false 2023-10-16T12:57:52.080 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on crush straw calc version zero = false 2023-10-16T12:57:52.080 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on no sortbitwise = false 2023-10-16T12:57:52.080 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on osd down out interval zero = false 2023-10-16T12:57:52.081 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on too few osds = false 2023-10-16T12:57:52.081 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-16T12:57:52.081 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-16T12:57:52.081 INFO:teuthology.orchestra.run.smithi124.stdout: mon_allow_pool_size_one = true 2023-10-16T12:57:52.081 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.082 INFO:teuthology.orchestra.run.smithi124.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-16T12:57:52.082 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.082 INFO:teuthology.orchestra.run.smithi124.stdout: osd default data pool replay window = 5 2023-10-16T12:57:52.082 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.082 INFO:teuthology.orchestra.run.smithi124.stdout: mon allow pool delete = true 2023-10-16T12:57:52.082 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.083 INFO:teuthology.orchestra.run.smithi124.stdout: mon cluster log file level = debug 2023-10-16T12:57:52.083 INFO:teuthology.orchestra.run.smithi124.stdout: debug asserts on shutdown = true 2023-10-16T12:57:52.083 INFO:teuthology.orchestra.run.smithi124.stdout: mon health detail to clog = false 2023-10-16T12:57:52.083 INFO:teuthology.orchestra.run.smithi124.stdout: mon host = "172.21.15.124,172.21.15.192,[v2:172.21.15.192:3301,v1:172.21.15.192:6790]" 2023-10-16T12:57:52.083 INFO:teuthology.orchestra.run.smithi124.stdout: ms die on skipped message = False 2023-10-16T12:57:52.084 INFO:teuthology.orchestra.run.smithi124.stdout: fsid = 4cfd077b-2400-4ae1-a7e8-14265fee7113 2023-10-16T12:57:52.084 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.084 INFO:teuthology.orchestra.run.smithi124.stdout:[osd] 2023-10-16T12:57:52.084 INFO:teuthology.orchestra.run.smithi124.stdout: osd journal size = 100 2023-10-16T12:57:52.084 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.084 INFO:teuthology.orchestra.run.smithi124.stdout: osd scrub load threshold = 5.0 2023-10-16T12:57:52.085 INFO:teuthology.orchestra.run.smithi124.stdout: osd scrub max interval = 600 2023-10-16T12:57:52.085 INFO:teuthology.orchestra.run.smithi124.stdout: osd mclock profile = high_recovery_ops 2023-10-16T12:57:52.085 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.085 INFO:teuthology.orchestra.run.smithi124.stdout: osd recover clone overlap = true 2023-10-16T12:57:52.085 INFO:teuthology.orchestra.run.smithi124.stdout: osd recovery max chunk = 1048576 2023-10-16T12:57:52.086 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.086 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug shutdown = true 2023-10-16T12:57:52.086 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug op order = true 2023-10-16T12:57:52.086 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug verify stray on activate = true 2023-10-16T12:57:52.086 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.086 INFO:teuthology.orchestra.run.smithi124.stdout: osd open classes on start = true 2023-10-16T12:57:52.087 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug pg log writeout = true 2023-10-16T12:57:52.087 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.087 INFO:teuthology.orchestra.run.smithi124.stdout: osd deep scrub update digest min age = 30 2023-10-16T12:57:52.087 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.087 INFO:teuthology.orchestra.run.smithi124.stdout: osd map max advance = 10 2023-10-16T12:57:52.088 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.088 INFO:teuthology.orchestra.run.smithi124.stdout: journal zero on create = true 2023-10-16T12:57:52.088 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.088 INFO:teuthology.orchestra.run.smithi124.stdout: filestore ondisk finisher threads = 3 2023-10-16T12:57:52.088 INFO:teuthology.orchestra.run.smithi124.stdout: filestore apply finisher threads = 3 2023-10-16T12:57:52.088 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.089 INFO:teuthology.orchestra.run.smithi124.stdout: bdev debug aio = true 2023-10-16T12:57:52.089 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug misdirected ops = true 2023-10-16T12:57:52.089 INFO:teuthology.orchestra.run.smithi124.stdout: bluestore block size = 96636764160 2023-10-16T12:57:52.089 INFO:teuthology.orchestra.run.smithi124.stdout: bluestore fsck on mount = True 2023-10-16T12:57:52.089 INFO:teuthology.orchestra.run.smithi124.stdout: debug bluefs = 20 2023-10-16T12:57:52.089 INFO:teuthology.orchestra.run.smithi124.stdout: debug bluestore = 20 2023-10-16T12:57:52.090 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2023-10-16T12:57:52.090 INFO:teuthology.orchestra.run.smithi124.stdout: debug osd = 20 2023-10-16T12:57:52.090 INFO:teuthology.orchestra.run.smithi124.stdout: debug rocksdb = 10 2023-10-16T12:57:52.090 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd backfillfull_ratio = 0.85 2023-10-16T12:57:52.090 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd full ratio = 0.9 2023-10-16T12:57:52.091 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd nearfull ratio = 0.8 2023-10-16T12:57:52.091 INFO:teuthology.orchestra.run.smithi124.stdout: osd failsafe full ratio = 0.95 2023-10-16T12:57:52.091 INFO:teuthology.orchestra.run.smithi124.stdout: osd objectstore = bluestore 2023-10-16T12:57:52.091 INFO:teuthology.orchestra.run.smithi124.stdout: osd op complaint time = 180 2023-10-16T12:57:52.091 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.091 INFO:teuthology.orchestra.run.smithi124.stdout:[mgr] 2023-10-16T12:57:52.092 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2023-10-16T12:57:52.092 INFO:teuthology.orchestra.run.smithi124.stdout: debug mgr = 20 2023-10-16T12:57:52.092 INFO:teuthology.orchestra.run.smithi124.stdout: debug mon = 20 2023-10-16T12:57:52.092 INFO:teuthology.orchestra.run.smithi124.stdout: debug auth = 20 2023-10-16T12:57:52.092 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min pgs per osd = 4 2023-10-16T12:57:52.092 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min bytes per osd = 10 2023-10-16T12:57:52.093 INFO:teuthology.orchestra.run.smithi124.stdout: mgr/telemetry/nag = false 2023-10-16T12:57:52.093 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.093 INFO:teuthology.orchestra.run.smithi124.stdout:[mon] 2023-10-16T12:57:52.093 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2023-10-16T12:57:52.093 INFO:teuthology.orchestra.run.smithi124.stdout: debug mon = 20 2023-10-16T12:57:52.093 INFO:teuthology.orchestra.run.smithi124.stdout: debug paxos = 20 2023-10-16T12:57:52.094 INFO:teuthology.orchestra.run.smithi124.stdout: debug auth = 20 2023-10-16T12:57:52.094 INFO:teuthology.orchestra.run.smithi124.stdout: mon data avail warn = 5 2023-10-16T12:57:52.094 INFO:teuthology.orchestra.run.smithi124.stdout: mon mgr mkfs grace = 240 2023-10-16T12:57:52.094 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min pgs per osd = 4 2023-10-16T12:57:52.094 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd reporter subtree level = osd 2023-10-16T12:57:52.094 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd prime pg temp = true 2023-10-16T12:57:52.095 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min bytes per osd = 10 2023-10-16T12:57:52.095 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.095 INFO:teuthology.orchestra.run.smithi124.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-16T12:57:52.095 INFO:teuthology.orchestra.run.smithi124.stdout: auth mon ticket ttl = 660 # 11m 2023-10-16T12:57:52.095 INFO:teuthology.orchestra.run.smithi124.stdout: auth service ticket ttl = 240 # 4m 2023-10-16T12:57:52.096 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.096 INFO:teuthology.orchestra.run.smithi124.stdout: # don't complain about insecure global_id in the test suite 2023-10-16T12:57:52.096 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-16T12:57:52.096 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-16T12:57:52.096 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.096 INFO:teuthology.orchestra.run.smithi124.stdout: # 1m isn't quite enough 2023-10-16T12:57:52.097 INFO:teuthology.orchestra.run.smithi124.stdout: mon_down_mkfs_grace = 2m 2023-10-16T12:57:52.097 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.097 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_filestore_osds = false 2023-10-16T12:57:52.097 INFO:teuthology.orchestra.run.smithi124.stdout: mon op complaint time = 120 2023-10-16T12:57:52.097 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:57:52.097 INFO:teuthology.orchestra.run.smithi124.stdout:[client] 2023-10-16T12:57:52.098 INFO:teuthology.orchestra.run.smithi124.stdout: rgw cache enabled = true 2023-10-16T12:57:52.098 INFO:teuthology.orchestra.run.smithi124.stdout: rgw enable ops log = true 2023-10-16T12:57:52.098 INFO:teuthology.orchestra.run.smithi124.stdout: rgw enable usage log = true 2023-10-16T12:57:52.098 INFO:teuthology.orchestra.run.smithi124.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-16T12:57:52.098 INFO:teuthology.orchestra.run.smithi124.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-16T12:57:52.098 INFO:teuthology.orchestra.run.smithi124.stdout: client mount timeout = 600 2023-10-16T12:57:52.099 INFO:teuthology.orchestra.run.smithi124.stdout: debug client = 20 2023-10-16T12:57:52.099 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2023-10-16T12:57:52.099 INFO:teuthology.orchestra.run.smithi124.stdout: pid file = "" 2023-10-16T12:57:52.099 INFO:teuthology.orchestra.run.smithi124.stdout: rados mon op timeout = 900 2023-10-16T12:57:52.099 INFO:teuthology.orchestra.run.smithi124.stdout: rados osd op timeout = 900 2023-10-16T12:57:52.099 INFO:teuthology.orchestra.run.smithi124.stdout:[mon.a] 2023-10-16T12:57:52.100 INFO:teuthology.orchestra.run.smithi124.stdout:[mon.b] 2023-10-16T12:57:52.100 INFO:teuthology.orchestra.run.smithi124.stdout:[mon.c] 2023-10-16T12:57:52.100 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.a] 2023-10-16T12:57:52.100 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.c] 2023-10-16T12:57:52.100 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.b] 2023-10-16T12:57:52.101 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.d] 2023-10-16T12:57:52.101 INFO:teuthology.orchestra.run.smithi124.stdout:[mds] 2023-10-16T12:57:52.101 INFO:teuthology.orchestra.run.smithi124.stdout: debug mds = 20 2023-10-16T12:57:52.101 INFO:teuthology.orchestra.run.smithi124.stdout: debug mds balancer = 20 2023-10-16T12:57:52.101 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2023-10-16T12:57:52.101 INFO:teuthology.orchestra.run.smithi124.stdout: mds debug frag = True 2023-10-16T12:57:52.102 INFO:teuthology.orchestra.run.smithi124.stdout: mds debug scatterstat = True 2023-10-16T12:57:52.102 INFO:teuthology.orchestra.run.smithi124.stdout: mds op complaint time = 180 2023-10-16T12:57:52.102 INFO:teuthology.orchestra.run.smithi124.stdout: mds verify scatter = True 2023-10-16T12:57:52.102 INFO:teuthology.orchestra.run.smithi124.stdout: osd op complaint time = 180 2023-10-16T12:57:52.102 INFO:teuthology.orchestra.run.smithi124.stdout: rados mon op timeout = 900 2023-10-16T12:57:52.102 INFO:teuthology.orchestra.run.smithi124.stdout: rados osd op timeout = 900 2023-10-16T12:57:52.104 INFO:teuthology.orchestra.run.smithi192.stdout:[global] 2023-10-16T12:57:52.104 INFO:teuthology.orchestra.run.smithi192.stdout: chdir = "" 2023-10-16T12:57:52.104 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-16T12:57:52.104 INFO:teuthology.orchestra.run.smithi192.stdout: auth supported = cephx 2023-10-16T12:57:52.104 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.105 INFO:teuthology.orchestra.run.smithi192.stdout: filestore xattr use omap = true 2023-10-16T12:57:52.105 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.105 INFO:teuthology.orchestra.run.smithi192.stdout: mon clock drift allowed = 1.000 2023-10-16T12:57:52.105 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.105 INFO:teuthology.orchestra.run.smithi192.stdout: osd crush chooseleaf type = 0 2023-10-16T12:57:52.106 INFO:teuthology.orchestra.run.smithi192.stdout: auth debug = true 2023-10-16T12:57:52.106 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.106 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on old message = true 2023-10-16T12:57:52.106 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on bug = true 2023-10-16T12:57:52.106 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.106 INFO:teuthology.orchestra.run.smithi192.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-16T12:57:52.107 INFO:teuthology.orchestra.run.smithi192.stdout: mon pg warn max object skew = 0 2023-10-16T12:57:52.107 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.107 INFO:teuthology.orchestra.run.smithi192.stdout: # disable pg_autoscaler by default for new pools 2023-10-16T12:57:52.107 INFO:teuthology.orchestra.run.smithi192.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-16T12:57:52.107 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.108 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default size = 2 2023-10-16T12:57:52.108 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.108 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow primary affinity = true 2023-10-16T12:57:52.108 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow pg remap = true 2023-10-16T12:57:52.108 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on legacy crush tunables = false 2023-10-16T12:57:52.108 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on crush straw calc version zero = false 2023-10-16T12:57:52.109 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on no sortbitwise = false 2023-10-16T12:57:52.109 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on osd down out interval zero = false 2023-10-16T12:57:52.109 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on too few osds = false 2023-10-16T12:57:52.109 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-16T12:57:52.109 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-16T12:57:52.109 INFO:teuthology.orchestra.run.smithi192.stdout: mon_allow_pool_size_one = true 2023-10-16T12:57:52.110 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.110 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-16T12:57:52.110 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.110 INFO:teuthology.orchestra.run.smithi192.stdout: osd default data pool replay window = 5 2023-10-16T12:57:52.110 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.111 INFO:teuthology.orchestra.run.smithi192.stdout: mon allow pool delete = true 2023-10-16T12:57:52.111 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.111 INFO:teuthology.orchestra.run.smithi192.stdout: mon cluster log file level = debug 2023-10-16T12:57:52.111 INFO:teuthology.orchestra.run.smithi192.stdout: debug asserts on shutdown = true 2023-10-16T12:57:52.111 INFO:teuthology.orchestra.run.smithi192.stdout: mon health detail to clog = false 2023-10-16T12:57:52.111 INFO:teuthology.orchestra.run.smithi192.stdout: mon host = "172.21.15.124,172.21.15.192,[v2:172.21.15.192:3301,v1:172.21.15.192:6790]" 2023-10-16T12:57:52.112 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on skipped message = False 2023-10-16T12:57:52.112 INFO:teuthology.orchestra.run.smithi192.stdout: fsid = 4cfd077b-2400-4ae1-a7e8-14265fee7113 2023-10-16T12:57:52.112 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.112 INFO:teuthology.orchestra.run.smithi192.stdout:[osd] 2023-10-16T12:57:52.112 INFO:teuthology.orchestra.run.smithi192.stdout: osd journal size = 100 2023-10-16T12:57:52.112 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.113 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub load threshold = 5.0 2023-10-16T12:57:52.113 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub max interval = 600 2023-10-16T12:57:52.113 INFO:teuthology.orchestra.run.smithi192.stdout: osd mclock profile = high_recovery_ops 2023-10-16T12:57:52.113 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.113 INFO:teuthology.orchestra.run.smithi192.stdout: osd recover clone overlap = true 2023-10-16T12:57:52.113 INFO:teuthology.orchestra.run.smithi192.stdout: osd recovery max chunk = 1048576 2023-10-16T12:57:52.114 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.114 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug shutdown = true 2023-10-16T12:57:52.114 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug op order = true 2023-10-16T12:57:52.114 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug verify stray on activate = true 2023-10-16T12:57:52.114 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.115 INFO:teuthology.orchestra.run.smithi192.stdout: osd open classes on start = true 2023-10-16T12:57:52.115 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug pg log writeout = true 2023-10-16T12:57:52.115 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.115 INFO:teuthology.orchestra.run.smithi192.stdout: osd deep scrub update digest min age = 30 2023-10-16T12:57:52.115 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.116 INFO:teuthology.orchestra.run.smithi192.stdout: osd map max advance = 10 2023-10-16T12:57:52.116 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.116 INFO:teuthology.orchestra.run.smithi192.stdout: journal zero on create = true 2023-10-16T12:57:52.116 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.116 INFO:teuthology.orchestra.run.smithi192.stdout: filestore ondisk finisher threads = 3 2023-10-16T12:57:52.116 INFO:teuthology.orchestra.run.smithi192.stdout: filestore apply finisher threads = 3 2023-10-16T12:57:52.117 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.117 INFO:teuthology.orchestra.run.smithi192.stdout: bdev debug aio = true 2023-10-16T12:57:52.117 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug misdirected ops = true 2023-10-16T12:57:52.117 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore block size = 96636764160 2023-10-16T12:57:52.117 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore fsck on mount = True 2023-10-16T12:57:52.117 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluefs = 20 2023-10-16T12:57:52.118 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluestore = 20 2023-10-16T12:57:52.118 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-10-16T12:57:52.118 INFO:teuthology.orchestra.run.smithi192.stdout: debug osd = 20 2023-10-16T12:57:52.118 INFO:teuthology.orchestra.run.smithi192.stdout: debug rocksdb = 10 2023-10-16T12:57:52.118 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd backfillfull_ratio = 0.85 2023-10-16T12:57:52.119 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd full ratio = 0.9 2023-10-16T12:57:52.119 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd nearfull ratio = 0.8 2023-10-16T12:57:52.119 INFO:teuthology.orchestra.run.smithi192.stdout: osd failsafe full ratio = 0.95 2023-10-16T12:57:52.119 INFO:teuthology.orchestra.run.smithi192.stdout: osd objectstore = bluestore 2023-10-16T12:57:52.119 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2023-10-16T12:57:52.119 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.120 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr] 2023-10-16T12:57:52.120 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-10-16T12:57:52.120 INFO:teuthology.orchestra.run.smithi192.stdout: debug mgr = 20 2023-10-16T12:57:52.120 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2023-10-16T12:57:52.120 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2023-10-16T12:57:52.121 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2023-10-16T12:57:52.121 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2023-10-16T12:57:52.121 INFO:teuthology.orchestra.run.smithi192.stdout: mgr/telemetry/nag = false 2023-10-16T12:57:52.121 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.121 INFO:teuthology.orchestra.run.smithi192.stdout:[mon] 2023-10-16T12:57:52.121 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-10-16T12:57:52.122 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2023-10-16T12:57:52.122 INFO:teuthology.orchestra.run.smithi192.stdout: debug paxos = 20 2023-10-16T12:57:52.122 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2023-10-16T12:57:52.122 INFO:teuthology.orchestra.run.smithi192.stdout: mon data avail warn = 5 2023-10-16T12:57:52.122 INFO:teuthology.orchestra.run.smithi192.stdout: mon mgr mkfs grace = 240 2023-10-16T12:57:52.123 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2023-10-16T12:57:52.123 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd reporter subtree level = osd 2023-10-16T12:57:52.123 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd prime pg temp = true 2023-10-16T12:57:52.123 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2023-10-16T12:57:52.123 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.124 INFO:teuthology.orchestra.run.smithi192.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-16T12:57:52.124 INFO:teuthology.orchestra.run.smithi192.stdout: auth mon ticket ttl = 660 # 11m 2023-10-16T12:57:52.124 INFO:teuthology.orchestra.run.smithi192.stdout: auth service ticket ttl = 240 # 4m 2023-10-16T12:57:52.124 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.124 INFO:teuthology.orchestra.run.smithi192.stdout: # don't complain about insecure global_id in the test suite 2023-10-16T12:57:52.124 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-16T12:57:52.125 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-16T12:57:52.125 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.125 INFO:teuthology.orchestra.run.smithi192.stdout: # 1m isn't quite enough 2023-10-16T12:57:52.125 INFO:teuthology.orchestra.run.smithi192.stdout: mon_down_mkfs_grace = 2m 2023-10-16T12:57:52.125 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.126 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_filestore_osds = false 2023-10-16T12:57:52.126 INFO:teuthology.orchestra.run.smithi192.stdout: mon op complaint time = 120 2023-10-16T12:57:52.126 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-16T12:57:52.126 INFO:teuthology.orchestra.run.smithi192.stdout:[client] 2023-10-16T12:57:52.126 INFO:teuthology.orchestra.run.smithi192.stdout: rgw cache enabled = true 2023-10-16T12:57:52.127 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable ops log = true 2023-10-16T12:57:52.127 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable usage log = true 2023-10-16T12:57:52.127 INFO:teuthology.orchestra.run.smithi192.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-16T12:57:52.127 INFO:teuthology.orchestra.run.smithi192.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-16T12:57:52.127 INFO:teuthology.orchestra.run.smithi192.stdout: client mount timeout = 600 2023-10-16T12:57:52.128 INFO:teuthology.orchestra.run.smithi192.stdout: debug client = 20 2023-10-16T12:57:52.128 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-10-16T12:57:52.128 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = "" 2023-10-16T12:57:52.128 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 900 2023-10-16T12:57:52.128 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 900 2023-10-16T12:57:52.128 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.a] 2023-10-16T12:57:52.129 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.b] 2023-10-16T12:57:52.129 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.c] 2023-10-16T12:57:52.129 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2023-10-16T12:57:52.129 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.c] 2023-10-16T12:57:52.129 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2023-10-16T12:57:52.129 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.d] 2023-10-16T12:57:52.130 INFO:teuthology.orchestra.run.smithi192.stdout:[mds] 2023-10-16T12:57:52.130 INFO:teuthology.orchestra.run.smithi192.stdout: debug mds = 20 2023-10-16T12:57:52.130 INFO:teuthology.orchestra.run.smithi192.stdout: debug mds balancer = 20 2023-10-16T12:57:52.130 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-10-16T12:57:52.130 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug frag = True 2023-10-16T12:57:52.131 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug scatterstat = True 2023-10-16T12:57:52.131 INFO:teuthology.orchestra.run.smithi192.stdout: mds op complaint time = 180 2023-10-16T12:57:52.131 INFO:teuthology.orchestra.run.smithi192.stdout: mds verify scatter = True 2023-10-16T12:57:52.131 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2023-10-16T12:57:52.131 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 900 2023-10-16T12:57:52.132 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 900 2023-10-16T12:57:52.132 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-16T12:57:52.132 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-16T12:57:52.200 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-16T12:57:52.201 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:57:52.201 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-16T12:57:52.218 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:57:52.218 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-16T12:57:52.274 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi124.front.sepia.ceph.com 2023-10-16T12:57:52.275 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:57:52.275 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-16T12:57:52.275 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T12:57:52.350 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:57:52.350 DEBUG:teuthology.orchestra.run.smithi124:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-16T12:57:52.408 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi192.front.sepia.ceph.com 2023-10-16T12:57:52.408 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:57:52.409 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-16T12:57:52.409 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T12:57:52.455 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:57:52.455 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-16T12:57:52.515 INFO:tasks.ceph:Setting up mon nodes... 2023-10-16T12:57:52.515 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-16T12:57:52.516 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-16T12:57:52.569 INFO:teuthology.orchestra.run.smithi124.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-16T12:57:52.572 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-16T12:57:52.723 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-16T12:57:52.726 INFO:tasks.ceph:Setting up mds nodes... 2023-10-16T12:57:52.727 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-16T12:57:52.780 INFO:teuthology.orchestra.run.smithi124.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-16T12:57:52.782 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-16T12:57:52.809 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-16T12:57:52.902 INFO:teuthology.orchestra.run.smithi124.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-16T12:57:52.905 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-16T12:57:52.931 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-16T12:57:52.995 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-16T12:57:52.997 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-16T12:57:53.025 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-16T12:57:53.121 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-16T12:57:53.123 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-16T12:57:53.149 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-16T12:57:53.150 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-16T12:57:53.193 INFO:teuthology.orchestra.run.smithi124.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-16T12:57:53.206 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-16T12:57:53.289 INFO:teuthology.orchestra.run.smithi124.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-16T12:57:53.301 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-16T12:57:53.344 INFO:teuthology.orchestra.run.smithi192.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-16T12:57:53.411 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-16T12:57:53.495 INFO:teuthology.orchestra.run.smithi192.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-16T12:57:53.507 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-16T12:57:53.508 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi124.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi192.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-16T12:57:53.508 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-16T12:57:53.535 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T12:57:53.535 INFO:tasks.ceph:role: osd.0 2023-10-16T12:57:53.536 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi124.front.sepia.ceph.com 2023-10-16T12:57:53.536 DEBUG:teuthology.orchestra.run.smithi124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-16T12:57:53.609 INFO:teuthology.orchestra.run.smithi124.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T12:57:53.609 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T12:57:53.609 INFO:teuthology.orchestra.run.smithi124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T12:57:53.609 INFO:teuthology.orchestra.run.smithi124.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T12:57:53.610 INFO:teuthology.orchestra.run.smithi124.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T12:57:53.610 INFO:teuthology.orchestra.run.smithi124.stdout: = sunit=0 swidth=0 blks 2023-10-16T12:57:53.610 INFO:teuthology.orchestra.run.smithi124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T12:57:53.611 INFO:teuthology.orchestra.run.smithi124.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T12:57:53.611 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T12:57:53.611 INFO:teuthology.orchestra.run.smithi124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T12:57:54.048 INFO:teuthology.orchestra.run.smithi124.stdout:Discarding blocks...Done. 2023-10-16T12:57:54.050 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi124.front.sepia.ceph.com -o noatime 2023-10-16T12:57:54.050 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-16T12:57:54.209 DEBUG:teuthology.orchestra.run.smithi124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-16T12:57:54.244 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-16T12:57:54.312 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T12:57:54.313 INFO:tasks.ceph:role: osd.1 2023-10-16T12:57:54.313 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi124.front.sepia.ceph.com 2023-10-16T12:57:54.313 DEBUG:teuthology.orchestra.run.smithi124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-16T12:57:54.388 INFO:teuthology.orchestra.run.smithi124.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T12:57:54.389 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T12:57:54.389 INFO:teuthology.orchestra.run.smithi124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T12:57:54.389 INFO:teuthology.orchestra.run.smithi124.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T12:57:54.389 INFO:teuthology.orchestra.run.smithi124.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T12:57:54.390 INFO:teuthology.orchestra.run.smithi124.stdout: = sunit=0 swidth=0 blks 2023-10-16T12:57:54.390 INFO:teuthology.orchestra.run.smithi124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T12:57:54.390 INFO:teuthology.orchestra.run.smithi124.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T12:57:54.390 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T12:57:54.390 INFO:teuthology.orchestra.run.smithi124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T12:57:54.822 INFO:teuthology.orchestra.run.smithi124.stdout:Discarding blocks...Done. 2023-10-16T12:57:54.825 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi124.front.sepia.ceph.com -o noatime 2023-10-16T12:57:54.825 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-16T12:57:54.934 DEBUG:teuthology.orchestra.run.smithi124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-16T12:57:54.971 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-16T12:57:55.044 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T12:57:55.044 INFO:tasks.ceph:role: osd.2 2023-10-16T12:57:55.045 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi124.front.sepia.ceph.com 2023-10-16T12:57:55.045 DEBUG:teuthology.orchestra.run.smithi124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-16T12:57:55.124 INFO:teuthology.orchestra.run.smithi124.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T12:57:55.124 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T12:57:55.124 INFO:teuthology.orchestra.run.smithi124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T12:57:55.124 INFO:teuthology.orchestra.run.smithi124.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T12:57:55.124 INFO:teuthology.orchestra.run.smithi124.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T12:57:55.125 INFO:teuthology.orchestra.run.smithi124.stdout: = sunit=0 swidth=0 blks 2023-10-16T12:57:55.125 INFO:teuthology.orchestra.run.smithi124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T12:57:55.125 INFO:teuthology.orchestra.run.smithi124.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T12:57:55.125 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T12:57:55.125 INFO:teuthology.orchestra.run.smithi124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T12:57:55.576 INFO:teuthology.orchestra.run.smithi124.stdout:Discarding blocks...Done. 2023-10-16T12:57:55.578 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi124.front.sepia.ceph.com -o noatime 2023-10-16T12:57:55.578 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-16T12:57:55.727 DEBUG:teuthology.orchestra.run.smithi124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-16T12:57:55.765 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-16T12:57:55.838 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T12:57:55.838 INFO:tasks.ceph:role: osd.3 2023-10-16T12:57:55.839 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi124.front.sepia.ceph.com 2023-10-16T12:57:55.841 DEBUG:teuthology.orchestra.run.smithi124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-16T12:57:55.917 INFO:teuthology.orchestra.run.smithi124.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T12:57:55.917 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T12:57:55.918 INFO:teuthology.orchestra.run.smithi124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T12:57:55.918 INFO:teuthology.orchestra.run.smithi124.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T12:57:55.918 INFO:teuthology.orchestra.run.smithi124.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T12:57:55.918 INFO:teuthology.orchestra.run.smithi124.stdout: = sunit=0 swidth=0 blks 2023-10-16T12:57:55.918 INFO:teuthology.orchestra.run.smithi124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T12:57:55.919 INFO:teuthology.orchestra.run.smithi124.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T12:57:55.919 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T12:57:55.919 INFO:teuthology.orchestra.run.smithi124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T12:57:56.360 INFO:teuthology.orchestra.run.smithi124.stdout:Discarding blocks...Done. 2023-10-16T12:57:56.362 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi124.front.sepia.ceph.com -o noatime 2023-10-16T12:57:56.363 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-16T12:57:56.523 DEBUG:teuthology.orchestra.run.smithi124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-16T12:57:56.560 DEBUG:teuthology.orchestra.run.smithi124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T12:57:56.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:57:56.678+0000 7f4a723d4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-16T12:57:56.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:57:56.679+0000 7f4a723d4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-16T12:57:56.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:57:56.679+0000 7f4a723d4640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-16T12:57:56.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:57:56.679+0000 7f4a723d4640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-16T12:57:56.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:57:56.679+0000 7f4a723d4640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-16T12:57:56.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:57:56.679+0000 7f4a723d4640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-16T12:57:59.553 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-16T12:57:59.585 DEBUG:teuthology.orchestra.run.smithi124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T12:57:59.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:57:59.677+0000 7fc3605bb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-16T12:57:59.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:57:59.678+0000 7fc3605bb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-16T12:57:59.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:57:59.678+0000 7fc3605bb640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-16T12:57:59.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:57:59.678+0000 7fc3605bb640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-16T12:57:59.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:57:59.678+0000 7fc3605bb640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-16T12:57:59.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:57:59.678+0000 7fc3605bb640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-16T12:58:02.545 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-16T12:58:02.578 DEBUG:teuthology.orchestra.run.smithi124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T12:58:02.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:02.670+0000 7f583e337640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-16T12:58:02.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:02.670+0000 7f583e337640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-16T12:58:02.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:02.670+0000 7f583e337640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-16T12:58:02.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:02.670+0000 7f583e337640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-16T12:58:02.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:02.670+0000 7f583e337640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-16T12:58:02.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:02.671+0000 7f583e337640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-16T12:58:05.540 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-16T12:58:05.572 DEBUG:teuthology.orchestra.run.smithi124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T12:58:05.668 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:05.665+0000 7fb968285640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-16T12:58:05.668 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:05.665+0000 7fb968285640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-16T12:58:05.668 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:05.665+0000 7fb968285640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-16T12:58:05.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:05.665+0000 7fb968285640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-16T12:58:05.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:05.665+0000 7fb968285640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-16T12:58:05.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:05.666+0000 7fb968285640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-16T12:58:08.534 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-16T12:58:08.567 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-16T12:58:08.601 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T12:58:08.601 INFO:tasks.ceph:role: osd.4 2023-10-16T12:58:08.602 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi192.front.sepia.ceph.com 2023-10-16T12:58:08.602 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-16T12:58:08.680 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T12:58:08.680 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T12:58:08.680 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T12:58:08.680 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T12:58:08.681 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T12:58:08.681 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2023-10-16T12:58:08.681 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T12:58:08.681 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T12:58:08.681 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T12:58:08.681 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T12:58:09.111 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2023-10-16T12:58:09.113 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2023-10-16T12:58:09.114 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-16T12:58:09.301 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-16T12:58:09.336 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-16T12:58:09.404 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T12:58:09.404 INFO:tasks.ceph:role: osd.5 2023-10-16T12:58:09.404 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi192.front.sepia.ceph.com 2023-10-16T12:58:09.405 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-16T12:58:09.479 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T12:58:09.479 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T12:58:09.479 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T12:58:09.479 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T12:58:09.479 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T12:58:09.480 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2023-10-16T12:58:09.480 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T12:58:09.480 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T12:58:09.480 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T12:58:09.481 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T12:58:09.900 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2023-10-16T12:58:09.902 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2023-10-16T12:58:09.903 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-16T12:58:10.007 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-16T12:58:10.040 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-16T12:58:10.109 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T12:58:10.110 INFO:tasks.ceph:role: osd.6 2023-10-16T12:58:10.110 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi192.front.sepia.ceph.com 2023-10-16T12:58:10.110 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-16T12:58:10.185 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T12:58:10.185 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T12:58:10.185 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T12:58:10.185 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T12:58:10.186 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T12:58:10.186 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2023-10-16T12:58:10.186 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T12:58:10.186 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T12:58:10.186 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T12:58:10.187 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T12:58:10.632 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2023-10-16T12:58:10.633 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2023-10-16T12:58:10.634 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-16T12:58:10.789 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-16T12:58:10.822 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-16T12:58:10.891 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T12:58:10.891 INFO:tasks.ceph:role: osd.7 2023-10-16T12:58:10.891 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi192.front.sepia.ceph.com 2023-10-16T12:58:10.892 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-16T12:58:10.965 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T12:58:10.965 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T12:58:10.966 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T12:58:10.966 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T12:58:10.966 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T12:58:10.966 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2023-10-16T12:58:10.967 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T12:58:10.967 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T12:58:10.967 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T12:58:10.967 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T12:58:11.416 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2023-10-16T12:58:11.418 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2023-10-16T12:58:11.418 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-16T12:58:11.586 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-16T12:58:11.619 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T12:58:11.725 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:11.722+0000 7f3e7d8cd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-16T12:58:11.725 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:11.722+0000 7f3e7d8cd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-16T12:58:11.725 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:11.722+0000 7f3e7d8cd640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-16T12:58:11.726 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:11.722+0000 7f3e7d8cd640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-16T12:58:11.726 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:11.722+0000 7f3e7d8cd640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-16T12:58:11.726 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:11.723+0000 7f3e7d8cd640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-16T12:58:14.593 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-16T12:58:14.624 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T12:58:14.715 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:14.713+0000 7f4be5752640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-16T12:58:14.716 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:14.713+0000 7f4be5752640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-16T12:58:14.716 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:14.713+0000 7f4be5752640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-16T12:58:14.716 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:14.713+0000 7f4be5752640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-16T12:58:14.717 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:14.713+0000 7f4be5752640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-16T12:58:14.717 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:14.713+0000 7f4be5752640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-16T12:58:17.579 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-16T12:58:17.610 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T12:58:17.701 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:17.698+0000 7fc2f75f7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-16T12:58:17.701 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:17.698+0000 7fc2f75f7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-16T12:58:17.701 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:17.698+0000 7fc2f75f7640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-16T12:58:17.702 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:17.698+0000 7fc2f75f7640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-16T12:58:17.702 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:17.698+0000 7fc2f75f7640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-16T12:58:17.702 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:17.699+0000 7fc2f75f7640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-16T12:58:20.042 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:58:20.045 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:58:20.566 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-16T12:58:20.597 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T12:58:20.690 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:20.687+0000 7f6a92454640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-16T12:58:20.691 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:20.688+0000 7f6a92454640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-16T12:58:20.691 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:20.688+0000 7f6a92454640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-16T12:58:20.691 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:20.688+0000 7f6a92454640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-16T12:58:20.691 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:20.688+0000 7f6a92454640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-16T12:58:20.691 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:20.688+0000 7f6a92454640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-16T12:58:23.551 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-16T12:58:23.583 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-16T12:58:23.584 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:58:23.584 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-16T12:58:23.616 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:58:23.616 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-16T12:58:23.688 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:58:23.689 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-16T12:58:23.760 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:58:23.760 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-16T12:58:23.832 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:58:23.832 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-16T12:58:23.903 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:58:23.903 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-16T12:58:23.975 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:58:23.975 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-16T12:58:24.045 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:58:24.046 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-16T12:58:24.078 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:58:24.079 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-16T12:58:24.148 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:58:24.149 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-16T12:58:24.217 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:58:24.218 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-16T12:58:24.285 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:58:24.286 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-16T12:58:24.352 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:58:24.353 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-16T12:58:24.420 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:58:24.420 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-16T12:58:24.487 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:58:24.487 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-16T12:58:24.508 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:58:24.508 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-16T12:58:24.567 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:58:24.568 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-16T12:58:24.585 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:58:24.585 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-16T12:58:24.642 INFO:tasks.ceph:Adding keys to all mons... 2023-10-16T12:58:24.642 DEBUG:teuthology.orchestra.run.smithi124:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-16T12:58:24.645 DEBUG:teuthology.orchestra.run.smithi192:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-16T12:58:24.685 INFO:teuthology.orchestra.run.smithi124.stdout:[mgr.y] 2023-10-16T12:58:24.685 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBQMy1lo8zhIRAAUQPIcrzYRE+e0c+p873jhQ== 2023-10-16T12:58:24.686 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.a] 2023-10-16T12:58:24.686 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBQMy1lun9zLhAAFvlm7Mqwljyq3Rfijz3hxg== 2023-10-16T12:58:24.686 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.c] 2023-10-16T12:58:24.686 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBQMy1lLaq8NRAAy51ell+YFYMSSlam7didKQ== 2023-10-16T12:58:24.687 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.0] 2023-10-16T12:58:24.687 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBUMy1l80SKKBAAAOJ0QOOlHlfs7nQBeg17lQ== 2023-10-16T12:58:24.687 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.1] 2023-10-16T12:58:24.687 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBXMy1lkGp8KBAAT0t+9k0eFGUOL7eCCqs0Ag== 2023-10-16T12:58:24.687 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.2] 2023-10-16T12:58:24.688 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBaMy1lZucMKBAAfdh6BU0ZMJ4M2AOPCKvPqg== 2023-10-16T12:58:24.688 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.3] 2023-10-16T12:58:24.688 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBdMy1l1Vy8JxAAk3Sjvx9JV5dKltHVPjoaMg== 2023-10-16T12:58:24.688 INFO:teuthology.orchestra.run.smithi124.stdout:[mgr.x] 2023-10-16T12:58:24.688 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBQMy1l1YQQKxAAN8TiRvcxQqwPyZYhrlW0FA== 2023-10-16T12:58:24.689 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.b] 2023-10-16T12:58:24.689 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBQMy1lPJU9OxAAQvRj59LE+jUH7UsJnwSUow== 2023-10-16T12:58:24.689 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.d] 2023-10-16T12:58:24.689 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBRMy1l97EpBxAAONJvOSLdBKd0pfwl0fWY/w== 2023-10-16T12:58:24.689 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.4] 2023-10-16T12:58:24.689 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBjMy1lZ/QlKxAAlh2gYAXnAN7YaOEKgMHoDA== 2023-10-16T12:58:24.690 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.5] 2023-10-16T12:58:24.690 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBmMy1l9fmTKhAARk1j0LLTBOp73x6nB2kytw== 2023-10-16T12:58:24.690 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.6] 2023-10-16T12:58:24.690 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBpMy1lbxm3KRAA8wVFPuYlH3vJe/zC0451Sg== 2023-10-16T12:58:24.690 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.7] 2023-10-16T12:58:24.691 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBsMy1lgHoTKRAAFtnzctn06ZpOyt4yEhWhjw== 2023-10-16T12:58:24.691 INFO:teuthology.orchestra.run.smithi124.stdout:[client.0] 2023-10-16T12:58:24.691 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBRMy1lwsZ6CxAAIfzwHgkpk89tbUgo7jfrhw== 2023-10-16T12:58:24.691 INFO:teuthology.orchestra.run.smithi124.stdout:[client.2] 2023-10-16T12:58:24.691 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBRMy1lcdIrERAArcCknGCSJUctxtpnP0UIwQ== 2023-10-16T12:58:24.692 INFO:teuthology.orchestra.run.smithi124.stdout:[client.1] 2023-10-16T12:58:24.692 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBRMy1ltpJ9FBAAOBWvead5CoT052W7b1QpMQ== 2023-10-16T12:58:24.692 INFO:teuthology.orchestra.run.smithi124.stdout:[client.3] 2023-10-16T12:58:24.692 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBRMy1laH5xHRAARZA1CZlXbImpeitk1mZPZA== 2023-10-16T12:58:24.707 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr.y] 2023-10-16T12:58:24.707 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBQMy1lo8zhIRAAUQPIcrzYRE+e0c+p873jhQ== 2023-10-16T12:58:24.707 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2023-10-16T12:58:24.707 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBQMy1lun9zLhAAFvlm7Mqwljyq3Rfijz3hxg== 2023-10-16T12:58:24.708 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.c] 2023-10-16T12:58:24.708 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBQMy1lLaq8NRAAy51ell+YFYMSSlam7didKQ== 2023-10-16T12:58:24.708 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.0] 2023-10-16T12:58:24.708 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBUMy1l80SKKBAAAOJ0QOOlHlfs7nQBeg17lQ== 2023-10-16T12:58:24.708 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.1] 2023-10-16T12:58:24.709 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBXMy1lkGp8KBAAT0t+9k0eFGUOL7eCCqs0Ag== 2023-10-16T12:58:24.709 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.2] 2023-10-16T12:58:24.709 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBaMy1lZucMKBAAfdh6BU0ZMJ4M2AOPCKvPqg== 2023-10-16T12:58:24.709 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.3] 2023-10-16T12:58:24.709 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBdMy1l1Vy8JxAAk3Sjvx9JV5dKltHVPjoaMg== 2023-10-16T12:58:24.709 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr.x] 2023-10-16T12:58:24.710 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBQMy1l1YQQKxAAN8TiRvcxQqwPyZYhrlW0FA== 2023-10-16T12:58:24.710 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2023-10-16T12:58:24.710 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBQMy1lPJU9OxAAQvRj59LE+jUH7UsJnwSUow== 2023-10-16T12:58:24.710 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.d] 2023-10-16T12:58:24.710 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBRMy1l97EpBxAAONJvOSLdBKd0pfwl0fWY/w== 2023-10-16T12:58:24.711 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.4] 2023-10-16T12:58:24.711 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBjMy1lZ/QlKxAAlh2gYAXnAN7YaOEKgMHoDA== 2023-10-16T12:58:24.711 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.5] 2023-10-16T12:58:24.711 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBmMy1l9fmTKhAARk1j0LLTBOp73x6nB2kytw== 2023-10-16T12:58:24.711 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.6] 2023-10-16T12:58:24.712 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBpMy1lbxm3KRAA8wVFPuYlH3vJe/zC0451Sg== 2023-10-16T12:58:24.712 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.7] 2023-10-16T12:58:24.712 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBsMy1lgHoTKRAAFtnzctn06ZpOyt4yEhWhjw== 2023-10-16T12:58:24.712 INFO:teuthology.orchestra.run.smithi192.stdout:[client.0] 2023-10-16T12:58:24.712 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBRMy1lwsZ6CxAAIfzwHgkpk89tbUgo7jfrhw== 2023-10-16T12:58:24.712 INFO:teuthology.orchestra.run.smithi192.stdout:[client.2] 2023-10-16T12:58:24.713 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBRMy1lcdIrERAArcCknGCSJUctxtpnP0UIwQ== 2023-10-16T12:58:24.713 INFO:teuthology.orchestra.run.smithi192.stdout:[client.1] 2023-10-16T12:58:24.713 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBRMy1ltpJ9FBAAOBWvead5CoT052W7b1QpMQ== 2023-10-16T12:58:24.713 INFO:teuthology.orchestra.run.smithi192.stdout:[client.3] 2023-10-16T12:58:24.713 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBRMy1laH5xHRAARZA1CZlXbImpeitk1mZPZA== 2023-10-16T12:58:24.714 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T12:58:24.735 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T12:58:24.808 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T12:58:24.810 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T12:58:24.866 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T12:58:24.868 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T12:58:24.924 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T12:58:24.927 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T12:58:24.979 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T12:58:24.982 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T12:58:25.034 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T12:58:25.037 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T12:58:25.090 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T12:58:25.092 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T12:58:25.145 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T12:58:25.148 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T12:58:25.200 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T12:58:25.203 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T12:58:25.259 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T12:58:25.261 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T12:58:25.317 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T12:58:25.320 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T12:58:25.373 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T12:58:25.376 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T12:58:25.429 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T12:58:25.432 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T12:58:25.484 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T12:58:25.487 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T12:58:25.540 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T12:58:25.543 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T12:58:25.599 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T12:58:25.601 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T12:58:25.657 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T12:58:25.660 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T12:58:25.715 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T12:58:25.718 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T12:58:25.774 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-16T12:58:25.775 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-16T12:58:25.802 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T12:58:25.899 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-16T12:58:25.925 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-16T12:58:25.953 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T12:58:26.051 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-16T12:58:26.079 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-16T12:58:26.145 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T12:58:26.243 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-16T12:58:26.270 DEBUG:teuthology.orchestra.run.smithi124:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-16T12:58:26.272 DEBUG:teuthology.orchestra.run.smithi192:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-16T12:58:26.327 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-16T12:58:26.327 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-16T12:58:26.328 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-16T12:58:26.330 INFO:tasks.ceph.mon.a:Started 2023-10-16T12:58:26.331 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-16T12:58:26.331 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-16T12:58:26.369 INFO:tasks.ceph.mon.b:Started 2023-10-16T12:58:26.370 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-16T12:58:26.370 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-16T12:58:26.374 INFO:tasks.ceph.mon.c:Started 2023-10-16T12:58:26.375 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-16T12:58:26.375 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-16T12:58:26.375 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-16T12:58:26.378 INFO:tasks.ceph.mgr.y:Started 2023-10-16T12:58:26.378 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-16T12:58:26.378 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-16T12:58:26.380 INFO:tasks.ceph.mgr.x:Started 2023-10-16T12:58:26.381 INFO:tasks.ceph:Setting crush tunables to default 2023-10-16T12:58:26.381 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd crush tunables default 2023-10-16T12:58:26.503 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.502+0000 7f807dff9700 1 Processor -- start 2023-10-16T12:58:26.504 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.502+0000 7f807dff9700 1 -- start start 2023-10-16T12:58:26.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.503+0000 7f807dff9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f807806b370 0x7f807815dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:26.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.503+0000 7f807dff9700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f807806a820 0x7f807806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:26.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.503+0000 7f807dff9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8078161360 con 0x7f80780cdd30 2023-10-16T12:58:26.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.503+0000 7f807dff9700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f807806b750 con 0x7f807806a820 2023-10-16T12:58:26.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.503+0000 7f807dff9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f807815e300 con 0x7f807806b370 2023-10-16T12:58:26.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.503+0000 7f8076ffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f807806a820 0x7f807806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:26.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.503+0000 7f8076ffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f807806a820 0x7f807806d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52420/0 (socket says 172.21.15.124:52420) 2023-10-16T12:58:26.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.503+0000 7f8076ffd700 1 -- 172.21.15.124:0/3852494346 learned_addr learned my addr 172.21.15.124:0/3852494346 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:26.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.503+0000 7f8076ffd700 1 -- 172.21.15.124:0/3852494346 >> v2:172.21.15.124:3300/0 conn(0x7f807806a820 msgr2=0x7f807806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T12:58:26.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.503+0000 7f8076ffd700 1 -- 172.21.15.124:0/3852494346 >> v2:172.21.15.124:3300/0 conn(0x7f807806a820 msgr2=0x7f807806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T12:58:26.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.503+0000 7f8076ffd700 1 --2- 172.21.15.124:0/3852494346 >> v2:172.21.15.124:3300/0 conn(0x7f807806a820 0x7f807806d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T12:58:26.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.503+0000 7f8076ffd700 1 --2- 172.21.15.124:0/3852494346 >> v2:172.21.15.124:3300/0 conn(0x7f807806a820 0x7f807806d5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T12:58:26.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.503+0000 7f80777fe700 1 --2- 172.21.15.124:0/3852494346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f807806b370 0x7f807815dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:26.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.503+0000 7f80777fe700 1 -- 172.21.15.124:0/3852494346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f807806b370 msgr2=0x7f807815dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T12:58:26.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.503+0000 7f80777fe700 1 -- 172.21.15.124:0/3852494346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f807806b370 msgr2=0x7f807815dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T12:58:26.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.503+0000 7f80777fe700 1 --2- 172.21.15.124:0/3852494346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f807806b370 0x7f807815dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T12:58:26.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.503+0000 7f80777fe700 1 --2- 172.21.15.124:0/3852494346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f807806b370 0x7f807815dcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T12:58:26.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.696+0000 7f80767fc700 1 -- 172.21.15.124:0/3852494346 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963056669 0 0) 0x7f8078161360 con 0x7f80780cdd30 2023-10-16T12:58:26.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.696+0000 7f80767fc700 1 -- 172.21.15.124:0/3852494346 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80600035b0 con 0x7f80780cdd30 2023-10-16T12:58:26.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.699+0000 7f80767fc700 1 -- 172.21.15.124:0/3852494346 <== mon.1 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2676560185 0 0) 0x7f80600035b0 con 0x7f80780cdd30 2023-10-16T12:58:26.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.699+0000 7f80767fc700 1 -- 172.21.15.124:0/3852494346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f807806b370 msgr2=0x7f807815dcb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T12:58:26.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.699+0000 7f80767fc700 1 --2- 172.21.15.124:0/3852494346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f807806b370 0x7f807815dcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:26.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.699+0000 7f80767fc700 1 -- 172.21.15.124:0/3852494346 >> v2:172.21.15.124:3300/0 conn(0x7f807806a820 msgr2=0x7f807806d5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T12:58:26.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.699+0000 7f80767fc700 1 --2- 172.21.15.124:0/3852494346 >> v2:172.21.15.124:3300/0 conn(0x7f807806a820 0x7f807806d5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:26.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.699+0000 7f80767fc700 1 -- 172.21.15.124:0/3852494346 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807815e5e0 con 0x7f80780cdd30 2023-10-16T12:58:26.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.699+0000 7f80767fc700 1 -- 172.21.15.124:0/3852494346 <== mon.1 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f80700019f0 con 0x7f80780cdd30 2023-10-16T12:58:26.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.699+0000 7f80767fc700 1 -- 172.21.15.124:0/3852494346 >> v1:172.21.15.192:6789/0 conn(0x7f80780cdd30 legacy=0x7f80781617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:26.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.699+0000 7f80767fc700 1 --2- 172.21.15.124:0/3852494346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f807806b370 0x7f8060003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:26.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.699+0000 7f80767fc700 1 --2- 172.21.15.124:0/3852494346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8060004080 0x7f8060004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:26.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.699+0000 7f80767fc700 1 --2- 172.21.15.124:0/3852494346 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8060004d90 0x7f8060005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:26.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.699+0000 7f80767fc700 1 -- 172.21.15.124:0/3852494346 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807806b750 con 0x7f8060004d90 2023-10-16T12:58:26.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.699+0000 7f80767fc700 1 -- 172.21.15.124:0/3852494346 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807815e300 con 0x7f8060004080 2023-10-16T12:58:26.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.699+0000 7f80767fc700 1 -- 172.21.15.124:0/3852494346 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806000bb70 con 0x7f807806b370 2023-10-16T12:58:26.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.699+0000 7f8077fff700 1 --2- 172.21.15.124:0/3852494346 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8060004d90 0x7f8060005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:26.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.700+0000 7f8076ffd700 1 --2- 172.21.15.124:0/3852494346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8060004080 0x7f8060004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:26.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.700+0000 7f80777fe700 1 --2- 172.21.15.124:0/3852494346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f807806b370 0x7f8060003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:26.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.700+0000 7f8077fff700 1 -- 172.21.15.124:0/3852494346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f807806b370 msgr2=0x7f8060003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:26.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.700+0000 7f8077fff700 1 --2- 172.21.15.124:0/3852494346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f807806b370 0x7f8060003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:26.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.700+0000 7f8077fff700 1 -- 172.21.15.124:0/3852494346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8060004080 msgr2=0x7f8060004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:26.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.700+0000 7f8077fff700 1 --2- 172.21.15.124:0/3852494346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8060004080 0x7f8060004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:26.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.700+0000 7f8077fff700 1 -- 172.21.15.124:0/3852494346 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80600035b0 con 0x7f8060004d90 2023-10-16T12:58:26.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.700+0000 7f8077fff700 1 --2- 172.21.15.124:0/3852494346 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8060004d90 0x7f8060005210 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f807000a7a0 tx=0x7f8060005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403012bca77d286d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:26.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.700+0000 7f80767fc700 1 -- 172.21.15.124:0/3852494346 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8070012620 con 0x7f8060004d90 2023-10-16T12:58:26.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.700+0000 7f80767fc700 1 -- 172.21.15.124:0/3852494346 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8070012780 con 0x7f8060004d90 2023-10-16T12:58:26.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.700+0000 7f80767fc700 1 -- 172.21.15.124:0/3852494346 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8070012b30 con 0x7f8060004d90 2023-10-16T12:58:26.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.701+0000 7f807dff9700 1 -- 172.21.15.124:0/3852494346 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8060004d90 msgr2=0x7f8060005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:26.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.701+0000 7f807dff9700 1 --2- 172.21.15.124:0/3852494346 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8060004d90 0x7f8060005210 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f807000a7a0 tx=0x7f8060005880 comp rx=0 tx=0).stop 2023-10-16T12:58:26.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.701+0000 7f8077fff700 1 -- 172.21.15.124:0/3852494346 reap_dead start 2023-10-16T12:58:26.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.701+0000 7f807dff9700 1 -- 172.21.15.124:0/3852494346 shutdown_connections 2023-10-16T12:58:26.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.701+0000 7f807dff9700 1 -- 172.21.15.124:0/3852494346 >> 172.21.15.124:0/3852494346 conn(0x7f80780ccbe0 msgr2=0x7f80780ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:26.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.701+0000 7f807dff9700 1 -- 172.21.15.124:0/3852494346 shutdown_connections 2023-10-16T12:58:26.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.701+0000 7f807dff9700 1 -- 172.21.15.124:0/3852494346 wait complete. 2023-10-16T12:58:26.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.702+0000 7f807dff9700 1 Processor -- start 2023-10-16T12:58:26.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.702+0000 7f807dff9700 1 -- start start 2023-10-16T12:58:26.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.703+0000 7f807dff9700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8060004d90 0x7f80780ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:26.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.703+0000 7f807dff9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80780c3da0 0x7f80781446a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:26.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.703+0000 7f807dff9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80780c4220 0x7f8078144be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:26.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.703+0000 7f807dff9700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80780add50 con 0x7f8060004d90 2023-10-16T12:58:26.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.703+0000 7f807dff9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80780ace00 con 0x7f80780c4220 2023-10-16T12:58:26.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.703+0000 7f807dff9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80780ad0d0 con 0x7f80780c3da0 2023-10-16T12:58:26.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.703+0000 7f80777fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8060004d90 0x7f80780ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:26.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.703+0000 7f80777fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8060004d90 0x7f80780ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52438/0 (socket says 172.21.15.124:52438) 2023-10-16T12:58:26.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.703+0000 7f80777fe700 1 -- 172.21.15.124:0/2728117014 learned_addr learned my addr 172.21.15.124:0/2728117014 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:26.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.703+0000 7f8077fff700 1 --2- 172.21.15.124:0/2728117014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80780c4220 0x7f8078144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:26.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.703+0000 7f8076ffd700 1 --2- 172.21.15.124:0/2728117014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80780c3da0 0x7f80781446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:26.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.703+0000 7f80777fe700 1 -- 172.21.15.124:0/2728117014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80780c3da0 msgr2=0x7f80781446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:26.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.703+0000 7f80777fe700 1 --2- 172.21.15.124:0/2728117014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80780c3da0 0x7f80781446a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:26.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.703+0000 7f80777fe700 1 -- 172.21.15.124:0/2728117014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80780c4220 msgr2=0x7f8078144be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:26.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.703+0000 7f80777fe700 1 --2- 172.21.15.124:0/2728117014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80780c4220 0x7f8078144be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:26.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.703+0000 7f80777fe700 1 -- 172.21.15.124:0/2728117014 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80780ad3b0 con 0x7f8060004d90 2023-10-16T12:58:26.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.703+0000 7f80777fe700 1 --2- 172.21.15.124:0/2728117014 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8060004d90 0x7f80780ac8c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f80680109f0 tx=0x7f8068010d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:26.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.704+0000 7f805ffff700 1 -- 172.21.15.124:0/2728117014 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8068006ea0 con 0x7f8060004d90 2023-10-16T12:58:26.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.704+0000 7f805ffff700 1 -- 172.21.15.124:0/2728117014 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806800ea70 con 0x7f8060004d90 2023-10-16T12:58:26.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.704+0000 7f807dff9700 1 -- 172.21.15.124:0/2728117014 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80780ad690 con 0x7f8060004d90 2023-10-16T12:58:26.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.704+0000 7f805ffff700 1 -- 172.21.15.124:0/2728117014 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8068009730 con 0x7f8060004d90 2023-10-16T12:58:26.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.704+0000 7f807dff9700 1 -- 172.21.15.124:0/2728117014 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80780ae170 con 0x7f8060004d90 2023-10-16T12:58:26.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.704+0000 7f805ffff700 1 -- 172.21.15.124:0/2728117014 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8068015470 con 0x7f8060004d90 2023-10-16T12:58:26.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.704+0000 7f805ffff700 1 -- 172.21.15.124:0/2728117014 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8068016460 con 0x7f8060004d90 2023-10-16T12:58:26.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.705+0000 7f807dff9700 1 -- 172.21.15.124:0/2728117014 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8078072d10 con 0x7f8060004d90 2023-10-16T12:58:26.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.707+0000 7f805ffff700 1 -- 172.21.15.124:0/2728117014 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f806803eb40 con 0x7f8060004d90 2023-10-16T12:58:26.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.780+0000 7f807dff9700 1 -- 172.21.15.124:0/2728117014 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f807815eb50 con 0x7f8060004d90 2023-10-16T12:58:26.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.782+0000 7f805ffff700 1 -- 172.21.15.124:0/2728117014 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f806802d020 con 0x7f8060004d90 2023-10-16T12:58:26.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.782+0000 7f807dff9700 1 -- 172.21.15.124:0/2728117014 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8060004d90 msgr2=0x7f80780ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:26.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.782+0000 7f807dff9700 1 --2- 172.21.15.124:0/2728117014 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8060004d90 0x7f80780ac8c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f80680109f0 tx=0x7f8068010d00 comp rx=0 tx=0).stop 2023-10-16T12:58:26.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.782+0000 7f807dff9700 1 -- 172.21.15.124:0/2728117014 shutdown_connections 2023-10-16T12:58:26.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.782+0000 7f807dff9700 1 --2- 172.21.15.124:0/2728117014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80780c4220 0x7f8078144be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:26.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.782+0000 7f807dff9700 1 --2- 172.21.15.124:0/2728117014 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8060004d90 0x7f80780ac8c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:26.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.782+0000 7f807dff9700 1 --2- 172.21.15.124:0/2728117014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80780c3da0 0x7f80781446a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:26.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.782+0000 7f807dff9700 1 -- 172.21.15.124:0/2728117014 >> 172.21.15.124:0/2728117014 conn(0x7f80780ccbe0 msgr2=0x7f80781573f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:26.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.782+0000 7f807dff9700 1 -- 172.21.15.124:0/2728117014 shutdown_connections 2023-10-16T12:58:26.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:26.782+0000 7f807dff9700 1 -- 172.21.15.124:0/2728117014 wait complete. 2023-10-16T12:58:26.786 INFO:teuthology.orchestra.run.smithi124.stderr:adjusted tunables profile to default 2023-10-16T12:58:26.795 INFO:tasks.ceph:check_enable_crimson: False 2023-10-16T12:58:26.796 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-16T12:58:26.796 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:58:26.796 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-16T12:58:26.823 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:58:26.823 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-16T12:58:26.889 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:58:26.889 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-16T12:58:26.955 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:58:26.956 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-16T12:58:27.021 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:58:27.022 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-16T12:58:27.049 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:58:27.049 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-16T12:58:27.116 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:58:27.116 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-16T12:58:27.170 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:27.168+0000 7f346ca1c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-16T12:58:27.181 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:27.179+0000 7f5e5dacd200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-16T12:58:27.183 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:58:27.183 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-16T12:58:27.235 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:27.233+0000 7f346ca1c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-16T12:58:27.249 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f 0 2023-10-16T12:58:27.252 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:27.249+0000 7f5e5dacd200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-16T12:58:27.310 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:27.308+0000 7f346ca1c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-16T12:58:27.334 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:27.332+0000 7f5e5dacd200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-16T12:58:27.373 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.370+0000 7f939a317700 1 Processor -- start 2023-10-16T12:58:27.373 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.370+0000 7f939a317700 1 -- start start 2023-10-16T12:58:27.375 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.371+0000 7f939a317700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f939415a330 0x7f93940725c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:27.376 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.371+0000 7f939a317700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93940ce740 0x7f9394071880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:27.376 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.371+0000 7f939a317700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93940ce520 con 0x7f939415a710 2023-10-16T12:58:27.376 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.371+0000 7f939a317700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f939415e5e0 con 0x7f939415a330 2023-10-16T12:58:27.376 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.371+0000 7f939a317700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9394072b00 con 0x7f93940ce740 2023-10-16T12:58:27.376 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.371+0000 7f9393fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f939415a330 0x7f93940725c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:27.377 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.371+0000 7f93988b4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93940ce740 0x7f9394071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:27.377 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.371+0000 7f9393fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f939415a330 0x7f93940725c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33262/0 (socket says 172.21.15.192:33262) 2023-10-16T12:58:27.377 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.371+0000 7f93988b4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93940ce740 0x7f9394071880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:60862/0 (socket says 172.21.15.192:60862) 2023-10-16T12:58:27.377 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.371+0000 7f9393fff700 1 -- 172.21.15.192:0/664891577 learned_addr learned my addr 172.21.15.192:0/664891577 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-16T12:58:27.377 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.371+0000 7f9393fff700 1 -- 172.21.15.192:0/664891577 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93940ce740 msgr2=0x7f9394071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:27.378 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.371+0000 7f9393fff700 1 --2- 172.21.15.192:0/664891577 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93940ce740 0x7f9394071880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.378 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.371+0000 7f9393fff700 1 -- 172.21.15.192:0/664891577 >> v1:172.21.15.124:6789/0 conn(0x7f939415a710 legacy=0x7f939415ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:27.378 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.371+0000 7f9393fff700 1 -- 172.21.15.192:0/664891577 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93940cdf60 con 0x7f939415a330 2023-10-16T12:58:27.378 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.371+0000 7f93988b4700 1 --2- 172.21.15.192:0/664891577 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93940ce740 0x7f9394071880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:58:27.378 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.372+0000 7f9393fff700 1 --2- 172.21.15.192:0/664891577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f939415a330 0x7f93940725c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f938400bb90 tx=0x7f938400bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49c0a65ee6d406b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:27.379 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.372+0000 7f9392ffd700 1 -- 172.21.15.192:0/664891577 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938400dd30 con 0x7f939415a330 2023-10-16T12:58:27.379 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.372+0000 7f9392ffd700 1 -- 172.21.15.192:0/664891577 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938400de90 con 0x7f939415a330 2023-10-16T12:58:27.379 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.372+0000 7f9392ffd700 1 -- 172.21.15.192:0/664891577 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9384010690 con 0x7f939415a330 2023-10-16T12:58:27.379 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.372+0000 7f939a317700 1 -- 172.21.15.192:0/664891577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f939415a330 msgr2=0x7f93940725c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:27.379 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.372+0000 7f939a317700 1 --2- 172.21.15.192:0/664891577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f939415a330 0x7f93940725c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f938400bb90 tx=0x7f938400bea0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.380 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.372+0000 7f939a317700 1 -- 172.21.15.192:0/664891577 shutdown_connections 2023-10-16T12:58:27.380 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.372+0000 7f939a317700 1 --2- 172.21.15.192:0/664891577 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93940ce740 0x7f9394071880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.380 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.372+0000 7f939a317700 1 --2- 172.21.15.192:0/664891577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f939415a330 0x7f93940725c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.380 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.372+0000 7f939a317700 1 -- 172.21.15.192:0/664891577 >> 172.21.15.192:0/664891577 conn(0x7f93940ccce0 msgr2=0x7f93940cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:27.380 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.372+0000 7f939a317700 1 -- 172.21.15.192:0/664891577 shutdown_connections 2023-10-16T12:58:27.380 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.372+0000 7f939a317700 1 -- 172.21.15.192:0/664891577 wait complete. 2023-10-16T12:58:27.383 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.374+0000 7f939a317700 1 Processor -- start 2023-10-16T12:58:27.383 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.374+0000 7f939a317700 1 -- start start 2023-10-16T12:58:27.383 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.374+0000 7f939a317700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93940ce740 0x7f93940cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:27.383 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.374+0000 7f939a317700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f939415a330 0x7f93940b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:27.383 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.374+0000 7f939a317700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f939415a710 0x7f93940b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:27.384 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.374+0000 7f939a317700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939415abd0 con 0x7f939415a710 2023-10-16T12:58:27.384 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.374+0000 7f939a317700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93940cc1f0 con 0x7f939415a330 2023-10-16T12:58:27.384 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.374+0000 7f939a317700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9394150c60 con 0x7f93940ce740 2023-10-16T12:58:27.384 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.375+0000 7f93937fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f939415a330 0x7f93940b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:27.384 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.375+0000 7f9393fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93940ce740 0x7f93940cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:27.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.375+0000 7f93937fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f939415a330 0x7f93940b2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33268/0 (socket says 172.21.15.192:33268) 2023-10-16T12:58:27.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.375+0000 7f93937fe700 1 -- 172.21.15.192:0/1568128663 learned_addr learned my addr 172.21.15.192:0/1568128663 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-16T12:58:27.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.375+0000 7f9393fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93940ce740 0x7f93940cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:60864/0 (socket says 172.21.15.192:60864) 2023-10-16T12:58:27.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.375+0000 7f93988b4700 1 --2- 172.21.15.192:0/1568128663 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f939415a710 0x7f93940b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:27.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.375+0000 7f93937fe700 1 -- 172.21.15.192:0/1568128663 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93940ce740 msgr2=0x7f93940cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:27.386 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.375+0000 7f93937fe700 1 --2- 172.21.15.192:0/1568128663 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93940ce740 0x7f93940cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.386 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.375+0000 7f93937fe700 1 -- 172.21.15.192:0/1568128663 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f939415a710 msgr2=0x7f93940b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:27.386 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.375+0000 7f93937fe700 1 --2- 172.21.15.192:0/1568128663 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f939415a710 0x7f93940b33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.386 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.375+0000 7f93937fe700 1 -- 172.21.15.192:0/1568128663 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c009a70 con 0x7f939415a330 2023-10-16T12:58:27.386 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.375+0000 7f93937fe700 1 --2- 172.21.15.192:0/1568128663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f939415a330 0x7f93940b2ea0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f938800c420 tx=0x7f938800c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:27.387 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.375+0000 7f9390ff9700 1 -- 172.21.15.192:0/1568128663 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93880052d0 con 0x7f939415a330 2023-10-16T12:58:27.387 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.375+0000 7f9390ff9700 1 -- 172.21.15.192:0/1568128663 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9388005430 con 0x7f939415a330 2023-10-16T12:58:27.387 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.375+0000 7f939a317700 1 -- 172.21.15.192:0/1568128663 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938400b7f0 con 0x7f939415a330 2023-10-16T12:58:27.387 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.375+0000 7f9390ff9700 1 -- 172.21.15.192:0/1568128663 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93880038c0 con 0x7f939415a330 2023-10-16T12:58:27.388 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.375+0000 7f939a317700 1 -- 172.21.15.192:0/1568128663 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f939415b100 con 0x7f939415a330 2023-10-16T12:58:27.388 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.376+0000 7f9390ff9700 1 -- 172.21.15.192:0/1568128663 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9388003d20 con 0x7f939415a330 2023-10-16T12:58:27.388 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.376+0000 7f9390ff9700 1 -- 172.21.15.192:0/1568128663 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f938801c780 con 0x7f939415a330 2023-10-16T12:58:27.388 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.376+0000 7f939a317700 1 -- 172.21.15.192:0/1568128663 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f939404ebb0 con 0x7f939415a330 2023-10-16T12:58:27.388 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.379+0000 7f9390ff9700 1 -- 172.21.15.192:0/1568128663 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f9388017070 con 0x7f939415a330 2023-10-16T12:58:27.389 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:27.387+0000 7f346ca1c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-16T12:58:27.421 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:27.419+0000 7f5e5dacd200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-16T12:58:27.465 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.462+0000 7f939a317700 1 -- 172.21.15.192:0/1568128663 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f", "id": 0} v 0) v1 -- 0x7f9394072190 con 0x7f939415a330 2023-10-16T12:58:27.470 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.468+0000 7f9390ff9700 1 -- 172.21.15.192:0/1568128663 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9388011d10 con 0x7f939415a330 2023-10-16T12:58:27.471 INFO:teuthology.orchestra.run.smithi192.stdout:0 2023-10-16T12:58:27.472 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.469+0000 7f939a317700 1 -- 172.21.15.192:0/1568128663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f939415a330 msgr2=0x7f93940b2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:27.472 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.469+0000 7f939a317700 1 --2- 172.21.15.192:0/1568128663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f939415a330 0x7f93940b2ea0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f938800c420 tx=0x7f938800c730 comp rx=0 tx=0).stop 2023-10-16T12:58:27.473 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.469+0000 7f939a317700 1 -- 172.21.15.192:0/1568128663 shutdown_connections 2023-10-16T12:58:27.473 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.469+0000 7f939a317700 1 --2- 172.21.15.192:0/1568128663 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f939415a710 0x7f93940b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.473 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.470+0000 7f939a317700 1 --2- 172.21.15.192:0/1568128663 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93940ce740 0x7f93940cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.473 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.470+0000 7f939a317700 1 --2- 172.21.15.192:0/1568128663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f939415a330 0x7f93940b2ea0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.474 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.470+0000 7f939a317700 1 -- 172.21.15.192:0/1568128663 >> 172.21.15.192:0/1568128663 conn(0x7f93940ccce0 msgr2=0x7f93940b15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:27.474 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.470+0000 7f939a317700 1 -- 172.21.15.192:0/1568128663 shutdown_connections 2023-10-16T12:58:27.474 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.470+0000 7f939a317700 1 -- 172.21.15.192:0/1568128663 wait complete. 2023-10-16T12:58:27.488 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new deb906c8-57d9-4abe-917b-2d1589d96b0e 1 2023-10-16T12:58:27.531 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:27.530+0000 7f346ca1c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-16T12:58:27.577 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:27.574+0000 7f5e5dacd200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-16T12:58:27.609 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.607+0000 7f3c28459700 1 Processor -- start 2023-10-16T12:58:27.610 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.607+0000 7f3c28459700 1 -- start start 2023-10-16T12:58:27.612 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.608+0000 7f3c28459700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3c2015d6b0 0x7f3c200ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:27.612 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.608+0000 7f3c28459700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c200cfab0 0x7f3c200b9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:27.612 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.608+0000 7f3c28459700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3c2006b7c0 0x7f3c2006bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:27.613 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.608+0000 7f3c28459700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c200b9590 con 0x7f3c2015d6b0 2023-10-16T12:58:27.613 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.608+0000 7f3c28459700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c2006c190 con 0x7f3c2006b7c0 2023-10-16T12:58:27.613 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.608+0000 7f3c28459700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c200cea10 con 0x7f3c200cfab0 2023-10-16T12:58:27.613 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.608+0000 7f3c259f4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c200cfab0 0x7f3c200b9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:27.613 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.608+0000 7f3c269f6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3c2006b7c0 0x7f3c2006bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:27.614 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.608+0000 7f3c259f4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c200cfab0 0x7f3c200b9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:60870/0 (socket says 172.21.15.192:60870) 2023-10-16T12:58:27.614 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.608+0000 7f3c259f4700 1 -- 172.21.15.192:0/1433859135 learned_addr learned my addr 172.21.15.192:0/1433859135 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-16T12:58:27.614 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.608+0000 7f3c261f5700 1 --2- 172.21.15.192:0/1433859135 >> v2:172.21.15.124:3300/0 conn(0x7f3c2015d6b0 0x7f3c200ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:27.614 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.608+0000 7f3c259f4700 1 -- 172.21.15.192:0/1433859135 >> v2:172.21.15.192:3300/0 conn(0x7f3c2006b7c0 msgr2=0x7f3c2006bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:27.615 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.608+0000 7f3c259f4700 1 --2- 172.21.15.192:0/1433859135 >> v2:172.21.15.192:3300/0 conn(0x7f3c2006b7c0 0x7f3c2006bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.615 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.608+0000 7f3c259f4700 1 -- 172.21.15.192:0/1433859135 >> v2:172.21.15.124:3300/0 conn(0x7f3c2015d6b0 msgr2=0x7f3c200ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:27.615 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.608+0000 7f3c259f4700 1 --2- 172.21.15.192:0/1433859135 >> v2:172.21.15.124:3300/0 conn(0x7f3c2015d6b0 0x7f3c200ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.615 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.608+0000 7f3c259f4700 1 -- 172.21.15.192:0/1433859135 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c200cecf0 con 0x7f3c200cfab0 2023-10-16T12:58:27.615 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.608+0000 7f3c269f6700 1 --2- 172.21.15.192:0/1433859135 >> v2:172.21.15.192:3300/0 conn(0x7f3c2006b7c0 0x7f3c2006bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:58:27.616 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.608+0000 7f3c259f4700 1 --2- 172.21.15.192:0/1433859135 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c200cfab0 0x7f3c200b9050 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3c200b6510 tx=0x7f3c10009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ca77d83bda69c44 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:27.616 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.608+0000 7f3c251f3700 1 -- 172.21.15.192:0/1433859135 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c10011830 con 0x7f3c200cfab0 2023-10-16T12:58:27.616 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.608+0000 7f3c251f3700 1 -- 172.21.15.192:0/1433859135 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c10011990 con 0x7f3c200cfab0 2023-10-16T12:58:27.616 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.608+0000 7f3c251f3700 1 -- 172.21.15.192:0/1433859135 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c10011d20 con 0x7f3c200cfab0 2023-10-16T12:58:27.617 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.609+0000 7f3c28459700 1 -- 172.21.15.192:0/1433859135 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c200cfab0 msgr2=0x7f3c200b9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:27.617 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.609+0000 7f3c28459700 1 --2- 172.21.15.192:0/1433859135 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c200cfab0 0x7f3c200b9050 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3c200b6510 tx=0x7f3c10009bd0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.617 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.609+0000 7f3c28459700 1 -- 172.21.15.192:0/1433859135 shutdown_connections 2023-10-16T12:58:27.617 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.609+0000 7f3c28459700 1 --2- 172.21.15.192:0/1433859135 >> v2:172.21.15.192:3300/0 conn(0x7f3c2006b7c0 0x7f3c2006bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.617 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.609+0000 7f3c28459700 1 --2- 172.21.15.192:0/1433859135 >> v2:172.21.15.124:3300/0 conn(0x7f3c2015d6b0 0x7f3c200ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.618 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.609+0000 7f3c28459700 1 --2- 172.21.15.192:0/1433859135 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c200cfab0 0x7f3c200b9050 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.618 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.609+0000 7f3c28459700 1 -- 172.21.15.192:0/1433859135 >> 172.21.15.192:0/1433859135 conn(0x7f3c20072340 msgr2=0x7f3c20072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:27.618 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.609+0000 7f3c28459700 1 -- 172.21.15.192:0/1433859135 shutdown_connections 2023-10-16T12:58:27.618 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.609+0000 7f3c28459700 1 -- 172.21.15.192:0/1433859135 wait complete. 2023-10-16T12:58:27.621 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.610+0000 7f3c28459700 1 Processor -- start 2023-10-16T12:58:27.621 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.610+0000 7f3c28459700 1 -- start start 2023-10-16T12:58:27.621 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.611+0000 7f3c28459700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c2006b7c0 0x7f3c200b5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:27.621 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.611+0000 7f3c28459700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c200cfab0 0x7f3c200cb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:27.621 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.611+0000 7f3c28459700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c2015d6b0 0x7f3c201f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:27.622 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.611+0000 7f3c28459700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c200cc170 con 0x7f3c2006b7c0 2023-10-16T12:58:27.622 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.611+0000 7f3c28459700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c200cc450 con 0x7f3c200cfab0 2023-10-16T12:58:27.622 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.611+0000 7f3c28459700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c200cc730 con 0x7f3c2015d6b0 2023-10-16T12:58:27.622 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.611+0000 7f3c259f4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c200cfab0 0x7f3c200cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:27.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.611+0000 7f3c269f6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c2015d6b0 0x7f3c201f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:27.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.611+0000 7f3c259f4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c200cfab0 0x7f3c200cb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33280/0 (socket says 172.21.15.192:33280) 2023-10-16T12:58:27.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.611+0000 7f3c269f6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c2015d6b0 0x7f3c201f60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:60880/0 (socket says 172.21.15.192:60880) 2023-10-16T12:58:27.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.611+0000 7f3c259f4700 1 -- 172.21.15.192:0/226542638 learned_addr learned my addr 172.21.15.192:0/226542638 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-16T12:58:27.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.611+0000 7f3c261f5700 1 --2- 172.21.15.192:0/226542638 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c2006b7c0 0x7f3c200b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:27.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.611+0000 7f3c259f4700 1 -- 172.21.15.192:0/226542638 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c2015d6b0 msgr2=0x7f3c201f60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:27.624 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.611+0000 7f3c259f4700 1 --2- 172.21.15.192:0/226542638 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c2015d6b0 0x7f3c201f60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.624 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.611+0000 7f3c259f4700 1 -- 172.21.15.192:0/226542638 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c2006b7c0 msgr2=0x7f3c200b5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:27.624 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.611+0000 7f3c259f4700 1 --2- 172.21.15.192:0/226542638 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c2006b7c0 0x7f3c200b5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.624 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.611+0000 7f3c259f4700 1 -- 172.21.15.192:0/226542638 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c18009a70 con 0x7f3c200cfab0 2023-10-16T12:58:27.624 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.612+0000 7f3c269f6700 1 --2- 172.21.15.192:0/226542638 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c2015d6b0 0x7f3c201f60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:58:27.624 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.612+0000 7f3c259f4700 1 --2- 172.21.15.192:0/226542638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c200cfab0 0x7f3c200cb670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3c10000c00 tx=0x7f3c10004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:27.625 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.612+0000 7f3c16ffd700 1 -- 172.21.15.192:0/226542638 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c10004240 con 0x7f3c200cfab0 2023-10-16T12:58:27.625 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.612+0000 7f3c16ffd700 1 -- 172.21.15.192:0/226542638 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1001f070 con 0x7f3c200cfab0 2023-10-16T12:58:27.625 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.612+0000 7f3c16ffd700 1 -- 172.21.15.192:0/226542638 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c100036a0 con 0x7f3c200cfab0 2023-10-16T12:58:27.625 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.612+0000 7f3c28459700 1 -- 172.21.15.192:0/226542638 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c10009550 con 0x7f3c200cfab0 2023-10-16T12:58:27.625 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.612+0000 7f3c28459700 1 -- 172.21.15.192:0/226542638 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c200cccf0 con 0x7f3c200cfab0 2023-10-16T12:58:27.626 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.612+0000 7f3c16ffd700 1 -- 172.21.15.192:0/226542638 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3c10021030 con 0x7f3c200cfab0 2023-10-16T12:58:27.626 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.612+0000 7f3c16ffd700 1 -- 172.21.15.192:0/226542638 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f3c1001a700 con 0x7f3c200cfab0 2023-10-16T12:58:27.626 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.613+0000 7f3c28459700 1 -- 172.21.15.192:0/226542638 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c200ccee0 con 0x7f3c200cfab0 2023-10-16T12:58:27.626 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.615+0000 7f3c16ffd700 1 -- 172.21.15.192:0/226542638 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f3c10015020 con 0x7f3c200cfab0 2023-10-16T12:58:27.703 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.700+0000 7f3c28459700 1 -- 172.21.15.192:0/226542638 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "deb906c8-57d9-4abe-917b-2d1589d96b0e", "id": 1} v 0) v1 -- 0x7f3c2004ebb0 con 0x7f3c200cfab0 2023-10-16T12:58:27.707 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.705+0000 7f3c16ffd700 1 -- 172.21.15.192:0/226542638 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "deb906c8-57d9-4abe-917b-2d1589d96b0e", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3c10003ce0 con 0x7f3c200cfab0 2023-10-16T12:58:27.708 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-10-16T12:58:27.709 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.706+0000 7f3c28459700 1 -- 172.21.15.192:0/226542638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c200cfab0 msgr2=0x7f3c200cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:27.709 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.706+0000 7f3c28459700 1 --2- 172.21.15.192:0/226542638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c200cfab0 0x7f3c200cb670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3c10000c00 tx=0x7f3c10004750 comp rx=0 tx=0).stop 2023-10-16T12:58:27.709 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.706+0000 7f3c28459700 1 -- 172.21.15.192:0/226542638 shutdown_connections 2023-10-16T12:58:27.709 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.706+0000 7f3c28459700 1 --2- 172.21.15.192:0/226542638 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c2015d6b0 0x7f3c201f60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.710 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.706+0000 7f3c28459700 1 --2- 172.21.15.192:0/226542638 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c2006b7c0 0x7f3c200b5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.710 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.706+0000 7f3c28459700 1 --2- 172.21.15.192:0/226542638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c200cfab0 0x7f3c200cb670 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.710 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.706+0000 7f3c28459700 1 -- 172.21.15.192:0/226542638 >> 172.21.15.192:0/226542638 conn(0x7f3c20072340 msgr2=0x7f3c200b7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:27.710 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.706+0000 7f3c28459700 1 -- 172.21.15.192:0/226542638 shutdown_connections 2023-10-16T12:58:27.710 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.706+0000 7f3c28459700 1 -- 172.21.15.192:0/226542638 wait complete. 2023-10-16T12:58:27.720 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 070e620e-1305-4bf1-b54c-4ec6f4e787a8 2 2023-10-16T12:58:27.839 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.836+0000 7fc177b5e700 1 Processor -- start 2023-10-16T12:58:27.839 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.837+0000 7fc177b5e700 1 -- start start 2023-10-16T12:58:27.841 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.837+0000 7fc177b5e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc17006a820 0x7fc17015dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:27.842 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.837+0000 7fc177b5e700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc170161360 con 0x7fc1700cdd30 2023-10-16T12:58:27.842 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.837+0000 7fc177b5e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17006b750 con 0x7fc17006b370 2023-10-16T12:58:27.842 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.837+0000 7fc177b5e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17006dcc0 con 0x7fc17006a820 2023-10-16T12:58:27.842 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.837+0000 7fc1750f9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc17006a820 0x7fc17015dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:27.843 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.838+0000 7fc1758fa700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fc17006b370 0x7fc17006d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:50116/0 (socket says 172.21.15.192:50116) 2023-10-16T12:58:27.843 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.838+0000 7fc1758fa700 1 -- 172.21.15.192:0/3268929207 learned_addr learned my addr 172.21.15.192:0/3268929207 (peer_addr_for_me v1:172.21.15.192:0/0) 2023-10-16T12:58:27.843 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.838+0000 7fc1750f9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc17006a820 0x7fc17015dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33286/0 (socket says 172.21.15.192:33286) 2023-10-16T12:58:27.843 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.838+0000 7fc1750f9700 1 -- 172.21.15.192:0/3268929207 >> v1:172.21.15.192:6789/0 conn(0x7fc17006b370 legacy=0x7fc17006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:27.843 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.838+0000 7fc1750f9700 1 -- 172.21.15.192:0/3268929207 >> v1:172.21.15.124:6789/0 conn(0x7fc1700cdd30 legacy=0x7fc1701617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:27.844 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.838+0000 7fc1750f9700 1 -- 172.21.15.192:0/3268929207 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17015e300 con 0x7fc17006a820 2023-10-16T12:58:27.844 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.838+0000 7fc1750f9700 1 --2- 172.21.15.192:0/3268929207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc17006a820 0x7fc17015dcb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009840 tx=0x7fc16c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=658bf59df9268a14 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:27.844 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.838+0000 7fc1748f8700 1 -- 172.21.15.192:0/3268929207 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c004230 con 0x7fc17006a820 2023-10-16T12:58:27.844 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.838+0000 7fc1748f8700 1 -- 172.21.15.192:0/3268929207 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c004390 con 0x7fc17006a820 2023-10-16T12:58:27.844 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.838+0000 7fc1748f8700 1 -- 172.21.15.192:0/3268929207 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c0036a0 con 0x7fc17006a820 2023-10-16T12:58:27.845 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.839+0000 7fc177b5e700 1 -- 172.21.15.192:0/3268929207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc17006a820 msgr2=0x7fc17015dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:27.845 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.839+0000 7fc177b5e700 1 --2- 172.21.15.192:0/3268929207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc17006a820 0x7fc17015dcb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009840 tx=0x7fc16c009b50 comp rx=0 tx=0).stop 2023-10-16T12:58:27.845 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.839+0000 7fc177b5e700 1 -- 172.21.15.192:0/3268929207 shutdown_connections 2023-10-16T12:58:27.845 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.839+0000 7fc177b5e700 1 --2- 172.21.15.192:0/3268929207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc17006a820 0x7fc17015dcb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.845 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.839+0000 7fc177b5e700 1 -- 172.21.15.192:0/3268929207 >> 172.21.15.192:0/3268929207 conn(0x7fc1700ccbe0 msgr2=0x7fc1700ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:27.846 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.839+0000 7fc177b5e700 1 -- 172.21.15.192:0/3268929207 shutdown_connections 2023-10-16T12:58:27.846 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.839+0000 7fc177b5e700 1 -- 172.21.15.192:0/3268929207 wait complete. 2023-10-16T12:58:27.848 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.840+0000 7fc177b5e700 1 Processor -- start 2023-10-16T12:58:27.848 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.840+0000 7fc177b5e700 1 -- start start 2023-10-16T12:58:27.848 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.841+0000 7fc177b5e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc17006a820 0x7fc170156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:27.849 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.841+0000 7fc177b5e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc17006b370 0x7fc17015c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:27.849 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.841+0000 7fc177b5e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1700cdd30 0x7fc17015ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:27.849 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.841+0000 7fc177b5e700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1700b47b0 con 0x7fc17006b370 2023-10-16T12:58:27.849 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.841+0000 7fc177b5e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1700c50f0 con 0x7fc1700cdd30 2023-10-16T12:58:27.850 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.841+0000 7fc177b5e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1700c53d0 con 0x7fc17006a820 2023-10-16T12:58:27.850 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.841+0000 7fc1760fb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1700cdd30 0x7fc17015ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:27.850 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.841+0000 7fc1758fa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc17006a820 0x7fc170156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:27.850 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.841+0000 7fc1760fb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1700cdd30 0x7fc17015ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33294/0 (socket says 172.21.15.192:33294) 2023-10-16T12:58:27.850 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.841+0000 7fc1760fb700 1 -- 172.21.15.192:0/808164508 learned_addr learned my addr 172.21.15.192:0/808164508 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-16T12:58:27.851 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.841+0000 7fc1750f9700 1 --2- 172.21.15.192:0/808164508 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc17006b370 0x7fc17015c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:27.851 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.842+0000 7fc1760fb700 1 -- 172.21.15.192:0/808164508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc17006a820 msgr2=0x7fc170156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:27.851 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.842+0000 7fc1760fb700 1 --2- 172.21.15.192:0/808164508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc17006a820 0x7fc170156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.851 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.842+0000 7fc1760fb700 1 -- 172.21.15.192:0/808164508 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc17006b370 msgr2=0x7fc17015c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:27.851 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.842+0000 7fc1760fb700 1 --2- 172.21.15.192:0/808164508 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc17006b370 0x7fc17015c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.851 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.842+0000 7fc1760fb700 1 -- 172.21.15.192:0/808164508 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16c0094a0 con 0x7fc1700cdd30 2023-10-16T12:58:27.852 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.842+0000 7fc1758fa700 1 --2- 172.21.15.192:0/808164508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc17006a820 0x7fc170156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:58:27.852 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.842+0000 7fc1760fb700 1 --2- 172.21.15.192:0/808164508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1700cdd30 0x7fc17015ce40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc16800b970 tx=0x7fc16800bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:27.852 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.842+0000 7fc1667fc700 1 -- 172.21.15.192:0/808164508 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16800d860 con 0x7fc1700cdd30 2023-10-16T12:58:27.852 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.842+0000 7fc1667fc700 1 -- 172.21.15.192:0/808164508 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16800d9c0 con 0x7fc1700cdd30 2023-10-16T12:58:27.852 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.842+0000 7fc177b5e700 1 -- 172.21.15.192:0/808164508 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1700b4440 con 0x7fc1700cdd30 2023-10-16T12:58:27.853 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.842+0000 7fc1667fc700 1 -- 172.21.15.192:0/808164508 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16800dd70 con 0x7fc1700cdd30 2023-10-16T12:58:27.853 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.842+0000 7fc177b5e700 1 -- 172.21.15.192:0/808164508 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1701f44b0 con 0x7fc1700cdd30 2023-10-16T12:58:27.853 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.842+0000 7fc1667fc700 1 -- 172.21.15.192:0/808164508 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc168003d00 con 0x7fc1700cdd30 2023-10-16T12:58:27.853 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.842+0000 7fc1667fc700 1 -- 172.21.15.192:0/808164508 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fc16800e850 con 0x7fc1700cdd30 2023-10-16T12:58:27.853 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.843+0000 7fc177b5e700 1 -- 172.21.15.192:0/808164508 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc170072d10 con 0x7fc1700cdd30 2023-10-16T12:58:27.854 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.847+0000 7fc1667fc700 1 -- 172.21.15.192:0/808164508 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc16801c020 con 0x7fc1700cdd30 2023-10-16T12:58:27.918 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:27.917+0000 7f346ca1c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-16T12:58:27.932 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.930+0000 7fc177b5e700 1 -- 172.21.15.192:0/808164508 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "070e620e-1305-4bf1-b54c-4ec6f4e787a8", "id": 2} v 0) v1 -- 0x7fc17004ebb0 con 0x7fc1700cdd30 2023-10-16T12:58:27.938 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.935+0000 7fc1667fc700 1 -- 172.21.15.192:0/808164508 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "070e620e-1305-4bf1-b54c-4ec6f4e787a8", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc16800e610 con 0x7fc1700cdd30 2023-10-16T12:58:27.938 INFO:teuthology.orchestra.run.smithi192.stdout:2 2023-10-16T12:58:27.939 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.936+0000 7fc177b5e700 1 -- 172.21.15.192:0/808164508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1700cdd30 msgr2=0x7fc17015ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:27.939 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.936+0000 7fc177b5e700 1 --2- 172.21.15.192:0/808164508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1700cdd30 0x7fc17015ce40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc16800b970 tx=0x7fc16800bc80 comp rx=0 tx=0).stop 2023-10-16T12:58:27.940 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.936+0000 7fc177b5e700 1 -- 172.21.15.192:0/808164508 shutdown_connections 2023-10-16T12:58:27.940 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.936+0000 7fc177b5e700 1 --2- 172.21.15.192:0/808164508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1700cdd30 0x7fc17015ce40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.940 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.936+0000 7fc177b5e700 1 --2- 172.21.15.192:0/808164508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc17006a820 0x7fc170156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.940 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.936+0000 7fc177b5e700 1 --2- 172.21.15.192:0/808164508 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc17006b370 0x7fc17015c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:27.940 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.936+0000 7fc177b5e700 1 -- 172.21.15.192:0/808164508 >> 172.21.15.192:0/808164508 conn(0x7fc1700ccbe0 msgr2=0x7fc1701575f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:27.941 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.936+0000 7fc177b5e700 1 -- 172.21.15.192:0/808164508 shutdown_connections 2023-10-16T12:58:27.941 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:27.936+0000 7fc177b5e700 1 -- 172.21.15.192:0/808164508 wait complete. 2023-10-16T12:58:27.951 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 81433737-c62b-4885-9b41-513f2aca8821 3 2023-10-16T12:58:28.004 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:28.001+0000 7f5e5dacd200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-16T12:58:28.033 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:28.032+0000 7f346ca1c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-16T12:58:28.071 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.069+0000 7fe08b72d700 1 Processor -- start 2023-10-16T12:58:28.071 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.069+0000 7fe08b72d700 1 -- start start 2023-10-16T12:58:28.074 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.070+0000 7fe08b72d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe08415b4e0 0x7fe08406f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:28.074 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.070+0000 7fe08b72d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe0840cd770 0x7fe0840b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:28.074 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.070+0000 7fe08b72d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0840b3670 con 0x7fe0840b3220 2023-10-16T12:58:28.074 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.070+0000 7fe08b72d700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe084070620 con 0x7fe08415b4e0 2023-10-16T12:58:28.075 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.070+0000 7fe08b72d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe084070900 con 0x7fe0840cd770 2023-10-16T12:58:28.075 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.070+0000 7fe088cc8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe0840cd770 0x7fe0840b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:28.075 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.070+0000 7fe089cca700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe0840b3220 0x7fe0840cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:50132/0 (socket says 172.21.15.192:50132) 2023-10-16T12:58:28.075 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.070+0000 7fe089cca700 1 -- 172.21.15.192:0/2641230216 learned_addr learned my addr 172.21.15.192:0/2641230216 (peer_addr_for_me v1:172.21.15.192:0/0) 2023-10-16T12:58:28.075 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.070+0000 7fe088cc8700 1 --2- 172.21.15.192:0/2641230216 >> v2:172.21.15.192:3300/0 conn(0x7fe0840cd770 0x7fe0840b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33298/0 (socket says 172.21.15.192:33298) 2023-10-16T12:58:28.076 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.070+0000 7fe0894c9700 1 --2- 172.21.15.192:0/2641230216 >> v2:172.21.15.124:3300/0 conn(0x7fe08415b4e0 0x7fe08406f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:28.076 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.070+0000 7fe088cc8700 1 -- 172.21.15.192:0/2641230216 >> v2:172.21.15.124:3300/0 conn(0x7fe08415b4e0 msgr2=0x7fe08406f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:28.076 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.070+0000 7fe088cc8700 1 --2- 172.21.15.192:0/2641230216 >> v2:172.21.15.124:3300/0 conn(0x7fe08415b4e0 0x7fe08406f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.076 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.070+0000 7fe088cc8700 1 -- 172.21.15.192:0/2641230216 >> v1:172.21.15.192:6789/0 conn(0x7fe0840b3220 legacy=0x7fe0840cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:28.076 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.070+0000 7fe088cc8700 1 -- 172.21.15.192:0/2641230216 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe084070be0 con 0x7fe0840cd770 2023-10-16T12:58:28.077 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.070+0000 7fe07bfff700 1 -- 172.21.15.192:0/2641230216 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3030388641 0 0) 0x7fe07c001490 con 0x7fe0840b3220 2023-10-16T12:58:28.077 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.070+0000 7fe088cc8700 1 --2- 172.21.15.192:0/2641230216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0840cd770 0x7fe0840b2ce0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe08406f7c0 tx=0x7fe074009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee2416cece1e4b3f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:28.077 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.070+0000 7fe07bfff700 1 -- 172.21.15.192:0/2641230216 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074011830 con 0x7fe0840cd770 2023-10-16T12:58:28.077 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.070+0000 7fe07bfff700 1 -- 172.21.15.192:0/2641230216 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe074011990 con 0x7fe0840cd770 2023-10-16T12:58:28.077 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.070+0000 7fe07bfff700 1 -- 172.21.15.192:0/2641230216 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074011d20 con 0x7fe0840cd770 2023-10-16T12:58:28.078 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.071+0000 7fe08b72d700 1 -- 172.21.15.192:0/2641230216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0840cd770 msgr2=0x7fe0840b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:28.078 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.071+0000 7fe08b72d700 1 --2- 172.21.15.192:0/2641230216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0840cd770 0x7fe0840b2ce0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe08406f7c0 tx=0x7fe074009b20 comp rx=0 tx=0).stop 2023-10-16T12:58:28.078 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.071+0000 7fe08b72d700 1 -- 172.21.15.192:0/2641230216 shutdown_connections 2023-10-16T12:58:28.078 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.071+0000 7fe08b72d700 1 --2- 172.21.15.192:0/2641230216 >> v2:172.21.15.124:3300/0 conn(0x7fe08415b4e0 0x7fe08406f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.078 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.071+0000 7fe08b72d700 1 --2- 172.21.15.192:0/2641230216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0840cd770 0x7fe0840b2ce0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.079 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.071+0000 7fe08b72d700 1 -- 172.21.15.192:0/2641230216 >> 172.21.15.192:0/2641230216 conn(0x7fe0840cdce0 msgr2=0x7fe0840ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:28.079 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.071+0000 7fe08b72d700 1 -- 172.21.15.192:0/2641230216 shutdown_connections 2023-10-16T12:58:28.079 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.071+0000 7fe08b72d700 1 -- 172.21.15.192:0/2641230216 wait complete. 2023-10-16T12:58:28.082 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.073+0000 7fe08b72d700 1 Processor -- start 2023-10-16T12:58:28.082 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.073+0000 7fe08b72d700 1 -- start start 2023-10-16T12:58:28.082 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.074+0000 7fe08b72d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0840b3220 0x7fe0840c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:28.082 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.074+0000 7fe08b72d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe0840cd770 0x7fe0840caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:28.082 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.074+0000 7fe08b72d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe08415b4e0 0x7fe0840cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:28.083 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.074+0000 7fe08b72d700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0840c48c0 con 0x7fe0840cd770 2023-10-16T12:58:28.083 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.074+0000 7fe08b72d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0841e0630 con 0x7fe08415b4e0 2023-10-16T12:58:28.083 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.074+0000 7fe08b72d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0841e0840 con 0x7fe0840b3220 2023-10-16T12:58:28.083 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.074+0000 7fe089cca700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe08415b4e0 0x7fe0840cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:28.083 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.074+0000 7fe0894c9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0840b3220 0x7fe0840c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:28.084 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.074+0000 7fe0894c9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0840b3220 0x7fe0840c4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:60900/0 (socket says 172.21.15.192:60900) 2023-10-16T12:58:28.084 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.074+0000 7fe089cca700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe08415b4e0 0x7fe0840cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33306/0 (socket says 172.21.15.192:33306) 2023-10-16T12:58:28.084 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.074+0000 7fe0894c9700 1 -- 172.21.15.192:0/1757297195 learned_addr learned my addr 172.21.15.192:0/1757297195 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-16T12:58:28.084 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.074+0000 7fe088cc8700 1 --2- 172.21.15.192:0/1757297195 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe0840cd770 0x7fe0840caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:28.084 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.074+0000 7fe0894c9700 1 -- 172.21.15.192:0/1757297195 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe08415b4e0 msgr2=0x7fe0840cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:28.085 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.074+0000 7fe0894c9700 1 --2- 172.21.15.192:0/1757297195 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe08415b4e0 0x7fe0840cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.085 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.074+0000 7fe0894c9700 1 -- 172.21.15.192:0/1757297195 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe0840cd770 msgr2=0x7fe0840caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:28.085 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.074+0000 7fe0894c9700 1 --2- 172.21.15.192:0/1757297195 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe0840cd770 0x7fe0840caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.085 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.074+0000 7fe0894c9700 1 -- 172.21.15.192:0/1757297195 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0740094a0 con 0x7fe0840b3220 2023-10-16T12:58:28.085 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.074+0000 7fe089cca700 1 --2- 172.21.15.192:0/1757297195 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe08415b4e0 0x7fe0840cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:58:28.086 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.074+0000 7fe088cc8700 1 --2- 172.21.15.192:0/1757297195 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe0840cd770 0x7fe0840caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:58:28.086 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.075+0000 7fe0894c9700 1 --2- 172.21.15.192:0/1757297195 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0840b3220 0x7fe0840c4380 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe08000e870 tx=0x7fe08000eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:28.086 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.075+0000 7fe079ffb700 1 -- 172.21.15.192:0/1757297195 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe080009590 con 0x7fe0840b3220 2023-10-16T12:58:28.086 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.075+0000 7fe079ffb700 1 -- 172.21.15.192:0/1757297195 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe080013680 con 0x7fe0840b3220 2023-10-16T12:58:28.086 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.075+0000 7fe08b72d700 1 -- 172.21.15.192:0/1757297195 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0841e0b20 con 0x7fe0840b3220 2023-10-16T12:58:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.075+0000 7fe079ffb700 1 -- 172.21.15.192:0/1757297195 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0800139f0 con 0x7fe0840b3220 2023-10-16T12:58:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.075+0000 7fe08b72d700 1 -- 172.21.15.192:0/1757297195 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0841e10e0 con 0x7fe0840b3220 2023-10-16T12:58:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.075+0000 7fe079ffb700 1 -- 172.21.15.192:0/1757297195 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe080005a20 con 0x7fe0840b3220 2023-10-16T12:58:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.075+0000 7fe079ffb700 1 -- 172.21.15.192:0/1757297195 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fe080005cd0 con 0x7fe0840b3220 2023-10-16T12:58:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.076+0000 7fe08b72d700 1 -- 172.21.15.192:0/1757297195 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0841e1450 con 0x7fe0840b3220 2023-10-16T12:58:28.088 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.078+0000 7fe079ffb700 1 -- 172.21.15.192:0/1757297195 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe080021060 con 0x7fe0840b3220 2023-10-16T12:58:28.119 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:28.118+0000 7f346ca1c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-16T12:58:28.126 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:28.124+0000 7f5e5dacd200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-16T12:58:28.164 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.161+0000 7fe08b72d700 1 -- 172.21.15.192:0/1757297195 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "81433737-c62b-4885-9b41-513f2aca8821", "id": 3} v 0) v1 -- 0x7fe08404ebb0 con 0x7fe0840b3220 2023-10-16T12:58:28.169 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.167+0000 7fe079ffb700 1 -- 172.21.15.192:0/1757297195 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "81433737-c62b-4885-9b41-513f2aca8821", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe080029020 con 0x7fe0840b3220 2023-10-16T12:58:28.169 INFO:teuthology.orchestra.run.smithi192.stdout:3 2023-10-16T12:58:28.170 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.168+0000 7fe08b72d700 1 -- 172.21.15.192:0/1757297195 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0840b3220 msgr2=0x7fe0840c4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:28.171 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.168+0000 7fe08b72d700 1 --2- 172.21.15.192:0/1757297195 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0840b3220 0x7fe0840c4380 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe08000e870 tx=0x7fe08000eb80 comp rx=0 tx=0).stop 2023-10-16T12:58:28.171 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.168+0000 7fe08b72d700 1 -- 172.21.15.192:0/1757297195 shutdown_connections 2023-10-16T12:58:28.171 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.168+0000 7fe08b72d700 1 --2- 172.21.15.192:0/1757297195 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe08415b4e0 0x7fe0840cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.171 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.168+0000 7fe08b72d700 1 --2- 172.21.15.192:0/1757297195 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0840b3220 0x7fe0840c4380 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.171 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.168+0000 7fe08b72d700 1 --2- 172.21.15.192:0/1757297195 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe0840cd770 0x7fe0840caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.172 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.168+0000 7fe08b72d700 1 -- 172.21.15.192:0/1757297195 >> 172.21.15.192:0/1757297195 conn(0x7fe0840cdce0 msgr2=0x7fe0840cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:28.172 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.168+0000 7fe08b72d700 1 -- 172.21.15.192:0/1757297195 shutdown_connections 2023-10-16T12:58:28.172 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.168+0000 7fe08b72d700 1 -- 172.21.15.192:0/1757297195 wait complete. 2023-10-16T12:58:28.182 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 4a17242a-6a6f-4946-bb53-4adae6fffb50 4 2023-10-16T12:58:28.201 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:28.199+0000 7f346ca1c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-16T12:58:28.214 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:28.212+0000 7f5e5dacd200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-16T12:58:28.300 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:28.297+0000 7f5e5dacd200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-16T12:58:28.303 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.301+0000 7f223c905700 1 Processor -- start 2023-10-16T12:58:28.303 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.301+0000 7f223c905700 1 -- start start 2023-10-16T12:58:28.305 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.302+0000 7f223c905700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f223815f8c0 0x7f2238167250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:28.305 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.302+0000 7f223c905700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22380cad30 con 0x7f223806a820 2023-10-16T12:58:28.305 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.302+0000 7f223c905700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22380cb1c0 con 0x7f223815ed30 2023-10-16T12:58:28.305 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.302+0000 7f223c905700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22380ca7b0 con 0x7f223815f8c0 2023-10-16T12:58:28.306 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.302+0000 7f2236d9d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f223815f8c0 0x7f2238167250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:28.306 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.302+0000 7f2236d9d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f223815f8c0 0x7f2238167250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33312/0 (socket says 172.21.15.192:33312) 2023-10-16T12:58:28.306 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.302+0000 7f2235d9b700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f223815ed30 0x7f223815f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:50142/0 (socket says 172.21.15.192:50142) 2023-10-16T12:58:28.306 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.302+0000 7f2236d9d700 1 -- 172.21.15.192:0/2506756389 learned_addr learned my addr 172.21.15.192:0/2506756389 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-16T12:58:28.307 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.302+0000 7f2236d9d700 1 -- 172.21.15.192:0/2506756389 >> v1:172.21.15.192:6789/0 conn(0x7f223815ed30 legacy=0x7f223815f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:28.307 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.302+0000 7f2236d9d700 1 -- 172.21.15.192:0/2506756389 >> v1:172.21.15.124:6789/0 conn(0x7f223806a820 legacy=0x7f223806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:28.307 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.302+0000 7f2236d9d700 1 -- 172.21.15.192:0/2506756389 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223806df70 con 0x7f223815f8c0 2023-10-16T12:58:28.307 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.302+0000 7f2236d9d700 1 --2- 172.21.15.192:0/2506756389 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f223815f8c0 0x7f2238167250 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2230009e50 tx=0x7f223000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5acaf18d9846e0c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:28.307 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.302+0000 7f223559a700 1 -- 172.21.15.192:0/2506756389 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223000e070 con 0x7f223815f8c0 2023-10-16T12:58:28.308 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.302+0000 7f223559a700 1 -- 172.21.15.192:0/2506756389 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223000b9c0 con 0x7f223815f8c0 2023-10-16T12:58:28.308 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.302+0000 7f223559a700 1 -- 172.21.15.192:0/2506756389 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223000bd70 con 0x7f223815f8c0 2023-10-16T12:58:28.311 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.303+0000 7f223c905700 1 -- 172.21.15.192:0/2506756389 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f223815f8c0 msgr2=0x7f2238167250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:28.311 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.303+0000 7f223c905700 1 --2- 172.21.15.192:0/2506756389 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f223815f8c0 0x7f2238167250 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2230009e50 tx=0x7f223000b330 comp rx=0 tx=0).stop 2023-10-16T12:58:28.311 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.303+0000 7f223c905700 1 -- 172.21.15.192:0/2506756389 shutdown_connections 2023-10-16T12:58:28.311 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.303+0000 7f223c905700 1 --2- 172.21.15.192:0/2506756389 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f223815f8c0 0x7f2238167250 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.312 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.303+0000 7f223c905700 1 -- 172.21.15.192:0/2506756389 >> 172.21.15.192:0/2506756389 conn(0x7f22380ccbe0 msgr2=0x7f22380ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:28.312 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.303+0000 7f223c905700 1 -- 172.21.15.192:0/2506756389 shutdown_connections 2023-10-16T12:58:28.312 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.303+0000 7f223c905700 1 -- 172.21.15.192:0/2506756389 wait complete. 2023-10-16T12:58:28.312 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.304+0000 7f223c905700 1 Processor -- start 2023-10-16T12:58:28.312 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.304+0000 7f223c905700 1 -- start start 2023-10-16T12:58:28.313 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.305+0000 7f223c905700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f223806a820 0x7f22381f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:28.313 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.305+0000 7f223c905700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f223815ed30 0x7f22380716b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:28.313 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.305+0000 7f223c905700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f223815f8c0 0x7f2238071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:28.313 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.305+0000 7f223c905700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22380cf860 con 0x7f223815ed30 2023-10-16T12:58:28.313 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.305+0000 7f223c905700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22380c72d0 con 0x7f223806a820 2023-10-16T12:58:28.314 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.305+0000 7f223c905700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22380c75b0 con 0x7f223815f8c0 2023-10-16T12:58:28.314 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.305+0000 7f223659c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f223806a820 0x7f22381f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:28.314 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.305+0000 7f223659c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f223806a820 0x7f22381f2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33314/0 (socket says 172.21.15.192:33314) 2023-10-16T12:58:28.314 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.305+0000 7f223659c700 1 -- 172.21.15.192:0/1424091984 learned_addr learned my addr 172.21.15.192:0/1424091984 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-16T12:58:28.315 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.305+0000 7f2236d9d700 1 --2- 172.21.15.192:0/1424091984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f223815f8c0 0x7f2238071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:28.315 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.305+0000 7f2235d9b700 1 --2- 172.21.15.192:0/1424091984 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f223815ed30 0x7f22380716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:28.315 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.305+0000 7f223659c700 1 -- 172.21.15.192:0/1424091984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f223815f8c0 msgr2=0x7f2238071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:28.315 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.306+0000 7f223659c700 1 --2- 172.21.15.192:0/1424091984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f223815f8c0 0x7f2238071bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.316 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.306+0000 7f223659c700 1 -- 172.21.15.192:0/1424091984 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f223815ed30 msgr2=0x7f22380716b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:28.316 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.306+0000 7f223659c700 1 --2- 172.21.15.192:0/1424091984 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f223815ed30 0x7f22380716b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.316 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.306+0000 7f223659c700 1 -- 172.21.15.192:0/1424091984 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2230009b30 con 0x7f223806a820 2023-10-16T12:58:28.316 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.306+0000 7f223659c700 1 --2- 172.21.15.192:0/1424091984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f223806a820 0x7f22381f2510 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f222800c510 tx=0x7f222800c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:28.316 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.306+0000 7f2226ffd700 1 -- 172.21.15.192:0/1424091984 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22280052d0 con 0x7f223806a820 2023-10-16T12:58:28.317 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.306+0000 7f2226ffd700 1 -- 172.21.15.192:0/1424091984 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2228005430 con 0x7f223806a820 2023-10-16T12:58:28.317 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.306+0000 7f223c905700 1 -- 172.21.15.192:0/1424091984 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22380c7890 con 0x7f223806a820 2023-10-16T12:58:28.317 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.306+0000 7f2226ffd700 1 -- 172.21.15.192:0/1424091984 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22280038c0 con 0x7f223806a820 2023-10-16T12:58:28.317 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.306+0000 7f223c905700 1 -- 172.21.15.192:0/1424091984 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22380c7e50 con 0x7f223806a820 2023-10-16T12:58:28.317 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.306+0000 7f2226ffd700 1 -- 172.21.15.192:0/1424091984 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2228003d20 con 0x7f223806a820 2023-10-16T12:58:28.318 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.306+0000 7f2226ffd700 1 -- 172.21.15.192:0/1424091984 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f2228011d60 con 0x7f223806a820 2023-10-16T12:58:28.318 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.307+0000 7f223c905700 1 -- 172.21.15.192:0/1424091984 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223804ebb0 con 0x7f223806a820 2023-10-16T12:58:28.318 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.309+0000 7f2226ffd700 1 -- 172.21.15.192:0/1424091984 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f2228017070 con 0x7f223806a820 2023-10-16T12:58:28.396 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.393+0000 7f223c905700 1 -- 172.21.15.192:0/1424091984 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4a17242a-6a6f-4946-bb53-4adae6fffb50", "id": 4} v 0) v1 -- 0x7f22380c5d30 con 0x7f223806a820 2023-10-16T12:58:28.401 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.398+0000 7f2226ffd700 1 -- 172.21.15.192:0/1424091984 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4a17242a-6a6f-4946-bb53-4adae6fffb50", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2228011590 con 0x7f223806a820 2023-10-16T12:58:28.401 INFO:teuthology.orchestra.run.smithi192.stdout:4 2023-10-16T12:58:28.402 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.399+0000 7f223c905700 1 -- 172.21.15.192:0/1424091984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f223806a820 msgr2=0x7f22381f2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:28.403 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.399+0000 7f223c905700 1 --2- 172.21.15.192:0/1424091984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f223806a820 0x7f22381f2510 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f222800c510 tx=0x7f222800c820 comp rx=0 tx=0).stop 2023-10-16T12:58:28.403 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.399+0000 7f223c905700 1 -- 172.21.15.192:0/1424091984 shutdown_connections 2023-10-16T12:58:28.403 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.399+0000 7f223c905700 1 --2- 172.21.15.192:0/1424091984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f223815f8c0 0x7f2238071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.403 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.399+0000 7f223c905700 1 --2- 172.21.15.192:0/1424091984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f223806a820 0x7f22381f2510 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.403 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.399+0000 7f223c905700 1 --2- 172.21.15.192:0/1424091984 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f223815ed30 0x7f22380716b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.404 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.399+0000 7f223c905700 1 -- 172.21.15.192:0/1424091984 >> 172.21.15.192:0/1424091984 conn(0x7f22380ccbe0 msgr2=0x7f223815f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:28.404 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.399+0000 7f223c905700 1 -- 172.21.15.192:0/1424091984 shutdown_connections 2023-10-16T12:58:28.404 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.399+0000 7f223c905700 1 -- 172.21.15.192:0/1424091984 wait complete. 2023-10-16T12:58:28.415 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new cf425c73-5ceb-4ba9-a3ab-f8bdc4875547 5 2023-10-16T12:58:28.575 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.573+0000 7fb54273f700 1 Processor -- start 2023-10-16T12:58:28.576 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.573+0000 7fb54273f700 1 -- start start 2023-10-16T12:58:28.578 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.574+0000 7fb54273f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb53c15dec0 0x7fb53c06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:28.578 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.574+0000 7fb54273f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb53c15e350 0x7fb53c06daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:28.578 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.574+0000 7fb54273f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb53c0cba90 con 0x7fb53c15a250 2023-10-16T12:58:28.579 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.574+0000 7fb54273f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb53c0cb510 con 0x7fb53c15dec0 2023-10-16T12:58:28.579 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.574+0000 7fb54273f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c071ec0 con 0x7fb53c15e350 2023-10-16T12:58:28.579 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.574+0000 7fb53b7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb53c15dec0 0x7fb53c06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:28.579 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.574+0000 7fb540cdc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb53c15e350 0x7fb53c06daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:28.579 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.574+0000 7fb53bfff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb53c15a250 0x7fb53c0717b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:50152/0 (socket says 172.21.15.192:50152) 2023-10-16T12:58:28.580 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.574+0000 7fb53bfff700 1 -- 172.21.15.192:0/2270748110 learned_addr learned my addr 172.21.15.192:0/2270748110 (peer_addr_for_me v1:172.21.15.192:0/0) 2023-10-16T12:58:28.580 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.574+0000 7fb53b7fe700 1 -- 172.21.15.192:0/2270748110 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb53c15e350 msgr2=0x7fb53c06daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:28.580 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.574+0000 7fb53b7fe700 1 --2- 172.21.15.192:0/2270748110 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb53c15e350 0x7fb53c06daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.580 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.574+0000 7fb53b7fe700 1 -- 172.21.15.192:0/2270748110 >> v1:172.21.15.192:6789/0 conn(0x7fb53c15a250 legacy=0x7fb53c0717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:28.580 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.574+0000 7fb53b7fe700 1 -- 172.21.15.192:0/2270748110 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c15ee40 con 0x7fb53c15dec0 2023-10-16T12:58:28.581 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.574+0000 7fb53affd700 1 -- 172.21.15.192:0/2270748110 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4250678909 0 0) 0x7fb53c0cba90 con 0x7fb53c15a250 2023-10-16T12:58:28.581 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.574+0000 7fb540cdc700 1 --2- 172.21.15.192:0/2270748110 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb53c15e350 0x7fb53c06daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:58:28.581 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.574+0000 7fb53b7fe700 1 --2- 172.21.15.192:0/2270748110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb53c15dec0 0x7fb53c06d5b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb530009840 tx=0x7fb530009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2f8ae985d3cf44b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:28.581 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.574+0000 7fb53affd700 1 -- 172.21.15.192:0/2270748110 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb530011830 con 0x7fb53c15dec0 2023-10-16T12:58:28.581 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.574+0000 7fb53affd700 1 -- 172.21.15.192:0/2270748110 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb530011990 con 0x7fb53c15dec0 2023-10-16T12:58:28.582 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.574+0000 7fb53affd700 1 -- 172.21.15.192:0/2270748110 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb530011d20 con 0x7fb53c15dec0 2023-10-16T12:58:28.582 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.575+0000 7fb54273f700 1 -- 172.21.15.192:0/2270748110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb53c15dec0 msgr2=0x7fb53c06d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:28.582 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.575+0000 7fb54273f700 1 --2- 172.21.15.192:0/2270748110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb53c15dec0 0x7fb53c06d5b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb530009840 tx=0x7fb530009b50 comp rx=0 tx=0).stop 2023-10-16T12:58:28.582 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.575+0000 7fb54273f700 1 -- 172.21.15.192:0/2270748110 shutdown_connections 2023-10-16T12:58:28.582 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.575+0000 7fb54273f700 1 --2- 172.21.15.192:0/2270748110 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb53c15e350 0x7fb53c06daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.583 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.575+0000 7fb54273f700 1 --2- 172.21.15.192:0/2270748110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb53c15dec0 0x7fb53c06d5b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.583 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.575+0000 7fb54273f700 1 -- 172.21.15.192:0/2270748110 >> 172.21.15.192:0/2270748110 conn(0x7fb53c0ccbe0 msgr2=0x7fb53c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:28.583 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.575+0000 7fb54273f700 1 -- 172.21.15.192:0/2270748110 shutdown_connections 2023-10-16T12:58:28.583 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.575+0000 7fb54273f700 1 -- 172.21.15.192:0/2270748110 wait complete. 2023-10-16T12:58:28.586 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.576+0000 7fb54273f700 1 Processor -- start 2023-10-16T12:58:28.586 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.576+0000 7fb54273f700 1 -- start start 2023-10-16T12:58:28.586 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.577+0000 7fb54273f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb53c15a250 0x7fb53c1511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:28.586 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.577+0000 7fb54273f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb53c15dec0 0x7fb53c1f3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:28.587 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.577+0000 7fb54273f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb53c15e350 0x7fb53c0c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:28.587 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.577+0000 7fb54273f700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0b3a40 con 0x7fb53c15e350 2023-10-16T12:58:28.587 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.577+0000 7fb54273f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0b3d20 con 0x7fb53c15dec0 2023-10-16T12:58:28.587 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.577+0000 7fb54273f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0b5de0 con 0x7fb53c15a250 2023-10-16T12:58:28.587 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.577+0000 7fb53bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb53c15a250 0x7fb53c1511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:28.587 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.577+0000 7fb53b7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb53c15dec0 0x7fb53c1f3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:28.588 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.577+0000 7fb53bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb53c15a250 0x7fb53c1511c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:60924/0 (socket says 172.21.15.192:60924) 2023-10-16T12:58:28.588 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.577+0000 7fb53bfff700 1 -- 172.21.15.192:0/1555335512 learned_addr learned my addr 172.21.15.192:0/1555335512 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-16T12:58:28.588 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.577+0000 7fb540cdc700 1 --2- 172.21.15.192:0/1555335512 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb53c15e350 0x7fb53c0c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:28.588 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.578+0000 7fb53bfff700 1 -- 172.21.15.192:0/1555335512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb53c15dec0 msgr2=0x7fb53c1f3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:28.588 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.578+0000 7fb53bfff700 1 --2- 172.21.15.192:0/1555335512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb53c15dec0 0x7fb53c1f3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.588 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.578+0000 7fb53bfff700 1 -- 172.21.15.192:0/1555335512 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb53c15e350 msgr2=0x7fb53c0c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:28.589 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.578+0000 7fb53bfff700 1 --2- 172.21.15.192:0/1555335512 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb53c15e350 0x7fb53c0c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.589 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.578+0000 7fb53bfff700 1 -- 172.21.15.192:0/1555335512 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb534009a70 con 0x7fb53c15a250 2023-10-16T12:58:28.589 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.578+0000 7fb53b7fe700 1 --2- 172.21.15.192:0/1555335512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb53c15dec0 0x7fb53c1f3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:58:28.589 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.578+0000 7fb53bfff700 1 --2- 172.21.15.192:0/1555335512 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb53c15a250 0x7fb53c1511c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb52c0011e0 tx=0x7fb52c00ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:28.589 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.578+0000 7fb538ff9700 1 -- 172.21.15.192:0/1555335512 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c004c80 con 0x7fb53c15a250 2023-10-16T12:58:28.590 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.578+0000 7fb538ff9700 1 -- 172.21.15.192:0/1555335512 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52c004de0 con 0x7fb53c15a250 2023-10-16T12:58:28.590 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.578+0000 7fb54273f700 1 -- 172.21.15.192:0/1555335512 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5300094a0 con 0x7fb53c15a250 2023-10-16T12:58:28.590 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.578+0000 7fb538ff9700 1 -- 172.21.15.192:0/1555335512 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c007310 con 0x7fb53c15a250 2023-10-16T12:58:28.590 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.578+0000 7fb54273f700 1 -- 172.21.15.192:0/1555335512 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53c1f42c0 con 0x7fb53c15a250 2023-10-16T12:58:28.590 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.578+0000 7fb538ff9700 1 -- 172.21.15.192:0/1555335512 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb52c01d3f0 con 0x7fb53c15a250 2023-10-16T12:58:28.591 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.578+0000 7fb538ff9700 1 -- 172.21.15.192:0/1555335512 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fb52c013940 con 0x7fb53c15a250 2023-10-16T12:58:28.591 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.579+0000 7fb54273f700 1 -- 172.21.15.192:0/1555335512 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb53c0caaf0 con 0x7fb53c15a250 2023-10-16T12:58:28.591 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.581+0000 7fb538ff9700 1 -- 172.21.15.192:0/1555335512 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fb52c013c50 con 0x7fb53c15a250 2023-10-16T12:58:28.637 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:28.636+0000 7f346ca1c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-16T12:58:28.677 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.675+0000 7fb54273f700 1 -- 172.21.15.192:0/1555335512 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cf425c73-5ceb-4ba9-a3ab-f8bdc4875547", "id": 5} v 0) v1 -- 0x7fb53c04ebb0 con 0x7fb53c15a250 2023-10-16T12:58:28.682 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.680+0000 7fb538ff9700 1 -- 172.21.15.192:0/1555335512 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cf425c73-5ceb-4ba9-a3ab-f8bdc4875547", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb52c0133c0 con 0x7fb53c15a250 2023-10-16T12:58:28.683 INFO:teuthology.orchestra.run.smithi192.stdout:5 2023-10-16T12:58:28.684 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.681+0000 7fb54273f700 1 -- 172.21.15.192:0/1555335512 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb53c15a250 msgr2=0x7fb53c1511c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:28.684 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.681+0000 7fb54273f700 1 --2- 172.21.15.192:0/1555335512 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb53c15a250 0x7fb53c1511c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb52c0011e0 tx=0x7fb52c00ca30 comp rx=0 tx=0).stop 2023-10-16T12:58:28.684 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.681+0000 7fb54273f700 1 -- 172.21.15.192:0/1555335512 shutdown_connections 2023-10-16T12:58:28.684 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.681+0000 7fb54273f700 1 --2- 172.21.15.192:0/1555335512 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb53c15e350 0x7fb53c0c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.685 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.681+0000 7fb54273f700 1 --2- 172.21.15.192:0/1555335512 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb53c15a250 0x7fb53c1511c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.685 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.681+0000 7fb54273f700 1 --2- 172.21.15.192:0/1555335512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb53c15dec0 0x7fb53c1f3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.685 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.681+0000 7fb54273f700 1 -- 172.21.15.192:0/1555335512 >> 172.21.15.192:0/1555335512 conn(0x7fb53c0ccbe0 msgr2=0x7fb53c06d640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:28.685 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.681+0000 7fb54273f700 1 -- 172.21.15.192:0/1555335512 shutdown_connections 2023-10-16T12:58:28.685 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.681+0000 7fb54273f700 1 -- 172.21.15.192:0/1555335512 wait complete. 2023-10-16T12:58:28.696 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 2eff9d8e-923c-4636-8ae0-be38233c8fa3 6 2023-10-16T12:58:28.753 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:28.751+0000 7f5e5dacd200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-16T12:58:28.818 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.816+0000 7fda5c639700 1 Processor -- start 2023-10-16T12:58:28.819 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.816+0000 7fda5c639700 1 -- start start 2023-10-16T12:58:28.821 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.817+0000 7fda5c639700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda5415a250 0x7fda540717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:28.822 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.817+0000 7fda5c639700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda540cba90 con 0x7fda5415dec0 2023-10-16T12:58:28.822 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.817+0000 7fda5c639700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5415ee40 con 0x7fda5406dcc0 2023-10-16T12:58:28.822 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.817+0000 7fda5c639700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda540cb510 con 0x7fda5415a250 2023-10-16T12:58:28.822 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.817+0000 7fda5a3d5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda5415a250 0x7fda540717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:28.822 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.817+0000 7fda5abd6700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fda5406dcc0 0x7fda540cbf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:50166/0 (socket says 172.21.15.192:50166) 2023-10-16T12:58:28.823 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.817+0000 7fda5abd6700 1 -- 172.21.15.192:0/1403027549 learned_addr learned my addr 172.21.15.192:0/1403027549 (peer_addr_for_me v1:172.21.15.192:0/0) 2023-10-16T12:58:28.823 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.817+0000 7fda5a3d5700 1 --2- 172.21.15.192:0/1403027549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda5415a250 0x7fda540717b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:60930/0 (socket says 172.21.15.192:60930) 2023-10-16T12:58:28.823 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.817+0000 7fda593d3700 1 -- 172.21.15.192:0/1403027549 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223320234 0 0) 0x7fda5415ee40 con 0x7fda5406dcc0 2023-10-16T12:58:28.823 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.817+0000 7fda593d3700 1 -- 172.21.15.192:0/1403027549 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda400035b0 con 0x7fda5406dcc0 2023-10-16T12:58:28.823 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.817+0000 7fda5a3d5700 1 -- 172.21.15.192:0/1403027549 >> v1:172.21.15.192:6789/0 conn(0x7fda5406dcc0 legacy=0x7fda540cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:28.824 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.817+0000 7fda5a3d5700 1 -- 172.21.15.192:0/1403027549 >> v1:172.21.15.124:6789/0 conn(0x7fda5415dec0 legacy=0x7fda5406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:28.824 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.817+0000 7fda5a3d5700 1 -- 172.21.15.192:0/1403027549 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5415e880 con 0x7fda5415a250 2023-10-16T12:58:28.824 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.818+0000 7fda5a3d5700 1 --2- 172.21.15.192:0/1403027549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda5415a250 0x7fda540717b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fda50009870 tx=0x7fda50009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b06e53a574b4a081 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:28.824 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.818+0000 7fda593d3700 1 -- 172.21.15.192:0/1403027549 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda50011830 con 0x7fda5415a250 2023-10-16T12:58:28.824 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.818+0000 7fda593d3700 1 -- 172.21.15.192:0/1403027549 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda50011990 con 0x7fda5415a250 2023-10-16T12:58:28.824 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.818+0000 7fda593d3700 1 -- 172.21.15.192:0/1403027549 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda50011d20 con 0x7fda5415a250 2023-10-16T12:58:28.825 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.818+0000 7fda5c639700 1 -- 172.21.15.192:0/1403027549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda5415a250 msgr2=0x7fda540717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:28.825 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.818+0000 7fda5c639700 1 --2- 172.21.15.192:0/1403027549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda5415a250 0x7fda540717b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fda50009870 tx=0x7fda50009b80 comp rx=0 tx=0).stop 2023-10-16T12:58:28.825 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.818+0000 7fda5c639700 1 -- 172.21.15.192:0/1403027549 shutdown_connections 2023-10-16T12:58:28.825 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.818+0000 7fda5c639700 1 --2- 172.21.15.192:0/1403027549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda5415a250 0x7fda540717b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.825 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.818+0000 7fda5c639700 1 -- 172.21.15.192:0/1403027549 >> 172.21.15.192:0/1403027549 conn(0x7fda540ccbe0 msgr2=0x7fda540ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:28.826 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.819+0000 7fda5c639700 1 -- 172.21.15.192:0/1403027549 shutdown_connections 2023-10-16T12:58:28.826 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.819+0000 7fda5c639700 1 -- 172.21.15.192:0/1403027549 wait complete. 2023-10-16T12:58:28.828 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.820+0000 7fda5c639700 1 Processor -- start 2023-10-16T12:58:28.828 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.820+0000 7fda5c639700 1 -- start start 2023-10-16T12:58:28.829 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.820+0000 7fda5c639700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda5406dcc0 0x7fda540c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:28.829 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.820+0000 7fda5c639700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda5415a250 0x7fda540b5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:28.829 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.820+0000 7fda5c639700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda5415dec0 0x7fda540b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:28.829 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.820+0000 7fda5c639700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda541591a0 con 0x7fda5415a250 2023-10-16T12:58:28.829 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.820+0000 7fda5c639700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda540c8860 con 0x7fda5415dec0 2023-10-16T12:58:28.830 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.820+0000 7fda5c639700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda540c8b40 con 0x7fda5406dcc0 2023-10-16T12:58:28.830 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.821+0000 7fda5a3d5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda5406dcc0 0x7fda540c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:28.830 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.821+0000 7fda5abd6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda5415dec0 0x7fda540b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:28.830 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.821+0000 7fda5a3d5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda5406dcc0 0x7fda540c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:60934/0 (socket says 172.21.15.192:60934) 2023-10-16T12:58:28.830 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.821+0000 7fda5abd6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda5415dec0 0x7fda540b3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33340/0 (socket says 172.21.15.192:33340) 2023-10-16T12:58:28.831 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.821+0000 7fda5a3d5700 1 -- 172.21.15.192:0/1793482915 learned_addr learned my addr 172.21.15.192:0/1793482915 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-16T12:58:28.831 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.821+0000 7fda59bd4700 1 --2- 172.21.15.192:0/1793482915 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda5415a250 0x7fda540b5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:28.831 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.821+0000 7fda5a3d5700 1 -- 172.21.15.192:0/1793482915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda5415dec0 msgr2=0x7fda540b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:28.831 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.821+0000 7fda5a3d5700 1 --2- 172.21.15.192:0/1793482915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda5415dec0 0x7fda540b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.831 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.821+0000 7fda5a3d5700 1 -- 172.21.15.192:0/1793482915 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda5415a250 msgr2=0x7fda540b5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:28.832 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.821+0000 7fda5a3d5700 1 --2- 172.21.15.192:0/1793482915 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda5415a250 0x7fda540b5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.833 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.821+0000 7fda5a3d5700 1 -- 172.21.15.192:0/1793482915 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda500094a0 con 0x7fda5406dcc0 2023-10-16T12:58:28.834 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.821+0000 7fda5a3d5700 1 --2- 172.21.15.192:0/1793482915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda5406dcc0 0x7fda540c8280 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fda50009bc0 tx=0x7fda50004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:28.834 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.821+0000 7fda4affd700 1 -- 172.21.15.192:0/1793482915 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda500036a0 con 0x7fda5406dcc0 2023-10-16T12:58:28.834 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.821+0000 7fda4affd700 1 -- 172.21.15.192:0/1793482915 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5001f070 con 0x7fda5406dcc0 2023-10-16T12:58:28.834 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.821+0000 7fda5c639700 1 -- 172.21.15.192:0/1793482915 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda540c8e20 con 0x7fda5406dcc0 2023-10-16T12:58:28.835 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.821+0000 7fda4affd700 1 -- 172.21.15.192:0/1793482915 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda50003a40 con 0x7fda5406dcc0 2023-10-16T12:58:28.835 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.821+0000 7fda5c639700 1 -- 172.21.15.192:0/1793482915 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda540c93e0 con 0x7fda5406dcc0 2023-10-16T12:58:28.835 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.823+0000 7fda4affd700 1 -- 172.21.15.192:0/1793482915 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fda50026480 con 0x7fda5406dcc0 2023-10-16T12:58:28.835 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.823+0000 7fda4affd700 1 -- 172.21.15.192:0/1793482915 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fda50021070 con 0x7fda5406dcc0 2023-10-16T12:58:28.835 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.823+0000 7fda5c639700 1 -- 172.21.15.192:0/1793482915 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5404ebb0 con 0x7fda5406dcc0 2023-10-16T12:58:28.836 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.825+0000 7fda4affd700 1 -- 172.21.15.192:0/1793482915 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fda50015020 con 0x7fda5406dcc0 2023-10-16T12:58:28.911 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.908+0000 7fda5c639700 1 -- 172.21.15.192:0/1793482915 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2eff9d8e-923c-4636-8ae0-be38233c8fa3", "id": 6} v 0) v1 -- 0x7fda540b60e0 con 0x7fda5406dcc0 2023-10-16T12:58:28.918 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.916+0000 7fda4affd700 1 -- 172.21.15.192:0/1793482915 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2eff9d8e-923c-4636-8ae0-be38233c8fa3", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fda50026990 con 0x7fda5406dcc0 2023-10-16T12:58:28.919 INFO:teuthology.orchestra.run.smithi192.stdout:6 2023-10-16T12:58:28.920 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.917+0000 7fda5c639700 1 -- 172.21.15.192:0/1793482915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda5406dcc0 msgr2=0x7fda540c8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:28.920 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.917+0000 7fda5c639700 1 --2- 172.21.15.192:0/1793482915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda5406dcc0 0x7fda540c8280 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fda50009bc0 tx=0x7fda50004750 comp rx=0 tx=0).stop 2023-10-16T12:58:28.920 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.917+0000 7fda5c639700 1 -- 172.21.15.192:0/1793482915 shutdown_connections 2023-10-16T12:58:28.920 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.917+0000 7fda5c639700 1 --2- 172.21.15.192:0/1793482915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda5415dec0 0x7fda540b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.921 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.917+0000 7fda5c639700 1 --2- 172.21.15.192:0/1793482915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda5406dcc0 0x7fda540c8280 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.921 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.917+0000 7fda5c639700 1 --2- 172.21.15.192:0/1793482915 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda5415a250 0x7fda540b5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:28.921 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.917+0000 7fda5c639700 1 -- 172.21.15.192:0/1793482915 >> 172.21.15.192:0/1793482915 conn(0x7fda540ccbe0 msgr2=0x7fda5406d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:28.921 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.917+0000 7fda5c639700 1 -- 172.21.15.192:0/1793482915 shutdown_connections 2023-10-16T12:58:28.921 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:28.917+0000 7fda5c639700 1 -- 172.21.15.192:0/1793482915 wait complete. 2023-10-16T12:58:28.931 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new dffa1b27-4737-4208-81a0-713a52c7adf8 7 2023-10-16T12:58:29.054 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.051+0000 7f3eb109d700 1 Processor -- start 2023-10-16T12:58:29.054 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.051+0000 7f3eb109d700 1 -- start start 2023-10-16T12:58:29.057 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.052+0000 7f3eb109d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3eac0ce540 0x7f3eac071b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:29.057 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.052+0000 7f3eb109d700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eac06a9c0 con 0x7f3eac15d660 2023-10-16T12:58:29.057 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.052+0000 7f3eb109d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eac06ac60 con 0x7f3eac0cd800 2023-10-16T12:58:29.057 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.052+0000 7f3eb109d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eac162210 con 0x7f3eac0ce540 2023-10-16T12:58:29.057 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.053+0000 7f3eaa59c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3eac0ce540 0x7f3eac071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:29.058 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.053+0000 7f3eab59e700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f3eac0cd800 0x7f3eac0720a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:50178/0 (socket says 172.21.15.192:50178) 2023-10-16T12:58:29.058 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.053+0000 7f3eaa59c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3eac0ce540 0x7f3eac071b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33344/0 (socket says 172.21.15.192:33344) 2023-10-16T12:58:29.058 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.053+0000 7f3eab59e700 1 -- 172.21.15.192:0/2849478792 learned_addr learned my addr 172.21.15.192:0/2849478792 (peer_addr_for_me v1:172.21.15.192:0/0) 2023-10-16T12:58:29.058 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.053+0000 7f3eaa59c700 1 -- 172.21.15.192:0/2849478792 >> v1:172.21.15.192:6789/0 conn(0x7f3eac0cd800 legacy=0x7f3eac0720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:29.058 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.053+0000 7f3eaa59c700 1 -- 172.21.15.192:0/2849478792 >> v1:172.21.15.124:6789/0 conn(0x7f3eac15d660 legacy=0x7f3eac0cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:29.059 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.053+0000 7f3eaa59c700 1 -- 172.21.15.192:0/2849478792 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac06af40 con 0x7f3eac0ce540 2023-10-16T12:58:29.059 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.053+0000 7f3eaa59c700 1 --2- 172.21.15.192:0/2849478792 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3eac0ce540 0x7f3eac071b60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009840 tx=0x7f3ea0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ecbfc7ea92e1615 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:29.059 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.053+0000 7f3ea9d9b700 1 -- 172.21.15.192:0/2849478792 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0011830 con 0x7f3eac0ce540 2023-10-16T12:58:29.059 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.053+0000 7f3ea9d9b700 1 -- 172.21.15.192:0/2849478792 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea0011990 con 0x7f3eac0ce540 2023-10-16T12:58:29.059 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.053+0000 7f3ea9d9b700 1 -- 172.21.15.192:0/2849478792 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0011d20 con 0x7f3eac0ce540 2023-10-16T12:58:29.060 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.054+0000 7f3eb109d700 1 -- 172.21.15.192:0/2849478792 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3eac0ce540 msgr2=0x7f3eac071b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:29.060 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.054+0000 7f3eb109d700 1 --2- 172.21.15.192:0/2849478792 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3eac0ce540 0x7f3eac071b60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009840 tx=0x7f3ea0009b50 comp rx=0 tx=0).stop 2023-10-16T12:58:29.060 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.054+0000 7f3eb109d700 1 -- 172.21.15.192:0/2849478792 shutdown_connections 2023-10-16T12:58:29.060 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.054+0000 7f3eb109d700 1 --2- 172.21.15.192:0/2849478792 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3eac0ce540 0x7f3eac071b60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:29.060 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.054+0000 7f3eb109d700 1 -- 172.21.15.192:0/2849478792 >> 172.21.15.192:0/2849478792 conn(0x7f3eac0ccce0 msgr2=0x7f3eac0cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:29.061 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.054+0000 7f3eb109d700 1 -- 172.21.15.192:0/2849478792 shutdown_connections 2023-10-16T12:58:29.061 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.054+0000 7f3eb109d700 1 -- 172.21.15.192:0/2849478792 wait complete. 2023-10-16T12:58:29.063 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.055+0000 7f3eb109d700 1 Processor -- start 2023-10-16T12:58:29.063 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.056+0000 7f3eb109d700 1 -- start start 2023-10-16T12:58:29.064 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.056+0000 7f3eb109d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3eac0cd800 0x7f3eac152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:29.064 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.056+0000 7f3eb109d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3eac0ce540 0x7f3eac0b5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:29.064 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.056+0000 7f3eb109d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3eac15d660 0x7f3eac15c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:29.064 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.056+0000 7f3eb109d700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac0b2fb0 con 0x7f3eac0cd800 2023-10-16T12:58:29.064 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.056+0000 7f3eb109d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac15e7d0 con 0x7f3eac15d660 2023-10-16T12:58:29.064 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.056+0000 7f3eb109d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac15ec60 con 0x7f3eac0ce540 2023-10-16T12:58:29.065 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.056+0000 7f3eab59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3eac15d660 0x7f3eac15c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:29.065 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.056+0000 7f3eaa59c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3eac0ce540 0x7f3eac0b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:29.065 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.056+0000 7f3eab59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3eac15d660 0x7f3eac15c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33352/0 (socket says 172.21.15.192:33352) 2023-10-16T12:58:29.065 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.056+0000 7f3eaa59c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3eac0ce540 0x7f3eac0b5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:60946/0 (socket says 172.21.15.192:60946) 2023-10-16T12:58:29.065 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.056+0000 7f3eab59e700 1 -- 172.21.15.192:0/870623223 learned_addr learned my addr 172.21.15.192:0/870623223 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-16T12:58:29.066 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.056+0000 7f3eaad9d700 1 --2- 172.21.15.192:0/870623223 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3eac0cd800 0x7f3eac152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:29.066 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.057+0000 7f3eab59e700 1 -- 172.21.15.192:0/870623223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3eac0ce540 msgr2=0x7f3eac0b5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:29.066 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.057+0000 7f3eab59e700 1 --2- 172.21.15.192:0/870623223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3eac0ce540 0x7f3eac0b5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:29.066 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.057+0000 7f3eab59e700 1 -- 172.21.15.192:0/870623223 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3eac0cd800 msgr2=0x7f3eac152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:29.067 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.057+0000 7f3eab59e700 1 --2- 172.21.15.192:0/870623223 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3eac0cd800 0x7f3eac152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:29.067 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.057+0000 7f3eab59e700 1 -- 172.21.15.192:0/870623223 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea00094a0 con 0x7f3eac15d660 2023-10-16T12:58:29.067 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.057+0000 7f3eaa59c700 1 --2- 172.21.15.192:0/870623223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3eac0ce540 0x7f3eac0b5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:58:29.067 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.057+0000 7f3eab59e700 1 --2- 172.21.15.192:0/870623223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3eac15d660 0x7f3eac15c240 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400cb10 tx=0x7f3ea400ce20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:29.067 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.057+0000 7f3e937fe700 1 -- 172.21.15.192:0/870623223 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea400a9e0 con 0x7f3eac15d660 2023-10-16T12:58:29.068 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.057+0000 7f3e937fe700 1 -- 172.21.15.192:0/870623223 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea400ab40 con 0x7f3eac15d660 2023-10-16T12:58:29.068 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.057+0000 7f3e937fe700 1 -- 172.21.15.192:0/870623223 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4012400 con 0x7f3eac15d660 2023-10-16T12:58:29.068 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.057+0000 7f3eb109d700 1 -- 172.21.15.192:0/870623223 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eac15dbc0 con 0x7f3eac15d660 2023-10-16T12:58:29.068 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.057+0000 7f3eb109d700 1 -- 172.21.15.192:0/870623223 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eac15e180 con 0x7f3eac15d660 2023-10-16T12:58:29.068 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.057+0000 7f3e937fe700 1 -- 172.21.15.192:0/870623223 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3ea4007d50 con 0x7f3eac15d660 2023-10-16T12:58:29.069 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.057+0000 7f3e937fe700 1 -- 172.21.15.192:0/870623223 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f3ea401ba10 con 0x7f3eac15d660 2023-10-16T12:58:29.069 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.058+0000 7f3eb109d700 1 -- 172.21.15.192:0/870623223 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eac04ebb0 con 0x7f3eac15d660 2023-10-16T12:58:29.069 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.060+0000 7f3e937fe700 1 -- 172.21.15.192:0/870623223 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f3ea4017070 con 0x7f3eac15d660 2023-10-16T12:58:29.147 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.144+0000 7f3eb109d700 1 -- 172.21.15.192:0/870623223 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dffa1b27-4737-4208-81a0-713a52c7adf8", "id": 7} v 0) v1 -- 0x7f3eac15e910 con 0x7f3eac15d660 2023-10-16T12:58:29.156 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.154+0000 7f3e937fe700 1 -- 172.21.15.192:0/870623223 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dffa1b27-4737-4208-81a0-713a52c7adf8", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3ea401bc20 con 0x7f3eac15d660 2023-10-16T12:58:29.157 INFO:teuthology.orchestra.run.smithi192.stdout:7 2023-10-16T12:58:29.157 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.155+0000 7f3eb109d700 1 -- 172.21.15.192:0/870623223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3eac15d660 msgr2=0x7f3eac15c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:29.158 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.155+0000 7f3eb109d700 1 --2- 172.21.15.192:0/870623223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3eac15d660 0x7f3eac15c240 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400cb10 tx=0x7f3ea400ce20 comp rx=0 tx=0).stop 2023-10-16T12:58:29.158 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.155+0000 7f3eb109d700 1 -- 172.21.15.192:0/870623223 shutdown_connections 2023-10-16T12:58:29.158 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.155+0000 7f3eb109d700 1 --2- 172.21.15.192:0/870623223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3eac15d660 0x7f3eac15c240 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:29.158 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.155+0000 7f3eb109d700 1 --2- 172.21.15.192:0/870623223 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3eac0cd800 0x7f3eac152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:29.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.155+0000 7f3eb109d700 1 --2- 172.21.15.192:0/870623223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3eac0ce540 0x7f3eac0b5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:29.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.155+0000 7f3eb109d700 1 -- 172.21.15.192:0/870623223 >> 172.21.15.192:0/870623223 conn(0x7f3eac0ccce0 msgr2=0x7f3eac0cab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:29.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.155+0000 7f3eb109d700 1 -- 172.21.15.192:0/870623223 shutdown_connections 2023-10-16T12:58:29.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-16T12:58:29.155+0000 7f3eb109d700 1 -- 172.21.15.192:0/870623223 wait complete. 2023-10-16T12:58:29.172 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-16T12:58:29.173 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-16T12:58:29.175 INFO:tasks.ceph.osd.0:Started 2023-10-16T12:58:29.175 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-16T12:58:29.176 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-16T12:58:29.178 INFO:tasks.ceph.osd.1:Started 2023-10-16T12:58:29.178 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-16T12:58:29.178 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-16T12:58:29.181 INFO:tasks.ceph.osd.2:Started 2023-10-16T12:58:29.181 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-16T12:58:29.181 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-16T12:58:29.184 INFO:tasks.ceph.osd.3:Started 2023-10-16T12:58:29.185 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-16T12:58:29.185 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-16T12:58:29.189 INFO:tasks.ceph.osd.4:Started 2023-10-16T12:58:29.190 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-16T12:58:29.190 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-16T12:58:29.197 INFO:tasks.ceph.osd.5:Started 2023-10-16T12:58:29.197 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-16T12:58:29.198 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-16T12:58:29.200 INFO:tasks.ceph.osd.6:Started 2023-10-16T12:58:29.200 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-16T12:58:29.200 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-16T12:58:29.203 INFO:tasks.ceph.osd.7:Started 2023-10-16T12:58:29.203 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:58:29.294 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:29.292+0000 7f346ca1c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-16T12:58:29.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.360+0000 7fe846447700 1 Processor -- start 2023-10-16T12:58:29.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.360+0000 7fe846447700 1 -- start start 2023-10-16T12:58:29.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.360+0000 7fe846447700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe8400af030 0x7fe8400af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:29.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.360+0000 7fe846447700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8400caee0 con 0x7fe84015d810 2023-10-16T12:58:29.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.360+0000 7fe846447700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8400cfc30 con 0x7fe84015dbf0 2023-10-16T12:58:29.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.360+0000 7fe846447700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8400cf990 con 0x7fe8400af030 2023-10-16T12:58:29.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.360+0000 7fe8449e4700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe8400af030 0x7fe8400af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:29.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.361+0000 7fe83ffff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fe84015d810 0x7fe8400ca7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:41152/0 (socket says 172.21.15.124:41152) 2023-10-16T12:58:29.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.361+0000 7fe8449e4700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe8400af030 0x7fe8400af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52488/0 (socket says 172.21.15.124:52488) 2023-10-16T12:58:29.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.361+0000 7fe83ffff700 1 -- 172.21.15.124:0/3658865409 learned_addr learned my addr 172.21.15.124:0/3658865409 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:58:29.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.361+0000 7fe8449e4700 1 -- 172.21.15.124:0/3658865409 >> v1:172.21.15.192:6789/0 conn(0x7fe84015dbf0 legacy=0x7fe840161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:29.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.361+0000 7fe8449e4700 1 -- 172.21.15.124:0/3658865409 >> v1:172.21.15.124:6789/0 conn(0x7fe84015d810 legacy=0x7fe8400ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:29.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.361+0000 7fe8449e4700 1 -- 172.21.15.124:0/3658865409 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8400cff10 con 0x7fe8400af030 2023-10-16T12:58:29.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.361+0000 7fe8449e4700 1 --2- 172.21.15.124:0/3658865409 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe8400af030 0x7fe8400af580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe838009d90 tx=0x7fe83800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14904985c755297b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:29.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.361+0000 7fe83effd700 1 -- 172.21.15.124:0/3658865409 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83800e070 con 0x7fe8400af030 2023-10-16T12:58:29.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.361+0000 7fe83effd700 1 -- 172.21.15.124:0/3658865409 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83800bbd0 con 0x7fe8400af030 2023-10-16T12:58:29.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.361+0000 7fe83effd700 1 -- 172.21.15.124:0/3658865409 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe838012430 con 0x7fe8400af030 2023-10-16T12:58:29.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.362+0000 7fe846447700 1 -- 172.21.15.124:0/3658865409 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe8400af030 msgr2=0x7fe8400af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:29.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.362+0000 7fe846447700 1 --2- 172.21.15.124:0/3658865409 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe8400af030 0x7fe8400af580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe838009d90 tx=0x7fe83800b330 comp rx=0 tx=0).stop 2023-10-16T12:58:29.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.362+0000 7fe846447700 1 -- 172.21.15.124:0/3658865409 shutdown_connections 2023-10-16T12:58:29.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.362+0000 7fe846447700 1 --2- 172.21.15.124:0/3658865409 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe8400af030 0x7fe8400af580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:29.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.362+0000 7fe846447700 1 -- 172.21.15.124:0/3658865409 >> 172.21.15.124:0/3658865409 conn(0x7fe8400d0180 msgr2=0x7fe8400d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:29.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.362+0000 7fe846447700 1 -- 172.21.15.124:0/3658865409 shutdown_connections 2023-10-16T12:58:29.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.362+0000 7fe846447700 1 -- 172.21.15.124:0/3658865409 wait complete. 2023-10-16T12:58:29.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.363+0000 7fe846447700 1 Processor -- start 2023-10-16T12:58:29.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.364+0000 7fe846447700 1 -- start start 2023-10-16T12:58:29.371 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:29.364+0000 7f346ca1c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-16T12:58:29.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.364+0000 7fe846447700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe8400af030 0x7fe8401f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:29.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.364+0000 7fe846447700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe84015d810 0x7fe84014d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:29.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.364+0000 7fe846447700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe84015dbf0 0x7fe84014d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:29.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.364+0000 7fe846447700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8400b56d0 con 0x7fe8400af030 2023-10-16T12:58:29.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.364+0000 7fe846447700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84014e150 con 0x7fe84015d810 2023-10-16T12:58:29.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.364+0000 7fe846447700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8400b47b0 con 0x7fe84015dbf0 2023-10-16T12:58:29.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.365+0000 7fe83ffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe8400af030 0x7fe8401f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:29.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.365+0000 7fe83ffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe8400af030 0x7fe8401f29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52490/0 (socket says 172.21.15.124:52490) 2023-10-16T12:58:29.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.365+0000 7fe83ffff700 1 -- 172.21.15.124:0/1900110050 learned_addr learned my addr 172.21.15.124:0/1900110050 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:29.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.365+0000 7fe8449e4700 1 --2- 172.21.15.124:0/1900110050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe84015dbf0 0x7fe84014d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:29.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.365+0000 7fe83f7fe700 1 --2- 172.21.15.124:0/1900110050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe84015d810 0x7fe84014d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:29.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.365+0000 7fe83ffff700 1 -- 172.21.15.124:0/1900110050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe84015dbf0 msgr2=0x7fe84014d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:29.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.365+0000 7fe83ffff700 1 --2- 172.21.15.124:0/1900110050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe84015dbf0 0x7fe84014d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:29.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.365+0000 7fe83ffff700 1 -- 172.21.15.124:0/1900110050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe84015d810 msgr2=0x7fe84014d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:29.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.365+0000 7fe83ffff700 1 --2- 172.21.15.124:0/1900110050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe84015d810 0x7fe84014d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:29.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.365+0000 7fe83ffff700 1 -- 172.21.15.124:0/1900110050 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe838009a70 con 0x7fe8400af030 2023-10-16T12:58:29.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.365+0000 7fe8449e4700 1 --2- 172.21.15.124:0/1900110050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe84015dbf0 0x7fe84014d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:58:29.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.365+0000 7fe83f7fe700 1 --2- 172.21.15.124:0/1900110050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe84015d810 0x7fe84014d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:58:29.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.365+0000 7fe83ffff700 1 --2- 172.21.15.124:0/1900110050 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe8400af030 0x7fe8401f29d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe83000c550 tx=0x7fe83000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:29.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.365+0000 7fe83cff9700 1 -- 172.21.15.124:0/1900110050 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe830005d70 con 0x7fe8400af030 2023-10-16T12:58:29.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.365+0000 7fe83cff9700 1 -- 172.21.15.124:0/1900110050 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8300070d0 con 0x7fe8400af030 2023-10-16T12:58:29.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.365+0000 7fe846447700 1 -- 172.21.15.124:0/1900110050 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8401f2f10 con 0x7fe8400af030 2023-10-16T12:58:29.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.365+0000 7fe83cff9700 1 -- 172.21.15.124:0/1900110050 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe830007440 con 0x7fe8400af030 2023-10-16T12:58:29.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.365+0000 7fe846447700 1 -- 172.21.15.124:0/1900110050 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8400b4d30 con 0x7fe8400af030 2023-10-16T12:58:29.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.365+0000 7fe83cff9700 1 -- 172.21.15.124:0/1900110050 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe83001c440 con 0x7fe8400af030 2023-10-16T12:58:29.379 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.365+0000 7fe83cff9700 1 -- 172.21.15.124:0/1900110050 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fe830012ad0 con 0x7fe8400af030 2023-10-16T12:58:29.379 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.366+0000 7fe846447700 1 -- 172.21.15.124:0/1900110050 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe84004ebb0 con 0x7fe8400af030 2023-10-16T12:58:29.379 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.368+0000 7fe83cff9700 1 -- 172.21.15.124:0/1900110050 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe830021060 con 0x7fe8400af030 2023-10-16T12:58:29.430 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:29.428+0000 7f5e5dacd200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-16T12:58:29.440 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.439+0000 7fe846447700 1 -- 172.21.15.124:0/1900110050 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe840072540 con 0x7fe8400af030 2023-10-16T12:58:29.441 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.439+0000 7fe83cff9700 1 -- 172.21.15.124:0/1900110050 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fe830017070 con 0x7fe8400af030 2023-10-16T12:58:29.441 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:58:29.442 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":10,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:58:29.146912+0000","last_up_change":"0.000000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:58:29.443 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.440+0000 7fe846447700 1 -- 172.21.15.124:0/1900110050 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe8400af030 msgr2=0x7fe8401f29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:29.443 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.440+0000 7fe846447700 1 --2- 172.21.15.124:0/1900110050 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe8400af030 0x7fe8401f29d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe83000c550 tx=0x7fe83000c910 comp rx=0 tx=0).stop 2023-10-16T12:58:29.443 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.440+0000 7fe846447700 1 -- 172.21.15.124:0/1900110050 shutdown_connections 2023-10-16T12:58:29.443 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.440+0000 7fe846447700 1 --2- 172.21.15.124:0/1900110050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe84015dbf0 0x7fe84014d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:29.444 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.440+0000 7fe846447700 1 --2- 172.21.15.124:0/1900110050 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe8400af030 0x7fe8401f29d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:29.444 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.440+0000 7fe846447700 1 --2- 172.21.15.124:0/1900110050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe84015d810 0x7fe84014d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:29.444 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.440+0000 7fe846447700 1 -- 172.21.15.124:0/1900110050 >> 172.21.15.124:0/1900110050 conn(0x7fe8400d0180 msgr2=0x7fe84006a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:29.444 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.440+0000 7fe846447700 1 -- 172.21.15.124:0/1900110050 shutdown_connections 2023-10-16T12:58:29.445 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:29.440+0000 7fe846447700 1 -- 172.21.15.124:0/1900110050 wait complete. 2023-10-16T12:58:29.454 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-16T12:58:29.454 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-16T12:58:29.498 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:29.496+0000 7f5e5dacd200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-16T12:58:29.797 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T12:58:29.794+0000 7f18ff961640 -1 Falling back to public interface 2023-10-16T12:58:29.797 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T12:58:29.795+0000 7f470db78640 -1 Falling back to public interface 2023-10-16T12:58:29.810 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T12:58:29.807+0000 7f5b6ccce640 -1 Falling back to public interface 2023-10-16T12:58:29.810 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T12:58:29.808+0000 7f432dbeb640 -1 Falling back to public interface 2023-10-16T12:58:29.819 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T12:58:29.817+0000 7f3e3aeb5640 -1 Falling back to public interface 2023-10-16T12:58:29.828 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T12:58:29.826+0000 7f948bb0a640 -1 Falling back to public interface 2023-10-16T12:58:29.842 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T12:58:29.840+0000 7ff267b15640 -1 Falling back to public interface 2023-10-16T12:58:29.842 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T12:58:29.840+0000 7f95ba8be640 -1 Falling back to public interface 2023-10-16T12:58:30.062 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:30.060+0000 7f346ca1c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-16T12:58:30.141 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:30.139+0000 7f346ca1c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-16T12:58:30.200 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:30.197+0000 7f5e5dacd200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-16T12:58:30.260 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-16T12:58:30.276 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:30.274+0000 7f5e5dacd200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-16T12:58:30.283 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:30.281+0000 7f346ca1c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-16T12:58:30.372 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.369+0000 7fc87219f700 1 Processor -- start 2023-10-16T12:58:30.372 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.369+0000 7fc87219f700 1 -- start start 2023-10-16T12:58:30.375 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.370+0000 7fc87219f700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc86c06ff50 0x7fc86c071c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:30.375 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.370+0000 7fc87219f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc86c072180 0x7fc86c1616a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:30.375 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.370+0000 7fc87219f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc86c0717b0 con 0x7fc86c15dc50 2023-10-16T12:58:30.375 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.370+0000 7fc87219f700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc86c15e030 con 0x7fc86c06ff50 2023-10-16T12:58:30.376 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.370+0000 7fc87219f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c072be0 con 0x7fc86c072180 2023-10-16T12:58:30.376 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.370+0000 7fc86affd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc86c06ff50 0x7fc86c071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:30.376 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.370+0000 7fc86affd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc86c06ff50 0x7fc86c071c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52498/0 (socket says 172.21.15.124:52498) 2023-10-16T12:58:30.376 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.370+0000 7fc86affd700 1 -- 172.21.15.124:0/2075815130 learned_addr learned my addr 172.21.15.124:0/2075815130 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:30.376 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.370+0000 7fc86bfff700 1 --2- 172.21.15.124:0/2075815130 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc86c072180 0x7fc86c1616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:30.376 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.371+0000 7fc86affd700 1 -- 172.21.15.124:0/2075815130 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc86c072180 msgr2=0x7fc86c1616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:30.377 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.371+0000 7fc86affd700 1 --2- 172.21.15.124:0/2075815130 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc86c072180 0x7fc86c1616a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:30.377 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.371+0000 7fc86affd700 1 -- 172.21.15.124:0/2075815130 >> v1:172.21.15.192:6789/0 conn(0x7fc86c15dc50 legacy=0x7fc86c0ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:30.377 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.371+0000 7fc86affd700 1 -- 172.21.15.124:0/2075815130 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c06b760 con 0x7fc86c06ff50 2023-10-16T12:58:30.377 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.371+0000 7fc86affd700 1 --2- 172.21.15.124:0/2075815130 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc86c06ff50 0x7fc86c071c40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc8600098f0 tx=0x7fc860009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4421d9a904c613 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:30.377 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.371+0000 7fc86a7fc700 1 -- 172.21.15.124:0/2075815130 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc860011830 con 0x7fc86c06ff50 2023-10-16T12:58:30.378 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.371+0000 7fc86a7fc700 1 -- 172.21.15.124:0/2075815130 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc860011990 con 0x7fc86c06ff50 2023-10-16T12:58:30.378 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.371+0000 7fc86a7fc700 1 -- 172.21.15.124:0/2075815130 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc860011d20 con 0x7fc86c06ff50 2023-10-16T12:58:30.378 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.371+0000 7fc87219f700 1 -- 172.21.15.124:0/2075815130 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc86c06ff50 msgr2=0x7fc86c071c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:30.378 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.371+0000 7fc87219f700 1 --2- 172.21.15.124:0/2075815130 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc86c06ff50 0x7fc86c071c40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc8600098f0 tx=0x7fc860009c00 comp rx=0 tx=0).stop 2023-10-16T12:58:30.378 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.372+0000 7fc87219f700 1 -- 172.21.15.124:0/2075815130 shutdown_connections 2023-10-16T12:58:30.379 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.372+0000 7fc87219f700 1 --2- 172.21.15.124:0/2075815130 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc86c072180 0x7fc86c1616a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:30.379 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.372+0000 7fc87219f700 1 --2- 172.21.15.124:0/2075815130 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc86c06ff50 0x7fc86c071c40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:30.379 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.372+0000 7fc87219f700 1 -- 172.21.15.124:0/2075815130 >> 172.21.15.124:0/2075815130 conn(0x7fc86c0b1db0 msgr2=0x7fc86c0b2190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:30.379 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.372+0000 7fc87219f700 1 -- 172.21.15.124:0/2075815130 shutdown_connections 2023-10-16T12:58:30.379 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.372+0000 7fc87219f700 1 -- 172.21.15.124:0/2075815130 wait complete. 2023-10-16T12:58:30.382 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.373+0000 7fc87219f700 1 Processor -- start 2023-10-16T12:58:30.382 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.373+0000 7fc87219f700 1 -- start start 2023-10-16T12:58:30.382 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.374+0000 7fc87219f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc86c06ff50 0x7fc86c151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:30.383 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.374+0000 7fc87219f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc86c072180 0x7fc86c0c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:30.383 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.374+0000 7fc87219f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc86c15dc50 0x7fc86c0cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:30.383 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.374+0000 7fc87219f700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c151f60 con 0x7fc86c072180 2023-10-16T12:58:30.383 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.374+0000 7fc87219f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c15efc0 con 0x7fc86c06ff50 2023-10-16T12:58:30.383 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.374+0000 7fc87219f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c15f2a0 con 0x7fc86c15dc50 2023-10-16T12:58:30.383 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.374+0000 7fc86affd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc86c072180 0x7fc86c0c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:30.384 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.374+0000 7fc86affd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc86c072180 0x7fc86c0c5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52504/0 (socket says 172.21.15.124:52504) 2023-10-16T12:58:30.384 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.374+0000 7fc86affd700 1 -- 172.21.15.124:0/3360643466 learned_addr learned my addr 172.21.15.124:0/3360643466 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:30.384 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.374+0000 7fc86b7fe700 1 --2- 172.21.15.124:0/3360643466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc86c06ff50 0x7fc86c151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:30.384 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.374+0000 7fc86bfff700 1 --2- 172.21.15.124:0/3360643466 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc86c15dc50 0x7fc86c0cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:30.384 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.374+0000 7fc86affd700 1 -- 172.21.15.124:0/3360643466 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc86c15dc50 msgr2=0x7fc86c0cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:30.385 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.374+0000 7fc86affd700 1 --2- 172.21.15.124:0/3360643466 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc86c15dc50 0x7fc86c0cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:30.385 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.374+0000 7fc86affd700 1 -- 172.21.15.124:0/3360643466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc86c06ff50 msgr2=0x7fc86c151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:30.385 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.374+0000 7fc86affd700 1 --2- 172.21.15.124:0/3360643466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc86c06ff50 0x7fc86c151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:30.385 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.374+0000 7fc86affd700 1 -- 172.21.15.124:0/3360643466 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc860009550 con 0x7fc86c072180 2023-10-16T12:58:30.385 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.374+0000 7fc86affd700 1 --2- 172.21.15.124:0/3360643466 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc86c072180 0x7fc86c0c5d40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc860000c00 tx=0x7fc860004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:30.386 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.374+0000 7fc853fff700 1 -- 172.21.15.124:0/3360643466 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8600036a0 con 0x7fc86c072180 2023-10-16T12:58:30.386 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.374+0000 7fc853fff700 1 -- 172.21.15.124:0/3360643466 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc860003800 con 0x7fc86c072180 2023-10-16T12:58:30.386 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.374+0000 7fc87219f700 1 -- 172.21.15.124:0/3360643466 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc86c15f580 con 0x7fc86c072180 2023-10-16T12:58:30.386 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.374+0000 7fc853fff700 1 -- 172.21.15.124:0/3360643466 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc860003bb0 con 0x7fc86c072180 2023-10-16T12:58:30.386 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.374+0000 7fc87219f700 1 -- 172.21.15.124:0/3360643466 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86c15fb40 con 0x7fc86c072180 2023-10-16T12:58:30.386 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.375+0000 7fc853fff700 1 -- 172.21.15.124:0/3360643466 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc860021070 con 0x7fc86c072180 2023-10-16T12:58:30.387 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.375+0000 7fc853fff700 1 -- 172.21.15.124:0/3360643466 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fc860003d10 con 0x7fc86c072180 2023-10-16T12:58:30.387 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.375+0000 7fc87219f700 1 -- 172.21.15.124:0/3360643466 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc86c0c3bb0 con 0x7fc86c072180 2023-10-16T12:58:30.387 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.377+0000 7fc853fff700 1 -- 172.21.15.124:0/3360643466 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc860029020 con 0x7fc86c072180 2023-10-16T12:58:30.419 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:30.417+0000 7f5e5dacd200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-16T12:58:30.449 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.447+0000 7fc87219f700 1 -- 172.21.15.124:0/3360643466 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc86c0ce680 con 0x7fc86c072180 2023-10-16T12:58:30.450 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.447+0000 7fc853fff700 1 -- 172.21.15.124:0/3360643466 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fc860015020 con 0x7fc86c072180 2023-10-16T12:58:30.450 INFO:teuthology.misc.health.smithi124.stdout: 2023-10-16T12:58:30.451 INFO:teuthology.misc.health.smithi124.stdout:{"epoch":10,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:58:29.146912+0000","last_up_change":"0.000000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:58:30.451 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.448+0000 7fc87219f700 1 -- 172.21.15.124:0/3360643466 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc86c072180 msgr2=0x7fc86c0c5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:30.452 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.448+0000 7fc87219f700 1 --2- 172.21.15.124:0/3360643466 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc86c072180 0x7fc86c0c5d40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc860000c00 tx=0x7fc860004750 comp rx=0 tx=0).stop 2023-10-16T12:58:30.452 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.448+0000 7fc87219f700 1 -- 172.21.15.124:0/3360643466 shutdown_connections 2023-10-16T12:58:30.452 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.448+0000 7fc87219f700 1 --2- 172.21.15.124:0/3360643466 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc86c15dc50 0x7fc86c0cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:30.452 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.448+0000 7fc87219f700 1 --2- 172.21.15.124:0/3360643466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc86c06ff50 0x7fc86c151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:30.452 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.448+0000 7fc87219f700 1 --2- 172.21.15.124:0/3360643466 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc86c072180 0x7fc86c0c5d40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:30.453 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.448+0000 7fc87219f700 1 -- 172.21.15.124:0/3360643466 >> 172.21.15.124:0/3360643466 conn(0x7fc86c0b1db0 msgr2=0x7fc86c0b2190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:30.453 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.448+0000 7fc87219f700 1 -- 172.21.15.124:0/3360643466 shutdown_connections 2023-10-16T12:58:30.453 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:30.448+0000 7fc87219f700 1 -- 172.21.15.124:0/3360643466 wait complete. 2023-10-16T12:58:30.461 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-16T12:58:30.527 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:30.524+0000 7f346ca1c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-16T12:58:30.653 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:30.650+0000 7f5e5dacd200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-16T12:58:30.738 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:30.736+0000 7f346ca1c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-16T12:58:30.868 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:30.865+0000 7f5e5dacd200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-16T12:58:30.869 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:30.866+0000 7f346ca1c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-16T12:58:31.003 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:31.000+0000 7f5e5dacd200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-16T12:58:31.089 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:31.086+0000 7f346ca1c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-16T12:58:31.221 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:31.219+0000 7f5e5dacd200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-16T12:58:31.245 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:31.243+0000 7f346ca1c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-16T12:58:31.359 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:31.357+0000 7f346ca1c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-16T12:58:31.377 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:31.374+0000 7f5e5dacd200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-16T12:58:31.493 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:31.490+0000 7f5e5dacd200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-16T12:58:31.679 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:31.677+0000 7f346ca1c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-16T12:58:31.780 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:31.777+0000 7f346ca1c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-16T12:58:31.820 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:31.818+0000 7f5e5dacd200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-16T12:58:31.919 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:31.917+0000 7f5e5dacd200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-16T12:58:31.965 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:31.962+0000 7f346ca1c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-16T12:58:32.106 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:32.104+0000 7f5e5dacd200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-16T12:58:32.595 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:32.592+0000 7f346ca1c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-16T12:58:32.803 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-16T12:58:32.801+0000 7f5e5dacd200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-16T12:58:33.298 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T12:58:33.295+0000 7f18ff961640 -1 osd.0 0 log_to_monitors true 2023-10-16T12:58:33.337 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T12:58:33.335+0000 7f470db78640 -1 osd.1 0 log_to_monitors true 2023-10-16T12:58:33.341 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T12:58:33.338+0000 7f948bb0a640 -1 osd.3 0 log_to_monitors true 2023-10-16T12:58:33.347 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T12:58:33.345+0000 7f3e3aeb5640 -1 osd.2 0 log_to_monitors true 2023-10-16T12:58:33.366 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T12:58:33.363+0000 7f432dbeb640 -1 osd.4 0 log_to_monitors true 2023-10-16T12:58:33.380 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T12:58:33.378+0000 7ff267b15640 -1 osd.5 0 log_to_monitors true 2023-10-16T12:58:33.395 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T12:58:33.393+0000 7f5b6ccce640 -1 osd.7 0 log_to_monitors true 2023-10-16T12:58:33.428 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T12:58:33.425+0000 7f95ba8be640 -1 osd.6 0 log_to_monitors true 2023-10-16T12:58:33.621 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:33.618+0000 7f34249aa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-16T12:58:33.622 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T12:58:33.620+0000 7f34249aa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-16T12:58:36.704 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T12:58:36.700+0000 7f4321fa3700 -1 osd.4 0 waiting for initial osdmap 2023-10-16T12:58:36.718 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T12:58:36.716+0000 7f95aec76700 -1 osd.6 0 waiting for initial osdmap 2023-10-16T12:58:36.721 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T12:58:36.719+0000 7f95a6850700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T12:58:36.723 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T12:58:36.721+0000 7f4319b7d700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T12:58:36.726 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T12:58:36.724+0000 7ff25becd700 -1 osd.5 0 waiting for initial osdmap 2023-10-16T12:58:36.736 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T12:58:36.733+0000 7f3e2f26d700 -1 osd.2 0 waiting for initial osdmap 2023-10-16T12:58:36.737 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T12:58:36.735+0000 7f947fec2700 -1 osd.3 0 waiting for initial osdmap 2023-10-16T12:58:36.738 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T12:58:36.736+0000 7ff253aa7700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T12:58:36.744 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T12:58:36.742+0000 7f5b61086700 -1 osd.7 0 waiting for initial osdmap 2023-10-16T12:58:36.746 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T12:58:36.743+0000 7f18f3d19700 -1 osd.0 0 waiting for initial osdmap 2023-10-16T12:58:36.755 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T12:58:36.753+0000 7f9477a9c700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T12:58:36.755 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T12:58:36.753+0000 7f3e26e47700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T12:58:36.758 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T12:58:36.756+0000 7f5b58c60700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T12:58:36.759 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T12:58:36.757+0000 7f18eb8f3700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T12:58:37.023 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T12:58:37.021+0000 7f4701f30700 -1 osd.1 0 waiting for initial osdmap 2023-10-16T12:58:37.037 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T12:58:37.035+0000 7f46f9b0a700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T12:58:37.267 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-16T12:58:37.378 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.376+0000 7f40aea98700 1 Processor -- start 2023-10-16T12:58:37.379 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.376+0000 7f40aea98700 1 -- start start 2023-10-16T12:58:37.380 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.377+0000 7f40aea98700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f40a80ce4a0 0x7f40a81685f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:37.381 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.377+0000 7f40aea98700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a80d1330 con 0x7f40a8157ba0 2023-10-16T12:58:37.381 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.377+0000 7f40aea98700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a80d1610 con 0x7f40a80d0eb0 2023-10-16T12:58:37.381 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.377+0000 7f40aea98700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a80d1fb0 con 0x7f40a80ce4a0 2023-10-16T12:58:37.381 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.377+0000 7f40ad035700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f40a80ce4a0 0x7f40a81685f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:37.381 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.377+0000 7f40ac834700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f40a8157ba0 0x7f40a815e6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:41270/0 (socket says 172.21.15.124:41270) 2023-10-16T12:58:37.381 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.377+0000 7f40ac834700 1 -- 172.21.15.124:0/1236740589 learned_addr learned my addr 172.21.15.124:0/1236740589 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:58:37.382 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.377+0000 7f40ad035700 1 -- 172.21.15.124:0/1236740589 >> v1:172.21.15.192:6789/0 conn(0x7f40a80d0eb0 legacy=0x7f40a80cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:37.382 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.377+0000 7f40ad035700 1 -- 172.21.15.124:0/1236740589 >> v1:172.21.15.124:6789/0 conn(0x7f40a8157ba0 legacy=0x7f40a815e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:37.382 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.377+0000 7f40ad035700 1 -- 172.21.15.124:0/1236740589 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a80d18f0 con 0x7f40a80ce4a0 2023-10-16T12:58:37.382 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.377+0000 7f40a77fe700 1 -- 172.21.15.124:0/1236740589 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316510534 0 0) 0x7f40a80d1330 con 0x7f40a8157ba0 2023-10-16T12:58:37.383 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.377+0000 7f40ad035700 1 --2- 172.21.15.124:0/1236740589 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40a80ce4a0 0x7f40a81685f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009d90 tx=0x7f40a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27399c40d19cd7ad server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:37.383 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.377+0000 7f40a77fe700 1 -- 172.21.15.124:0/1236740589 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a000e070 con 0x7f40a80ce4a0 2023-10-16T12:58:37.383 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.377+0000 7f40a77fe700 1 -- 172.21.15.124:0/1236740589 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a000bb90 con 0x7f40a80ce4a0 2023-10-16T12:58:37.383 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.377+0000 7f40a77fe700 1 -- 172.21.15.124:0/1236740589 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a0003a20 con 0x7f40a80ce4a0 2023-10-16T12:58:37.383 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.378+0000 7f40aea98700 1 -- 172.21.15.124:0/1236740589 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40a80ce4a0 msgr2=0x7f40a81685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:37.383 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.378+0000 7f40aea98700 1 --2- 172.21.15.124:0/1236740589 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40a80ce4a0 0x7f40a81685f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009d90 tx=0x7f40a000b330 comp rx=0 tx=0).stop 2023-10-16T12:58:37.384 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.378+0000 7f40aea98700 1 -- 172.21.15.124:0/1236740589 shutdown_connections 2023-10-16T12:58:37.384 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.378+0000 7f40aea98700 1 --2- 172.21.15.124:0/1236740589 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40a80ce4a0 0x7f40a81685f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:37.384 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.378+0000 7f40aea98700 1 -- 172.21.15.124:0/1236740589 >> 172.21.15.124:0/1236740589 conn(0x7f40a806a820 msgr2=0x7f40a806ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:37.384 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.378+0000 7f40aea98700 1 -- 172.21.15.124:0/1236740589 shutdown_connections 2023-10-16T12:58:37.384 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.378+0000 7f40aea98700 1 -- 172.21.15.124:0/1236740589 wait complete. 2023-10-16T12:58:37.387 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.380+0000 7f40aea98700 1 Processor -- start 2023-10-16T12:58:37.387 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.380+0000 7f40aea98700 1 -- start start 2023-10-16T12:58:37.387 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.381+0000 7f40aea98700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40a80ce4a0 0x7f40a81508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:37.387 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.381+0000 7f40aea98700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40a80d0eb0 0x7f40a81f3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:37.388 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.381+0000 7f40aea98700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40a8157ba0 0x7f40a80c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:37.388 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.381+0000 7f40aea98700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a81f41a0 con 0x7f40a80d0eb0 2023-10-16T12:58:37.388 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.381+0000 7f40aea98700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a81f4300 con 0x7f40a8157ba0 2023-10-16T12:58:37.388 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.381+0000 7f40aea98700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a8150e30 con 0x7f40a80ce4a0 2023-10-16T12:58:37.388 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.381+0000 7f40a7fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40a80d0eb0 0x7f40a81f3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:37.389 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.381+0000 7f40a7fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40a80d0eb0 0x7f40a81f3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52610/0 (socket says 172.21.15.124:52610) 2023-10-16T12:58:37.389 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.381+0000 7f40a7fff700 1 -- 172.21.15.124:0/3579784256 learned_addr learned my addr 172.21.15.124:0/3579784256 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:37.389 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.381+0000 7f40ac834700 1 --2- 172.21.15.124:0/3579784256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40a80ce4a0 0x7f40a81508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:37.389 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.381+0000 7f40a7fff700 1 -- 172.21.15.124:0/3579784256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40a80ce4a0 msgr2=0x7f40a81508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:37.389 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.381+0000 7f40a7fff700 1 --2- 172.21.15.124:0/3579784256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40a80ce4a0 0x7f40a81508f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:37.390 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.381+0000 7f40ad035700 1 --2- 172.21.15.124:0/3579784256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40a8157ba0 0x7f40a80c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:37.390 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.381+0000 7f40a7fff700 1 -- 172.21.15.124:0/3579784256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40a8157ba0 msgr2=0x7f40a80c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:37.390 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.381+0000 7f40a7fff700 1 --2- 172.21.15.124:0/3579784256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40a8157ba0 0x7f40a80c64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:37.390 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.381+0000 7f40a7fff700 1 -- 172.21.15.124:0/3579784256 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a0009a70 con 0x7f40a80d0eb0 2023-10-16T12:58:37.390 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.381+0000 7f40a7fff700 1 --2- 172.21.15.124:0/3579784256 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40a80d0eb0 0x7f40a81f3150 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f409400c500 tx=0x7f409400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:37.391 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.381+0000 7f40a57fa700 1 -- 172.21.15.124:0/3579784256 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4094011790 con 0x7f40a80d0eb0 2023-10-16T12:58:37.391 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.381+0000 7f40a57fa700 1 -- 172.21.15.124:0/3579784256 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40940118f0 con 0x7f40a80d0eb0 2023-10-16T12:58:37.391 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.381+0000 7f40aea98700 1 -- 172.21.15.124:0/3579784256 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a81f3be0 con 0x7f40a80d0eb0 2023-10-16T12:58:37.391 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.381+0000 7f40a57fa700 1 -- 172.21.15.124:0/3579784256 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4094011ca0 con 0x7f40a80d0eb0 2023-10-16T12:58:37.391 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.381+0000 7f40aea98700 1 -- 172.21.15.124:0/3579784256 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a80b5130 con 0x7f40a80d0eb0 2023-10-16T12:58:37.392 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.382+0000 7f40aea98700 1 -- 172.21.15.124:0/3579784256 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a80b4f90 con 0x7f40a80d0eb0 2023-10-16T12:58:37.392 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.383+0000 7f40a57fa700 1 -- 172.21.15.124:0/3579784256 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f409401c460 con 0x7f40a80d0eb0 2023-10-16T12:58:37.392 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.384+0000 7f40a57fa700 1 --2- 172.21.15.124:0/3579784256 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f408c06ae70 0x7f408c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:37.392 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.384+0000 7f40a57fa700 1 -- 172.21.15.124:0/3579784256 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f4094088dd0 con 0x7f40a80d0eb0 2023-10-16T12:58:37.392 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.384+0000 7f40ac834700 1 --2- 172.21.15.124:0/3579784256 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f408c06ae70 0x7f408c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:37.392 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.384+0000 7f40ac834700 1 --2- 172.21.15.124:0/3579784256 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f408c06ae70 0x7f408c06d330 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f409c000f60 tx=0x7f409c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:37.393 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.388+0000 7f40a57fa700 1 -- 172.21.15.124:0/3579784256 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4094054e60 con 0x7f40a80d0eb0 2023-10-16T12:58:37.583 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.581+0000 7f40aea98700 1 -- 172.21.15.124:0/3579784256 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40a80b4f90 con 0x7f40a80d0eb0 2023-10-16T12:58:37.584 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.581+0000 7f40a57fa700 1 -- 172.21.15.124:0/3579784256 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f40a80b4f90 con 0x7f40a80d0eb0 2023-10-16T12:58:37.584 INFO:teuthology.misc.health.smithi124.stdout: 2023-10-16T12:58:37.585 INFO:teuthology.misc.health.smithi124.stdout:{"epoch":12,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:58:34.685448+0000","last_up_change":"0.000000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:58:37.586 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.583+0000 7f40aea98700 1 -- 172.21.15.124:0/3579784256 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f408c06ae70 msgr2=0x7f408c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:37.587 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.583+0000 7f40aea98700 1 --2- 172.21.15.124:0/3579784256 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f408c06ae70 0x7f408c06d330 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f409c000f60 tx=0x7f409c009040 comp rx=0 tx=0).stop 2023-10-16T12:58:37.587 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.583+0000 7f40aea98700 1 -- 172.21.15.124:0/3579784256 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40a80d0eb0 msgr2=0x7f40a81f3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:37.587 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.583+0000 7f40aea98700 1 --2- 172.21.15.124:0/3579784256 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40a80d0eb0 0x7f40a81f3150 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f409400c500 tx=0x7f409400c8c0 comp rx=0 tx=0).stop 2023-10-16T12:58:37.587 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.584+0000 7f40aea98700 1 -- 172.21.15.124:0/3579784256 shutdown_connections 2023-10-16T12:58:37.587 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.584+0000 7f40aea98700 1 --2- 172.21.15.124:0/3579784256 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f408c06ae70 0x7f408c06d330 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:37.588 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.584+0000 7f40aea98700 1 --2- 172.21.15.124:0/3579784256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40a8157ba0 0x7f40a80c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:37.588 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.584+0000 7f40aea98700 1 --2- 172.21.15.124:0/3579784256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40a80ce4a0 0x7f40a81508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:37.588 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.584+0000 7f40aea98700 1 --2- 172.21.15.124:0/3579784256 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40a80d0eb0 0x7f40a81f3150 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:37.588 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.584+0000 7f40aea98700 1 -- 172.21.15.124:0/3579784256 >> 172.21.15.124:0/3579784256 conn(0x7f40a806a820 msgr2=0x7f40a806cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:37.588 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.584+0000 7f40aea98700 1 -- 172.21.15.124:0/3579784256 shutdown_connections 2023-10-16T12:58:37.588 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:37.584+0000 7f40aea98700 1 -- 172.21.15.124:0/3579784256 wait complete. 2023-10-16T12:58:37.597 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-16T12:58:44.403 DEBUG:teuthology.orchestra.run.smithi124:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-16T12:58:44.523 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.520+0000 7f32de7aa700 1 Processor -- start 2023-10-16T12:58:44.523 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.520+0000 7f32de7aa700 1 -- start start 2023-10-16T12:58:44.526 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.521+0000 7f32de7aa700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f32d815a800 0x7f32d80717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:44.526 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.521+0000 7f32de7aa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32d80728f0 0x7f32d8071cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:44.526 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.521+0000 7f32de7aa700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f32d815e460 0x7f32d806ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:44.526 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.521+0000 7f32de7aa700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32d80cb980 con 0x7f32d815a800 2023-10-16T12:58:44.527 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.521+0000 7f32de7aa700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32d80cbc20 con 0x7f32d815e460 2023-10-16T12:58:44.527 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.521+0000 7f32de7aa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d80cbec0 con 0x7f32d80728f0 2023-10-16T12:58:44.527 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.521+0000 7f32d7fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f32d815a800 0x7f32d80717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:44.527 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.521+0000 7f32d7fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f32d815a800 0x7f32d80717b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52840/0 (socket says 172.21.15.124:52840) 2023-10-16T12:58:44.527 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.521+0000 7f32d7fff700 1 -- 172.21.15.124:0/117688915 learned_addr learned my addr 172.21.15.124:0/117688915 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:44.527 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.522+0000 7f32d77fe700 1 --2- 172.21.15.124:0/117688915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32d80728f0 0x7f32d8071cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:44.528 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.522+0000 7f32dcd47700 1 --2- 172.21.15.124:0/117688915 >> v2:172.21.15.192:3300/0 conn(0x7f32d815e460 0x7f32d806ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:44.528 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.522+0000 7f32d7fff700 1 -- 172.21.15.124:0/117688915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32d80728f0 msgr2=0x7f32d8071cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:44.528 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.522+0000 7f32d7fff700 1 --2- 172.21.15.124:0/117688915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32d80728f0 0x7f32d8071cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:44.528 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.522+0000 7f32d7fff700 1 -- 172.21.15.124:0/117688915 >> v2:172.21.15.192:3300/0 conn(0x7f32d815e460 msgr2=0x7f32d806ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:44.528 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.522+0000 7f32d7fff700 1 --2- 172.21.15.124:0/117688915 >> v2:172.21.15.192:3300/0 conn(0x7f32d815e460 0x7f32d806ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:44.529 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.522+0000 7f32d7fff700 1 -- 172.21.15.124:0/117688915 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d80cc1a0 con 0x7f32d815a800 2023-10-16T12:58:44.529 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.522+0000 7f32d7fff700 1 --2- 172.21.15.124:0/117688915 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32d815a800 0x7f32d80717b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f32d815f480 tx=0x7f32cc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f49330fc04bbd6f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:44.529 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.522+0000 7f32d6ffd700 1 -- 172.21.15.124:0/117688915 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc00b870 con 0x7f32d815a800 2023-10-16T12:58:44.529 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.522+0000 7f32d6ffd700 1 -- 172.21.15.124:0/117688915 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32cc00b9d0 con 0x7f32d815a800 2023-10-16T12:58:44.529 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.522+0000 7f32d6ffd700 1 -- 172.21.15.124:0/117688915 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc00bd60 con 0x7f32d815a800 2023-10-16T12:58:44.530 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.522+0000 7f32de7aa700 1 -- 172.21.15.124:0/117688915 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32d815a800 msgr2=0x7f32d80717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:44.530 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.522+0000 7f32de7aa700 1 --2- 172.21.15.124:0/117688915 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32d815a800 0x7f32d80717b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f32d815f480 tx=0x7f32cc009bd0 comp rx=0 tx=0).stop 2023-10-16T12:58:44.530 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.523+0000 7f32de7aa700 1 -- 172.21.15.124:0/117688915 shutdown_connections 2023-10-16T12:58:44.530 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.523+0000 7f32de7aa700 1 --2- 172.21.15.124:0/117688915 >> v2:172.21.15.192:3300/0 conn(0x7f32d815e460 0x7f32d806ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:44.530 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.523+0000 7f32de7aa700 1 --2- 172.21.15.124:0/117688915 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32d815a800 0x7f32d80717b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:44.531 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.523+0000 7f32de7aa700 1 --2- 172.21.15.124:0/117688915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32d80728f0 0x7f32d8071cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:44.531 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.523+0000 7f32de7aa700 1 -- 172.21.15.124:0/117688915 >> 172.21.15.124:0/117688915 conn(0x7f32d80b1db0 msgr2=0x7f32d80b2190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:44.531 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.523+0000 7f32de7aa700 1 -- 172.21.15.124:0/117688915 shutdown_connections 2023-10-16T12:58:44.531 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.523+0000 7f32de7aa700 1 -- 172.21.15.124:0/117688915 wait complete. 2023-10-16T12:58:44.534 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.524+0000 7f32de7aa700 1 Processor -- start 2023-10-16T12:58:44.534 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.524+0000 7f32de7aa700 1 -- start start 2023-10-16T12:58:44.534 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.525+0000 7f32de7aa700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32d80728f0 0x7f32d81f6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:44.534 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.525+0000 7f32de7aa700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32d815a800 0x7f32d815d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:44.535 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.525+0000 7f32de7aa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32d815e460 0x7f32d81f4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:44.535 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.525+0000 7f32de7aa700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d81f3260 con 0x7f32d80728f0 2023-10-16T12:58:44.535 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.525+0000 7f32de7aa700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d815af10 con 0x7f32d815a800 2023-10-16T12:58:44.535 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.525+0000 7f32de7aa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d81f49f0 con 0x7f32d815e460 2023-10-16T12:58:44.535 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.525+0000 7f32d7fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32d80728f0 0x7f32d81f6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:44.536 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.525+0000 7f32d7fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32d80728f0 0x7f32d81f6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52844/0 (socket says 172.21.15.124:52844) 2023-10-16T12:58:44.536 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.525+0000 7f32d7fff700 1 -- 172.21.15.124:0/3729987935 learned_addr learned my addr 172.21.15.124:0/3729987935 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:44.536 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.525+0000 7f32d77fe700 1 --2- 172.21.15.124:0/3729987935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32d815a800 0x7f32d815d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:44.536 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.525+0000 7f32dcd47700 1 --2- 172.21.15.124:0/3729987935 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32d815e460 0x7f32d81f4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:44.536 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.525+0000 7f32d7fff700 1 -- 172.21.15.124:0/3729987935 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32d815e460 msgr2=0x7f32d81f4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:44.537 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.525+0000 7f32d7fff700 1 --2- 172.21.15.124:0/3729987935 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32d815e460 0x7f32d81f4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:44.537 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.525+0000 7f32d7fff700 1 -- 172.21.15.124:0/3729987935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32d815a800 msgr2=0x7f32d815d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:44.537 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.525+0000 7f32d7fff700 1 --2- 172.21.15.124:0/3729987935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32d815a800 0x7f32d815d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:44.537 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.525+0000 7f32d7fff700 1 -- 172.21.15.124:0/3729987935 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32cc009550 con 0x7f32d80728f0 2023-10-16T12:58:44.537 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.525+0000 7f32d77fe700 1 --2- 172.21.15.124:0/3729987935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32d815a800 0x7f32d815d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:58:44.537 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.525+0000 7f32d7fff700 1 --2- 172.21.15.124:0/3729987935 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32d80728f0 0x7f32d81f6740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f32cc000c00 tx=0x7f32cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:44.538 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.525+0000 7f32d4ff9700 1 -- 172.21.15.124:0/3729987935 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc004540 con 0x7f32d80728f0 2023-10-16T12:58:44.538 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.525+0000 7f32d4ff9700 1 -- 172.21.15.124:0/3729987935 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32cc0036a0 con 0x7f32d80728f0 2023-10-16T12:58:44.538 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.525+0000 7f32de7aa700 1 -- 172.21.15.124:0/3729987935 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d81f6d20 con 0x7f32d80728f0 2023-10-16T12:58:44.538 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.525+0000 7f32d4ff9700 1 -- 172.21.15.124:0/3729987935 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc003a50 con 0x7f32d80728f0 2023-10-16T12:58:44.538 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.526+0000 7f32de7aa700 1 -- 172.21.15.124:0/3729987935 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d81f72e0 con 0x7f32d80728f0 2023-10-16T12:58:44.539 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.526+0000 7f32de7aa700 1 -- 172.21.15.124:0/3729987935 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32d804ebb0 con 0x7f32d80728f0 2023-10-16T12:58:44.539 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.527+0000 7f32d4ff9700 1 -- 172.21.15.124:0/3729987935 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f32cc021070 con 0x7f32d80728f0 2023-10-16T12:58:44.539 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.527+0000 7f32d4ff9700 1 --2- 172.21.15.124:0/3729987935 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f32c406af00 0x7f32c406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:44.539 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.527+0000 7f32d77fe700 1 --2- 172.21.15.124:0/3729987935 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f32c406af00 0x7f32c406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:44.539 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.527+0000 7f32d4ff9700 1 -- 172.21.15.124:0/3729987935 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f32cc08a9f0 con 0x7f32d80728f0 2023-10-16T12:58:44.540 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.528+0000 7f32d77fe700 1 --2- 172.21.15.124:0/3729987935 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f32c406af00 0x7f32c406d3c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f32d80b07e0 tx=0x7f32c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:44.540 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.532+0000 7f32d4ff9700 1 -- 172.21.15.124:0/3729987935 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f32cc055df0 con 0x7f32d80728f0 2023-10-16T12:58:44.727 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.724+0000 7f32de7aa700 1 -- 172.21.15.124:0/3729987935 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32d80724c0 con 0x7f32d80728f0 2023-10-16T12:58:44.728 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.725+0000 7f32d4ff9700 1 -- 172.21.15.124:0/3729987935 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f32cc015020 con 0x7f32d80728f0 2023-10-16T12:58:44.728 INFO:teuthology.misc.health.smithi124.stdout: 2023-10-16T12:58:44.728 INFO:teuthology.misc.health.smithi124.stdout:{"epoch":16,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:58:41.037780+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:58:44.730 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.727+0000 7f32de7aa700 1 -- 172.21.15.124:0/3729987935 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f32c406af00 msgr2=0x7f32c406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:44.730 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.727+0000 7f32de7aa700 1 --2- 172.21.15.124:0/3729987935 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f32c406af00 0x7f32c406d3c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f32d80b07e0 tx=0x7f32c8008040 comp rx=0 tx=0).stop 2023-10-16T12:58:44.730 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.727+0000 7f32de7aa700 1 -- 172.21.15.124:0/3729987935 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32d80728f0 msgr2=0x7f32d81f6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:44.731 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.727+0000 7f32de7aa700 1 --2- 172.21.15.124:0/3729987935 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32d80728f0 0x7f32d81f6740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f32cc000c00 tx=0x7f32cc004750 comp rx=0 tx=0).stop 2023-10-16T12:58:44.731 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.727+0000 7f32de7aa700 1 -- 172.21.15.124:0/3729987935 shutdown_connections 2023-10-16T12:58:44.731 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.727+0000 7f32de7aa700 1 --2- 172.21.15.124:0/3729987935 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f32c406af00 0x7f32c406d3c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:44.731 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.727+0000 7f32de7aa700 1 --2- 172.21.15.124:0/3729987935 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32d815e460 0x7f32d81f4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:44.731 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.727+0000 7f32de7aa700 1 --2- 172.21.15.124:0/3729987935 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32d80728f0 0x7f32d81f6740 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:44.731 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.727+0000 7f32de7aa700 1 --2- 172.21.15.124:0/3729987935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32d815a800 0x7f32d815d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:44.732 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.727+0000 7f32de7aa700 1 -- 172.21.15.124:0/3729987935 >> 172.21.15.124:0/3729987935 conn(0x7f32d80b1db0 msgr2=0x7f32d815e950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:44.732 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.727+0000 7f32de7aa700 1 -- 172.21.15.124:0/3729987935 shutdown_connections 2023-10-16T12:58:44.732 INFO:teuthology.misc.health.smithi124.stderr:2023-10-16T12:58:44.727+0000 7f32de7aa700 1 -- 172.21.15.124:0/3729987935 wait complete. 2023-10-16T12:58:44.741 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-16T12:58:44.741 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-16T12:58:44.742 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-16T12:58:44.742 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-16T12:58:44.744 INFO:tasks.ceph.mds.a:Started 2023-10-16T12:58:44.745 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-16T12:58:44.745 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-16T12:58:44.747 INFO:tasks.ceph.mds.c:Started 2023-10-16T12:58:44.747 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-16T12:58:44.748 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-16T12:58:44.751 INFO:tasks.ceph.mds.b:Started 2023-10-16T12:58:44.751 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-16T12:58:44.751 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-16T12:58:44.753 INFO:tasks.ceph.mds.d:Started 2023-10-16T12:58:44.754 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-16T12:58:44.754 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:58:44.823 INFO:tasks.ceph.mds.a.smithi124.stdout:starting mds.a at 2023-10-16T12:58:44.823 INFO:tasks.ceph.mds.c.smithi124.stdout:starting mds.c at 2023-10-16T12:58:44.824 INFO:tasks.ceph.mds.c.smithi124.stderr:2023-10-16T12:58:44.821+0000 7ff3d2ad5700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-16T12:58:44.840 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-10-16T12:58:44.840 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-10-16T12:58:44.879 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.877+0000 7ff3cf6ac700 1 Processor -- start 2023-10-16T12:58:44.879 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.877+0000 7ff3cf6ac700 1 -- start start 2023-10-16T12:58:44.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.878+0000 7ff3cf6ac700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff3c80ca7d0 0x7ff3c80cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:44.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.878+0000 7ff3cf6ac700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff3c815f000 0x7ff3c815f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:44.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.878+0000 7ff3cf6ac700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c80726b0 con 0x7ff3c806a820 2023-10-16T12:58:44.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.878+0000 7ff3cf6ac700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c815ca20 con 0x7ff3c80ca7d0 2023-10-16T12:58:44.883 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.878+0000 7ff3cf6ac700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c80718f0 con 0x7ff3c815f000 2023-10-16T12:58:44.883 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.878+0000 7ff3cd448700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7ff3c806a820 0x7ff3c806ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:41548/0 (socket says 172.21.15.124:41548) 2023-10-16T12:58:44.883 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.878+0000 7ff3cd448700 1 -- 172.21.15.124:0/223567937 learned_addr learned my addr 172.21.15.124:0/223567937 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:58:44.883 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.878+0000 7ff3ccc47700 1 --2- 172.21.15.124:0/223567937 >> v2:172.21.15.124:3300/0 conn(0x7ff3c80ca7d0 0x7ff3c80cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:44.883 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.878+0000 7ff3bffff700 1 -- 172.21.15.124:0/223567937 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322325869 0 0) 0x7ff3c80726b0 con 0x7ff3c806a820 2023-10-16T12:58:44.883 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.878+0000 7ff3cdc49700 1 --2- 172.21.15.124:0/223567937 >> v2:172.21.15.192:3300/0 conn(0x7ff3c815f000 0x7ff3c815f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:44.884 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.878+0000 7ff3bffff700 1 -- 172.21.15.124:0/223567937 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3b40035b0 con 0x7ff3c806a820 2023-10-16T12:58:44.884 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.878+0000 7ff3ccc47700 1 -- 172.21.15.124:0/223567937 >> v2:172.21.15.192:3300/0 conn(0x7ff3c815f000 msgr2=0x7ff3c815f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:44.884 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.878+0000 7ff3ccc47700 1 --2- 172.21.15.124:0/223567937 >> v2:172.21.15.192:3300/0 conn(0x7ff3c815f000 0x7ff3c815f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:44.884 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.878+0000 7ff3ccc47700 1 -- 172.21.15.124:0/223567937 >> v1:172.21.15.124:6789/0 conn(0x7ff3c806a820 legacy=0x7ff3c806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:44.884 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.878+0000 7ff3ccc47700 1 -- 172.21.15.124:0/223567937 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c8071bd0 con 0x7ff3c80ca7d0 2023-10-16T12:58:44.884 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.879+0000 7ff3ccc47700 1 --2- 172.21.15.124:0/223567937 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3c80ca7d0 0x7ff3c80cc310 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80717e0 tx=0x7ff3b8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9a74d2a271954a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:44.885 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.879+0000 7ff3bffff700 1 -- 172.21.15.124:0/223567937 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8011830 con 0x7ff3c80ca7d0 2023-10-16T12:58:44.885 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.879+0000 7ff3bffff700 1 -- 172.21.15.124:0/223567937 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b8011990 con 0x7ff3c80ca7d0 2023-10-16T12:58:44.885 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.879+0000 7ff3bffff700 1 -- 172.21.15.124:0/223567937 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8011d20 con 0x7ff3c80ca7d0 2023-10-16T12:58:44.885 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.879+0000 7ff3cf6ac700 1 -- 172.21.15.124:0/223567937 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3c80ca7d0 msgr2=0x7ff3c80cc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:44.885 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.879+0000 7ff3cf6ac700 1 --2- 172.21.15.124:0/223567937 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3c80ca7d0 0x7ff3c80cc310 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80717e0 tx=0x7ff3b8009b20 comp rx=0 tx=0).stop 2023-10-16T12:58:44.886 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.879+0000 7ff3cf6ac700 1 -- 172.21.15.124:0/223567937 shutdown_connections 2023-10-16T12:58:44.886 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.879+0000 7ff3cf6ac700 1 --2- 172.21.15.124:0/223567937 >> v2:172.21.15.192:3300/0 conn(0x7ff3c815f000 0x7ff3c815f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:44.886 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.879+0000 7ff3cf6ac700 1 --2- 172.21.15.124:0/223567937 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3c80ca7d0 0x7ff3c80cc310 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:44.886 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.879+0000 7ff3cf6ac700 1 -- 172.21.15.124:0/223567937 >> 172.21.15.124:0/223567937 conn(0x7ff3c80d0180 msgr2=0x7ff3c80d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:44.886 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.879+0000 7ff3cf6ac700 1 -- 172.21.15.124:0/223567937 shutdown_connections 2023-10-16T12:58:44.887 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.879+0000 7ff3cf6ac700 1 -- 172.21.15.124:0/223567937 wait complete. 2023-10-16T12:58:44.889 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.880+0000 7ff3cf6ac700 1 Processor -- start 2023-10-16T12:58:44.889 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.881+0000 7ff3cf6ac700 1 -- start start 2023-10-16T12:58:44.889 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.881+0000 7ff3cf6ac700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3c806a820 0x7ff3c81f0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:44.890 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.881+0000 7ff3cf6ac700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3c80ca7d0 0x7ff3c80c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:44.890 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.881+0000 7ff3cf6ac700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3c815f000 0x7ff3c80c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:44.890 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.881+0000 7ff3cf6ac700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c81f1080 con 0x7ff3c806a820 2023-10-16T12:58:44.890 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.881+0000 7ff3cf6ac700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c80b4560 con 0x7ff3c80ca7d0 2023-10-16T12:58:44.890 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.881+0000 7ff3cf6ac700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c80b53c0 con 0x7ff3c815f000 2023-10-16T12:58:44.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.881+0000 7ff3cd448700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3c806a820 0x7ff3c81f0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:44.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.881+0000 7ff3cd448700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3c806a820 0x7ff3c81f0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52886/0 (socket says 172.21.15.124:52886) 2023-10-16T12:58:44.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.881+0000 7ff3cd448700 1 -- 172.21.15.124:0/673791404 learned_addr learned my addr 172.21.15.124:0/673791404 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:44.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.881+0000 7ff3ccc47700 1 --2- 172.21.15.124:0/673791404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3c80ca7d0 0x7ff3c80c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:44.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.882+0000 7ff3cdc49700 1 --2- 172.21.15.124:0/673791404 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3c815f000 0x7ff3c80c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:44.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.882+0000 7ff3cd448700 1 -- 172.21.15.124:0/673791404 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3c815f000 msgr2=0x7ff3c80c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:44.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.882+0000 7ff3cd448700 1 --2- 172.21.15.124:0/673791404 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3c815f000 0x7ff3c80c5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:44.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.882+0000 7ff3cd448700 1 -- 172.21.15.124:0/673791404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3c80ca7d0 msgr2=0x7ff3c80c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:44.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.882+0000 7ff3cd448700 1 --2- 172.21.15.124:0/673791404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3c80ca7d0 0x7ff3c80c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:44.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.882+0000 7ff3cd448700 1 -- 172.21.15.124:0/673791404 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b80094a0 con 0x7ff3c806a820 2023-10-16T12:58:44.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.882+0000 7ff3ccc47700 1 --2- 172.21.15.124:0/673791404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3c80ca7d0 0x7ff3c80c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:58:44.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.882+0000 7ff3cd448700 1 --2- 172.21.15.124:0/673791404 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3c806a820 0x7ff3c81f0b40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400c700 tx=0x7ff3c400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:44.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.882+0000 7ff3bdffb700 1 -- 172.21.15.124:0/673791404 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4005d70 con 0x7ff3c806a820 2023-10-16T12:58:44.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.882+0000 7ff3bdffb700 1 -- 172.21.15.124:0/673791404 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c40070d0 con 0x7ff3c806a820 2023-10-16T12:58:44.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.882+0000 7ff3cf6ac700 1 -- 172.21.15.124:0/673791404 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c80c8e60 con 0x7ff3c806a820 2023-10-16T12:58:44.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.882+0000 7ff3bdffb700 1 -- 172.21.15.124:0/673791404 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4007460 con 0x7ff3c806a820 2023-10-16T12:58:44.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.882+0000 7ff3cf6ac700 1 -- 172.21.15.124:0/673791404 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c80b4a90 con 0x7ff3c806a820 2023-10-16T12:58:44.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.883+0000 7ff3cf6ac700 1 -- 172.21.15.124:0/673791404 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c8067d10 con 0x7ff3c806a820 2023-10-16T12:58:44.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.883+0000 7ff3bdffb700 1 -- 172.21.15.124:0/673791404 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff3c40075c0 con 0x7ff3c806a820 2023-10-16T12:58:44.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.884+0000 7ff3bdffb700 1 --2- 172.21.15.124:0/673791404 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff3ac06af00 0x7ff3ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:44.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.884+0000 7ff3bdffb700 1 -- 172.21.15.124:0/673791404 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff3c4088860 con 0x7ff3c806a820 2023-10-16T12:58:44.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.884+0000 7ff3ccc47700 1 --2- 172.21.15.124:0/673791404 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff3ac06af00 0x7ff3ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:44.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.884+0000 7ff3ccc47700 1 --2- 172.21.15.124:0/673791404 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff3ac06af00 0x7ff3ac06d3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff3b80090b0 tx=0x7ff3b8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:44.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:44.888+0000 7ff3bdffb700 1 -- 172.21.15.124:0/673791404 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff3c4053c70 con 0x7ff3c806a820 2023-10-16T12:58:45.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.076+0000 7ff3cf6ac700 1 -- 172.21.15.124:0/673791404 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3c804ebb0 con 0x7ff3c806a820 2023-10-16T12:58:45.080 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.077+0000 7ff3bdffb700 1 -- 172.21.15.124:0/673791404 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12850 (secure 0 0 0) 0x7ff3c4057290 con 0x7ff3c806a820 2023-10-16T12:58:45.080 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:58:45.080 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":16,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:58:41.037780+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:58:45.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.079+0000 7ff3cf6ac700 1 -- 172.21.15.124:0/673791404 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff3ac06af00 msgr2=0x7ff3ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:45.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.079+0000 7ff3cf6ac700 1 --2- 172.21.15.124:0/673791404 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff3ac06af00 0x7ff3ac06d3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff3b80090b0 tx=0x7ff3b8008030 comp rx=0 tx=0).stop 2023-10-16T12:58:45.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.079+0000 7ff3cf6ac700 1 -- 172.21.15.124:0/673791404 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3c806a820 msgr2=0x7ff3c81f0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:45.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.079+0000 7ff3cf6ac700 1 --2- 172.21.15.124:0/673791404 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3c806a820 0x7ff3c81f0b40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400c700 tx=0x7ff3c400cac0 comp rx=0 tx=0).stop 2023-10-16T12:58:45.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.080+0000 7ff3cf6ac700 1 -- 172.21.15.124:0/673791404 shutdown_connections 2023-10-16T12:58:45.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.080+0000 7ff3cf6ac700 1 --2- 172.21.15.124:0/673791404 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff3ac06af00 0x7ff3ac06d3c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:45.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.080+0000 7ff3cf6ac700 1 --2- 172.21.15.124:0/673791404 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3c815f000 0x7ff3c80c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:45.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.080+0000 7ff3cf6ac700 1 --2- 172.21.15.124:0/673791404 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3c806a820 0x7ff3c81f0b40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:45.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.080+0000 7ff3cf6ac700 1 --2- 172.21.15.124:0/673791404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3c80ca7d0 0x7ff3c80c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:45.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.080+0000 7ff3cf6ac700 1 -- 172.21.15.124:0/673791404 >> 172.21.15.124:0/673791404 conn(0x7ff3c80d0180 msgr2=0x7ff3c815d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:45.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.080+0000 7ff3cf6ac700 1 -- 172.21.15.124:0/673791404 shutdown_connections 2023-10-16T12:58:45.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.080+0000 7ff3cf6ac700 1 -- 172.21.15.124:0/673791404 wait complete. 2023-10-16T12:58:45.094 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T12:58:38.667813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T12:58:45.095 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T12:58:45.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.214+0000 7f36cfb53700 1 Processor -- start 2023-10-16T12:58:45.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.214+0000 7f36cfb53700 1 -- start start 2023-10-16T12:58:45.219 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.215+0000 7f36cfb53700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f36c80cdbd0 0x7f36c806af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:45.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.215+0000 7f36cfb53700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36c815d960 0x7f36c806b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:45.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.215+0000 7f36cfb53700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36c806a820 con 0x7f36c815d580 2023-10-16T12:58:45.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.215+0000 7f36cfb53700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c8066cd0 con 0x7f36c80cdbd0 2023-10-16T12:58:45.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.215+0000 7f36cfb53700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c806d490 con 0x7f36c815d960 2023-10-16T12:58:45.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.216+0000 7f36cd0ee700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f36c80cdbd0 0x7f36c806af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:45.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.216+0000 7f36ce0f0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36c815d960 0x7f36c806b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:45.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.216+0000 7f36cd8ef700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f36c815d580 0x7f36c80cd4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.124:53558/0 (socket says 172.21.15.124:53558) 2023-10-16T12:58:45.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.216+0000 7f36cd8ef700 1 -- 172.21.15.124:0/1133632977 learned_addr learned my addr 172.21.15.124:0/1133632977 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:58:45.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.216+0000 7f36cc8ed700 1 -- 172.21.15.124:0/1133632977 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2911593561 0 0) 0x7f36c806a820 con 0x7f36c815d580 2023-10-16T12:58:45.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.216+0000 7f36cc8ed700 1 -- 172.21.15.124:0/1133632977 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36b40035b0 con 0x7f36c815d580 2023-10-16T12:58:45.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.216+0000 7f36cd0ee700 1 -- 172.21.15.124:0/1133632977 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36c815d960 msgr2=0x7f36c806b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:45.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.216+0000 7f36cd0ee700 1 --2- 172.21.15.124:0/1133632977 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36c815d960 0x7f36c806b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:45.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.216+0000 7f36cd0ee700 1 -- 172.21.15.124:0/1133632977 >> v1:172.21.15.192:6789/0 conn(0x7f36c815d580 legacy=0x7f36c80cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:45.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.216+0000 7f36cd0ee700 1 -- 172.21.15.124:0/1133632977 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c806d770 con 0x7f36c80cdbd0 2023-10-16T12:58:45.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.216+0000 7f36ce0f0700 1 --2- 172.21.15.124:0/1133632977 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36c815d960 0x7f36c806b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:58:45.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.216+0000 7f36cd0ee700 1 --2- 172.21.15.124:0/1133632977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36c80cdbd0 0x7f36c806af90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f36c4009840 tx=0x7f36c4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40ffe16d3a5339c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:45.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.216+0000 7f36cc8ed700 1 -- 172.21.15.124:0/1133632977 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c4011830 con 0x7f36c80cdbd0 2023-10-16T12:58:45.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.216+0000 7f36cc8ed700 1 -- 172.21.15.124:0/1133632977 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c4011990 con 0x7f36c80cdbd0 2023-10-16T12:58:45.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.216+0000 7f36cc8ed700 1 -- 172.21.15.124:0/1133632977 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c4011d20 con 0x7f36c80cdbd0 2023-10-16T12:58:45.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.217+0000 7f36cfb53700 1 -- 172.21.15.124:0/1133632977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36c80cdbd0 msgr2=0x7f36c806af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:45.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.217+0000 7f36cfb53700 1 --2- 172.21.15.124:0/1133632977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36c80cdbd0 0x7f36c806af90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f36c4009840 tx=0x7f36c4009b50 comp rx=0 tx=0).stop 2023-10-16T12:58:45.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.217+0000 7f36cfb53700 1 -- 172.21.15.124:0/1133632977 shutdown_connections 2023-10-16T12:58:45.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.217+0000 7f36cfb53700 1 --2- 172.21.15.124:0/1133632977 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36c815d960 0x7f36c806b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:45.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.217+0000 7f36cfb53700 1 --2- 172.21.15.124:0/1133632977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36c80cdbd0 0x7f36c806af90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:45.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.217+0000 7f36cfb53700 1 -- 172.21.15.124:0/1133632977 >> 172.21.15.124:0/1133632977 conn(0x7f36c80b13e0 msgr2=0x7f36c80b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:45.225 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.217+0000 7f36cfb53700 1 -- 172.21.15.124:0/1133632977 shutdown_connections 2023-10-16T12:58:45.225 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.217+0000 7f36cfb53700 1 -- 172.21.15.124:0/1133632977 wait complete. 2023-10-16T12:58:45.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.218+0000 7f36cfb53700 1 Processor -- start 2023-10-16T12:58:45.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.218+0000 7f36cfb53700 1 -- start start 2023-10-16T12:58:45.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.219+0000 7f36cfb53700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36c80cdbd0 0x7f36c8150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:45.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.219+0000 7f36cfb53700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36c815d580 0x7f36c80ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:45.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.219+0000 7f36cfb53700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36c815d960 0x7f36c80c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:45.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.219+0000 7f36cfb53700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c80b0100 con 0x7f36c80cdbd0 2023-10-16T12:58:45.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.219+0000 7f36cfb53700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c8150580 con 0x7f36c815d960 2023-10-16T12:58:45.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.219+0000 7f36cfb53700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c80af250 con 0x7f36c815d580 2023-10-16T12:58:45.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.219+0000 7f36cd8ef700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36c80cdbd0 0x7f36c8150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:45.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.219+0000 7f36cd8ef700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36c80cdbd0 0x7f36c8150040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52900/0 (socket says 172.21.15.124:52900) 2023-10-16T12:58:45.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.219+0000 7f36cd8ef700 1 -- 172.21.15.124:0/2750811612 learned_addr learned my addr 172.21.15.124:0/2750811612 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:45.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.219+0000 7f36ce0f0700 1 --2- 172.21.15.124:0/2750811612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36c815d960 0x7f36c80c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:45.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.219+0000 7f36cd0ee700 1 --2- 172.21.15.124:0/2750811612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36c815d580 0x7f36c80ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:45.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.219+0000 7f36cd8ef700 1 -- 172.21.15.124:0/2750811612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36c815d580 msgr2=0x7f36c80ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:45.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.219+0000 7f36cd8ef700 1 --2- 172.21.15.124:0/2750811612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36c815d580 0x7f36c80ca190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:45.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.219+0000 7f36cd8ef700 1 -- 172.21.15.124:0/2750811612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36c815d960 msgr2=0x7f36c80c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:45.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.219+0000 7f36cd8ef700 1 --2- 172.21.15.124:0/2750811612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36c815d960 0x7f36c80c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:45.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.219+0000 7f36cd8ef700 1 -- 172.21.15.124:0/2750811612 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c0009a70 con 0x7f36c80cdbd0 2023-10-16T12:58:45.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.219+0000 7f36cd8ef700 1 --2- 172.21.15.124:0/2750811612 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36c80cdbd0 0x7f36c8150040 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f36b800c730 tx=0x7f36b800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:45.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.219+0000 7f36be7fc700 1 -- 172.21.15.124:0/2750811612 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b8005d70 con 0x7f36c80cdbd0 2023-10-16T12:58:45.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.219+0000 7f36be7fc700 1 -- 172.21.15.124:0/2750811612 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b80070d0 con 0x7f36c80cdbd0 2023-10-16T12:58:45.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.219+0000 7f36cfb53700 1 -- 172.21.15.124:0/2750811612 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c40094a0 con 0x7f36c80cdbd0 2023-10-16T12:58:45.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.219+0000 7f36be7fc700 1 -- 172.21.15.124:0/2750811612 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b8007440 con 0x7f36c80cdbd0 2023-10-16T12:58:45.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.220+0000 7f36cfb53700 1 -- 172.21.15.124:0/2750811612 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c80af7d0 con 0x7f36c80cdbd0 2023-10-16T12:58:45.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.220+0000 7f36cfb53700 1 -- 172.21.15.124:0/2750811612 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c804ebb0 con 0x7f36c80cdbd0 2023-10-16T12:58:45.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.221+0000 7f36be7fc700 1 -- 172.21.15.124:0/2750811612 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f36b80075a0 con 0x7f36c80cdbd0 2023-10-16T12:58:45.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.221+0000 7f36be7fc700 1 --2- 172.21.15.124:0/2750811612 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f36ac06af00 0x7f36ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:45.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.221+0000 7f36be7fc700 1 -- 172.21.15.124:0/2750811612 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f36b8088590 con 0x7f36c80cdbd0 2023-10-16T12:58:45.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.221+0000 7f36cd0ee700 1 --2- 172.21.15.124:0/2750811612 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f36ac06af00 0x7f36ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:45.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.222+0000 7f36cd0ee700 1 --2- 172.21.15.124:0/2750811612 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f36ac06af00 0x7f36ac06d3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f36c4009840 tx=0x7f36c4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:45.234 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.226+0000 7f36be7fc700 1 -- 172.21.15.124:0/2750811612 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f36b8053a40 con 0x7f36c80cdbd0 2023-10-16T12:58:45.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.414+0000 7f36cfb53700 1 -- 172.21.15.124:0/2750811612 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f36c8066780 con 0x7f36c80cdbd0 2023-10-16T12:58:45.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.415+0000 7f36be7fc700 1 -- 172.21.15.124:0/2750811612 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f36b8017020 con 0x7f36c80cdbd0 2023-10-16T12:58:45.418 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-16T12:58:45.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.416+0000 7f36cfb53700 1 -- 172.21.15.124:0/2750811612 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f36ac06af00 msgr2=0x7f36ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:45.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.417+0000 7f36cfb53700 1 --2- 172.21.15.124:0/2750811612 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f36ac06af00 0x7f36ac06d3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f36c4009840 tx=0x7f36c4008030 comp rx=0 tx=0).stop 2023-10-16T12:58:45.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.417+0000 7f36cfb53700 1 -- 172.21.15.124:0/2750811612 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36c80cdbd0 msgr2=0x7f36c8150040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:45.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.417+0000 7f36cfb53700 1 --2- 172.21.15.124:0/2750811612 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36c80cdbd0 0x7f36c8150040 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f36b800c730 tx=0x7f36b800ca40 comp rx=0 tx=0).stop 2023-10-16T12:58:45.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.417+0000 7f36cfb53700 1 -- 172.21.15.124:0/2750811612 shutdown_connections 2023-10-16T12:58:45.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.417+0000 7f36cfb53700 1 --2- 172.21.15.124:0/2750811612 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f36ac06af00 0x7f36ac06d3c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:45.421 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.417+0000 7f36cfb53700 1 --2- 172.21.15.124:0/2750811612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36c815d960 0x7f36c80c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:45.421 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.417+0000 7f36cfb53700 1 --2- 172.21.15.124:0/2750811612 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36c80cdbd0 0x7f36c8150040 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:45.421 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.417+0000 7f36cfb53700 1 --2- 172.21.15.124:0/2750811612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36c815d580 0x7f36c80ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:45.421 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.417+0000 7f36cfb53700 1 -- 172.21.15.124:0/2750811612 >> 172.21.15.124:0/2750811612 conn(0x7f36c80b13e0 msgr2=0x7f36c80cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:45.421 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.417+0000 7f36cfb53700 1 -- 172.21.15.124:0/2750811612 shutdown_connections 2023-10-16T12:58:45.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.417+0000 7f36cfb53700 1 -- 172.21.15.124:0/2750811612 wait complete. 2023-10-16T12:58:45.431 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T12:58:45.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.548+0000 7ff29b76b700 1 Processor -- start 2023-10-16T12:58:45.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.548+0000 7ff29b76b700 1 -- start start 2023-10-16T12:58:45.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.549+0000 7ff29b76b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff29406a820 0x7ff2940cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:45.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.549+0000 7ff29b76b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff2940ca7d0 0x7ff294071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:45.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.549+0000 7ff29b76b700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2940cfeb0 con 0x7ff29415e7f0 2023-10-16T12:58:45.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.549+0000 7ff29b76b700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2940ce410 con 0x7ff29406a820 2023-10-16T12:58:45.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.549+0000 7ff29b76b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29415ec50 con 0x7ff2940ca7d0 2023-10-16T12:58:45.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.549+0000 7ff299507700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff29406a820 0x7ff2940cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:45.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.549+0000 7ff298d06700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7ff29415e7f0 0x7ff29406ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:41576/0 (socket says 172.21.15.124:41576) 2023-10-16T12:58:45.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.549+0000 7ff298d06700 1 -- 172.21.15.124:0/3214321621 learned_addr learned my addr 172.21.15.124:0/3214321621 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:58:45.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.549+0000 7ff299d08700 1 --2- 172.21.15.124:0/3214321621 >> v2:172.21.15.192:3300/0 conn(0x7ff2940ca7d0 0x7ff294071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:45.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.549+0000 7ff299507700 1 -- 172.21.15.124:0/3214321621 >> v2:172.21.15.192:3300/0 conn(0x7ff2940ca7d0 msgr2=0x7ff294071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:45.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.549+0000 7ff299507700 1 --2- 172.21.15.124:0/3214321621 >> v2:172.21.15.192:3300/0 conn(0x7ff2940ca7d0 0x7ff294071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:45.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.549+0000 7ff299507700 1 -- 172.21.15.124:0/3214321621 >> v1:172.21.15.124:6789/0 conn(0x7ff29415e7f0 legacy=0x7ff29406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:45.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.549+0000 7ff28bfff700 1 -- 172.21.15.124:0/3214321621 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 952700384 0 0) 0x7ff2940cfeb0 con 0x7ff29415e7f0 2023-10-16T12:58:45.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.549+0000 7ff299507700 1 -- 172.21.15.124:0/3214321621 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2940af9d0 con 0x7ff29406a820 2023-10-16T12:58:45.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.550+0000 7ff299507700 1 --2- 172.21.15.124:0/3214321621 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff29406a820 0x7ff2940cf7d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff2940b2cb0 tx=0x7ff284009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d1ac67bdd509c6a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:45.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.550+0000 7ff28bfff700 1 -- 172.21.15.124:0/3214321621 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff284011830 con 0x7ff29406a820 2023-10-16T12:58:45.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.550+0000 7ff28bfff700 1 -- 172.21.15.124:0/3214321621 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff284011990 con 0x7ff29406a820 2023-10-16T12:58:45.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.550+0000 7ff28bfff700 1 -- 172.21.15.124:0/3214321621 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff284011d20 con 0x7ff29406a820 2023-10-16T12:58:45.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.550+0000 7ff29b76b700 1 -- 172.21.15.124:0/3214321621 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff29406a820 msgr2=0x7ff2940cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:45.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.550+0000 7ff29b76b700 1 --2- 172.21.15.124:0/3214321621 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff29406a820 0x7ff2940cf7d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff2940b2cb0 tx=0x7ff284009b20 comp rx=0 tx=0).stop 2023-10-16T12:58:45.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.550+0000 7ff29b76b700 1 -- 172.21.15.124:0/3214321621 shutdown_connections 2023-10-16T12:58:45.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.550+0000 7ff29b76b700 1 --2- 172.21.15.124:0/3214321621 >> v2:172.21.15.192:3300/0 conn(0x7ff2940ca7d0 0x7ff294071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:45.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.550+0000 7ff29b76b700 1 --2- 172.21.15.124:0/3214321621 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff29406a820 0x7ff2940cf7d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:45.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.550+0000 7ff29b76b700 1 -- 172.21.15.124:0/3214321621 >> 172.21.15.124:0/3214321621 conn(0x7ff2940d0180 msgr2=0x7ff2940d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:45.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.550+0000 7ff29b76b700 1 -- 172.21.15.124:0/3214321621 shutdown_connections 2023-10-16T12:58:45.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.550+0000 7ff29b76b700 1 -- 172.21.15.124:0/3214321621 wait complete. 2023-10-16T12:58:45.560 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.551+0000 7ff29b76b700 1 Processor -- start 2023-10-16T12:58:45.561 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.552+0000 7ff29b76b700 1 -- start start 2023-10-16T12:58:45.561 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.552+0000 7ff29b76b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff29406a820 0x7ff294157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:45.561 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.552+0000 7ff29b76b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2940ca7d0 0x7ff2940acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:45.561 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.552+0000 7ff29b76b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff29415e7f0 0x7ff2941f4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:45.561 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.552+0000 7ff29b76b700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2940c3c90 con 0x7ff29415e7f0 2023-10-16T12:58:45.562 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.552+0000 7ff29b76b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff294157c40 con 0x7ff29406a820 2023-10-16T12:58:45.562 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.552+0000 7ff29b76b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2940ad640 con 0x7ff2940ca7d0 2023-10-16T12:58:45.562 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.552+0000 7ff299d08700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff29415e7f0 0x7ff2941f4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:45.562 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.552+0000 7ff299d08700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff29415e7f0 0x7ff2941f4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52918/0 (socket says 172.21.15.124:52918) 2023-10-16T12:58:45.563 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.552+0000 7ff299d08700 1 -- 172.21.15.124:0/3684296593 learned_addr learned my addr 172.21.15.124:0/3684296593 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:45.563 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.552+0000 7ff299507700 1 --2- 172.21.15.124:0/3684296593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff29406a820 0x7ff294157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:45.563 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.552+0000 7ff298d06700 1 --2- 172.21.15.124:0/3684296593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2940ca7d0 0x7ff2940acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:45.563 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.553+0000 7ff299d08700 1 -- 172.21.15.124:0/3684296593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2940ca7d0 msgr2=0x7ff2940acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:45.563 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.553+0000 7ff299d08700 1 --2- 172.21.15.124:0/3684296593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2940ca7d0 0x7ff2940acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:45.564 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.553+0000 7ff299d08700 1 -- 172.21.15.124:0/3684296593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff29406a820 msgr2=0x7ff294157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:45.564 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.553+0000 7ff299d08700 1 --2- 172.21.15.124:0/3684296593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff29406a820 0x7ff294157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:45.564 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.553+0000 7ff299d08700 1 -- 172.21.15.124:0/3684296593 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2840094a0 con 0x7ff29415e7f0 2023-10-16T12:58:45.564 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.553+0000 7ff298d06700 1 --2- 172.21.15.124:0/3684296593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2940ca7d0 0x7ff2940acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:58:45.564 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.553+0000 7ff299d08700 1 --2- 172.21.15.124:0/3684296593 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff29415e7f0 0x7ff2941f4220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff28c007e70 tx=0x7ff28c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:45.564 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.553+0000 7ff289ffb700 1 -- 172.21.15.124:0/3684296593 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c00ede0 con 0x7ff29415e7f0 2023-10-16T12:58:45.565 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.553+0000 7ff289ffb700 1 -- 172.21.15.124:0/3684296593 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c014420 con 0x7ff29415e7f0 2023-10-16T12:58:45.565 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.553+0000 7ff29b76b700 1 -- 172.21.15.124:0/3684296593 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2940ad920 con 0x7ff29415e7f0 2023-10-16T12:58:45.565 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.553+0000 7ff289ffb700 1 -- 172.21.15.124:0/3684296593 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c0147d0 con 0x7ff29415e7f0 2023-10-16T12:58:45.565 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.553+0000 7ff29b76b700 1 -- 172.21.15.124:0/3684296593 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2940c3ee0 con 0x7ff29415e7f0 2023-10-16T12:58:45.565 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.554+0000 7ff29b76b700 1 -- 172.21.15.124:0/3684296593 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2940c4100 con 0x7ff29415e7f0 2023-10-16T12:58:45.566 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.554+0000 7ff289ffb700 1 -- 172.21.15.124:0/3684296593 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff28c014930 con 0x7ff29415e7f0 2023-10-16T12:58:45.566 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.555+0000 7ff289ffb700 1 --2- 172.21.15.124:0/3684296593 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff27806af00 0x7ff27806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:45.566 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.555+0000 7ff289ffb700 1 -- 172.21.15.124:0/3684296593 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff28c089910 con 0x7ff29415e7f0 2023-10-16T12:58:45.567 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.555+0000 7ff299507700 1 --2- 172.21.15.124:0/3684296593 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff27806af00 0x7ff27806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:45.567 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.555+0000 7ff299507700 1 --2- 172.21.15.124:0/3684296593 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff27806af00 0x7ff27806d3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff2840090b0 tx=0x7ff284008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:45.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.559+0000 7ff289ffb700 1 -- 172.21.15.124:0/3684296593 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff28c054da0 con 0x7ff29415e7f0 2023-10-16T12:58:45.797 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.794+0000 7ff29b76b700 1 -- 172.21.15.124:0/3684296593 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff29404ebb0 con 0x7ff29415e7f0 2023-10-16T12:58:45.797 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.795+0000 7ff289ffb700 1 -- 172.21.15.124:0/3684296593 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7ff28c0583c0 con 0x7ff29415e7f0 2023-10-16T12:58:45.798 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:58:45.798 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1247092782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":1247092782},{"type":"v1","addr":"172.21.15.124:6837","nonce":1247092782}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-16T12:58:45.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.797+0000 7ff29b76b700 1 -- 172.21.15.124:0/3684296593 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff27806af00 msgr2=0x7ff27806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:45.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.797+0000 7ff29b76b700 1 --2- 172.21.15.124:0/3684296593 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff27806af00 0x7ff27806d3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff2840090b0 tx=0x7ff284008030 comp rx=0 tx=0).stop 2023-10-16T12:58:45.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.797+0000 7ff29b76b700 1 -- 172.21.15.124:0/3684296593 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff29415e7f0 msgr2=0x7ff2941f4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:45.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.797+0000 7ff29b76b700 1 --2- 172.21.15.124:0/3684296593 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff29415e7f0 0x7ff2941f4220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff28c007e70 tx=0x7ff28c00e3c0 comp rx=0 tx=0).stop 2023-10-16T12:58:45.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.797+0000 7ff29b76b700 1 -- 172.21.15.124:0/3684296593 shutdown_connections 2023-10-16T12:58:45.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.797+0000 7ff29b76b700 1 --2- 172.21.15.124:0/3684296593 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff27806af00 0x7ff27806d3c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:45.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.797+0000 7ff29b76b700 1 --2- 172.21.15.124:0/3684296593 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff29415e7f0 0x7ff2941f4220 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:45.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.797+0000 7ff29b76b700 1 --2- 172.21.15.124:0/3684296593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff29406a820 0x7ff294157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:45.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.797+0000 7ff29b76b700 1 --2- 172.21.15.124:0/3684296593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2940ca7d0 0x7ff2940acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:45.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.797+0000 7ff29b76b700 1 -- 172.21.15.124:0/3684296593 >> 172.21.15.124:0/3684296593 conn(0x7ff2940d0180 msgr2=0x7ff2940b0640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:45.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.797+0000 7ff29b76b700 1 -- 172.21.15.124:0/3684296593 shutdown_connections 2023-10-16T12:58:45.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:45.797+0000 7ff29b76b700 1 -- 172.21.15.124:0/3684296593 wait complete. 2023-10-16T12:58:45.802 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 2 2023-10-16T12:58:47.812 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T12:58:47.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.943+0000 7f92ea17f700 1 Processor -- start 2023-10-16T12:58:47.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.943+0000 7f92ea17f700 1 -- start start 2023-10-16T12:58:47.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.944+0000 7f92ea17f700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f92e40cf7d0 0x7f92e415e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:47.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.944+0000 7f92ea17f700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e40cfeb0 con 0x7f92e406a820 2023-10-16T12:58:47.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.944+0000 7f92ea17f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e40cfc30 con 0x7f92e40ca7d0 2023-10-16T12:58:47.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.944+0000 7f92ea17f700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e40ce410 con 0x7f92e40cf7d0 2023-10-16T12:58:47.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.944+0000 7f92e2ffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f92e40cf7d0 0x7f92e415e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:47.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.944+0000 7f92e37fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f92e406a820 0x7f92e406ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:41592/0 (socket says 172.21.15.124:41592) 2023-10-16T12:58:47.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.944+0000 7f92e37fe700 1 -- 172.21.15.124:0/764793600 learned_addr learned my addr 172.21.15.124:0/764793600 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:58:47.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.944+0000 7f92e2ffd700 1 -- 172.21.15.124:0/764793600 >> v1:172.21.15.192:6789/0 conn(0x7f92e40ca7d0 legacy=0x7f92e4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:47.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.944+0000 7f92e2ffd700 1 -- 172.21.15.124:0/764793600 >> v1:172.21.15.124:6789/0 conn(0x7f92e406a820 legacy=0x7f92e406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:47.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.944+0000 7f92e2ffd700 1 -- 172.21.15.124:0/764793600 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e40af9d0 con 0x7f92e40cf7d0 2023-10-16T12:58:47.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.944+0000 7f92e27fc700 1 -- 172.21.15.124:0/764793600 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829688672 0 0) 0x7f92e40cfeb0 con 0x7f92e406a820 2023-10-16T12:58:47.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.944+0000 7f92e2ffd700 1 --2- 172.21.15.124:0/764793600 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f92e40cf7d0 0x7f92e415e7f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f92d4009840 tx=0x7f92d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f6a74bc0e839c76 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:47.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.944+0000 7f92e27fc700 1 -- 172.21.15.124:0/764793600 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d4004230 con 0x7f92e40cf7d0 2023-10-16T12:58:47.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.945+0000 7f92e27fc700 1 -- 172.21.15.124:0/764793600 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d4004390 con 0x7f92e40cf7d0 2023-10-16T12:58:47.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.945+0000 7f92e27fc700 1 -- 172.21.15.124:0/764793600 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d40036a0 con 0x7f92e40cf7d0 2023-10-16T12:58:47.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.945+0000 7f92ea17f700 1 -- 172.21.15.124:0/764793600 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f92e40cf7d0 msgr2=0x7f92e415e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:47.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.945+0000 7f92ea17f700 1 --2- 172.21.15.124:0/764793600 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f92e40cf7d0 0x7f92e415e7f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f92d4009840 tx=0x7f92d4009b50 comp rx=0 tx=0).stop 2023-10-16T12:58:47.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.945+0000 7f92ea17f700 1 -- 172.21.15.124:0/764793600 shutdown_connections 2023-10-16T12:58:47.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.945+0000 7f92ea17f700 1 --2- 172.21.15.124:0/764793600 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f92e40cf7d0 0x7f92e415e7f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:47.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.945+0000 7f92ea17f700 1 -- 172.21.15.124:0/764793600 >> 172.21.15.124:0/764793600 conn(0x7f92e40d0180 msgr2=0x7f92e40d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:47.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.945+0000 7f92ea17f700 1 -- 172.21.15.124:0/764793600 shutdown_connections 2023-10-16T12:58:47.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.945+0000 7f92ea17f700 1 -- 172.21.15.124:0/764793600 wait complete. 2023-10-16T12:58:47.954 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.946+0000 7f92ea17f700 1 Processor -- start 2023-10-16T12:58:47.954 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.946+0000 7f92ea17f700 1 -- start start 2023-10-16T12:58:47.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.947+0000 7f92ea17f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f92e406a820 0x7f92e40c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:47.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.947+0000 7f92ea17f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92e40ca7d0 0x7f92e40ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:47.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.947+0000 7f92ea17f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92e40cf7d0 0x7f92e40c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:47.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.947+0000 7f92ea17f700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e4159850 con 0x7f92e406a820 2023-10-16T12:58:47.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.947+0000 7f92ea17f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e40c9470 con 0x7f92e40cf7d0 2023-10-16T12:58:47.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.947+0000 7f92ea17f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e40c8860 con 0x7f92e40ca7d0 2023-10-16T12:58:47.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.947+0000 7f92e37fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f92e406a820 0x7f92e40c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:47.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.947+0000 7f92e37fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f92e406a820 0x7f92e40c7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52930/0 (socket says 172.21.15.124:52930) 2023-10-16T12:58:47.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.947+0000 7f92e37fe700 1 -- 172.21.15.124:0/2639345064 learned_addr learned my addr 172.21.15.124:0/2639345064 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:47.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.947+0000 7f92e2ffd700 1 --2- 172.21.15.124:0/2639345064 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92e40ca7d0 0x7f92e40ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:47.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.947+0000 7f92e3fff700 1 --2- 172.21.15.124:0/2639345064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92e40cf7d0 0x7f92e40c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:47.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.948+0000 7f92e37fe700 1 -- 172.21.15.124:0/2639345064 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92e40ca7d0 msgr2=0x7f92e40ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:47.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.948+0000 7f92e37fe700 1 --2- 172.21.15.124:0/2639345064 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92e40ca7d0 0x7f92e40ae0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:47.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.948+0000 7f92e37fe700 1 -- 172.21.15.124:0/2639345064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92e40cf7d0 msgr2=0x7f92e40c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:47.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.948+0000 7f92e37fe700 1 --2- 172.21.15.124:0/2639345064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92e40cf7d0 0x7f92e40c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:47.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.948+0000 7f92e37fe700 1 -- 172.21.15.124:0/2639345064 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d40094a0 con 0x7f92e406a820 2023-10-16T12:58:47.958 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.948+0000 7f92e37fe700 1 --2- 172.21.15.124:0/2639345064 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f92e406a820 0x7f92e40c7c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f92cc0011e0 tx=0x7f92cc00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:47.958 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.948+0000 7f92dbfff700 1 -- 172.21.15.124:0/2639345064 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92cc004c80 con 0x7f92e406a820 2023-10-16T12:58:47.958 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.948+0000 7f92dbfff700 1 -- 172.21.15.124:0/2639345064 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92cc004e00 con 0x7f92e406a820 2023-10-16T12:58:47.958 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.948+0000 7f92ea17f700 1 -- 172.21.15.124:0/2639345064 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e40c8b40 con 0x7f92e406a820 2023-10-16T12:58:47.958 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.948+0000 7f92dbfff700 1 -- 172.21.15.124:0/2639345064 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92cc007310 con 0x7f92e406a820 2023-10-16T12:58:47.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.948+0000 7f92ea17f700 1 -- 172.21.15.124:0/2639345064 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e40c9100 con 0x7f92e406a820 2023-10-16T12:58:47.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.949+0000 7f92ea17f700 1 -- 172.21.15.124:0/2639345064 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e40af6d0 con 0x7f92e406a820 2023-10-16T12:58:47.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.949+0000 7f92dbfff700 1 -- 172.21.15.124:0/2639345064 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f92cc007470 con 0x7f92e406a820 2023-10-16T12:58:47.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.950+0000 7f92dbfff700 1 --2- 172.21.15.124:0/2639345064 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f92c406af00 0x7f92c406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:47.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.950+0000 7f92dbfff700 1 -- 172.21.15.124:0/2639345064 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f92cc0890c0 con 0x7f92e406a820 2023-10-16T12:58:47.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.950+0000 7f92e2ffd700 1 --2- 172.21.15.124:0/2639345064 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f92c406af00 0x7f92c406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:47.960 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.950+0000 7f92e2ffd700 1 --2- 172.21.15.124:0/2639345064 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f92c406af00 0x7f92c406d3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f92d40090b0 tx=0x7f92d4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:47.960 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:47.954+0000 7f92dbfff700 1 -- 172.21.15.124:0/2639345064 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f92e40af6d0 con 0x7f92e406a820 2023-10-16T12:58:48.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.184+0000 7f92ea17f700 1 -- 172.21.15.124:0/2639345064 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92e40af6d0 con 0x7f92e406a820 2023-10-16T12:58:48.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.184+0000 7f92dbfff700 1 -- 172.21.15.124:0/2639345064 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3703 (secure 0 0 0) 0x7f92e40af6d0 con 0x7f92e406a820 2023-10-16T12:58:48.187 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:58:48.188 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1489119886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6833","nonce":1489119886},{"type":"v1","addr":"172.21.15.192:6835","nonce":1489119886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/2221949787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":2221949787},{"type":"v1","addr":"172.21.15.124:6836","nonce":2221949787}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1247092782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":1247092782},{"type":"v1","addr":"172.21.15.124:6837","nonce":1247092782}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6834/621867052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":621867052},{"type":"v1","addr":"172.21.15.192:6834","nonce":621867052}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-16T12:58:48.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.186+0000 7f92ea17f700 1 -- 172.21.15.124:0/2639345064 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f92c406af00 msgr2=0x7f92c406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:48.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.186+0000 7f92ea17f700 1 --2- 172.21.15.124:0/2639345064 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f92c406af00 0x7f92c406d3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f92d40090b0 tx=0x7f92d4008030 comp rx=0 tx=0).stop 2023-10-16T12:58:48.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.186+0000 7f92ea17f700 1 -- 172.21.15.124:0/2639345064 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f92e406a820 msgr2=0x7f92e40c7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:48.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.186+0000 7f92ea17f700 1 --2- 172.21.15.124:0/2639345064 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f92e406a820 0x7f92e40c7c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f92cc0011e0 tx=0x7f92cc00cae0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.187+0000 7f92ea17f700 1 -- 172.21.15.124:0/2639345064 shutdown_connections 2023-10-16T12:58:48.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.187+0000 7f92ea17f700 1 --2- 172.21.15.124:0/2639345064 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f92c406af00 0x7f92c406d3c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.187+0000 7f92ea17f700 1 --2- 172.21.15.124:0/2639345064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92e40cf7d0 0x7f92e40c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.187+0000 7f92ea17f700 1 --2- 172.21.15.124:0/2639345064 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f92e406a820 0x7f92e40c7c60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.187+0000 7f92ea17f700 1 --2- 172.21.15.124:0/2639345064 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92e40ca7d0 0x7f92e40ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.187+0000 7f92ea17f700 1 -- 172.21.15.124:0/2639345064 >> 172.21.15.124:0/2639345064 conn(0x7f92e40d0180 msgr2=0x7f92e4159e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:48.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.187+0000 7f92ea17f700 1 -- 172.21.15.124:0/2639345064 shutdown_connections 2023-10-16T12:58:48.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.187+0000 7f92ea17f700 1 -- 172.21.15.124:0/2639345064 wait complete. 2023-10-16T12:58:48.192 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 3 2023-10-16T12:58:48.202 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:58:48.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.319+0000 7f5f1a25a700 1 Processor -- start 2023-10-16T12:58:48.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.320+0000 7f5f1a25a700 1 -- start start 2023-10-16T12:58:48.326 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f1a25a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5f1415d890 0x7f5f140ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:48.326 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f1a25a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f1406bef0 0x7f5f140b6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:48.326 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f1a25a700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f140ceab0 con 0x7f5f140ce610 2023-10-16T12:58:48.327 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f1a25a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f140ced90 con 0x7f5f1415d890 2023-10-16T12:58:48.327 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f1a25a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f140cf070 con 0x7f5f1406bef0 2023-10-16T12:58:48.327 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f12ffd700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f5f140ce610 0x7f5f1406b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:41608/0 (socket says 172.21.15.124:41608) 2023-10-16T12:58:48.327 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f12ffd700 1 -- 172.21.15.124:0/1485854314 learned_addr learned my addr 172.21.15.124:0/1485854314 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:58:48.327 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f137fe700 1 --2- 172.21.15.124:0/1485854314 >> v2:172.21.15.192:3300/0 conn(0x7f5f1415d890 0x7f5f140ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:48.327 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f13fff700 1 --2- 172.21.15.124:0/1485854314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f1406bef0 0x7f5f140b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:48.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f127fc700 1 -- 172.21.15.124:0/1485854314 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362047213 0 0) 0x7f5f140ceab0 con 0x7f5f140ce610 2023-10-16T12:58:48.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f127fc700 1 -- 172.21.15.124:0/1485854314 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f000035b0 con 0x7f5f140ce610 2023-10-16T12:58:48.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f127fc700 1 -- 172.21.15.124:0/1485854314 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3648042128 0 0) 0x7f5f000035b0 con 0x7f5f140ce610 2023-10-16T12:58:48.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f127fc700 1 -- 172.21.15.124:0/1485854314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f1406bef0 msgr2=0x7f5f140b6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:48.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f127fc700 1 --2- 172.21.15.124:0/1485854314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f1406bef0 0x7f5f140b6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f127fc700 1 -- 172.21.15.124:0/1485854314 >> v2:172.21.15.192:3300/0 conn(0x7f5f1415d890 msgr2=0x7f5f140ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:48.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f127fc700 1 --2- 172.21.15.124:0/1485854314 >> v2:172.21.15.192:3300/0 conn(0x7f5f1415d890 0x7f5f140ce0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f127fc700 1 -- 172.21.15.124:0/1485854314 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f140cf350 con 0x7f5f140ce610 2023-10-16T12:58:48.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f127fc700 1 -- 172.21.15.124:0/1485854314 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f5efc001670 con 0x7f5f140ce610 2023-10-16T12:58:48.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f137fe700 1 --2- 172.21.15.124:0/1485854314 >> v2:172.21.15.192:3300/0 conn(0x7f5f1415d890 0x7f5f140ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:58:48.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f127fc700 1 -- 172.21.15.124:0/1485854314 >> v1:172.21.15.124:6789/0 conn(0x7f5f140ce610 legacy=0x7f5f1406b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:48.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f127fc700 1 --2- 172.21.15.124:0/1485854314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f1406bef0 0x7f5f00003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:48.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f127fc700 1 --2- 172.21.15.124:0/1485854314 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5f00003f80 0x7f5f00004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:48.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f127fc700 1 --2- 172.21.15.124:0/1485854314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f00004d90 0x7f5f00005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:48.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f127fc700 1 -- 172.21.15.124:0/1485854314 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f140ced90 con 0x7f5f00003f80 2023-10-16T12:58:48.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f127fc700 1 -- 172.21.15.124:0/1485854314 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f140cf070 con 0x7f5f00004d90 2023-10-16T12:58:48.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.321+0000 7f5f127fc700 1 -- 172.21.15.124:0/1485854314 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0000ba40 con 0x7f5f1406bef0 2023-10-16T12:58:48.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.322+0000 7f5f12ffd700 1 --2- 172.21.15.124:0/1485854314 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5f00003f80 0x7f5f00004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:48.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.322+0000 7f5f137fe700 1 --2- 172.21.15.124:0/1485854314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f1406bef0 0x7f5f00003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:48.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.322+0000 7f5f13fff700 1 --2- 172.21.15.124:0/1485854314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f00004d90 0x7f5f00005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:48.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.322+0000 7f5f12ffd700 1 -- 172.21.15.124:0/1485854314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f1406bef0 msgr2=0x7f5f00003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:48.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.322+0000 7f5f12ffd700 1 --2- 172.21.15.124:0/1485854314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f1406bef0 0x7f5f00003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.322+0000 7f5f12ffd700 1 -- 172.21.15.124:0/1485854314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f00004d90 msgr2=0x7f5f00005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:48.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.322+0000 7f5f12ffd700 1 --2- 172.21.15.124:0/1485854314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f00004d90 0x7f5f00005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.322+0000 7f5f12ffd700 1 -- 172.21.15.124:0/1485854314 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f000035b0 con 0x7f5f00003f80 2023-10-16T12:58:48.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.322+0000 7f5f12ffd700 1 --2- 172.21.15.124:0/1485854314 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5f00003f80 0x7f5f00004850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5f140b6050 tx=0x7f5f00005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1fdde8edc61a95 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:48.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.322+0000 7f5f127fc700 1 -- 172.21.15.124:0/1485854314 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc007c60 con 0x7f5f00003f80 2023-10-16T12:58:48.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.322+0000 7f5f127fc700 1 -- 172.21.15.124:0/1485854314 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5efc00ce50 con 0x7f5f00003f80 2023-10-16T12:58:48.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.322+0000 7f5f127fc700 1 -- 172.21.15.124:0/1485854314 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc005ba0 con 0x7f5f00003f80 2023-10-16T12:58:48.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.323+0000 7f5f1a25a700 1 -- 172.21.15.124:0/1485854314 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5f00003f80 msgr2=0x7f5f00004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:48.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.323+0000 7f5f1a25a700 1 --2- 172.21.15.124:0/1485854314 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5f00003f80 0x7f5f00004850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5f140b6050 tx=0x7f5f00005880 comp rx=0 tx=0).stop 2023-10-16T12:58:48.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.323+0000 7f5f13fff700 1 -- 172.21.15.124:0/1485854314 reap_dead start 2023-10-16T12:58:48.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.323+0000 7f5f1a25a700 1 -- 172.21.15.124:0/1485854314 shutdown_connections 2023-10-16T12:58:48.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.323+0000 7f5f1a25a700 1 -- 172.21.15.124:0/1485854314 >> 172.21.15.124:0/1485854314 conn(0x7f5f14072340 msgr2=0x7f5f14072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:48.334 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.323+0000 7f5f1a25a700 1 -- 172.21.15.124:0/1485854314 shutdown_connections 2023-10-16T12:58:48.334 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.323+0000 7f5f1a25a700 1 -- 172.21.15.124:0/1485854314 wait complete. 2023-10-16T12:58:48.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.324+0000 7f5f1a25a700 1 Processor -- start 2023-10-16T12:58:48.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.324+0000 7f5f1a25a700 1 -- start start 2023-10-16T12:58:48.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.325+0000 7f5f1a25a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f00003f80 0x7f5f140b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:48.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.325+0000 7f5f1a25a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f140abf60 0x7f5f140cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:48.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.325+0000 7f5f1a25a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5f140ac3e0 0x7f5f140cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:48.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.325+0000 7f5f1a25a700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f140ac8e0 con 0x7f5f140ac3e0 2023-10-16T12:58:48.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.325+0000 7f5f1a25a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f140acbc0 con 0x7f5f00003f80 2023-10-16T12:58:48.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.325+0000 7f5f1a25a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f140acea0 con 0x7f5f140abf60 2023-10-16T12:58:48.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.325+0000 7f5f13fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5f140ac3e0 0x7f5f140cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:48.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.325+0000 7f5f13fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5f140ac3e0 0x7f5f140cc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52954/0 (socket says 172.21.15.124:52954) 2023-10-16T12:58:48.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.325+0000 7f5f13fff700 1 -- 172.21.15.124:0/2429272457 learned_addr learned my addr 172.21.15.124:0/2429272457 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:48.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.326+0000 7f5f137fe700 1 --2- 172.21.15.124:0/2429272457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f00003f80 0x7f5f140b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:48.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.326+0000 7f5f12ffd700 1 --2- 172.21.15.124:0/2429272457 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f140abf60 0x7f5f140cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:48.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.326+0000 7f5f13fff700 1 -- 172.21.15.124:0/2429272457 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f140abf60 msgr2=0x7f5f140cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:48.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.326+0000 7f5f13fff700 1 --2- 172.21.15.124:0/2429272457 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f140abf60 0x7f5f140cc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.326+0000 7f5f13fff700 1 -- 172.21.15.124:0/2429272457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f00003f80 msgr2=0x7f5f140b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:48.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.326+0000 7f5f13fff700 1 --2- 172.21.15.124:0/2429272457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f00003f80 0x7f5f140b5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.326+0000 7f5f13fff700 1 -- 172.21.15.124:0/2429272457 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f140cfcd0 con 0x7f5f140ac3e0 2023-10-16T12:58:48.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.326+0000 7f5f137fe700 1 --2- 172.21.15.124:0/2429272457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f00003f80 0x7f5f140b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:58:48.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.326+0000 7f5f12ffd700 1 --2- 172.21.15.124:0/2429272457 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f140abf60 0x7f5f140cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:58:48.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.326+0000 7f5f13fff700 1 --2- 172.21.15.124:0/2429272457 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5f140ac3e0 0x7f5f140cc7a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5f140d0e60 tx=0x7f5f0c011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:48.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.326+0000 7f5f0bfff700 1 -- 172.21.15.124:0/2429272457 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c00e040 con 0x7f5f140ac3e0 2023-10-16T12:58:48.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.326+0000 7f5f0bfff700 1 -- 172.21.15.124:0/2429272457 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0c00f040 con 0x7f5f140ac3e0 2023-10-16T12:58:48.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.326+0000 7f5f1a25a700 1 -- 172.21.15.124:0/2429272457 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f141f4040 con 0x7f5f140ac3e0 2023-10-16T12:58:48.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.326+0000 7f5f0bfff700 1 -- 172.21.15.124:0/2429272457 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c00f9a0 con 0x7f5f140ac3e0 2023-10-16T12:58:48.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.326+0000 7f5f1a25a700 1 -- 172.21.15.124:0/2429272457 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f140aaaf0 con 0x7f5f140ac3e0 2023-10-16T12:58:48.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.327+0000 7f5f1a25a700 1 -- 172.21.15.124:0/2429272457 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f141f4560 con 0x7f5f140ac3e0 2023-10-16T12:58:48.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.327+0000 7f5f0bfff700 1 -- 172.21.15.124:0/2429272457 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5f0c00fb00 con 0x7f5f140ac3e0 2023-10-16T12:58:48.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.328+0000 7f5f0bfff700 1 --2- 172.21.15.124:0/2429272457 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5ef406af00 0x7f5ef406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:48.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.328+0000 7f5f0bfff700 1 -- 172.21.15.124:0/2429272457 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5f0c0897a0 con 0x7f5f140ac3e0 2023-10-16T12:58:48.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.328+0000 7f5f137fe700 1 --2- 172.21.15.124:0/2429272457 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5ef406af00 0x7f5ef406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:48.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.328+0000 7f5f137fe700 1 --2- 172.21.15.124:0/2429272457 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5ef406af00 0x7f5ef406d3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5f04009ce0 tx=0x7f5f04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:48.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.332+0000 7f5f0bfff700 1 -- 172.21.15.124:0/2429272457 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5f141f4560 con 0x7f5f140ac3e0 2023-10-16T12:58:48.526 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.524+0000 7f5f1a25a700 1 -- 172.21.15.124:0/2429272457 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f141f4560 con 0x7f5f140ac3e0 2023-10-16T12:58:48.527 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.525+0000 7f5f0bfff700 1 -- 172.21.15.124:0/2429272457 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f5f141f4560 con 0x7f5f140ac3e0 2023-10-16T12:58:48.527 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:58:48.528 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":16,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:58:41.037780+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:58:48.529 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.527+0000 7f5f1a25a700 1 -- 172.21.15.124:0/2429272457 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5ef406af00 msgr2=0x7f5ef406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:48.530 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.527+0000 7f5f1a25a700 1 --2- 172.21.15.124:0/2429272457 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5ef406af00 0x7f5ef406d3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5f04009ce0 tx=0x7f5f04008040 comp rx=0 tx=0).stop 2023-10-16T12:58:48.530 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.527+0000 7f5f1a25a700 1 -- 172.21.15.124:0/2429272457 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5f140ac3e0 msgr2=0x7f5f140cc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:48.530 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.527+0000 7f5f1a25a700 1 --2- 172.21.15.124:0/2429272457 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5f140ac3e0 0x7f5f140cc7a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5f140d0e60 tx=0x7f5f0c011f80 comp rx=0 tx=0).stop 2023-10-16T12:58:48.530 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.527+0000 7f5f1a25a700 1 -- 172.21.15.124:0/2429272457 shutdown_connections 2023-10-16T12:58:48.531 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.527+0000 7f5f1a25a700 1 --2- 172.21.15.124:0/2429272457 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5ef406af00 0x7f5ef406d3c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.531 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.527+0000 7f5f1a25a700 1 --2- 172.21.15.124:0/2429272457 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5f140ac3e0 0x7f5f140cc7a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.531 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.527+0000 7f5f1a25a700 1 --2- 172.21.15.124:0/2429272457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f00003f80 0x7f5f140b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.531 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.527+0000 7f5f1a25a700 1 --2- 172.21.15.124:0/2429272457 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f140abf60 0x7f5f140cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.531 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.527+0000 7f5f1a25a700 1 -- 172.21.15.124:0/2429272457 >> 172.21.15.124:0/2429272457 conn(0x7f5f14072340 msgr2=0x7f5f140b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:48.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.527+0000 7f5f1a25a700 1 -- 172.21.15.124:0/2429272457 shutdown_connections 2023-10-16T12:58:48.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.527+0000 7f5f1a25a700 1 -- 172.21.15.124:0/2429272457 wait complete. 2023-10-16T12:58:48.541 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T12:58:38.667813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T12:58:48.542 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T12:58:48.667 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.664+0000 7f8820751700 1 Processor -- start 2023-10-16T12:58:48.667 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.664+0000 7f8820751700 1 -- start start 2023-10-16T12:58:48.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.665+0000 7f8820751700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f881815f8c0 0x7f8818167250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:48.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.665+0000 7f8820751700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88180cad30 con 0x7f881815ed30 2023-10-16T12:58:48.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.665+0000 7f8820751700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88180cb1c0 con 0x7f881806a820 2023-10-16T12:58:48.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.665+0000 7f8820751700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88180ca7b0 con 0x7f881815f8c0 2023-10-16T12:58:48.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.665+0000 7f881dcec700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f881815ed30 0x7f881815f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:41626/0 (socket says 172.21.15.124:41626) 2023-10-16T12:58:48.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.665+0000 7f881dcec700 1 -- 172.21.15.124:0/2425816296 learned_addr learned my addr 172.21.15.124:0/2425816296 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:58:48.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881ecee700 1 --2- 172.21.15.124:0/2425816296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f881815f8c0 0x7f8818167250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:48.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881d4eb700 1 -- 172.21.15.124:0/2425816296 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569981509 0 0) 0x7f88180cad30 con 0x7f881815ed30 2023-10-16T12:58:48.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881d4eb700 1 -- 172.21.15.124:0/2425816296 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88040035b0 con 0x7f881815ed30 2023-10-16T12:58:48.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881d4eb700 1 -- 172.21.15.124:0/2425816296 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167476955 0 0) 0x7f88180cb1c0 con 0x7f881806a820 2023-10-16T12:58:48.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881d4eb700 1 -- 172.21.15.124:0/2425816296 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88180cad30 con 0x7f881806a820 2023-10-16T12:58:48.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881d4eb700 1 -- 172.21.15.124:0/2425816296 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2121037596 0 0) 0x7f88040035b0 con 0x7f881815ed30 2023-10-16T12:58:48.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881d4eb700 1 -- 172.21.15.124:0/2425816296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f881815f8c0 msgr2=0x7f8818167250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:48.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881d4eb700 1 --2- 172.21.15.124:0/2425816296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f881815f8c0 0x7f8818167250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881d4eb700 1 -- 172.21.15.124:0/2425816296 >> v1:172.21.15.192:6789/0 conn(0x7f881806a820 legacy=0x7f881806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:48.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881d4eb700 1 -- 172.21.15.124:0/2425816296 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881806df70 con 0x7f881815ed30 2023-10-16T12:58:48.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881d4eb700 1 -- 172.21.15.124:0/2425816296 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f8814001670 con 0x7f881815ed30 2023-10-16T12:58:48.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881d4eb700 1 -- 172.21.15.124:0/2425816296 >> v1:172.21.15.124:6789/0 conn(0x7f881815ed30 legacy=0x7f881815f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:48.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881d4eb700 1 --2- 172.21.15.124:0/2425816296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f881815f8c0 0x7f8804003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:48.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881d4eb700 1 --2- 172.21.15.124:0/2425816296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8804004170 0x7f8804004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:48.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881d4eb700 1 --2- 172.21.15.124:0/2425816296 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8804004d90 0x7f8804005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:48.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881d4eb700 1 -- 172.21.15.124:0/2425816296 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88180ca7b0 con 0x7f8804004d90 2023-10-16T12:58:48.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881d4eb700 1 -- 172.21.15.124:0/2425816296 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880400bbd0 con 0x7f8804004170 2023-10-16T12:58:48.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881d4eb700 1 -- 172.21.15.124:0/2425816296 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880400bd90 con 0x7f881815f8c0 2023-10-16T12:58:48.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881ecee700 1 --2- 172.21.15.124:0/2425816296 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8804004d90 0x7f8804005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:48.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881dcec700 1 --2- 172.21.15.124:0/2425816296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8804004170 0x7f8804004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:48.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881e4ed700 1 --2- 172.21.15.124:0/2425816296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f881815f8c0 0x7f8804003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:48.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881ecee700 1 -- 172.21.15.124:0/2425816296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f881815f8c0 msgr2=0x7f8804003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:48.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881ecee700 1 --2- 172.21.15.124:0/2425816296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f881815f8c0 0x7f8804003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881ecee700 1 -- 172.21.15.124:0/2425816296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8804004170 msgr2=0x7f8804004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:48.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881ecee700 1 --2- 172.21.15.124:0/2425816296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8804004170 0x7f8804004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.666+0000 7f881ecee700 1 -- 172.21.15.124:0/2425816296 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88040035b0 con 0x7f8804004d90 2023-10-16T12:58:48.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.667+0000 7f881ecee700 1 --2- 172.21.15.124:0/2425816296 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8804004d90 0x7f8804005210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8810009fc0 tx=0x7f8804005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc9e0850a42bb7e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:48.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.667+0000 7f881d4eb700 1 -- 172.21.15.124:0/2425816296 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881000ec30 con 0x7f8804004d90 2023-10-16T12:58:48.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.667+0000 7f881d4eb700 1 -- 172.21.15.124:0/2425816296 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881000f040 con 0x7f8804004d90 2023-10-16T12:58:48.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.667+0000 7f881d4eb700 1 -- 172.21.15.124:0/2425816296 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8810014480 con 0x7f8804004d90 2023-10-16T12:58:48.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.667+0000 7f8820751700 1 -- 172.21.15.124:0/2425816296 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8804004d90 msgr2=0x7f8804005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:48.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.667+0000 7f8820751700 1 --2- 172.21.15.124:0/2425816296 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8804004d90 0x7f8804005210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8810009fc0 tx=0x7f8804005880 comp rx=0 tx=0).stop 2023-10-16T12:58:48.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.667+0000 7f881ecee700 1 -- 172.21.15.124:0/2425816296 reap_dead start 2023-10-16T12:58:48.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.667+0000 7f8820751700 1 -- 172.21.15.124:0/2425816296 shutdown_connections 2023-10-16T12:58:48.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.667+0000 7f8820751700 1 -- 172.21.15.124:0/2425816296 >> 172.21.15.124:0/2425816296 conn(0x7f88180ccbe0 msgr2=0x7f88180ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:48.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.667+0000 7f8820751700 1 -- 172.21.15.124:0/2425816296 shutdown_connections 2023-10-16T12:58:48.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.667+0000 7f8820751700 1 -- 172.21.15.124:0/2425816296 wait complete. 2023-10-16T12:58:48.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.669+0000 7f8820751700 1 Processor -- start 2023-10-16T12:58:48.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.669+0000 7f8820751700 1 -- start start 2023-10-16T12:58:48.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.669+0000 7f8820751700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8804004d90 0x7f88181ee130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:48.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.669+0000 7f8820751700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88181533b0 0x7f88181f1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:48.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.669+0000 7f8820751700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88181557b0 0x7f8818155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:48.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.669+0000 7f8820751700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88180b5740 con 0x7f8804004d90 2023-10-16T12:58:48.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.669+0000 7f8820751700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88181ee670 con 0x7f88181557b0 2023-10-16T12:58:48.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.669+0000 7f8820751700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88181f1bc0 con 0x7f88181533b0 2023-10-16T12:58:48.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.669+0000 7f881e4ed700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8804004d90 0x7f88181ee130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:48.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.669+0000 7f881e4ed700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8804004d90 0x7f88181ee130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52970/0 (socket says 172.21.15.124:52970) 2023-10-16T12:58:48.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.669+0000 7f881e4ed700 1 -- 172.21.15.124:0/792397571 learned_addr learned my addr 172.21.15.124:0/792397571 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:48.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.669+0000 7f881dcec700 1 --2- 172.21.15.124:0/792397571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88181533b0 0x7f88181f1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:48.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.669+0000 7f881ecee700 1 --2- 172.21.15.124:0/792397571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88181557b0 0x7f8818155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:48.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.670+0000 7f881e4ed700 1 -- 172.21.15.124:0/792397571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88181533b0 msgr2=0x7f88181f1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:48.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.670+0000 7f881e4ed700 1 --2- 172.21.15.124:0/792397571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88181533b0 0x7f88181f1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.670+0000 7f881e4ed700 1 -- 172.21.15.124:0/792397571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88181557b0 msgr2=0x7f8818155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:48.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.670+0000 7f881e4ed700 1 --2- 172.21.15.124:0/792397571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88181557b0 0x7f8818155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.670+0000 7f881e4ed700 1 -- 172.21.15.124:0/792397571 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8818156700 con 0x7f8804004d90 2023-10-16T12:58:48.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.670+0000 7f881e4ed700 1 --2- 172.21.15.124:0/792397571 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8804004d90 0x7f88181ee130 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f880800f8e0 tx=0x7f880800fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:48.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.670+0000 7f880effd700 1 -- 172.21.15.124:0/792397571 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88080052e0 con 0x7f8804004d90 2023-10-16T12:58:48.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.670+0000 7f880effd700 1 -- 172.21.15.124:0/792397571 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8808005440 con 0x7f8804004d90 2023-10-16T12:58:48.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.670+0000 7f880effd700 1 -- 172.21.15.124:0/792397571 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88080038c0 con 0x7f8804004d90 2023-10-16T12:58:48.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.670+0000 7f8820751700 1 -- 172.21.15.124:0/792397571 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8818153870 con 0x7f8804004d90 2023-10-16T12:58:48.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.670+0000 7f8820751700 1 -- 172.21.15.124:0/792397571 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88180b5c00 con 0x7f8804004d90 2023-10-16T12:58:48.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.671+0000 7f8820751700 1 -- 172.21.15.124:0/792397571 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f881815e4e0 con 0x7f8804004d90 2023-10-16T12:58:48.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.671+0000 7f880effd700 1 -- 172.21.15.124:0/792397571 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8808003a20 con 0x7f8804004d90 2023-10-16T12:58:48.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.672+0000 7f880effd700 1 --2- 172.21.15.124:0/792397571 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f87fc06af00 0x7f87fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:48.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.672+0000 7f881dcec700 1 --2- 172.21.15.124:0/792397571 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f87fc06af00 0x7f87fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:48.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.672+0000 7f880effd700 1 -- 172.21.15.124:0/792397571 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8808089120 con 0x7f8804004d90 2023-10-16T12:58:48.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.672+0000 7f881dcec700 1 --2- 172.21.15.124:0/792397571 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f87fc06af00 0x7f87fc06d3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f881815e4b0 tx=0x7f8814000f80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:48.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.676+0000 7f880effd700 1 -- 172.21.15.124:0/792397571 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8808054530 con 0x7f8804004d90 2023-10-16T12:58:48.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.864+0000 7f8820751700 1 -- 172.21.15.124:0/792397571 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f88180c3970 con 0x7f8804004d90 2023-10-16T12:58:48.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.864+0000 7f880effd700 1 -- 172.21.15.124:0/792397571 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8808057b50 con 0x7f8804004d90 2023-10-16T12:58:48.868 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-16T12:58:48.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.866+0000 7f8820751700 1 -- 172.21.15.124:0/792397571 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f87fc06af00 msgr2=0x7f87fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:48.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.866+0000 7f8820751700 1 --2- 172.21.15.124:0/792397571 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f87fc06af00 0x7f87fc06d3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f881815e4b0 tx=0x7f8814000f80 comp rx=0 tx=0).stop 2023-10-16T12:58:48.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.866+0000 7f8820751700 1 -- 172.21.15.124:0/792397571 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8804004d90 msgr2=0x7f88181ee130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:48.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.866+0000 7f8820751700 1 --2- 172.21.15.124:0/792397571 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8804004d90 0x7f88181ee130 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f880800f8e0 tx=0x7f880800fbf0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.866+0000 7f8820751700 1 -- 172.21.15.124:0/792397571 shutdown_connections 2023-10-16T12:58:48.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.866+0000 7f8820751700 1 --2- 172.21.15.124:0/792397571 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f87fc06af00 0x7f87fc06d3c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.866+0000 7f8820751700 1 --2- 172.21.15.124:0/792397571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88181557b0 0x7f8818155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.871 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.866+0000 7f8820751700 1 --2- 172.21.15.124:0/792397571 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8804004d90 0x7f88181ee130 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.871 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.866+0000 7f8820751700 1 --2- 172.21.15.124:0/792397571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88181533b0 0x7f88181f1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:48.871 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.866+0000 7f8820751700 1 -- 172.21.15.124:0/792397571 >> 172.21.15.124:0/792397571 conn(0x7f88180ccbe0 msgr2=0x7f881815a070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:48.871 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.866+0000 7f8820751700 1 -- 172.21.15.124:0/792397571 shutdown_connections 2023-10-16T12:58:48.871 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.866+0000 7f8820751700 1 -- 172.21.15.124:0/792397571 wait complete. 2023-10-16T12:58:48.881 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-16T12:58:49.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:48.999+0000 7fdc60241700 1 Processor -- start 2023-10-16T12:58:49.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.000+0000 7fdc60241700 1 -- start start 2023-10-16T12:58:49.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.000+0000 7fdc60241700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc5815daa0 0x7fdc580af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:49.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.000+0000 7fdc60241700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdc58071f60 0x7fdc5806d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:49.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.000+0000 7fdc60241700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc5815ed10 con 0x7fdc580af560 2023-10-16T12:58:49.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.000+0000 7fdc60241700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc5815de80 con 0x7fdc58071f60 2023-10-16T12:58:49.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.000+0000 7fdc60241700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5815e100 con 0x7fdc5815daa0 2023-10-16T12:58:49.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.001+0000 7fdc5dfdd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc5815daa0 0x7fdc580af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:49.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.001+0000 7fdc5e7de700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdc58071f60 0x7fdc5806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:49.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.001+0000 7fdc5dfdd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc5815daa0 0x7fdc580af020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:39056/0 (socket says 172.21.15.124:39056) 2023-10-16T12:58:49.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.001+0000 7fdc5e7de700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdc58071f60 0x7fdc5806d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:33148/0 (socket says 172.21.15.124:33148) 2023-10-16T12:58:49.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.001+0000 7fdc5dfdd700 1 -- 172.21.15.124:0/923948174 learned_addr learned my addr 172.21.15.124:0/923948174 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:49.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.001+0000 7fdc5d7dc700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fdc580af560 0x7fdc58071850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.124:53642/0 (socket says 172.21.15.124:53642) 2023-10-16T12:58:49.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.001+0000 7fdc5e7de700 1 -- 172.21.15.124:0/923948174 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc5815daa0 msgr2=0x7fdc580af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:49.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.001+0000 7fdc5e7de700 1 --2- 172.21.15.124:0/923948174 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc5815daa0 0x7fdc580af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:49.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.001+0000 7fdc5e7de700 1 -- 172.21.15.124:0/923948174 >> v1:172.21.15.192:6789/0 conn(0x7fdc580af560 legacy=0x7fdc58071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:49.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.001+0000 7fdc5cfdb700 1 -- 172.21.15.124:0/923948174 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3756702488 0 0) 0x7fdc5815ed10 con 0x7fdc580af560 2023-10-16T12:58:49.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.001+0000 7fdc5e7de700 1 -- 172.21.15.124:0/923948174 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5815e3e0 con 0x7fdc58071f60 2023-10-16T12:58:49.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.001+0000 7fdc5e7de700 1 --2- 172.21.15.124:0/923948174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc58071f60 0x7fdc5806d100 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009d90 tx=0x7fdc5000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8e0b4ed6d8c9ffb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:49.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.001+0000 7fdc5cfdb700 1 -- 172.21.15.124:0/923948174 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5000e070 con 0x7fdc58071f60 2023-10-16T12:58:49.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.001+0000 7fdc5cfdb700 1 -- 172.21.15.124:0/923948174 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5000bb20 con 0x7fdc58071f60 2023-10-16T12:58:49.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.001+0000 7fdc5cfdb700 1 -- 172.21.15.124:0/923948174 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50012430 con 0x7fdc58071f60 2023-10-16T12:58:49.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.002+0000 7fdc60241700 1 -- 172.21.15.124:0/923948174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc58071f60 msgr2=0x7fdc5806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:49.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.002+0000 7fdc60241700 1 --2- 172.21.15.124:0/923948174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc58071f60 0x7fdc5806d100 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009d90 tx=0x7fdc5000b330 comp rx=0 tx=0).stop 2023-10-16T12:58:49.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.002+0000 7fdc60241700 1 -- 172.21.15.124:0/923948174 shutdown_connections 2023-10-16T12:58:49.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.002+0000 7fdc60241700 1 --2- 172.21.15.124:0/923948174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc58071f60 0x7fdc5806d100 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:49.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.002+0000 7fdc60241700 1 --2- 172.21.15.124:0/923948174 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc5815daa0 0x7fdc580af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:49.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.002+0000 7fdc60241700 1 -- 172.21.15.124:0/923948174 >> 172.21.15.124:0/923948174 conn(0x7fdc580d0180 msgr2=0x7fdc580d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:49.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.002+0000 7fdc60241700 1 -- 172.21.15.124:0/923948174 shutdown_connections 2023-10-16T12:58:49.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.002+0000 7fdc60241700 1 -- 172.21.15.124:0/923948174 wait complete. 2023-10-16T12:58:49.012 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.003+0000 7fdc60241700 1 Processor -- start 2023-10-16T12:58:49.012 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.003+0000 7fdc60241700 1 -- start start 2023-10-16T12:58:49.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.004+0000 7fdc60241700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc58071f60 0x7fdc580c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:49.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.004+0000 7fdc60241700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc580af560 0x7fdc580c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:49.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.004+0000 7fdc60241700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdc5815daa0 0x7fdc58157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:49.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.004+0000 7fdc60241700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc58145be0 con 0x7fdc5815daa0 2023-10-16T12:58:49.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.004+0000 7fdc60241700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc580c2fe0 con 0x7fdc580af560 2023-10-16T12:58:49.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.004+0000 7fdc60241700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc580c9a00 con 0x7fdc58071f60 2023-10-16T12:58:49.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.004+0000 7fdc5e7de700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdc5815daa0 0x7fdc58157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:49.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.004+0000 7fdc5e7de700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdc5815daa0 0x7fdc58157e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52988/0 (socket says 172.21.15.124:52988) 2023-10-16T12:58:49.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.004+0000 7fdc5e7de700 1 -- 172.21.15.124:0/2423023221 learned_addr learned my addr 172.21.15.124:0/2423023221 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:49.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.004+0000 7fdc5d7dc700 1 --2- 172.21.15.124:0/2423023221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc580af560 0x7fdc580c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:49.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.004+0000 7fdc5dfdd700 1 --2- 172.21.15.124:0/2423023221 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc58071f60 0x7fdc580c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:49.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.004+0000 7fdc5e7de700 1 -- 172.21.15.124:0/2423023221 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc58071f60 msgr2=0x7fdc580c2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:49.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.004+0000 7fdc5e7de700 1 --2- 172.21.15.124:0/2423023221 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc58071f60 0x7fdc580c2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:49.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.004+0000 7fdc5e7de700 1 -- 172.21.15.124:0/2423023221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc580af560 msgr2=0x7fdc580c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:49.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.004+0000 7fdc5e7de700 1 --2- 172.21.15.124:0/2423023221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc580af560 0x7fdc580c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:49.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.004+0000 7fdc5e7de700 1 -- 172.21.15.124:0/2423023221 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc50009a70 con 0x7fdc5815daa0 2023-10-16T12:58:49.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.004+0000 7fdc5dfdd700 1 --2- 172.21.15.124:0/2423023221 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc58071f60 0x7fdc580c2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:58:49.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.005+0000 7fdc5e7de700 1 --2- 172.21.15.124:0/2423023221 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdc5815daa0 0x7fdc58157e10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000b370 tx=0x7fdc50004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:49.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.005+0000 7fdc4e7fc700 1 -- 172.21.15.124:0/2423023221 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50012430 con 0x7fdc5815daa0 2023-10-16T12:58:49.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.005+0000 7fdc4e7fc700 1 -- 172.21.15.124:0/2423023221 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc50020070 con 0x7fdc5815daa0 2023-10-16T12:58:49.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.005+0000 7fdc60241700 1 -- 172.21.15.124:0/2423023221 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc580c9ce0 con 0x7fdc5815daa0 2023-10-16T12:58:49.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.005+0000 7fdc4e7fc700 1 -- 172.21.15.124:0/2423023221 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50004280 con 0x7fdc5815daa0 2023-10-16T12:58:49.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.005+0000 7fdc60241700 1 -- 172.21.15.124:0/2423023221 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc58145870 con 0x7fdc5815daa0 2023-10-16T12:58:49.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.006+0000 7fdc60241700 1 -- 172.21.15.124:0/2423023221 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc5804ebb0 con 0x7fdc5815daa0 2023-10-16T12:58:49.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.006+0000 7fdc4e7fc700 1 -- 172.21.15.124:0/2423023221 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdc500043e0 con 0x7fdc5815daa0 2023-10-16T12:58:49.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.006+0000 7fdc4e7fc700 1 --2- 172.21.15.124:0/2423023221 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fdc3c06af00 0x7fdc3c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:49.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.007+0000 7fdc5dfdd700 1 --2- 172.21.15.124:0/2423023221 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fdc3c06af00 0x7fdc3c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:49.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.007+0000 7fdc4e7fc700 1 -- 172.21.15.124:0/2423023221 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdc50022070 con 0x7fdc5815daa0 2023-10-16T12:58:49.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.007+0000 7fdc5dfdd700 1 --2- 172.21.15.124:0/2423023221 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fdc3c06af00 0x7fdc3c06d3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009c20 tx=0x7fdc48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:49.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.011+0000 7fdc4e7fc700 1 -- 172.21.15.124:0/2423023221 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdc50056370 con 0x7fdc5815daa0 2023-10-16T12:58:49.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.202+0000 7fdc60241700 1 -- 172.21.15.124:0/2423023221 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdc58145d20 con 0x7fdc5815daa0 2023-10-16T12:58:49.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.202+0000 7fdc4e7fc700 1 -- 172.21.15.124:0/2423023221 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fdc5002c020 con 0x7fdc5815daa0 2023-10-16T12:58:49.205 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:58:49.205 INFO:teuthology.orchestra.run.smithi124.stdout:[ 2023-10-16T12:58:49.205 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:58:49.206 INFO:teuthology.orchestra.run.smithi124.stdout: "poolnum": 1, 2023-10-16T12:58:49.206 INFO:teuthology.orchestra.run.smithi124.stdout: "poolname": ".mgr" 2023-10-16T12:58:49.206 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:58:49.206 INFO:teuthology.orchestra.run.smithi124.stdout:] 2023-10-16T12:58:49.207 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.204+0000 7fdc60241700 1 -- 172.21.15.124:0/2423023221 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fdc3c06af00 msgr2=0x7fdc3c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:49.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.204+0000 7fdc60241700 1 --2- 172.21.15.124:0/2423023221 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fdc3c06af00 0x7fdc3c06d3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009c20 tx=0x7fdc48008040 comp rx=0 tx=0).stop 2023-10-16T12:58:49.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.204+0000 7fdc60241700 1 -- 172.21.15.124:0/2423023221 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdc5815daa0 msgr2=0x7fdc58157e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:49.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.204+0000 7fdc60241700 1 --2- 172.21.15.124:0/2423023221 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdc5815daa0 0x7fdc58157e10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000b370 tx=0x7fdc50004b20 comp rx=0 tx=0).stop 2023-10-16T12:58:49.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.204+0000 7fdc60241700 1 -- 172.21.15.124:0/2423023221 shutdown_connections 2023-10-16T12:58:49.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.204+0000 7fdc60241700 1 --2- 172.21.15.124:0/2423023221 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fdc3c06af00 0x7fdc3c06d3c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:49.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.204+0000 7fdc60241700 1 --2- 172.21.15.124:0/2423023221 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdc5815daa0 0x7fdc58157e10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:49.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.204+0000 7fdc60241700 1 --2- 172.21.15.124:0/2423023221 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc58071f60 0x7fdc580c2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:49.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.204+0000 7fdc60241700 1 --2- 172.21.15.124:0/2423023221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc580af560 0x7fdc580c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:49.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.204+0000 7fdc60241700 1 -- 172.21.15.124:0/2423023221 >> 172.21.15.124:0/2423023221 conn(0x7fdc580d0180 msgr2=0x7fdc580cb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:49.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.204+0000 7fdc60241700 1 -- 172.21.15.124:0/2423023221 shutdown_connections 2023-10-16T12:58:49.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.204+0000 7fdc60241700 1 -- 172.21.15.124:0/2423023221 wait complete. 2023-10-16T12:58:49.218 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-16T12:58:49.219 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-16T12:58:49.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.340+0000 7f87933fa700 1 Processor -- start 2023-10-16T12:58:49.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.340+0000 7f87933fa700 1 -- start start 2023-10-16T12:58:49.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.341+0000 7f87933fa700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f878c06bd30 0x7f878c0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:49.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.341+0000 7f87933fa700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f878c0ce280 0x7f878c0ca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:49.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.341+0000 7f87933fa700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878c159f30 con 0x7f878c159b50 2023-10-16T12:58:49.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.341+0000 7f87933fa700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878c06c1e0 con 0x7f878c06bd30 2023-10-16T12:58:49.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.341+0000 7f87933fa700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878c0ce6d0 con 0x7f878c0ce280 2023-10-16T12:58:49.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.341+0000 7f8790995700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f878c06bd30 0x7f878c0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:49.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.341+0000 7f8791196700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f878c159b50 0x7f878c06e310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:41660/0 (socket says 172.21.15.124:41660) 2023-10-16T12:58:49.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.341+0000 7f8791196700 1 -- 172.21.15.124:0/2095528177 learned_addr learned my addr 172.21.15.124:0/2095528177 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:58:49.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.341+0000 7f8791997700 1 --2- 172.21.15.124:0/2095528177 >> v2:172.21.15.192:3300/0 conn(0x7f878c0ce280 0x7f878c0ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:49.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.341+0000 7f8790995700 1 -- 172.21.15.124:0/2095528177 >> v2:172.21.15.192:3300/0 conn(0x7f878c0ce280 msgr2=0x7f878c0ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:49.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.341+0000 7f8790995700 1 --2- 172.21.15.124:0/2095528177 >> v2:172.21.15.192:3300/0 conn(0x7f878c0ce280 0x7f878c0ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:49.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.341+0000 7f8790995700 1 -- 172.21.15.124:0/2095528177 >> v1:172.21.15.124:6789/0 conn(0x7f878c159b50 legacy=0x7f878c06e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:49.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.341+0000 7f8783fff700 1 -- 172.21.15.124:0/2095528177 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046142457 0 0) 0x7f878c159f30 con 0x7f878c159b50 2023-10-16T12:58:49.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.341+0000 7f8790995700 1 -- 172.21.15.124:0/2095528177 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c06ea20 con 0x7f878c06bd30 2023-10-16T12:58:49.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.341+0000 7f8790995700 1 --2- 172.21.15.124:0/2095528177 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f878c06bd30 0x7f878c0cdd40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f878c0cd570 tx=0x7f8788009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd8211fcd706959 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:49.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.341+0000 7f8783fff700 1 -- 172.21.15.124:0/2095528177 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878800c820 con 0x7f878c06bd30 2023-10-16T12:58:49.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.342+0000 7f8783fff700 1 -- 172.21.15.124:0/2095528177 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878800c980 con 0x7f878c06bd30 2023-10-16T12:58:49.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.342+0000 7f8783fff700 1 -- 172.21.15.124:0/2095528177 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878800cd10 con 0x7f878c06bd30 2023-10-16T12:58:49.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.342+0000 7f87933fa700 1 -- 172.21.15.124:0/2095528177 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f878c06bd30 msgr2=0x7f878c0cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:49.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.342+0000 7f87933fa700 1 --2- 172.21.15.124:0/2095528177 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f878c06bd30 0x7f878c0cdd40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f878c0cd570 tx=0x7f8788009b20 comp rx=0 tx=0).stop 2023-10-16T12:58:49.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.342+0000 7f87933fa700 1 -- 172.21.15.124:0/2095528177 shutdown_connections 2023-10-16T12:58:49.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.342+0000 7f87933fa700 1 --2- 172.21.15.124:0/2095528177 >> v2:172.21.15.192:3300/0 conn(0x7f878c0ce280 0x7f878c0ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:49.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.342+0000 7f87933fa700 1 --2- 172.21.15.124:0/2095528177 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f878c06bd30 0x7f878c0cdd40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:49.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.342+0000 7f87933fa700 1 -- 172.21.15.124:0/2095528177 >> 172.21.15.124:0/2095528177 conn(0x7f878c0b13e0 msgr2=0x7f878c0b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:49.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.342+0000 7f87933fa700 1 -- 172.21.15.124:0/2095528177 shutdown_connections 2023-10-16T12:58:49.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.342+0000 7f87933fa700 1 -- 172.21.15.124:0/2095528177 wait complete. 2023-10-16T12:58:49.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.344+0000 7f87933fa700 1 Processor -- start 2023-10-16T12:58:49.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.344+0000 7f87933fa700 1 -- start start 2023-10-16T12:58:49.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.345+0000 7f87933fa700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f878c06bd30 0x7f878c152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:49.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.345+0000 7f87933fa700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f878c0ce280 0x7f878c159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:49.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.345+0000 7f87933fa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f878c159b50 0x7f878c15c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:49.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.345+0000 7f87933fa700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c1535e0 con 0x7f878c06bd30 2023-10-16T12:58:49.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.345+0000 7f87933fa700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c153390 con 0x7f878c0ce280 2023-10-16T12:58:49.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.345+0000 7f87933fa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878c14c5c0 con 0x7f878c159b50 2023-10-16T12:58:49.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.345+0000 7f8791196700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f878c06bd30 0x7f878c152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:49.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.345+0000 7f8791196700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f878c06bd30 0x7f878c152e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:52998/0 (socket says 172.21.15.124:52998) 2023-10-16T12:58:49.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.345+0000 7f8791196700 1 -- 172.21.15.124:0/1754974500 learned_addr learned my addr 172.21.15.124:0/1754974500 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:49.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.345+0000 7f8790995700 1 --2- 172.21.15.124:0/1754974500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f878c0ce280 0x7f878c159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:49.356 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.345+0000 7f8791997700 1 --2- 172.21.15.124:0/1754974500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f878c159b50 0x7f878c15c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:49.356 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.345+0000 7f8791196700 1 -- 172.21.15.124:0/1754974500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f878c159b50 msgr2=0x7f878c15c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:49.356 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.345+0000 7f8791196700 1 --2- 172.21.15.124:0/1754974500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f878c159b50 0x7f878c15c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:49.356 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.345+0000 7f8791196700 1 -- 172.21.15.124:0/1754974500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f878c0ce280 msgr2=0x7f878c159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:49.356 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.345+0000 7f8791196700 1 --2- 172.21.15.124:0/1754974500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f878c0ce280 0x7f878c159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:49.357 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.345+0000 7f8791196700 1 -- 172.21.15.124:0/1754974500 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87880094a0 con 0x7f878c06bd30 2023-10-16T12:58:49.357 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.345+0000 7f8790995700 1 --2- 172.21.15.124:0/1754974500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f878c0ce280 0x7f878c159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:58:49.357 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.345+0000 7f8791196700 1 --2- 172.21.15.124:0/1754974500 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f878c06bd30 0x7f878c152e50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f877c00c550 tx=0x7f877c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:49.357 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.345+0000 7f8781ffb700 1 -- 172.21.15.124:0/1754974500 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c004c80 con 0x7f878c06bd30 2023-10-16T12:58:49.357 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.345+0000 7f8781ffb700 1 -- 172.21.15.124:0/1754974500 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877c004e00 con 0x7f878c06bd30 2023-10-16T12:58:49.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.345+0000 7f87933fa700 1 -- 172.21.15.124:0/1754974500 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878c14e510 con 0x7f878c06bd30 2023-10-16T12:58:49.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.345+0000 7f8781ffb700 1 -- 172.21.15.124:0/1754974500 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c007310 con 0x7f878c06bd30 2023-10-16T12:58:49.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.346+0000 7f87933fa700 1 -- 172.21.15.124:0/1754974500 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878c14ea90 con 0x7f878c06bd30 2023-10-16T12:58:49.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.347+0000 7f87933fa700 1 -- 172.21.15.124:0/1754974500 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f878c04ebb0 con 0x7f878c06bd30 2023-10-16T12:58:49.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.347+0000 7f8781ffb700 1 -- 172.21.15.124:0/1754974500 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f877c007470 con 0x7f878c06bd30 2023-10-16T12:58:49.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.347+0000 7f8781ffb700 1 --2- 172.21.15.124:0/1754974500 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f877006af00 0x7f877006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:49.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.347+0000 7f8781ffb700 1 -- 172.21.15.124:0/1754974500 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f877c089030 con 0x7f878c06bd30 2023-10-16T12:58:49.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.347+0000 7f8790995700 1 --2- 172.21.15.124:0/1754974500 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f877006af00 0x7f877006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:49.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.348+0000 7f8790995700 1 --2- 172.21.15.124:0/1754974500 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f877006af00 0x7f877006d3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8788000c00 tx=0x7f8788008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:49.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.352+0000 7f8781ffb700 1 -- 172.21.15.124:0/1754974500 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f877c0543a0 con 0x7f878c06bd30 2023-10-16T12:58:49.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.543+0000 7f87933fa700 1 -- 172.21.15.124:0/1754974500 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f878c0c9ca0 con 0x7f878c06bd30 2023-10-16T12:58:49.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.647+0000 7f8781ffb700 1 -- 172.21.15.124:0/1754974500 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f877c0579c0 con 0x7f878c06bd30 2023-10-16T12:58:49.653 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.650+0000 7f87933fa700 1 -- 172.21.15.124:0/1754974500 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f877006af00 msgr2=0x7f877006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:49.653 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.650+0000 7f87933fa700 1 --2- 172.21.15.124:0/1754974500 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f877006af00 0x7f877006d3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8788000c00 tx=0x7f8788008030 comp rx=0 tx=0).stop 2023-10-16T12:58:49.653 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.650+0000 7f87933fa700 1 -- 172.21.15.124:0/1754974500 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f878c06bd30 msgr2=0x7f878c152e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:49.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.650+0000 7f87933fa700 1 --2- 172.21.15.124:0/1754974500 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f878c06bd30 0x7f878c152e50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f877c00c550 tx=0x7f877c00c910 comp rx=0 tx=0).stop 2023-10-16T12:58:49.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.652+0000 7f87933fa700 1 -- 172.21.15.124:0/1754974500 shutdown_connections 2023-10-16T12:58:49.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.652+0000 7f87933fa700 1 --2- 172.21.15.124:0/1754974500 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f877006af00 0x7f877006d3c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:49.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.652+0000 7f87933fa700 1 --2- 172.21.15.124:0/1754974500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f878c159b50 0x7f878c15c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:49.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.652+0000 7f87933fa700 1 --2- 172.21.15.124:0/1754974500 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f878c06bd30 0x7f878c152e50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:49.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.652+0000 7f87933fa700 1 --2- 172.21.15.124:0/1754974500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f878c0ce280 0x7f878c159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:49.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.652+0000 7f87933fa700 1 -- 172.21.15.124:0/1754974500 >> 172.21.15.124:0/1754974500 conn(0x7f878c0b13e0 msgr2=0x7f878c0cd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:49.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.652+0000 7f87933fa700 1 -- 172.21.15.124:0/1754974500 shutdown_connections 2023-10-16T12:58:49.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.652+0000 7f87933fa700 1 -- 172.21.15.124:0/1754974500 wait complete. 2023-10-16T12:58:49.657 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_metadata' created 2023-10-16T12:58:49.668 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-16T12:58:49.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.792+0000 7f50b63b1700 1 Processor -- start 2023-10-16T12:58:49.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.792+0000 7f50b63b1700 1 -- start start 2023-10-16T12:58:49.797 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.793+0000 7f50b63b1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50b015a710 0x7f50b015ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:49.797 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.793+0000 7f50b63b1700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f50b00ce740 0x7f50b0071880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:49.797 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.793+0000 7f50b63b1700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b00ce520 con 0x7f50b015a330 2023-10-16T12:58:49.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.793+0000 7f50b63b1700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b015e5e0 con 0x7f50b00ce740 2023-10-16T12:58:49.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.793+0000 7f50b63b1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b00cdf60 con 0x7f50b015a710 2023-10-16T12:58:49.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.793+0000 7f50b494e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f50b00ce740 0x7f50b0071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:49.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.793+0000 7f50affff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f50b015a330 0x7f50b00725c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:41674/0 (socket says 172.21.15.124:41674) 2023-10-16T12:58:49.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.793+0000 7f50affff700 1 -- 172.21.15.124:0/805278644 learned_addr learned my addr 172.21.15.124:0/805278644 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:58:49.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.793+0000 7f50af7fe700 1 --2- 172.21.15.124:0/805278644 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50b015a710 0x7f50b015ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:49.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.793+0000 7f50b494e700 1 -- 172.21.15.124:0/805278644 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50b015a710 msgr2=0x7f50b015ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:49.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.793+0000 7f50b494e700 1 --2- 172.21.15.124:0/805278644 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50b015a710 0x7f50b015ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:49.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.793+0000 7f50b494e700 1 -- 172.21.15.124:0/805278644 >> v1:172.21.15.124:6789/0 conn(0x7f50b015a330 legacy=0x7f50b00725c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:49.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.793+0000 7f50aeffd700 1 -- 172.21.15.124:0/805278644 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297871484 0 0) 0x7f50b00ce520 con 0x7f50b015a330 2023-10-16T12:58:49.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.793+0000 7f50b494e700 1 -- 172.21.15.124:0/805278644 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b00ce240 con 0x7f50b00ce740 2023-10-16T12:58:49.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.793+0000 7f50b494e700 1 --2- 172.21.15.124:0/805278644 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50b00ce740 0x7f50b0071880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f50a8009d90 tx=0x7f50a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3e2390ac2adf1b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:49.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.793+0000 7f50aeffd700 1 -- 172.21.15.124:0/805278644 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a800e070 con 0x7f50b00ce740 2023-10-16T12:58:49.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.793+0000 7f50aeffd700 1 -- 172.21.15.124:0/805278644 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a800bbd0 con 0x7f50b00ce740 2023-10-16T12:58:49.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.793+0000 7f50aeffd700 1 -- 172.21.15.124:0/805278644 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a8012430 con 0x7f50b00ce740 2023-10-16T12:58:49.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.794+0000 7f50b63b1700 1 -- 172.21.15.124:0/805278644 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50b00ce740 msgr2=0x7f50b0071880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:49.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.794+0000 7f50b63b1700 1 --2- 172.21.15.124:0/805278644 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50b00ce740 0x7f50b0071880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f50a8009d90 tx=0x7f50a800b330 comp rx=0 tx=0).stop 2023-10-16T12:58:49.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.794+0000 7f50b63b1700 1 -- 172.21.15.124:0/805278644 shutdown_connections 2023-10-16T12:58:49.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.794+0000 7f50b63b1700 1 --2- 172.21.15.124:0/805278644 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50b00ce740 0x7f50b0071880 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:49.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.794+0000 7f50b63b1700 1 --2- 172.21.15.124:0/805278644 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50b015a710 0x7f50b015ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:49.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.794+0000 7f50b63b1700 1 -- 172.21.15.124:0/805278644 >> 172.21.15.124:0/805278644 conn(0x7f50b00ccce0 msgr2=0x7f50b00cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:49.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.794+0000 7f50b63b1700 1 -- 172.21.15.124:0/805278644 shutdown_connections 2023-10-16T12:58:49.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.794+0000 7f50b63b1700 1 -- 172.21.15.124:0/805278644 wait complete. 2023-10-16T12:58:49.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.795+0000 7f50b63b1700 1 Processor -- start 2023-10-16T12:58:49.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.795+0000 7f50b63b1700 1 -- start start 2023-10-16T12:58:49.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.796+0000 7f50b63b1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50b00ce740 0x7f50b0156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:49.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.796+0000 7f50b63b1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50b015a330 0x7f50b015c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:49.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.796+0000 7f50b63b1700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50b015a710 0x7f50b015c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:49.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.796+0000 7f50b63b1700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b00b5a30 con 0x7f50b015a710 2023-10-16T12:58:49.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.796+0000 7f50b63b1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b0156da0 con 0x7f50b015a330 2023-10-16T12:58:49.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.796+0000 7f50b63b1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b00b4e20 con 0x7f50b00ce740 2023-10-16T12:58:49.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.796+0000 7f50b494e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50b015a710 0x7f50b015c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:49.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.796+0000 7f50b494e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50b015a710 0x7f50b015c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53014/0 (socket says 172.21.15.124:53014) 2023-10-16T12:58:49.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.796+0000 7f50b494e700 1 -- 172.21.15.124:0/2753623030 learned_addr learned my addr 172.21.15.124:0/2753623030 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:49.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.796+0000 7f50b494e700 1 -- 172.21.15.124:0/2753623030 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50b00ce740 msgr2=0x7f50b0156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:49.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.796+0000 7f50b494e700 1 --2- 172.21.15.124:0/2753623030 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50b00ce740 0x7f50b0156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:49.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.796+0000 7f50af7fe700 1 --2- 172.21.15.124:0/2753623030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50b015a330 0x7f50b015c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:49.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.796+0000 7f50b494e700 1 -- 172.21.15.124:0/2753623030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50b015a330 msgr2=0x7f50b015c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:49.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.796+0000 7f50b494e700 1 --2- 172.21.15.124:0/2753623030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50b015a330 0x7f50b015c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:49.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.796+0000 7f50b494e700 1 -- 172.21.15.124:0/2753623030 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a8009a70 con 0x7f50b015a710 2023-10-16T12:58:49.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.797+0000 7f50b494e700 1 --2- 172.21.15.124:0/2753623030 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50b015a710 0x7f50b015c7a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f50a8014040 tx=0x7f50a8004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:49.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.797+0000 7f50acff9700 1 -- 172.21.15.124:0/2753623030 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a8012430 con 0x7f50b015a710 2023-10-16T12:58:49.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.797+0000 7f50acff9700 1 -- 172.21.15.124:0/2753623030 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a8020070 con 0x7f50b015a710 2023-10-16T12:58:49.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.797+0000 7f50acff9700 1 -- 172.21.15.124:0/2753623030 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a8004480 con 0x7f50b015a710 2023-10-16T12:58:49.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.797+0000 7f50b63b1700 1 -- 172.21.15.124:0/2753623030 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b00b5100 con 0x7f50b015a710 2023-10-16T12:58:49.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.797+0000 7f50b63b1700 1 -- 172.21.15.124:0/2753623030 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b00b56c0 con 0x7f50b015a710 2023-10-16T12:58:49.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.798+0000 7f50b63b1700 1 -- 172.21.15.124:0/2753623030 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b00b5850 con 0x7f50b015a710 2023-10-16T12:58:49.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.798+0000 7f50acff9700 1 -- 172.21.15.124:0/2753623030 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f50a80045e0 con 0x7f50b015a710 2023-10-16T12:58:49.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.799+0000 7f50acff9700 1 --2- 172.21.15.124:0/2753623030 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f509c06af00 0x7f509c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:49.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.799+0000 7f50acff9700 1 -- 172.21.15.124:0/2753623030 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f50a8022070 con 0x7f50b015a710 2023-10-16T12:58:49.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.799+0000 7f50affff700 1 --2- 172.21.15.124:0/2753623030 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f509c06af00 0x7f509c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:49.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.799+0000 7f50affff700 1 --2- 172.21.15.124:0/2753623030 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f509c06af00 0x7f509c06d3c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f50a40011e0 tx=0x7f50a40079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:49.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.803+0000 7f50acff9700 1 -- 172.21.15.124:0/2753623030 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f50a8056650 con 0x7f50b015a710 2023-10-16T12:58:49.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:49.992+0000 7f50b63b1700 1 -- 172.21.15.124:0/2753623030 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f50b00b5b70 con 0x7f50b015a710 2023-10-16T12:58:50.114 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:58:50.117 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:58:50.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.652+0000 7f50acff9700 1 -- 172.21.15.124:0/2753623030 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7f50b00b5b70 con 0x7f50b015a710 2023-10-16T12:58:50.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.655+0000 7f50b63b1700 1 -- 172.21.15.124:0/2753623030 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f509c06af00 msgr2=0x7f509c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:50.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.655+0000 7f50b63b1700 1 --2- 172.21.15.124:0/2753623030 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f509c06af00 0x7f509c06d3c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f50a40011e0 tx=0x7f50a40079b0 comp rx=0 tx=0).stop 2023-10-16T12:58:50.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.655+0000 7f50b63b1700 1 -- 172.21.15.124:0/2753623030 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50b015a710 msgr2=0x7f50b015c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:50.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.655+0000 7f50b63b1700 1 --2- 172.21.15.124:0/2753623030 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50b015a710 0x7f50b015c7a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f50a8014040 tx=0x7f50a8004b20 comp rx=0 tx=0).stop 2023-10-16T12:58:50.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.655+0000 7f50b63b1700 1 -- 172.21.15.124:0/2753623030 shutdown_connections 2023-10-16T12:58:50.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.655+0000 7f50b63b1700 1 --2- 172.21.15.124:0/2753623030 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f509c06af00 0x7f509c06d3c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:50.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.655+0000 7f50b63b1700 1 --2- 172.21.15.124:0/2753623030 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50b015a710 0x7f50b015c7a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:50.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.655+0000 7f50b63b1700 1 --2- 172.21.15.124:0/2753623030 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50b00ce740 0x7f50b0156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:50.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.655+0000 7f50b63b1700 1 --2- 172.21.15.124:0/2753623030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50b015a330 0x7f50b015c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:50.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.655+0000 7f50b63b1700 1 -- 172.21.15.124:0/2753623030 >> 172.21.15.124:0/2753623030 conn(0x7f50b00ccce0 msgr2=0x7f50b0072520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:50.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.655+0000 7f50b63b1700 1 -- 172.21.15.124:0/2753623030 shutdown_connections 2023-10-16T12:58:50.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.655+0000 7f50b63b1700 1 -- 172.21.15.124:0/2753623030 wait complete. 2023-10-16T12:58:50.660 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_data' created 2023-10-16T12:58:50.677 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-16T12:58:50.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.799+0000 7f06e2de8700 1 Processor -- start 2023-10-16T12:58:50.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.799+0000 7f06e2de8700 1 -- start start 2023-10-16T12:58:50.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.800+0000 7f06e2de8700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f06dc15a250 0x7f06dc0717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:50.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.800+0000 7f06e2de8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f06dc15dec0 0x7f06dc06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:50.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.800+0000 7f06e2de8700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06dc0cba90 con 0x7f06dc15e350 2023-10-16T12:58:50.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.800+0000 7f06e2de8700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06dc0cb510 con 0x7f06dc15a250 2023-10-16T12:58:50.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.800+0000 7f06e2de8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06dc15ee40 con 0x7f06dc15dec0 2023-10-16T12:58:50.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.800+0000 7f06e0b84700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f06dc15a250 0x7f06dc0717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:50.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.800+0000 7f06e1385700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f06dc15e350 0x7f06dc0cbf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:41688/0 (socket says 172.21.15.124:41688) 2023-10-16T12:58:50.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.800+0000 7f06e1385700 1 -- 172.21.15.124:0/2806540369 learned_addr learned my addr 172.21.15.124:0/2806540369 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:58:50.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.800+0000 7f06dbfff700 1 --2- 172.21.15.124:0/2806540369 >> v2:172.21.15.192:3300/0 conn(0x7f06dc15dec0 0x7f06dc06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:50.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.800+0000 7f06e0b84700 1 -- 172.21.15.124:0/2806540369 >> v2:172.21.15.192:3300/0 conn(0x7f06dc15dec0 msgr2=0x7f06dc06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:50.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.800+0000 7f06e0b84700 1 --2- 172.21.15.124:0/2806540369 >> v2:172.21.15.192:3300/0 conn(0x7f06dc15dec0 0x7f06dc06d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:50.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.800+0000 7f06e0b84700 1 -- 172.21.15.124:0/2806540369 >> v1:172.21.15.124:6789/0 conn(0x7f06dc15e350 legacy=0x7f06dc0cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:50.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.800+0000 7f06e0b84700 1 -- 172.21.15.124:0/2806540369 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc15e880 con 0x7f06dc15a250 2023-10-16T12:58:50.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.800+0000 7f06db7fe700 1 -- 172.21.15.124:0/2806540369 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892002329 0 0) 0x7f06dc0cba90 con 0x7f06dc15e350 2023-10-16T12:58:50.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.800+0000 7f06e0b84700 1 --2- 172.21.15.124:0/2806540369 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f06dc15a250 0x7f06dc0717b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0af840 tx=0x7f06d0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e100e4467f29462 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:50.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.800+0000 7f06db7fe700 1 -- 172.21.15.124:0/2806540369 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0011830 con 0x7f06dc15a250 2023-10-16T12:58:50.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.801+0000 7f06db7fe700 1 -- 172.21.15.124:0/2806540369 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d0011990 con 0x7f06dc15a250 2023-10-16T12:58:50.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.801+0000 7f06db7fe700 1 -- 172.21.15.124:0/2806540369 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0011d20 con 0x7f06dc15a250 2023-10-16T12:58:50.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.801+0000 7f06e2de8700 1 -- 172.21.15.124:0/2806540369 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f06dc15a250 msgr2=0x7f06dc0717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:50.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.801+0000 7f06e2de8700 1 --2- 172.21.15.124:0/2806540369 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f06dc15a250 0x7f06dc0717b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0af840 tx=0x7f06d0009b20 comp rx=0 tx=0).stop 2023-10-16T12:58:50.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.801+0000 7f06e2de8700 1 -- 172.21.15.124:0/2806540369 shutdown_connections 2023-10-16T12:58:50.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.801+0000 7f06e2de8700 1 --2- 172.21.15.124:0/2806540369 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f06dc15a250 0x7f06dc0717b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:50.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.801+0000 7f06e2de8700 1 --2- 172.21.15.124:0/2806540369 >> v2:172.21.15.192:3300/0 conn(0x7f06dc15dec0 0x7f06dc06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:50.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.801+0000 7f06e2de8700 1 -- 172.21.15.124:0/2806540369 >> 172.21.15.124:0/2806540369 conn(0x7f06dc0ccbe0 msgr2=0x7f06dc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:50.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.801+0000 7f06e2de8700 1 -- 172.21.15.124:0/2806540369 shutdown_connections 2023-10-16T12:58:50.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.801+0000 7f06e2de8700 1 -- 172.21.15.124:0/2806540369 wait complete. 2023-10-16T12:58:50.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.802+0000 7f06e2de8700 1 Processor -- start 2023-10-16T12:58:50.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.802+0000 7f06e2de8700 1 -- start start 2023-10-16T12:58:50.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.803+0000 7f06e2de8700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f06dc15a250 0x7f06dc143980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:50.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.803+0000 7f06e2de8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06dc15dec0 0x7f06dc1ef390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:50.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.803+0000 7f06e2de8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06dc15e350 0x7f06dc1f2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:50.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.803+0000 7f06e2de8700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc144d70 con 0x7f06dc15a250 2023-10-16T12:58:50.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.803+0000 7f06e2de8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc143ec0 con 0x7f06dc15e350 2023-10-16T12:58:50.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.803+0000 7f06e2de8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc144160 con 0x7f06dc15dec0 2023-10-16T12:58:50.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.803+0000 7f06e0b84700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f06dc15a250 0x7f06dc143980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:50.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.803+0000 7f06e0b84700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f06dc15a250 0x7f06dc143980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53024/0 (socket says 172.21.15.124:53024) 2023-10-16T12:58:50.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.803+0000 7f06e0b84700 1 -- 172.21.15.124:0/185438336 learned_addr learned my addr 172.21.15.124:0/185438336 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:50.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.803+0000 7f06e0b84700 1 -- 172.21.15.124:0/185438336 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06dc15dec0 msgr2=0x7f06dc1ef390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:50.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.803+0000 7f06e0b84700 1 --2- 172.21.15.124:0/185438336 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06dc15dec0 0x7f06dc1ef390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:50.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.803+0000 7f06e0b84700 1 -- 172.21.15.124:0/185438336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06dc15e350 msgr2=0x7f06dc1f2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:50.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.803+0000 7f06e0b84700 1 --2- 172.21.15.124:0/185438336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06dc15e350 0x7f06dc1f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:50.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.803+0000 7f06e0b84700 1 -- 172.21.15.124:0/185438336 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d00094a0 con 0x7f06dc15a250 2023-10-16T12:58:50.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.804+0000 7f06e0b84700 1 --2- 172.21.15.124:0/185438336 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f06dc15a250 0x7f06dc143980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009b60 tx=0x7f06d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:50.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.804+0000 7f06d97fa700 1 -- 172.21.15.124:0/185438336 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d00038a0 con 0x7f06dc15a250 2023-10-16T12:58:50.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.804+0000 7f06d97fa700 1 -- 172.21.15.124:0/185438336 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d001e070 con 0x7f06dc15a250 2023-10-16T12:58:50.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.804+0000 7f06e2de8700 1 -- 172.21.15.124:0/185438336 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06dc144440 con 0x7f06dc15a250 2023-10-16T12:58:50.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.804+0000 7f06d97fa700 1 -- 172.21.15.124:0/185438336 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0003c20 con 0x7f06dc15a250 2023-10-16T12:58:50.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.804+0000 7f06e2de8700 1 -- 172.21.15.124:0/185438336 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06dc144a00 con 0x7f06dc15a250 2023-10-16T12:58:50.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.805+0000 7f06e2de8700 1 -- 172.21.15.124:0/185438336 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06dc144b90 con 0x7f06dc15a250 2023-10-16T12:58:50.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.805+0000 7f06d97fa700 1 -- 172.21.15.124:0/185438336 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f06d002d450 con 0x7f06dc15a250 2023-10-16T12:58:50.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.806+0000 7f06d97fa700 1 --2- 172.21.15.124:0/185438336 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f06c006af00 0x7f06c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:50.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.806+0000 7f06d97fa700 1 -- 172.21.15.124:0/185438336 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f06d008a5b0 con 0x7f06dc15a250 2023-10-16T12:58:50.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.806+0000 7f06dbfff700 1 --2- 172.21.15.124:0/185438336 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f06c006af00 0x7f06c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:50.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.806+0000 7f06dbfff700 1 --2- 172.21.15.124:0/185438336 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f06c006af00 0x7f06c006d3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f06dc072b10 tx=0x7f06c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:50.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:50.810+0000 7f06d97fa700 1 -- 172.21.15.124:0/185438336 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f06d0055750 con 0x7f06dc15a250 2023-10-16T12:58:51.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.045+0000 7f06e2de8700 1 -- 172.21.15.124:0/185438336 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f06dc04ebb0 con 0x7f06dc15a250 2023-10-16T12:58:51.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.654+0000 7f06d97fa700 1 -- 172.21.15.124:0/185438336 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f06d0058d70 con 0x7f06dc15a250 2023-10-16T12:58:51.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.656+0000 7f06e2de8700 1 -- 172.21.15.124:0/185438336 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f06c006af00 msgr2=0x7f06c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:51.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.656+0000 7f06e2de8700 1 --2- 172.21.15.124:0/185438336 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f06c006af00 0x7f06c006d3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f06dc072b10 tx=0x7f06c8008040 comp rx=0 tx=0).stop 2023-10-16T12:58:51.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.656+0000 7f06e2de8700 1 -- 172.21.15.124:0/185438336 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f06dc15a250 msgr2=0x7f06dc143980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:51.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.656+0000 7f06e2de8700 1 --2- 172.21.15.124:0/185438336 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f06dc15a250 0x7f06dc143980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009b60 tx=0x7f06d0004750 comp rx=0 tx=0).stop 2023-10-16T12:58:51.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.656+0000 7f06e2de8700 1 -- 172.21.15.124:0/185438336 shutdown_connections 2023-10-16T12:58:51.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.656+0000 7f06e2de8700 1 --2- 172.21.15.124:0/185438336 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f06c006af00 0x7f06c006d3c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:51.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.656+0000 7f06e2de8700 1 --2- 172.21.15.124:0/185438336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06dc15e350 0x7f06dc1f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:51.661 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.656+0000 7f06e2de8700 1 --2- 172.21.15.124:0/185438336 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f06dc15a250 0x7f06dc143980 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:51.661 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.656+0000 7f06e2de8700 1 --2- 172.21.15.124:0/185438336 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06dc15dec0 0x7f06dc1ef390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:51.661 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.656+0000 7f06e2de8700 1 -- 172.21.15.124:0/185438336 >> 172.21.15.124:0/185438336 conn(0x7f06dc0ccbe0 msgr2=0x7f06dc158a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:51.661 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.656+0000 7f06e2de8700 1 -- 172.21.15.124:0/185438336 shutdown_connections 2023-10-16T12:58:51.661 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.656+0000 7f06e2de8700 1 -- 172.21.15.124:0/185438336 wait complete. 2023-10-16T12:58:51.662 INFO:teuthology.orchestra.run.smithi124.stderr:new fs with metadata pool 2 and data pool 3 2023-10-16T12:58:51.675 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-16T12:58:51.676 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-16T12:58:51.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.799+0000 7f5715bd8700 1 Processor -- start 2023-10-16T12:58:51.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.799+0000 7f5715bd8700 1 -- start start 2023-10-16T12:58:51.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f5715bd8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57100cf690 0x7f571015df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:51.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f5715bd8700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f571015b610 con 0x7f57100b2ce0 2023-10-16T12:58:51.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f5715bd8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5710161210 con 0x7f571006b930 2023-10-16T12:58:51.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f5715bd8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57101614f0 con 0x7f57100cf690 2023-10-16T12:58:51.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f570f7fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f57100b2ce0 0x7f57100b30c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:41700/0 (socket says 172.21.15.124:41700) 2023-10-16T12:58:51.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f570f7fe700 1 -- 172.21.15.124:0/2737940587 learned_addr learned my addr 172.21.15.124:0/2737940587 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:58:51.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f570e7fc700 1 -- 172.21.15.124:0/2737940587 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1219714442 0 0) 0x7f571015b610 con 0x7f57100b2ce0 2023-10-16T12:58:51.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f570e7fc700 1 -- 172.21.15.124:0/2737940587 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56f80035b0 con 0x7f57100b2ce0 2023-10-16T12:58:51.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f570ffff700 1 --2- 172.21.15.124:0/2737940587 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57100cf690 0x7f571015df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:51.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f570e7fc700 1 -- 172.21.15.124:0/2737940587 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4003581128 0 0) 0x7f56f80035b0 con 0x7f57100b2ce0 2023-10-16T12:58:51.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f570e7fc700 1 -- 172.21.15.124:0/2737940587 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57100cf690 msgr2=0x7f571015df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:51.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f570e7fc700 1 --2- 172.21.15.124:0/2737940587 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57100cf690 0x7f571015df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:51.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f570e7fc700 1 -- 172.21.15.124:0/2737940587 >> v1:172.21.15.192:6789/0 conn(0x7f571006b930 legacy=0x7f57100cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:51.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f570e7fc700 1 -- 172.21.15.124:0/2737940587 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57101617d0 con 0x7f57100b2ce0 2023-10-16T12:58:51.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f570e7fc700 1 -- 172.21.15.124:0/2737940587 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f5700001670 con 0x7f57100b2ce0 2023-10-16T12:58:51.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f570e7fc700 1 -- 172.21.15.124:0/2737940587 >> v1:172.21.15.124:6789/0 conn(0x7f57100b2ce0 legacy=0x7f57100b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:51.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f570e7fc700 1 --2- 172.21.15.124:0/2737940587 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57100cf690 0x7f56f8003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:51.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f570e7fc700 1 --2- 172.21.15.124:0/2737940587 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56f8003fb0 0x7f56f8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:51.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f570e7fc700 1 --2- 172.21.15.124:0/2737940587 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f56f8004d90 0x7f56f8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:51.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f570e7fc700 1 -- 172.21.15.124:0/2737940587 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57101614f0 con 0x7f56f8004d90 2023-10-16T12:58:51.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f570e7fc700 1 -- 172.21.15.124:0/2737940587 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f800baf0 con 0x7f56f8003fb0 2023-10-16T12:58:51.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f570e7fc700 1 -- 172.21.15.124:0/2737940587 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f800bcb0 con 0x7f57100cf690 2023-10-16T12:58:51.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f570ffff700 1 --2- 172.21.15.124:0/2737940587 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f56f8004d90 0x7f56f8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:51.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f570f7fe700 1 --2- 172.21.15.124:0/2737940587 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57100cf690 0x7f56f8003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:51.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.800+0000 7f570effd700 1 --2- 172.21.15.124:0/2737940587 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56f8003fb0 0x7f56f8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:51.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.801+0000 7f570ffff700 1 -- 172.21.15.124:0/2737940587 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57100cf690 msgr2=0x7f56f8003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:51.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.801+0000 7f570ffff700 1 --2- 172.21.15.124:0/2737940587 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57100cf690 0x7f56f8003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:51.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.801+0000 7f570ffff700 1 -- 172.21.15.124:0/2737940587 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56f8003fb0 msgr2=0x7f56f8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:51.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.801+0000 7f570ffff700 1 --2- 172.21.15.124:0/2737940587 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56f8003fb0 0x7f56f8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:51.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.801+0000 7f570ffff700 1 -- 172.21.15.124:0/2737940587 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f80035b0 con 0x7f56f8004d90 2023-10-16T12:58:51.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.801+0000 7f570ffff700 1 --2- 172.21.15.124:0/2737940587 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f56f8004d90 0x7f56f8005210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f571006ef10 tx=0x7f56f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3a26b1889d099c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:51.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.801+0000 7f570e7fc700 1 -- 172.21.15.124:0/2737940587 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570800ebd0 con 0x7f56f8004d90 2023-10-16T12:58:51.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.801+0000 7f570e7fc700 1 -- 172.21.15.124:0/2737940587 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570800f040 con 0x7f56f8004d90 2023-10-16T12:58:51.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.801+0000 7f570e7fc700 1 -- 172.21.15.124:0/2737940587 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5708014480 con 0x7f56f8004d90 2023-10-16T12:58:51.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.801+0000 7f5715bd8700 1 -- 172.21.15.124:0/2737940587 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f56f8004d90 msgr2=0x7f56f8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:51.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.801+0000 7f5715bd8700 1 --2- 172.21.15.124:0/2737940587 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f56f8004d90 0x7f56f8005210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f571006ef10 tx=0x7f56f8005880 comp rx=0 tx=0).stop 2023-10-16T12:58:51.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.801+0000 7f570ffff700 1 -- 172.21.15.124:0/2737940587 reap_dead start 2023-10-16T12:58:51.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.801+0000 7f5715bd8700 1 -- 172.21.15.124:0/2737940587 shutdown_connections 2023-10-16T12:58:51.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.801+0000 7f5715bd8700 1 -- 172.21.15.124:0/2737940587 >> 172.21.15.124:0/2737940587 conn(0x7f57100cdce0 msgr2=0x7f57100ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:51.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.801+0000 7f5715bd8700 1 -- 172.21.15.124:0/2737940587 shutdown_connections 2023-10-16T12:58:51.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.801+0000 7f5715bd8700 1 -- 172.21.15.124:0/2737940587 wait complete. 2023-10-16T12:58:51.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.803+0000 7f5715bd8700 1 Processor -- start 2023-10-16T12:58:51.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.803+0000 7f5715bd8700 1 -- start start 2023-10-16T12:58:51.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.804+0000 7f5715bd8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5710155760 0x7f57101609b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:51.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.804+0000 7f5715bd8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5710155b40 0x7f57100b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:51.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.804+0000 7f5715bd8700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f57100b2420 0x7f57100cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:51.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.804+0000 7f5715bd8700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57100b28a0 con 0x7f57100b2420 2023-10-16T12:58:51.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.804+0000 7f5715bd8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57101e7fb0 con 0x7f5710155b40 2023-10-16T12:58:51.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.804+0000 7f5715bd8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57101e73a0 con 0x7f5710155760 2023-10-16T12:58:51.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.804+0000 7f570ffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f57100b2420 0x7f57100cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:51.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.804+0000 7f570ffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f57100b2420 0x7f57100cb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53048/0 (socket says 172.21.15.124:53048) 2023-10-16T12:58:51.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.804+0000 7f570ffff700 1 -- 172.21.15.124:0/2269704621 learned_addr learned my addr 172.21.15.124:0/2269704621 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:51.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.804+0000 7f570f7fe700 1 --2- 172.21.15.124:0/2269704621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5710155760 0x7f57101609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:51.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.804+0000 7f570effd700 1 --2- 172.21.15.124:0/2269704621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5710155b40 0x7f57100b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:51.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.804+0000 7f570ffff700 1 -- 172.21.15.124:0/2269704621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5710155760 msgr2=0x7f57101609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:51.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.804+0000 7f570ffff700 1 --2- 172.21.15.124:0/2269704621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5710155760 0x7f57101609b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:51.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.804+0000 7f570ffff700 1 -- 172.21.15.124:0/2269704621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5710155b40 msgr2=0x7f57100b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:51.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.804+0000 7f570ffff700 1 --2- 172.21.15.124:0/2269704621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5710155b40 0x7f57100b1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:51.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.804+0000 7f570ffff700 1 -- 172.21.15.124:0/2269704621 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57101e7680 con 0x7f57100b2420 2023-10-16T12:58:51.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.804+0000 7f570ffff700 1 --2- 172.21.15.124:0/2269704621 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f57100b2420 0x7f57100cb890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f570800b010 tx=0x7f5708009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:51.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.804+0000 7f56f7fff700 1 -- 172.21.15.124:0/2269704621 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5708007000 con 0x7f57100b2420 2023-10-16T12:58:51.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.804+0000 7f56f7fff700 1 -- 172.21.15.124:0/2269704621 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5708022070 con 0x7f57100b2420 2023-10-16T12:58:51.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.804+0000 7f5715bd8700 1 -- 172.21.15.124:0/2269704621 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57101e7960 con 0x7f57100b2420 2023-10-16T12:58:51.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.804+0000 7f56f7fff700 1 -- 172.21.15.124:0/2269704621 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5708003ea0 con 0x7f57100b2420 2023-10-16T12:58:51.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.804+0000 7f5715bd8700 1 -- 172.21.15.124:0/2269704621 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5710160ef0 con 0x7f57100b2420 2023-10-16T12:58:51.823 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.805+0000 7f5715bd8700 1 -- 172.21.15.124:0/2269704621 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57101e8160 con 0x7f57100b2420 2023-10-16T12:58:51.824 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.806+0000 7f56f7fff700 1 -- 172.21.15.124:0/2269704621 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5708024070 con 0x7f57100b2420 2023-10-16T12:58:51.824 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.806+0000 7f56f7fff700 1 --2- 172.21.15.124:0/2269704621 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f56fc06af00 0x7f56fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:51.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.806+0000 7f56f7fff700 1 -- 172.21.15.124:0/2269704621 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f570808acc0 con 0x7f57100b2420 2023-10-16T12:58:51.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.806+0000 7f570f7fe700 1 --2- 172.21.15.124:0/2269704621 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f56fc06af00 0x7f56fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:51.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.806+0000 7f570f7fe700 1 --2- 172.21.15.124:0/2269704621 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f56fc06af00 0x7f56fc06d3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5700001200 tx=0x7f5700001150 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:51.826 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:51.810+0000 7f56f7fff700 1 -- 172.21.15.124:0/2269704621 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f57101e8160 con 0x7f57100b2420 2023-10-16T12:58:52.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.011+0000 7f5715bd8700 1 -- 172.21.15.124:0/2269704621 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f57101e8120 con 0x7f57100b2420 2023-10-16T12:58:52.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.421+0000 7f56f7fff700 1 -- 172.21.15.124:0/2269704621 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7f5708018020 con 0x7f57100b2420 2023-10-16T12:58:52.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.425+0000 7f5715bd8700 1 -- 172.21.15.124:0/2269704621 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f56fc06af00 msgr2=0x7f56fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:52.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.425+0000 7f5715bd8700 1 --2- 172.21.15.124:0/2269704621 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f56fc06af00 0x7f56fc06d3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5700001200 tx=0x7f5700001150 comp rx=0 tx=0).stop 2023-10-16T12:58:52.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.425+0000 7f5715bd8700 1 -- 172.21.15.124:0/2269704621 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f57100b2420 msgr2=0x7f57100cb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:52.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.425+0000 7f5715bd8700 1 --2- 172.21.15.124:0/2269704621 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f57100b2420 0x7f57100cb890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f570800b010 tx=0x7f5708009750 comp rx=0 tx=0).stop 2023-10-16T12:58:52.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.425+0000 7f5715bd8700 1 -- 172.21.15.124:0/2269704621 shutdown_connections 2023-10-16T12:58:52.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.425+0000 7f5715bd8700 1 --2- 172.21.15.124:0/2269704621 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f56fc06af00 0x7f56fc06d3c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:52.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.425+0000 7f5715bd8700 1 --2- 172.21.15.124:0/2269704621 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f57100b2420 0x7f57100cb890 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:52.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.425+0000 7f5715bd8700 1 --2- 172.21.15.124:0/2269704621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5710155760 0x7f57101609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:52.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.425+0000 7f5715bd8700 1 --2- 172.21.15.124:0/2269704621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5710155b40 0x7f57100b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:52.430 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.425+0000 7f5715bd8700 1 -- 172.21.15.124:0/2269704621 >> 172.21.15.124:0/2269704621 conn(0x7f57100cdce0 msgr2=0x7f571006bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:52.430 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.425+0000 7f5715bd8700 1 -- 172.21.15.124:0/2269704621 shutdown_connections 2023-10-16T12:58:52.430 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.425+0000 7f5715bd8700 1 -- 172.21.15.124:0/2269704621 wait complete. 2023-10-16T12:58:52.440 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-16T12:58:52.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.566+0000 7f949518d700 1 Processor -- start 2023-10-16T12:58:52.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.566+0000 7f949518d700 1 -- start start 2023-10-16T12:58:52.571 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.567+0000 7f949518d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f94900cf550 0x7f9490142e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:52.572 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.567+0000 7f949518d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9490146e70 0x7f9490161ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:52.572 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.567+0000 7f949518d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f94900b2cd0 0x7f94900b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:52.572 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.567+0000 7f949518d700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94900cf930 con 0x7f9490146e70 2023-10-16T12:58:52.572 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.567+0000 7f949518d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94900b36c0 con 0x7f94900cf550 2023-10-16T12:58:52.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.567+0000 7f949518d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9490161630 con 0x7f94900b2cd0 2023-10-16T12:58:52.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.567+0000 7f948e59c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9490146e70 0x7f9490161ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:52.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.567+0000 7f948e59c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9490146e70 0x7f9490161ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53052/0 (socket says 172.21.15.124:53052) 2023-10-16T12:58:52.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.567+0000 7f948e59c700 1 -- 172.21.15.124:0/852143074 learned_addr learned my addr 172.21.15.124:0/852143074 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:52.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.567+0000 7f948ed9d700 1 --2- 172.21.15.124:0/852143074 >> v2:172.21.15.192:3300/0 conn(0x7f94900cf550 0x7f9490142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:52.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.567+0000 7f948e59c700 1 -- 172.21.15.124:0/852143074 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f94900b2cd0 msgr2=0x7f94900b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:52.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.567+0000 7f948e59c700 1 --2- 172.21.15.124:0/852143074 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f94900b2cd0 0x7f94900b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:52.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.567+0000 7f948e59c700 1 -- 172.21.15.124:0/852143074 >> v2:172.21.15.192:3300/0 conn(0x7f94900cf550 msgr2=0x7f9490142e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:52.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.567+0000 7f948e59c700 1 --2- 172.21.15.124:0/852143074 >> v2:172.21.15.192:3300/0 conn(0x7f94900cf550 0x7f9490142e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:52.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.567+0000 7f948e59c700 1 -- 172.21.15.124:0/852143074 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9490143d50 con 0x7f9490146e70 2023-10-16T12:58:52.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.567+0000 7f948ed9d700 1 --2- 172.21.15.124:0/852143074 >> v2:172.21.15.192:3300/0 conn(0x7f94900cf550 0x7f9490142e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:58:52.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.568+0000 7f948e59c700 1 --2- 172.21.15.124:0/852143074 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9490146e70 0x7f9490161ac0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f94900b3ac0 tx=0x7f9480009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c74beda9773289 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:52.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.568+0000 7f948dd9b700 1 -- 172.21.15.124:0/852143074 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948000b870 con 0x7f9490146e70 2023-10-16T12:58:52.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.568+0000 7f948dd9b700 1 -- 172.21.15.124:0/852143074 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948000b9d0 con 0x7f9490146e70 2023-10-16T12:58:52.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.568+0000 7f948dd9b700 1 -- 172.21.15.124:0/852143074 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948000bd60 con 0x7f9490146e70 2023-10-16T12:58:52.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.568+0000 7f949518d700 1 -- 172.21.15.124:0/852143074 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9490146e70 msgr2=0x7f9490161ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:52.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.568+0000 7f949518d700 1 --2- 172.21.15.124:0/852143074 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9490146e70 0x7f9490161ac0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f94900b3ac0 tx=0x7f9480009bd0 comp rx=0 tx=0).stop 2023-10-16T12:58:52.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.568+0000 7f949518d700 1 -- 172.21.15.124:0/852143074 shutdown_connections 2023-10-16T12:58:52.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.568+0000 7f949518d700 1 --2- 172.21.15.124:0/852143074 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f94900b2cd0 0x7f94900b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:52.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.568+0000 7f949518d700 1 --2- 172.21.15.124:0/852143074 >> v2:172.21.15.192:3300/0 conn(0x7f94900cf550 0x7f9490142e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:52.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.568+0000 7f949518d700 1 --2- 172.21.15.124:0/852143074 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9490146e70 0x7f9490161ac0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:52.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.568+0000 7f949518d700 1 -- 172.21.15.124:0/852143074 >> 172.21.15.124:0/852143074 conn(0x7f94900d1250 msgr2=0x7f94900d1630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:52.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.568+0000 7f949518d700 1 -- 172.21.15.124:0/852143074 shutdown_connections 2023-10-16T12:58:52.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.568+0000 7f949518d700 1 -- 172.21.15.124:0/852143074 wait complete. 2023-10-16T12:58:52.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.570+0000 7f949518d700 1 Processor -- start 2023-10-16T12:58:52.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.570+0000 7f949518d700 1 -- start start 2023-10-16T12:58:52.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.571+0000 7f949518d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94900b2cd0 0x7f949015ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:52.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.571+0000 7f949518d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94900cf550 0x7f949015d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:52.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.571+0000 7f949518d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9490146e70 0x7f949015b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:52.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.571+0000 7f949518d700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94900c7ef0 con 0x7f94900cf550 2023-10-16T12:58:52.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.571+0000 7f949518d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949015e760 con 0x7f94900b2cd0 2023-10-16T12:58:52.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.571+0000 7f949518d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94900b2420 con 0x7f9490146e70 2023-10-16T12:58:52.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.571+0000 7f948e59c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94900cf550 0x7f949015d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:52.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.571+0000 7f948e59c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94900cf550 0x7f949015d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53058/0 (socket says 172.21.15.124:53058) 2023-10-16T12:58:52.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.571+0000 7f948e59c700 1 -- 172.21.15.124:0/467158920 learned_addr learned my addr 172.21.15.124:0/467158920 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:52.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.571+0000 7f948ed9d700 1 --2- 172.21.15.124:0/467158920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94900b2cd0 0x7f949015ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:52.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.571+0000 7f948f59e700 1 --2- 172.21.15.124:0/467158920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9490146e70 0x7f949015b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:52.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.572+0000 7f948e59c700 1 -- 172.21.15.124:0/467158920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9490146e70 msgr2=0x7f949015b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:52.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.572+0000 7f948e59c700 1 --2- 172.21.15.124:0/467158920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9490146e70 0x7f949015b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:52.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.572+0000 7f948e59c700 1 -- 172.21.15.124:0/467158920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94900b2cd0 msgr2=0x7f949015ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:52.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.572+0000 7f948e59c700 1 --2- 172.21.15.124:0/467158920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94900b2cd0 0x7f949015ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:52.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.572+0000 7f948e59c700 1 -- 172.21.15.124:0/467158920 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9480009550 con 0x7f94900cf550 2023-10-16T12:58:52.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.572+0000 7f948ed9d700 1 --2- 172.21.15.124:0/467158920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94900b2cd0 0x7f949015ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:58:52.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.572+0000 7f948e59c700 1 --2- 172.21.15.124:0/467158920 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94900cf550 0x7f949015d980 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9480014040 tx=0x7f9480004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:52.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.572+0000 7f94777fe700 1 -- 172.21.15.124:0/467158920 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480004310 con 0x7f94900cf550 2023-10-16T12:58:52.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.572+0000 7f94777fe700 1 -- 172.21.15.124:0/467158920 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948001f070 con 0x7f94900cf550 2023-10-16T12:58:52.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.572+0000 7f949518d700 1 -- 172.21.15.124:0/467158920 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94900b2700 con 0x7f94900cf550 2023-10-16T12:58:52.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.572+0000 7f94777fe700 1 -- 172.21.15.124:0/467158920 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94800036a0 con 0x7f94900cf550 2023-10-16T12:58:52.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.572+0000 7f949518d700 1 -- 172.21.15.124:0/467158920 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94900b29e0 con 0x7f94900cf550 2023-10-16T12:58:52.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.573+0000 7f949518d700 1 -- 172.21.15.124:0/467158920 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949004ebb0 con 0x7f94900cf550 2023-10-16T12:58:52.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.573+0000 7f94777fe700 1 -- 172.21.15.124:0/467158920 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9480021030 con 0x7f94900cf550 2023-10-16T12:58:52.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.574+0000 7f94777fe700 1 --2- 172.21.15.124:0/467158920 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f947c06af30 0x7f947c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:52.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.574+0000 7f94777fe700 1 -- 172.21.15.124:0/467158920 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f948008a9c0 con 0x7f94900cf550 2023-10-16T12:58:52.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.574+0000 7f948ed9d700 1 --2- 172.21.15.124:0/467158920 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f947c06af30 0x7f947c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:52.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.574+0000 7f948ed9d700 1 --2- 172.21.15.124:0/467158920 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f947c06af30 0x7f947c06d3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9484006fd0 tx=0x7f9484008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:52.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.578+0000 7f94777fe700 1 -- 172.21.15.124:0/467158920 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9480055aa0 con 0x7f94900cf550 2023-10-16T12:58:52.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:52.772+0000 7f949518d700 1 -- 172.21.15.124:0/467158920 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f949006f660 con 0x7f94900cf550 2023-10-16T12:58:54.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.672+0000 7f94777fe700 1 -- 172.21.15.124:0/467158920 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7f9480029100 con 0x7f94900cf550 2023-10-16T12:58:54.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.675+0000 7f949518d700 1 -- 172.21.15.124:0/467158920 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f947c06af30 msgr2=0x7f947c06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:54.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.675+0000 7f949518d700 1 --2- 172.21.15.124:0/467158920 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f947c06af30 0x7f947c06d3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9484006fd0 tx=0x7f9484008040 comp rx=0 tx=0).stop 2023-10-16T12:58:54.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.675+0000 7f949518d700 1 -- 172.21.15.124:0/467158920 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94900cf550 msgr2=0x7f949015d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:54.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.675+0000 7f949518d700 1 --2- 172.21.15.124:0/467158920 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94900cf550 0x7f949015d980 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9480014040 tx=0x7f9480004750 comp rx=0 tx=0).stop 2023-10-16T12:58:54.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.676+0000 7f949518d700 1 -- 172.21.15.124:0/467158920 shutdown_connections 2023-10-16T12:58:54.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.676+0000 7f949518d700 1 --2- 172.21.15.124:0/467158920 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f947c06af30 0x7f947c06d3f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:54.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.676+0000 7f949518d700 1 --2- 172.21.15.124:0/467158920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9490146e70 0x7f949015b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:54.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.676+0000 7f949518d700 1 --2- 172.21.15.124:0/467158920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94900b2cd0 0x7f949015ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:54.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.676+0000 7f949518d700 1 --2- 172.21.15.124:0/467158920 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f94900cf550 0x7f949015d980 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9480014040 tx=0x7f9480004750 comp rx=0 tx=0).stop 2023-10-16T12:58:54.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.676+0000 7f949518d700 1 -- 172.21.15.124:0/467158920 >> 172.21.15.124:0/467158920 conn(0x7f94900d1250 msgr2=0x7f94901466c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:54.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.676+0000 7f949518d700 1 -- 172.21.15.124:0/467158920 shutdown_connections 2023-10-16T12:58:54.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.677+0000 7f949518d700 1 -- 172.21.15.124:0/467158920 wait complete. 2023-10-16T12:58:54.688 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_data_ec' created 2023-10-16T12:58:54.699 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-16T12:58:54.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.826+0000 7ff9b66f8700 1 Processor -- start 2023-10-16T12:58:54.829 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.826+0000 7ff9b66f8700 1 -- start start 2023-10-16T12:58:54.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.827+0000 7ff9b66f8700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff9b006a820 0x7ff9b006ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:54.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.827+0000 7ff9b66f8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff9b00717b0 0x7ff9b0071c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:54.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.827+0000 7ff9b66f8700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b00cad30 con 0x7ff9b0072170 2023-10-16T12:58:54.832 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.827+0000 7ff9b66f8700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b00ca7b0 con 0x7ff9b006a820 2023-10-16T12:58:54.832 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.827+0000 7ff9b66f8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b00cb1c0 con 0x7ff9b00717b0 2023-10-16T12:58:54.832 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.827+0000 7ff9affff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff9b006a820 0x7ff9b006ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:54.832 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.827+0000 7ff9b4c95700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7ff9b0072170 0x7ff9b015ed30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:41738/0 (socket says 172.21.15.124:41738) 2023-10-16T12:58:54.832 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.827+0000 7ff9b4c95700 1 -- 172.21.15.124:0/2891865340 learned_addr learned my addr 172.21.15.124:0/2891865340 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:58:54.833 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.827+0000 7ff9af7fe700 1 --2- 172.21.15.124:0/2891865340 >> v2:172.21.15.192:3300/0 conn(0x7ff9b00717b0 0x7ff9b0071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:54.833 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.827+0000 7ff9affff700 1 -- 172.21.15.124:0/2891865340 >> v2:172.21.15.192:3300/0 conn(0x7ff9b00717b0 msgr2=0x7ff9b0071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:54.833 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.827+0000 7ff9affff700 1 --2- 172.21.15.124:0/2891865340 >> v2:172.21.15.192:3300/0 conn(0x7ff9b00717b0 0x7ff9b0071c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:54.833 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.827+0000 7ff9affff700 1 -- 172.21.15.124:0/2891865340 >> v1:172.21.15.124:6789/0 conn(0x7ff9b0072170 legacy=0x7ff9b015ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:54.833 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.827+0000 7ff9affff700 1 -- 172.21.15.124:0/2891865340 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b00725e0 con 0x7ff9b006a820 2023-10-16T12:58:54.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.827+0000 7ff9aeffd700 1 -- 172.21.15.124:0/2891865340 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709441694 0 0) 0x7ff9b00cad30 con 0x7ff9b0072170 2023-10-16T12:58:54.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.827+0000 7ff9affff700 1 --2- 172.21.15.124:0/2891865340 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9b006a820 0x7ff9b006ac00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0070360 tx=0x7ff9a4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bfe3b774febc5d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:54.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.827+0000 7ff9aeffd700 1 -- 172.21.15.124:0/2891865340 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4011830 con 0x7ff9b006a820 2023-10-16T12:58:54.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.827+0000 7ff9aeffd700 1 -- 172.21.15.124:0/2891865340 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a4011990 con 0x7ff9b006a820 2023-10-16T12:58:54.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.827+0000 7ff9aeffd700 1 -- 172.21.15.124:0/2891865340 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4011d20 con 0x7ff9b006a820 2023-10-16T12:58:54.835 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.828+0000 7ff9b66f8700 1 -- 172.21.15.124:0/2891865340 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9b006a820 msgr2=0x7ff9b006ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:54.835 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.828+0000 7ff9b66f8700 1 --2- 172.21.15.124:0/2891865340 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9b006a820 0x7ff9b006ac00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0070360 tx=0x7ff9a4009b20 comp rx=0 tx=0).stop 2023-10-16T12:58:54.835 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.828+0000 7ff9b66f8700 1 -- 172.21.15.124:0/2891865340 shutdown_connections 2023-10-16T12:58:54.835 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.828+0000 7ff9b66f8700 1 --2- 172.21.15.124:0/2891865340 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9b006a820 0x7ff9b006ac00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:54.835 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.828+0000 7ff9b66f8700 1 --2- 172.21.15.124:0/2891865340 >> v2:172.21.15.192:3300/0 conn(0x7ff9b00717b0 0x7ff9b0071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:54.836 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.828+0000 7ff9b66f8700 1 -- 172.21.15.124:0/2891865340 >> 172.21.15.124:0/2891865340 conn(0x7ff9b00ccbe0 msgr2=0x7ff9b00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:54.836 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.828+0000 7ff9b66f8700 1 -- 172.21.15.124:0/2891865340 shutdown_connections 2023-10-16T12:58:54.836 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.828+0000 7ff9b66f8700 1 -- 172.21.15.124:0/2891865340 wait complete. 2023-10-16T12:58:54.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.830+0000 7ff9b66f8700 1 Processor -- start 2023-10-16T12:58:54.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.830+0000 7ff9b66f8700 1 -- start start 2023-10-16T12:58:54.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.831+0000 7ff9b66f8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9b006a820 0x7ff9b0157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:54.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.831+0000 7ff9b66f8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9b00717b0 0x7ff9b015db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:54.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.831+0000 7ff9b66f8700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9b0072170 0x7ff9b015e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:54.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.831+0000 7ff9b66f8700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b00aaa00 con 0x7ff9b0072170 2023-10-16T12:58:54.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.831+0000 7ff9b66f8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b00aace0 con 0x7ff9b00717b0 2023-10-16T12:58:54.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.831+0000 7ff9b66f8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b015bbd0 con 0x7ff9b006a820 2023-10-16T12:58:54.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.831+0000 7ff9b4c95700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9b0072170 0x7ff9b015e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:54.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.831+0000 7ff9b4c95700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9b0072170 0x7ff9b015e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53076/0 (socket says 172.21.15.124:53076) 2023-10-16T12:58:54.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.831+0000 7ff9b4c95700 1 -- 172.21.15.124:0/3144213852 learned_addr learned my addr 172.21.15.124:0/3144213852 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:54.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.831+0000 7ff9af7fe700 1 --2- 172.21.15.124:0/3144213852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9b00717b0 0x7ff9b015db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:54.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.831+0000 7ff9affff700 1 --2- 172.21.15.124:0/3144213852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9b006a820 0x7ff9b0157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:54.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.831+0000 7ff9b4c95700 1 -- 172.21.15.124:0/3144213852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9b006a820 msgr2=0x7ff9b0157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:54.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.831+0000 7ff9b4c95700 1 --2- 172.21.15.124:0/3144213852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9b006a820 0x7ff9b0157320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:54.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.831+0000 7ff9b4c95700 1 -- 172.21.15.124:0/3144213852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9b00717b0 msgr2=0x7ff9b015db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:54.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.831+0000 7ff9b4c95700 1 --2- 172.21.15.124:0/3144213852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9b00717b0 0x7ff9b015db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:54.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.831+0000 7ff9b4c95700 1 -- 172.21.15.124:0/3144213852 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a40094a0 con 0x7ff9b0072170 2023-10-16T12:58:54.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.831+0000 7ff9b4c95700 1 --2- 172.21.15.124:0/3144213852 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9b0072170 0x7ff9b015e040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800cb60 tx=0x7ff9a800ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:54.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.831+0000 7ff9acff9700 1 -- 172.21.15.124:0/3144213852 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a800a9e0 con 0x7ff9b0072170 2023-10-16T12:58:54.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.831+0000 7ff9acff9700 1 -- 172.21.15.124:0/3144213852 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a800ab40 con 0x7ff9b0072170 2023-10-16T12:58:54.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.831+0000 7ff9b66f8700 1 -- 172.21.15.124:0/3144213852 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b015beb0 con 0x7ff9b0072170 2023-10-16T12:58:54.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.831+0000 7ff9acff9700 1 -- 172.21.15.124:0/3144213852 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a80070d0 con 0x7ff9b0072170 2023-10-16T12:58:54.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.831+0000 7ff9b66f8700 1 -- 172.21.15.124:0/3144213852 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b0157860 con 0x7ff9b0072170 2023-10-16T12:58:54.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.832+0000 7ff9b66f8700 1 -- 172.21.15.124:0/3144213852 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b00aab40 con 0x7ff9b0072170 2023-10-16T12:58:54.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.833+0000 7ff9acff9700 1 -- 172.21.15.124:0/3144213852 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff9a8007230 con 0x7ff9b0072170 2023-10-16T12:58:54.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.833+0000 7ff9acff9700 1 --2- 172.21.15.124:0/3144213852 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff99c06af00 0x7ff99c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:54.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.833+0000 7ff9acff9700 1 -- 172.21.15.124:0/3144213852 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7ff9a80894f0 con 0x7ff9b0072170 2023-10-16T12:58:54.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.833+0000 7ff9affff700 1 --2- 172.21.15.124:0/3144213852 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff99c06af00 0x7ff99c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:54.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.834+0000 7ff9affff700 1 --2- 172.21.15.124:0/3144213852 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff99c06af00 0x7ff99c06d3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40090b0 tx=0x7ff9a4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:54.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:54.838+0000 7ff9acff9700 1 -- 172.21.15.124:0/3144213852 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff9b00aab40 con 0x7ff9b0072170 2023-10-16T12:58:55.029 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.026+0000 7ff9b66f8700 1 -- 172.21.15.124:0/3144213852 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7ff9b015c3d0 con 0x7ff9b0072170 2023-10-16T12:58:55.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.674+0000 7ff9acff9700 1 -- 172.21.15.124:0/3144213852 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff9b015c3d0 con 0x7ff9b0072170 2023-10-16T12:58:55.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.678+0000 7ff9b66f8700 1 -- 172.21.15.124:0/3144213852 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff99c06af00 msgr2=0x7ff99c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:55.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.678+0000 7ff9b66f8700 1 --2- 172.21.15.124:0/3144213852 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff99c06af00 0x7ff99c06d3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40090b0 tx=0x7ff9a4008030 comp rx=0 tx=0).stop 2023-10-16T12:58:55.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.678+0000 7ff9b66f8700 1 -- 172.21.15.124:0/3144213852 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9b0072170 msgr2=0x7ff9b015e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:55.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.678+0000 7ff9b66f8700 1 --2- 172.21.15.124:0/3144213852 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9b0072170 0x7ff9b015e040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800cb60 tx=0x7ff9a800ce70 comp rx=0 tx=0).stop 2023-10-16T12:58:55.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.678+0000 7ff9b66f8700 1 -- 172.21.15.124:0/3144213852 shutdown_connections 2023-10-16T12:58:55.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.678+0000 7ff9b66f8700 1 --2- 172.21.15.124:0/3144213852 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff99c06af00 0x7ff99c06d3c0 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40090b0 tx=0x7ff9a4008030 comp rx=0 tx=0).stop 2023-10-16T12:58:55.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.678+0000 7ff9b66f8700 1 --2- 172.21.15.124:0/3144213852 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9b0072170 0x7ff9b015e040 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:55.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.678+0000 7ff9b66f8700 1 --2- 172.21.15.124:0/3144213852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9b006a820 0x7ff9b0157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:55.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.678+0000 7ff9b66f8700 1 --2- 172.21.15.124:0/3144213852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9b00717b0 0x7ff9b015db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:55.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.678+0000 7ff9b66f8700 1 -- 172.21.15.124:0/3144213852 >> 172.21.15.124:0/3144213852 conn(0x7ff9b00ccbe0 msgr2=0x7ff9b00c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:55.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.679+0000 7ff9b66f8700 1 -- 172.21.15.124:0/3144213852 shutdown_connections 2023-10-16T12:58:55.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.679+0000 7ff9b66f8700 1 -- 172.21.15.124:0/3144213852 wait complete. 2023-10-16T12:58:55.690 INFO:teuthology.orchestra.run.smithi124.stderr:set pool 4 allow_ec_overwrites to true 2023-10-16T12:58:55.716 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-16T12:58:55.840 INFO:tasks.ceph.mds.b.smithi192.stderr:2023-10-16T12:58:55.838+0000 7f36372b3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T12:58:55.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.838+0000 7fbd47652700 1 Processor -- start 2023-10-16T12:58:55.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.839+0000 7fbd47652700 1 -- start start 2023-10-16T12:58:55.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.839+0000 7fbd47652700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fbd4015d660 0x7fbd400cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:55.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.839+0000 7fbd47652700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbd40161c50 0x7fbd400ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:55.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.840+0000 7fbd47652700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd40072b70 con 0x7fbd400cd800 2023-10-16T12:58:55.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.840+0000 7fbd47652700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd40162210 con 0x7fbd4015d660 2023-10-16T12:58:55.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.840+0000 7fbd47652700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4006a9c0 con 0x7fbd40161c50 2023-10-16T12:58:55.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.840+0000 7fbd453ee700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fbd4015d660 0x7fbd400cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:55.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.840+0000 7fbd453ee700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fbd4015d660 0x7fbd400cde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53080/0 (socket says 172.21.15.124:53080) 2023-10-16T12:58:55.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.840+0000 7fbd453ee700 1 -- 172.21.15.124:0/1815137342 learned_addr learned my addr 172.21.15.124:0/1815137342 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:55.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.840+0000 7fbd45bef700 1 --2- 172.21.15.124:0/1815137342 >> v2:172.21.15.192:3300/0 conn(0x7fbd40161c50 0x7fbd400ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:55.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.840+0000 7fbd453ee700 1 -- 172.21.15.124:0/1815137342 >> v2:172.21.15.192:3300/0 conn(0x7fbd40161c50 msgr2=0x7fbd400ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:55.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.840+0000 7fbd453ee700 1 --2- 172.21.15.124:0/1815137342 >> v2:172.21.15.192:3300/0 conn(0x7fbd40161c50 0x7fbd400ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:55.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.840+0000 7fbd453ee700 1 -- 172.21.15.124:0/1815137342 >> v1:172.21.15.192:6789/0 conn(0x7fbd400cd800 legacy=0x7fbd4006ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:55.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.840+0000 7fbd453ee700 1 -- 172.21.15.124:0/1815137342 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4006ac60 con 0x7fbd4015d660 2023-10-16T12:58:55.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.840+0000 7fbd453ee700 1 --2- 172.21.15.124:0/1815137342 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd4015d660 0x7fbd400cde30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbd400744c0 tx=0x7fbd3c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7794d061ba8341 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:55.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.840+0000 7fbd37fff700 1 -- 172.21.15.124:0/1815137342 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c004230 con 0x7fbd4015d660 2023-10-16T12:58:55.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.840+0000 7fbd37fff700 1 -- 172.21.15.124:0/1815137342 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3c004390 con 0x7fbd4015d660 2023-10-16T12:58:55.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.840+0000 7fbd37fff700 1 -- 172.21.15.124:0/1815137342 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c0036a0 con 0x7fbd4015d660 2023-10-16T12:58:55.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.841+0000 7fbd47652700 1 -- 172.21.15.124:0/1815137342 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd4015d660 msgr2=0x7fbd400cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:55.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.841+0000 7fbd47652700 1 --2- 172.21.15.124:0/1815137342 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd4015d660 0x7fbd400cde30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbd400744c0 tx=0x7fbd3c009bd0 comp rx=0 tx=0).stop 2023-10-16T12:58:55.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.841+0000 7fbd47652700 1 -- 172.21.15.124:0/1815137342 shutdown_connections 2023-10-16T12:58:55.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.841+0000 7fbd47652700 1 --2- 172.21.15.124:0/1815137342 >> v2:172.21.15.192:3300/0 conn(0x7fbd40161c50 0x7fbd400ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:55.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.841+0000 7fbd47652700 1 --2- 172.21.15.124:0/1815137342 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd4015d660 0x7fbd400cde30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:55.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.841+0000 7fbd47652700 1 -- 172.21.15.124:0/1815137342 >> 172.21.15.124:0/1815137342 conn(0x7fbd400ccce0 msgr2=0x7fbd400cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:55.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.841+0000 7fbd47652700 1 -- 172.21.15.124:0/1815137342 shutdown_connections 2023-10-16T12:58:55.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.841+0000 7fbd47652700 1 -- 172.21.15.124:0/1815137342 wait complete. 2023-10-16T12:58:55.852 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.842+0000 7fbd47652700 1 Processor -- start 2023-10-16T12:58:55.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.843+0000 7fbd47652700 1 -- start start 2023-10-16T12:58:55.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.843+0000 7fbd47652700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd400cd800 0x7fbd400c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:55.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.843+0000 7fbd47652700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd4015d660 0x7fbd400ae490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:55.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.843+0000 7fbd47652700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbd40161c50 0x7fbd400ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:55.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.843+0000 7fbd47652700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd401f6aa0 con 0x7fbd4015d660 2023-10-16T12:58:55.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.843+0000 7fbd47652700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd401f6d80 con 0x7fbd400cd800 2023-10-16T12:58:55.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.843+0000 7fbd47652700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd401f7060 con 0x7fbd40161c50 2023-10-16T12:58:55.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.843+0000 7fbd44bed700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd4015d660 0x7fbd400ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:55.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.844+0000 7fbd44bed700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd4015d660 0x7fbd400ae490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53088/0 (socket says 172.21.15.124:53088) 2023-10-16T12:58:55.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.844+0000 7fbd44bed700 1 -- 172.21.15.124:0/1232855326 learned_addr learned my addr 172.21.15.124:0/1232855326 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:55.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.844+0000 7fbd453ee700 1 --2- 172.21.15.124:0/1232855326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd400cd800 0x7fbd400c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:55.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.844+0000 7fbd45bef700 1 --2- 172.21.15.124:0/1232855326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbd40161c50 0x7fbd400ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:55.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.844+0000 7fbd44bed700 1 -- 172.21.15.124:0/1232855326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbd40161c50 msgr2=0x7fbd400ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:55.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.844+0000 7fbd44bed700 1 --2- 172.21.15.124:0/1232855326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbd40161c50 0x7fbd400ae9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:55.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.844+0000 7fbd44bed700 1 -- 172.21.15.124:0/1232855326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd400cd800 msgr2=0x7fbd400c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:55.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.844+0000 7fbd44bed700 1 --2- 172.21.15.124:0/1232855326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd400cd800 0x7fbd400c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:55.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.844+0000 7fbd44bed700 1 -- 172.21.15.124:0/1232855326 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3c009550 con 0x7fbd4015d660 2023-10-16T12:58:55.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.844+0000 7fbd45bef700 1 --2- 172.21.15.124:0/1232855326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbd40161c50 0x7fbd400ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:58:55.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.844+0000 7fbd44bed700 1 --2- 172.21.15.124:0/1232855326 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd4015d660 0x7fbd400ae490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000c4a0 tx=0x7fbd3000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:55.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.844+0000 7fbd35ffb700 1 -- 172.21.15.124:0/1232855326 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd30011790 con 0x7fbd4015d660 2023-10-16T12:58:55.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.844+0000 7fbd35ffb700 1 -- 172.21.15.124:0/1232855326 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd300118f0 con 0x7fbd4015d660 2023-10-16T12:58:55.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.844+0000 7fbd35ffb700 1 -- 172.21.15.124:0/1232855326 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd30011ca0 con 0x7fbd4015d660 2023-10-16T12:58:55.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.844+0000 7fbd47652700 1 -- 172.21.15.124:0/1232855326 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd401f7340 con 0x7fbd4015d660 2023-10-16T12:58:55.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.844+0000 7fbd47652700 1 -- 172.21.15.124:0/1232855326 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd400c6b20 con 0x7fbd4015d660 2023-10-16T12:58:55.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.845+0000 7fbd47652700 1 -- 172.21.15.124:0/1232855326 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4004ebb0 con 0x7fbd4015d660 2023-10-16T12:58:55.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.845+0000 7fbd35ffb700 1 -- 172.21.15.124:0/1232855326 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbd3001c460 con 0x7fbd4015d660 2023-10-16T12:58:55.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.846+0000 7fbd35ffb700 1 --2- 172.21.15.124:0/1232855326 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbd2406af00 0x7fbd2406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:55.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.846+0000 7fbd453ee700 1 --2- 172.21.15.124:0/1232855326 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbd2406af00 0x7fbd2406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:55.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.846+0000 7fbd35ffb700 1 -- 172.21.15.124:0/1232855326 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fbd30089650 con 0x7fbd4015d660 2023-10-16T12:58:55.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.846+0000 7fbd453ee700 1 --2- 172.21.15.124:0/1232855326 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbd2406af00 0x7fbd2406d3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c009130 tx=0x7fbd3c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:55.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:55.850+0000 7fbd35ffb700 1 -- 172.21.15.124:0/1232855326 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbd30054430 con 0x7fbd4015d660 2023-10-16T12:58:56.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.088+0000 7fbd47652700 1 -- 172.21.15.124:0/1232855326 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fbd400ae270 con 0x7fbd4015d660 2023-10-16T12:58:56.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.710+0000 7fbd35ffb700 1 -- 172.21.15.124:0/1232855326 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fbd30057a50 con 0x7fbd4015d660 2023-10-16T12:58:56.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.713+0000 7fbd47652700 1 -- 172.21.15.124:0/1232855326 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbd2406af00 msgr2=0x7fbd2406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:56.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.713+0000 7fbd47652700 1 --2- 172.21.15.124:0/1232855326 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbd2406af00 0x7fbd2406d3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c009130 tx=0x7fbd3c008030 comp rx=0 tx=0).stop 2023-10-16T12:58:56.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.713+0000 7fbd47652700 1 -- 172.21.15.124:0/1232855326 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd4015d660 msgr2=0x7fbd400ae490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:56.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.713+0000 7fbd47652700 1 --2- 172.21.15.124:0/1232855326 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd4015d660 0x7fbd400ae490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000c4a0 tx=0x7fbd3000c7b0 comp rx=0 tx=0).stop 2023-10-16T12:58:56.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.713+0000 7fbd47652700 1 -- 172.21.15.124:0/1232855326 shutdown_connections 2023-10-16T12:58:56.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.713+0000 7fbd47652700 1 --2- 172.21.15.124:0/1232855326 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbd2406af00 0x7fbd2406d3c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:56.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.713+0000 7fbd47652700 1 --2- 172.21.15.124:0/1232855326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbd40161c50 0x7fbd400ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:56.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.713+0000 7fbd47652700 1 --2- 172.21.15.124:0/1232855326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd400cd800 0x7fbd400c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:56.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.713+0000 7fbd47652700 1 --2- 172.21.15.124:0/1232855326 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd4015d660 0x7fbd400ae490 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:56.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.713+0000 7fbd47652700 1 -- 172.21.15.124:0/1232855326 >> 172.21.15.124:0/1232855326 conn(0x7fbd400ccce0 msgr2=0x7fbd4006ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:56.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.713+0000 7fbd47652700 1 -- 172.21.15.124:0/1232855326 shutdown_connections 2023-10-16T12:58:56.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.713+0000 7fbd47652700 1 -- 172.21.15.124:0/1232855326 wait complete. 2023-10-16T12:58:56.718 INFO:teuthology.orchestra.run.smithi124.stderr:added data pool 4 to fsmap 2023-10-16T12:58:56.730 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T12:58:56.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.853+0000 7f4483192700 1 Processor -- start 2023-10-16T12:58:56.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.853+0000 7f4483192700 1 -- start start 2023-10-16T12:58:56.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.854+0000 7f4483192700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f447c15daa0 0x7f447c0af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:56.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.854+0000 7f4483192700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f447c15ed10 con 0x7f447c071f60 2023-10-16T12:58:56.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.854+0000 7f4483192700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f447c15de80 con 0x7f447c0af560 2023-10-16T12:58:56.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.854+0000 7f4483192700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f447c15e100 con 0x7f447c15daa0 2023-10-16T12:58:56.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.854+0000 7f4480f2e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f447c15daa0 0x7f447c0af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:56.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.854+0000 7f448172f700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f447c071f60 0x7f447c06d100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:41766/0 (socket says 172.21.15.124:41766) 2023-10-16T12:58:56.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.854+0000 7f448172f700 1 -- 172.21.15.124:0/3818625185 learned_addr learned my addr 172.21.15.124:0/3818625185 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:58:56.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.854+0000 7f4480f2e700 1 -- 172.21.15.124:0/3818625185 >> v1:172.21.15.192:6789/0 conn(0x7f447c0af560 legacy=0x7f447c071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:56.860 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.854+0000 7f4480f2e700 1 -- 172.21.15.124:0/3818625185 >> v1:172.21.15.124:6789/0 conn(0x7f447c071f60 legacy=0x7f447c06d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:56.860 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.854+0000 7f447b7fe700 1 -- 172.21.15.124:0/3818625185 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040727096 0 0) 0x7f447c15ed10 con 0x7f447c071f60 2023-10-16T12:58:56.860 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.854+0000 7f4480f2e700 1 -- 172.21.15.124:0/3818625185 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447c15e3e0 con 0x7f447c15daa0 2023-10-16T12:58:56.860 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.854+0000 7f4480f2e700 1 --2- 172.21.15.124:0/3818625185 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f447c15daa0 0x7f447c0af020 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4470009840 tx=0x7f4470009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a21fe5292f97075 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:56.861 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.854+0000 7f447b7fe700 1 -- 172.21.15.124:0/3818625185 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470004230 con 0x7f447c15daa0 2023-10-16T12:58:56.861 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.854+0000 7f447b7fe700 1 -- 172.21.15.124:0/3818625185 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4470004390 con 0x7f447c15daa0 2023-10-16T12:58:56.861 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.854+0000 7f447b7fe700 1 -- 172.21.15.124:0/3818625185 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44700036a0 con 0x7f447c15daa0 2023-10-16T12:58:56.861 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.855+0000 7f4483192700 1 -- 172.21.15.124:0/3818625185 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f447c15daa0 msgr2=0x7f447c0af020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:56.861 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.855+0000 7f4483192700 1 --2- 172.21.15.124:0/3818625185 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f447c15daa0 0x7f447c0af020 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4470009840 tx=0x7f4470009b50 comp rx=0 tx=0).stop 2023-10-16T12:58:56.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.855+0000 7f4483192700 1 -- 172.21.15.124:0/3818625185 shutdown_connections 2023-10-16T12:58:56.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.855+0000 7f4483192700 1 --2- 172.21.15.124:0/3818625185 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f447c15daa0 0x7f447c0af020 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:56.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.855+0000 7f4483192700 1 -- 172.21.15.124:0/3818625185 >> 172.21.15.124:0/3818625185 conn(0x7f447c0d0180 msgr2=0x7f447c0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:56.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.855+0000 7f4483192700 1 -- 172.21.15.124:0/3818625185 shutdown_connections 2023-10-16T12:58:56.863 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.855+0000 7f4483192700 1 -- 172.21.15.124:0/3818625185 wait complete. 2023-10-16T12:58:56.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.856+0000 7f4483192700 1 Processor -- start 2023-10-16T12:58:56.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.856+0000 7f4483192700 1 -- start start 2023-10-16T12:58:56.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.857+0000 7f4483192700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f447c071f60 0x7f447c0c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:56.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.857+0000 7f4483192700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f447c0af560 0x7f447c0c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:56.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.857+0000 7f4483192700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f447c15daa0 0x7f447c0ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:56.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.857+0000 7f4483192700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447c0c9fb0 con 0x7f447c071f60 2023-10-16T12:58:56.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.857+0000 7f4483192700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447c0c8920 con 0x7f447c15daa0 2023-10-16T12:58:56.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.857+0000 7f4483192700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447c0c7d10 con 0x7f447c0af560 2023-10-16T12:58:56.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.857+0000 7f4480f2e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f447c071f60 0x7f447c0c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:56.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.857+0000 7f4480f2e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f447c071f60 0x7f447c0c9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53102/0 (socket says 172.21.15.124:53102) 2023-10-16T12:58:56.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.857+0000 7f4480f2e700 1 -- 172.21.15.124:0/1145628952 learned_addr learned my addr 172.21.15.124:0/1145628952 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:56.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.857+0000 7f447bfff700 1 --2- 172.21.15.124:0/1145628952 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f447c0af560 0x7f447c0c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:56.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.857+0000 7f448172f700 1 --2- 172.21.15.124:0/1145628952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f447c15daa0 0x7f447c0ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:56.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.857+0000 7f4480f2e700 1 -- 172.21.15.124:0/1145628952 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f447c0af560 msgr2=0x7f447c0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:56.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.857+0000 7f4480f2e700 1 --2- 172.21.15.124:0/1145628952 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f447c0af560 0x7f447c0c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:56.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.857+0000 7f4480f2e700 1 -- 172.21.15.124:0/1145628952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f447c15daa0 msgr2=0x7f447c0ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:56.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.857+0000 7f4480f2e700 1 --2- 172.21.15.124:0/1145628952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f447c15daa0 0x7f447c0ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:56.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.857+0000 7f4480f2e700 1 -- 172.21.15.124:0/1145628952 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44700094a0 con 0x7f447c071f60 2023-10-16T12:58:56.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.857+0000 7f4480f2e700 1 --2- 172.21.15.124:0/1145628952 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f447c071f60 0x7f447c0c9a70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f44700090b0 tx=0x7f44700047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:56.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.858+0000 7f44797fa700 1 -- 172.21.15.124:0/1145628952 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470011630 con 0x7f447c071f60 2023-10-16T12:58:56.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.858+0000 7f44797fa700 1 -- 172.21.15.124:0/1145628952 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4470011790 con 0x7f447c071f60 2023-10-16T12:58:56.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.858+0000 7f4483192700 1 -- 172.21.15.124:0/1145628952 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f447c0c7ff0 con 0x7f447c071f60 2023-10-16T12:58:56.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.858+0000 7f44797fa700 1 -- 172.21.15.124:0/1145628952 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470011b40 con 0x7f447c071f60 2023-10-16T12:58:56.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.858+0000 7f4483192700 1 -- 172.21.15.124:0/1145628952 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f447c0c85b0 con 0x7f447c071f60 2023-10-16T12:58:56.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.859+0000 7f4483192700 1 -- 172.21.15.124:0/1145628952 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447c15ae80 con 0x7f447c071f60 2023-10-16T12:58:56.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.859+0000 7f44797fa700 1 -- 172.21.15.124:0/1145628952 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4470011ca0 con 0x7f447c071f60 2023-10-16T12:58:56.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.859+0000 7f44797fa700 1 --2- 172.21.15.124:0/1145628952 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f446006af00 0x7f446006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:56.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.859+0000 7f44797fa700 1 -- 172.21.15.124:0/1145628952 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f447008b220 con 0x7f447c071f60 2023-10-16T12:58:56.871 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.859+0000 7f447bfff700 1 --2- 172.21.15.124:0/1145628952 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f446006af00 0x7f446006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:56.871 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.860+0000 7f447bfff700 1 --2- 172.21.15.124:0/1145628952 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f446006af00 0x7f446006d3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f447c1f40f0 tx=0x7f4468009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:56.871 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:56.864+0000 7f44797fa700 1 -- 172.21.15.124:0/1145628952 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4470056070 con 0x7f447c071f60 2023-10-16T12:58:57.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.096+0000 7f4483192700 1 -- 172.21.15.124:0/1145628952 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f447c04ebb0 con 0x7f447c071f60 2023-10-16T12:58:57.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.097+0000 7f44797fa700 1 -- 172.21.15.124:0/1145628952 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4918 (secure 0 0 0) 0x7f4470059690 con 0x7f447c071f60 2023-10-16T12:58:57.100 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:58:57.100 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1489119886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6833","nonce":1489119886},{"type":"v1","addr":"172.21.15.192:6835","nonce":1489119886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/2221949787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":2221949787},{"type":"v1","addr":"172.21.15.124:6836","nonce":2221949787}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1247092782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":1247092782},{"type":"v1","addr":"172.21.15.124:6837","nonce":1247092782}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T12:58:51.047667+0000","modified":"2023-10-16T12:58:56.089924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6834/621867052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":621867052},{"type":"v1","addr":"172.21.15.192:6834","nonce":621867052}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-16T12:58:57.101 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.099+0000 7f4483192700 1 -- 172.21.15.124:0/1145628952 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f446006af00 msgr2=0x7f446006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:57.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.099+0000 7f4483192700 1 --2- 172.21.15.124:0/1145628952 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f446006af00 0x7f446006d3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f447c1f40f0 tx=0x7f4468009040 comp rx=0 tx=0).stop 2023-10-16T12:58:57.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.099+0000 7f4483192700 1 -- 172.21.15.124:0/1145628952 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f447c071f60 msgr2=0x7f447c0c9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:57.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.099+0000 7f4483192700 1 --2- 172.21.15.124:0/1145628952 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f447c071f60 0x7f447c0c9a70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f44700090b0 tx=0x7f44700047c0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.099+0000 7f4483192700 1 -- 172.21.15.124:0/1145628952 shutdown_connections 2023-10-16T12:58:57.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.099+0000 7f4483192700 1 --2- 172.21.15.124:0/1145628952 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f446006af00 0x7f446006d3c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.099+0000 7f4483192700 1 --2- 172.21.15.124:0/1145628952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f447c15daa0 0x7f447c0ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.099+0000 7f4483192700 1 --2- 172.21.15.124:0/1145628952 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f447c071f60 0x7f447c0c9a70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.099+0000 7f4483192700 1 --2- 172.21.15.124:0/1145628952 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f447c0af560 0x7f447c0c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.099+0000 7f4483192700 1 -- 172.21.15.124:0/1145628952 >> 172.21.15.124:0/1145628952 conn(0x7f447c0d0180 msgr2=0x7f447c0cb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:57.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.099+0000 7f4483192700 1 -- 172.21.15.124:0/1145628952 shutdown_connections 2023-10-16T12:58:57.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.099+0000 7f4483192700 1 -- 172.21.15.124:0/1145628952 wait complete. 2023-10-16T12:58:57.104 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 7 2023-10-16T12:58:57.113 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:58:57.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.230+0000 7fe9f2c1f700 1 Processor -- start 2023-10-16T12:58:57.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.231+0000 7fe9f2c1f700 1 -- start start 2023-10-16T12:58:57.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.231+0000 7fe9f2c1f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9ec0712e0 0x7fe9ec15f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:57.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.231+0000 7fe9f2c1f700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe9ec144ea0 0x7fe9ec0cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:57.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.231+0000 7fe9f2c1f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe9ec0716c0 0x7fe9ec06a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:57.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.231+0000 7fe9f2c1f700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ec0cc150 con 0x7fe9ec144ea0 2023-10-16T12:58:57.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.231+0000 7fe9f2c1f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ec0cd4b0 con 0x7fe9ec0716c0 2023-10-16T12:58:57.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.231+0000 7fe9f2c1f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec15b8f0 con 0x7fe9ec0712e0 2023-10-16T12:58:57.237 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.231+0000 7fe9ebfff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe9ec144ea0 0x7fe9ec0cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:57.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.232+0000 7fe9ebfff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe9ec144ea0 0x7fe9ec0cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53108/0 (socket says 172.21.15.124:53108) 2023-10-16T12:58:57.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.232+0000 7fe9ebfff700 1 -- 172.21.15.124:0/992076224 learned_addr learned my addr 172.21.15.124:0/992076224 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:57.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.232+0000 7fe9f11bc700 1 --2- 172.21.15.124:0/992076224 >> v2:172.21.15.192:3300/0 conn(0x7fe9ec0716c0 0x7fe9ec06a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:57.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.232+0000 7fe9f09bb700 1 --2- 172.21.15.124:0/992076224 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9ec0712e0 0x7fe9ec15f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:57.238 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.232+0000 7fe9ebfff700 1 -- 172.21.15.124:0/992076224 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9ec0712e0 msgr2=0x7fe9ec15f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:57.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.232+0000 7fe9ebfff700 1 --2- 172.21.15.124:0/992076224 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9ec0712e0 0x7fe9ec15f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.232+0000 7fe9ebfff700 1 -- 172.21.15.124:0/992076224 >> v2:172.21.15.192:3300/0 conn(0x7fe9ec0716c0 msgr2=0x7fe9ec06a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:57.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.232+0000 7fe9ebfff700 1 --2- 172.21.15.124:0/992076224 >> v2:172.21.15.192:3300/0 conn(0x7fe9ec0716c0 0x7fe9ec06a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.232+0000 7fe9ebfff700 1 -- 172.21.15.124:0/992076224 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec15fdb0 con 0x7fe9ec144ea0 2023-10-16T12:58:57.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.232+0000 7fe9ebfff700 1 --2- 172.21.15.124:0/992076224 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9ec144ea0 0x7fe9ec0cbc10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0ae950 tx=0x7fe9d8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbbe95520b839198 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:57.240 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.232+0000 7fe9eb7fe700 1 -- 172.21.15.124:0/992076224 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d800b870 con 0x7fe9ec144ea0 2023-10-16T12:58:57.240 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.232+0000 7fe9eb7fe700 1 -- 172.21.15.124:0/992076224 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d800b9d0 con 0x7fe9ec144ea0 2023-10-16T12:58:57.240 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.232+0000 7fe9eb7fe700 1 -- 172.21.15.124:0/992076224 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d800bd60 con 0x7fe9ec144ea0 2023-10-16T12:58:57.240 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.233+0000 7fe9f2c1f700 1 -- 172.21.15.124:0/992076224 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9ec144ea0 msgr2=0x7fe9ec0cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:57.240 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.233+0000 7fe9f2c1f700 1 --2- 172.21.15.124:0/992076224 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9ec144ea0 0x7fe9ec0cbc10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0ae950 tx=0x7fe9d8009bd0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.233+0000 7fe9f2c1f700 1 -- 172.21.15.124:0/992076224 shutdown_connections 2023-10-16T12:58:57.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.233+0000 7fe9f2c1f700 1 --2- 172.21.15.124:0/992076224 >> v2:172.21.15.192:3300/0 conn(0x7fe9ec0716c0 0x7fe9ec06a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.233+0000 7fe9f2c1f700 1 --2- 172.21.15.124:0/992076224 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9ec0712e0 0x7fe9ec15f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.233+0000 7fe9f2c1f700 1 --2- 172.21.15.124:0/992076224 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9ec144ea0 0x7fe9ec0cbc10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.233+0000 7fe9f2c1f700 1 -- 172.21.15.124:0/992076224 >> 172.21.15.124:0/992076224 conn(0x7fe9ec0cfcd0 msgr2=0x7fe9ec0d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:57.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.233+0000 7fe9f2c1f700 1 -- 172.21.15.124:0/992076224 shutdown_connections 2023-10-16T12:58:57.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.233+0000 7fe9f2c1f700 1 -- 172.21.15.124:0/992076224 wait complete. 2023-10-16T12:58:57.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.234+0000 7fe9f2c1f700 1 Processor -- start 2023-10-16T12:58:57.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.234+0000 7fe9f2c1f700 1 -- start start 2023-10-16T12:58:57.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.235+0000 7fe9f2c1f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9ec0712e0 0x7fe9ec150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:57.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.235+0000 7fe9f2c1f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9ec0716c0 0x7fe9ec14ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:57.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.235+0000 7fe9f2c1f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9ec144ea0 0x7fe9ec0b06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:57.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.235+0000 7fe9f2c1f700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0c81a0 con 0x7fe9ec0712e0 2023-10-16T12:58:57.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.235+0000 7fe9f2c1f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec150960 con 0x7fe9ec0716c0 2023-10-16T12:58:57.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.235+0000 7fe9f2c1f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec14d3d0 con 0x7fe9ec144ea0 2023-10-16T12:58:57.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.235+0000 7fe9f09bb700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9ec0712e0 0x7fe9ec150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:57.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.235+0000 7fe9f09bb700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9ec0712e0 0x7fe9ec150420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53114/0 (socket says 172.21.15.124:53114) 2023-10-16T12:58:57.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.235+0000 7fe9f09bb700 1 -- 172.21.15.124:0/2934195637 learned_addr learned my addr 172.21.15.124:0/2934195637 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:57.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.235+0000 7fe9f11bc700 1 --2- 172.21.15.124:0/2934195637 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9ec144ea0 0x7fe9ec0b06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:57.247 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.235+0000 7fe9ebfff700 1 --2- 172.21.15.124:0/2934195637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9ec0716c0 0x7fe9ec14ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:57.247 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.235+0000 7fe9f09bb700 1 -- 172.21.15.124:0/2934195637 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9ec144ea0 msgr2=0x7fe9ec0b06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:57.247 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.235+0000 7fe9f09bb700 1 --2- 172.21.15.124:0/2934195637 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9ec144ea0 0x7fe9ec0b06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.247 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.235+0000 7fe9f09bb700 1 -- 172.21.15.124:0/2934195637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9ec0716c0 msgr2=0x7fe9ec14ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:57.247 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.235+0000 7fe9f09bb700 1 --2- 172.21.15.124:0/2934195637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9ec0716c0 0x7fe9ec14ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.235+0000 7fe9f09bb700 1 -- 172.21.15.124:0/2934195637 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d8009550 con 0x7fe9ec0712e0 2023-10-16T12:58:57.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.235+0000 7fe9f09bb700 1 --2- 172.21.15.124:0/2934195637 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9ec0712e0 0x7fe9ec150420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe9e000d800 tx=0x7fe9e000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:57.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.235+0000 7fe9e97fa700 1 -- 172.21.15.124:0/2934195637 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e00125f0 con 0x7fe9ec0712e0 2023-10-16T12:58:57.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.235+0000 7fe9e97fa700 1 -- 172.21.15.124:0/2934195637 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e0012750 con 0x7fe9ec0712e0 2023-10-16T12:58:57.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.235+0000 7fe9f2c1f700 1 -- 172.21.15.124:0/2934195637 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ec0c6e90 con 0x7fe9ec0712e0 2023-10-16T12:58:57.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.235+0000 7fe9e97fa700 1 -- 172.21.15.124:0/2934195637 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0012ae0 con 0x7fe9ec0712e0 2023-10-16T12:58:57.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.235+0000 7fe9f2c1f700 1 -- 172.21.15.124:0/2934195637 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ec0c7450 con 0x7fe9ec0712e0 2023-10-16T12:58:57.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.236+0000 7fe9f2c1f700 1 -- 172.21.15.124:0/2934195637 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ec04ebb0 con 0x7fe9ec0712e0 2023-10-16T12:58:57.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.237+0000 7fe9e97fa700 1 -- 172.21.15.124:0/2934195637 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe9e0012c40 con 0x7fe9ec0712e0 2023-10-16T12:58:57.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.237+0000 7fe9e97fa700 1 --2- 172.21.15.124:0/2934195637 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe9d006af00 0x7fe9d006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:57.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.237+0000 7fe9e97fa700 1 -- 172.21.15.124:0/2934195637 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe9e0089b50 con 0x7fe9ec0712e0 2023-10-16T12:58:57.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.237+0000 7fe9ebfff700 1 --2- 172.21.15.124:0/2934195637 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe9d006af00 0x7fe9d006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:57.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.238+0000 7fe9ebfff700 1 --2- 172.21.15.124:0/2934195637 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe9d006af00 0x7fe9d006d3c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8000c00 tx=0x7fe9d8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:57.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.241+0000 7fe9e97fa700 1 -- 172.21.15.124:0/2934195637 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe9e00549a0 con 0x7fe9ec0712e0 2023-10-16T12:58:57.437 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.434+0000 7fe9f2c1f700 1 -- 172.21.15.124:0/2934195637 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9ec06bd10 con 0x7fe9ec0712e0 2023-10-16T12:58:57.438 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.435+0000 7fe9e97fa700 1 -- 172.21.15.124:0/2934195637 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fe9e0057fc0 con 0x7fe9ec0712e0 2023-10-16T12:58:57.438 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:58:57.438 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":24,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:58:56.089767+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:58:57.440 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.437+0000 7fe9f2c1f700 1 -- 172.21.15.124:0/2934195637 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe9d006af00 msgr2=0x7fe9d006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:57.440 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.437+0000 7fe9f2c1f700 1 --2- 172.21.15.124:0/2934195637 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe9d006af00 0x7fe9d006d3c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8000c00 tx=0x7fe9d8008030 comp rx=0 tx=0).stop 2023-10-16T12:58:57.441 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.437+0000 7fe9f2c1f700 1 -- 172.21.15.124:0/2934195637 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9ec0712e0 msgr2=0x7fe9ec150420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:57.441 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.437+0000 7fe9f2c1f700 1 --2- 172.21.15.124:0/2934195637 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9ec0712e0 0x7fe9ec150420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe9e000d800 tx=0x7fe9e000dbc0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.441 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.437+0000 7fe9f2c1f700 1 -- 172.21.15.124:0/2934195637 shutdown_connections 2023-10-16T12:58:57.441 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.437+0000 7fe9f2c1f700 1 --2- 172.21.15.124:0/2934195637 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe9d006af00 0x7fe9d006d3c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.441 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.437+0000 7fe9f2c1f700 1 --2- 172.21.15.124:0/2934195637 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9ec144ea0 0x7fe9ec0b06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.437+0000 7fe9f2c1f700 1 --2- 172.21.15.124:0/2934195637 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9ec0712e0 0x7fe9ec150420 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.437+0000 7fe9f2c1f700 1 --2- 172.21.15.124:0/2934195637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9ec0716c0 0x7fe9ec14ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.437+0000 7fe9f2c1f700 1 -- 172.21.15.124:0/2934195637 >> 172.21.15.124:0/2934195637 conn(0x7fe9ec0cfcd0 msgr2=0x7fe9ec0b44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:57.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.437+0000 7fe9f2c1f700 1 -- 172.21.15.124:0/2934195637 shutdown_connections 2023-10-16T12:58:57.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.437+0000 7fe9f2c1f700 1 -- 172.21.15.124:0/2934195637 wait complete. 2023-10-16T12:58:57.452 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:58:57.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.570+0000 7fcfb4e4a700 1 Processor -- start 2023-10-16T12:58:57.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.570+0000 7fcfb4e4a700 1 -- start start 2023-10-16T12:58:57.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.571+0000 7fcfb4e4a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfb015d810 0x7fcfb00af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:57.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.571+0000 7fcfb4e4a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcfb015dbf0 0x7fcfb00ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:57.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.571+0000 7fcfb4e4a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb00cfc30 con 0x7fcfb00af030 2023-10-16T12:58:57.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.571+0000 7fcfb4e4a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb00cf990 con 0x7fcfb015dbf0 2023-10-16T12:58:57.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.571+0000 7fcfb4e4a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb00cff10 con 0x7fcfb015d810 2023-10-16T12:58:57.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.571+0000 7fcfae59c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfb015d810 0x7fcfb00af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:57.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.571+0000 7fcfadd9b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcfb015dbf0 0x7fcfb00ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:57.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.571+0000 7fcfaed9d700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fcfb00af030 0x7fcfb0161560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.124:53790/0 (socket says 172.21.15.124:53790) 2023-10-16T12:58:57.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.571+0000 7fcfaed9d700 1 -- 172.21.15.124:0/2842224465 learned_addr learned my addr 172.21.15.124:0/2842224465 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:58:57.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.572+0000 7fcfae59c700 1 -- 172.21.15.124:0/2842224465 >> v2:172.21.15.192:3300/0 conn(0x7fcfb015dbf0 msgr2=0x7fcfb00ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:57.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.572+0000 7fcfae59c700 1 --2- 172.21.15.124:0/2842224465 >> v2:172.21.15.192:3300/0 conn(0x7fcfb015dbf0 0x7fcfb00ca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.572+0000 7fcfae59c700 1 -- 172.21.15.124:0/2842224465 >> v1:172.21.15.192:6789/0 conn(0x7fcfb00af030 legacy=0x7fcfb0161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:57.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.572+0000 7fcfae59c700 1 -- 172.21.15.124:0/2842224465 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb0072290 con 0x7fcfb015d810 2023-10-16T12:58:57.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.572+0000 7fcfad59a700 1 -- 172.21.15.124:0/2842224465 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414023893 0 0) 0x7fcfb00cfc30 con 0x7fcfb00af030 2023-10-16T12:58:57.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.572+0000 7fcfadd9b700 1 --2- 172.21.15.124:0/2842224465 >> v2:172.21.15.192:3300/0 conn(0x7fcfb015dbf0 0x7fcfb00ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:58:57.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.572+0000 7fcfae59c700 1 --2- 172.21.15.124:0/2842224465 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfb015d810 0x7fcfb00af580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0009840 tx=0x7fcfa0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=617118768a3761f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:57.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.572+0000 7fcfad59a700 1 -- 172.21.15.124:0/2842224465 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0011830 con 0x7fcfb015d810 2023-10-16T12:58:57.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.572+0000 7fcfad59a700 1 -- 172.21.15.124:0/2842224465 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa0011990 con 0x7fcfb015d810 2023-10-16T12:58:57.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.572+0000 7fcfad59a700 1 -- 172.21.15.124:0/2842224465 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0011d20 con 0x7fcfb015d810 2023-10-16T12:58:57.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.573+0000 7fcfb4e4a700 1 -- 172.21.15.124:0/2842224465 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfb015d810 msgr2=0x7fcfb00af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:57.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.573+0000 7fcfb4e4a700 1 --2- 172.21.15.124:0/2842224465 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfb015d810 0x7fcfb00af580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0009840 tx=0x7fcfa0009b50 comp rx=0 tx=0).stop 2023-10-16T12:58:57.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.573+0000 7fcfb4e4a700 1 -- 172.21.15.124:0/2842224465 shutdown_connections 2023-10-16T12:58:57.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.573+0000 7fcfb4e4a700 1 --2- 172.21.15.124:0/2842224465 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfb015d810 0x7fcfb00af580 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.573+0000 7fcfb4e4a700 1 --2- 172.21.15.124:0/2842224465 >> v2:172.21.15.192:3300/0 conn(0x7fcfb015dbf0 0x7fcfb00ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.573+0000 7fcfb4e4a700 1 -- 172.21.15.124:0/2842224465 >> 172.21.15.124:0/2842224465 conn(0x7fcfb00d0180 msgr2=0x7fcfb00d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:57.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.573+0000 7fcfb4e4a700 1 -- 172.21.15.124:0/2842224465 shutdown_connections 2023-10-16T12:58:57.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.573+0000 7fcfb4e4a700 1 -- 172.21.15.124:0/2842224465 wait complete. 2023-10-16T12:58:57.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.574+0000 7fcfb4e4a700 1 Processor -- start 2023-10-16T12:58:57.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.574+0000 7fcfb4e4a700 1 -- start start 2023-10-16T12:58:57.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.575+0000 7fcfb4e4a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfb00af030 0x7fcfb00c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:57.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.575+0000 7fcfb4e4a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfb015d810 0x7fcfb015f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:57.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.575+0000 7fcfb4e4a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfb015dbf0 0x7fcfb01f38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:57.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.575+0000 7fcfb4e4a700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb01f3e20 con 0x7fcfb00af030 2023-10-16T12:58:57.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.575+0000 7fcfb4e4a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb00b4470 con 0x7fcfb015d810 2023-10-16T12:58:57.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.575+0000 7fcfb4e4a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb015f7c0 con 0x7fcfb015dbf0 2023-10-16T12:58:57.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.575+0000 7fcfae59c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfb00af030 0x7fcfb00c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:57.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.575+0000 7fcfae59c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfb00af030 0x7fcfb00c80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53128/0 (socket says 172.21.15.124:53128) 2023-10-16T12:58:57.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.575+0000 7fcfae59c700 1 -- 172.21.15.124:0/1250025253 learned_addr learned my addr 172.21.15.124:0/1250025253 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:57.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.575+0000 7fcfadd9b700 1 --2- 172.21.15.124:0/1250025253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfb015d810 0x7fcfb015f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:57.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.575+0000 7fcfaed9d700 1 --2- 172.21.15.124:0/1250025253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfb015dbf0 0x7fcfb01f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:57.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.575+0000 7fcfae59c700 1 -- 172.21.15.124:0/1250025253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfb015dbf0 msgr2=0x7fcfb01f38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:57.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.575+0000 7fcfae59c700 1 --2- 172.21.15.124:0/1250025253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfb015dbf0 0x7fcfb01f38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.575+0000 7fcfae59c700 1 -- 172.21.15.124:0/1250025253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfb015d810 msgr2=0x7fcfb015f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:57.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.575+0000 7fcfae59c700 1 --2- 172.21.15.124:0/1250025253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfb015d810 0x7fcfb015f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.575+0000 7fcfae59c700 1 -- 172.21.15.124:0/1250025253 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa40094a0 con 0x7fcfb00af030 2023-10-16T12:58:57.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.575+0000 7fcfadd9b700 1 --2- 172.21.15.124:0/1250025253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfb015d810 0x7fcfb015f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:58:57.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.575+0000 7fcfae59c700 1 --2- 172.21.15.124:0/1250025253 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfb00af030 0x7fcfb00c80b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00090b0 tx=0x7fcfa0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:57.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.575+0000 7fcf9effd700 1 -- 172.21.15.124:0/1250025253 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa00038a0 con 0x7fcfb00af030 2023-10-16T12:58:57.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.575+0000 7fcf9effd700 1 -- 172.21.15.124:0/1250025253 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa001f070 con 0x7fcfb00af030 2023-10-16T12:58:57.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.575+0000 7fcfb4e4a700 1 -- 172.21.15.124:0/1250025253 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa00094a0 con 0x7fcfb00af030 2023-10-16T12:58:57.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.576+0000 7fcf9effd700 1 -- 172.21.15.124:0/1250025253 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0003c00 con 0x7fcfb00af030 2023-10-16T12:58:57.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.576+0000 7fcfb4e4a700 1 -- 172.21.15.124:0/1250025253 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb015fd80 con 0x7fcfb00af030 2023-10-16T12:58:57.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.576+0000 7fcfb4e4a700 1 -- 172.21.15.124:0/1250025253 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb004ebb0 con 0x7fcfb00af030 2023-10-16T12:58:57.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.577+0000 7fcf9effd700 1 -- 172.21.15.124:0/1250025253 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcfa001a430 con 0x7fcfb00af030 2023-10-16T12:58:57.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.577+0000 7fcf9effd700 1 --2- 172.21.15.124:0/1250025253 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fcf9006af00 0x7fcf9006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:57.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.577+0000 7fcf9effd700 1 -- 172.21.15.124:0/1250025253 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcfa0021070 con 0x7fcfb00af030 2023-10-16T12:58:57.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.577+0000 7fcfadd9b700 1 --2- 172.21.15.124:0/1250025253 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fcf9006af00 0x7fcf9006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:57.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.578+0000 7fcfadd9b700 1 --2- 172.21.15.124:0/1250025253 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fcf9006af00 0x7fcf9006d3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcfb006aa30 tx=0x7fcfa4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:57.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.582+0000 7fcf9effd700 1 -- 172.21.15.124:0/1250025253 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcfa0056030 con 0x7fcfb00af030 2023-10-16T12:58:57.779 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.777+0000 7fcfb4e4a700 1 -- 172.21.15.124:0/1250025253 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfb00b6100 con 0x7fcfb00af030 2023-10-16T12:58:57.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.778+0000 7fcf9effd700 1 -- 172.21.15.124:0/1250025253 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fcfa0059650 con 0x7fcfb00af030 2023-10-16T12:58:57.781 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:58:57.781 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":24,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:58:56.089767+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:58:57.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.780+0000 7fcfb4e4a700 1 -- 172.21.15.124:0/1250025253 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fcf9006af00 msgr2=0x7fcf9006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:57.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.780+0000 7fcfb4e4a700 1 --2- 172.21.15.124:0/1250025253 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fcf9006af00 0x7fcf9006d3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcfb006aa30 tx=0x7fcfa4008040 comp rx=0 tx=0).stop 2023-10-16T12:58:57.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.780+0000 7fcfb4e4a700 1 -- 172.21.15.124:0/1250025253 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfb00af030 msgr2=0x7fcfb00c80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:57.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.780+0000 7fcfb4e4a700 1 --2- 172.21.15.124:0/1250025253 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfb00af030 0x7fcfb00c80b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00090b0 tx=0x7fcfa0004750 comp rx=0 tx=0).stop 2023-10-16T12:58:57.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.780+0000 7fcfb4e4a700 1 -- 172.21.15.124:0/1250025253 shutdown_connections 2023-10-16T12:58:57.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.780+0000 7fcfb4e4a700 1 --2- 172.21.15.124:0/1250025253 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fcf9006af00 0x7fcf9006d3c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.780+0000 7fcfb4e4a700 1 --2- 172.21.15.124:0/1250025253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfb015dbf0 0x7fcfb01f38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.780+0000 7fcfb4e4a700 1 --2- 172.21.15.124:0/1250025253 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfb00af030 0x7fcfb00c80b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.780+0000 7fcfb4e4a700 1 --2- 172.21.15.124:0/1250025253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfb015d810 0x7fcfb015f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.780+0000 7fcfb4e4a700 1 -- 172.21.15.124:0/1250025253 >> 172.21.15.124:0/1250025253 conn(0x7fcfb00d0180 msgr2=0x7fcfb015c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:57.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.780+0000 7fcfb4e4a700 1 -- 172.21.15.124:0/1250025253 shutdown_connections 2023-10-16T12:58:57.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.780+0000 7fcfb4e4a700 1 -- 172.21.15.124:0/1250025253 wait complete. 2023-10-16T12:58:57.810 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T12:58:57.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.926+0000 7f2c55eae700 1 Processor -- start 2023-10-16T12:58:57.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.927+0000 7f2c55eae700 1 -- start start 2023-10-16T12:58:57.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.928+0000 7f2c55eae700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2c50152470 0x7f2c500cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:57.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.928+0000 7f2c55eae700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c500cb8d0 0x7f2c500b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:57.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.928+0000 7f2c55eae700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2c500b3240 0x7f2c500b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:57.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.928+0000 7f2c55eae700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c500b36d0 con 0x7f2c500b3240 2023-10-16T12:58:57.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.928+0000 7f2c55eae700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c50071200 con 0x7f2c50152470 2023-10-16T12:58:57.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.928+0000 7f2c55eae700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c50070d70 con 0x7f2c500cb8d0 2023-10-16T12:58:57.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.928+0000 7f2c4ffff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2c500b3240 0x7f2c500b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:57.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.928+0000 7f2c4ffff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2c500b3240 0x7f2c500b60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53140/0 (socket says 172.21.15.124:53140) 2023-10-16T12:58:57.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.928+0000 7f2c4ffff700 1 -- 172.21.15.124:0/1926784585 learned_addr learned my addr 172.21.15.124:0/1926784585 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:57.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.928+0000 7f2c4effd700 1 --2- 172.21.15.124:0/1926784585 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c500cb8d0 0x7f2c500b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:57.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.928+0000 7f2c4f7fe700 1 --2- 172.21.15.124:0/1926784585 >> v2:172.21.15.192:3300/0 conn(0x7f2c50152470 0x7f2c500cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:57.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.928+0000 7f2c4ffff700 1 -- 172.21.15.124:0/1926784585 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c500cb8d0 msgr2=0x7f2c500b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:57.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.928+0000 7f2c4ffff700 1 --2- 172.21.15.124:0/1926784585 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c500cb8d0 0x7f2c500b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.928+0000 7f2c4ffff700 1 -- 172.21.15.124:0/1926784585 >> v2:172.21.15.192:3300/0 conn(0x7f2c50152470 msgr2=0x7f2c500cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:57.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.928+0000 7f2c4ffff700 1 --2- 172.21.15.124:0/1926784585 >> v2:172.21.15.192:3300/0 conn(0x7f2c50152470 0x7f2c500cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.928+0000 7f2c4ffff700 1 -- 172.21.15.124:0/1926784585 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c50070440 con 0x7f2c500b3240 2023-10-16T12:58:57.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.928+0000 7f2c4ffff700 1 --2- 172.21.15.124:0/1926784585 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2c500b3240 0x7f2c500b60f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2c50071460 tx=0x7f2c4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc9dfdc15ea5276 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:57.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.928+0000 7f2c4e7fc700 1 -- 172.21.15.124:0/1926784585 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4800e070 con 0x7f2c500b3240 2023-10-16T12:58:57.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.928+0000 7f2c4e7fc700 1 -- 172.21.15.124:0/1926784585 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4800b910 con 0x7f2c500b3240 2023-10-16T12:58:57.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.928+0000 7f2c4e7fc700 1 -- 172.21.15.124:0/1926784585 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4800bcc0 con 0x7f2c500b3240 2023-10-16T12:58:57.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.929+0000 7f2c55eae700 1 -- 172.21.15.124:0/1926784585 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2c500b3240 msgr2=0x7f2c500b60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:57.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.929+0000 7f2c55eae700 1 --2- 172.21.15.124:0/1926784585 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2c500b3240 0x7f2c500b60f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2c50071460 tx=0x7f2c4800b330 comp rx=0 tx=0).stop 2023-10-16T12:58:57.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.929+0000 7f2c55eae700 1 -- 172.21.15.124:0/1926784585 shutdown_connections 2023-10-16T12:58:57.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.929+0000 7f2c55eae700 1 --2- 172.21.15.124:0/1926784585 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2c500b3240 0x7f2c500b60f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.929+0000 7f2c55eae700 1 --2- 172.21.15.124:0/1926784585 >> v2:172.21.15.192:3300/0 conn(0x7f2c50152470 0x7f2c500cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.929+0000 7f2c55eae700 1 --2- 172.21.15.124:0/1926784585 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c500cb8d0 0x7f2c500b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.929+0000 7f2c55eae700 1 -- 172.21.15.124:0/1926784585 >> 172.21.15.124:0/1926784585 conn(0x7f2c500cdd00 msgr2=0x7f2c500ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:57.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.929+0000 7f2c55eae700 1 -- 172.21.15.124:0/1926784585 shutdown_connections 2023-10-16T12:58:57.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.929+0000 7f2c55eae700 1 -- 172.21.15.124:0/1926784585 wait complete. 2023-10-16T12:58:57.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.931+0000 7f2c55eae700 1 Processor -- start 2023-10-16T12:58:57.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.931+0000 7f2c55eae700 1 -- start start 2023-10-16T12:58:57.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.932+0000 7f2c55eae700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c500b3240 0x7f2c501f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:57.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.932+0000 7f2c55eae700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2c500cb8d0 0x7f2c500b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:57.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.932+0000 7f2c55eae700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c50152470 0x7f2c500b6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:57.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.932+0000 7f2c55eae700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c501f52f0 con 0x7f2c500cb8d0 2023-10-16T12:58:57.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.932+0000 7f2c55eae700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c500b5500 con 0x7f2c50152470 2023-10-16T12:58:57.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.932+0000 7f2c55eae700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c500b4460 con 0x7f2c500b3240 2023-10-16T12:58:57.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.932+0000 7f2c4effd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2c500cb8d0 0x7f2c500b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:57.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.932+0000 7f2c4effd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2c500cb8d0 0x7f2c500b5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53144/0 (socket says 172.21.15.124:53144) 2023-10-16T12:58:57.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.932+0000 7f2c4effd700 1 -- 172.21.15.124:0/4042707593 learned_addr learned my addr 172.21.15.124:0/4042707593 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:57.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.932+0000 7f2c4f7fe700 1 --2- 172.21.15.124:0/4042707593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c500b3240 0x7f2c501f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:57.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.932+0000 7f2c4ffff700 1 --2- 172.21.15.124:0/4042707593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c50152470 0x7f2c500b6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:57.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.932+0000 7f2c4effd700 1 -- 172.21.15.124:0/4042707593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c500b3240 msgr2=0x7f2c501f4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:57.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.932+0000 7f2c4effd700 1 --2- 172.21.15.124:0/4042707593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c500b3240 0x7f2c501f4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.932+0000 7f2c4effd700 1 -- 172.21.15.124:0/4042707593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c50152470 msgr2=0x7f2c500b6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:57.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.932+0000 7f2c4effd700 1 --2- 172.21.15.124:0/4042707593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c50152470 0x7f2c500b6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:57.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.932+0000 7f2c4effd700 1 -- 172.21.15.124:0/4042707593 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c48009b30 con 0x7f2c500cb8d0 2023-10-16T12:58:57.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.932+0000 7f2c4f7fe700 1 --2- 172.21.15.124:0/4042707593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c500b3240 0x7f2c501f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:58:57.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.932+0000 7f2c4ffff700 1 --2- 172.21.15.124:0/4042707593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c50152470 0x7f2c500b6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:58:57.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.932+0000 7f2c4effd700 1 --2- 172.21.15.124:0/4042707593 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2c500cb8d0 0x7f2c500b5de0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400e960 tx=0x7f2c4400ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:57.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.932+0000 7f2c37fff700 1 -- 172.21.15.124:0/4042707593 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c44009690 con 0x7f2c500cb8d0 2023-10-16T12:58:57.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.932+0000 7f2c37fff700 1 -- 172.21.15.124:0/4042707593 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4400c850 con 0x7f2c500cb8d0 2023-10-16T12:58:57.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.932+0000 7f2c55eae700 1 -- 172.21.15.124:0/4042707593 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c500b4740 con 0x7f2c500cb8d0 2023-10-16T12:58:57.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.932+0000 7f2c37fff700 1 -- 172.21.15.124:0/4042707593 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4400cbc0 con 0x7f2c500cb8d0 2023-10-16T12:58:57.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.932+0000 7f2c55eae700 1 -- 172.21.15.124:0/4042707593 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c500b4d00 con 0x7f2c500cb8d0 2023-10-16T12:58:57.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.933+0000 7f2c55eae700 1 -- 172.21.15.124:0/4042707593 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c5004ebb0 con 0x7f2c500cb8d0 2023-10-16T12:58:57.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.934+0000 7f2c37fff700 1 -- 172.21.15.124:0/4042707593 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2c4400cd20 con 0x7f2c500cb8d0 2023-10-16T12:58:57.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.934+0000 7f2c37fff700 1 --2- 172.21.15.124:0/4042707593 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f2c3c06af00 0x7f2c3c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:57.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.934+0000 7f2c37fff700 1 -- 172.21.15.124:0/4042707593 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2c440898a0 con 0x7f2c500cb8d0 2023-10-16T12:58:57.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.934+0000 7f2c4f7fe700 1 --2- 172.21.15.124:0/4042707593 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f2c3c06af00 0x7f2c3c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:57.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.934+0000 7f2c4f7fe700 1 --2- 172.21.15.124:0/4042707593 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f2c3c06af00 0x7f2c3c06d3c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009c30 tx=0x7f2c40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:57.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:57.938+0000 7f2c37fff700 1 -- 172.21.15.124:0/4042707593 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2c440546f0 con 0x7f2c500cb8d0 2023-10-16T12:58:58.171 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.169+0000 7f2c55eae700 1 -- 172.21.15.124:0/4042707593 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c5006f630 con 0x7f2c500cb8d0 2023-10-16T12:58:58.172 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.169+0000 7f2c37fff700 1 -- 172.21.15.124:0/4042707593 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4918 (secure 0 0 0) 0x7f2c44057d10 con 0x7f2c500cb8d0 2023-10-16T12:58:58.172 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:58:58.172 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1489119886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6833","nonce":1489119886},{"type":"v1","addr":"172.21.15.192:6835","nonce":1489119886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/2221949787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":2221949787},{"type":"v1","addr":"172.21.15.124:6836","nonce":2221949787}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1247092782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":1247092782},{"type":"v1","addr":"172.21.15.124:6837","nonce":1247092782}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T12:58:51.047667+0000","modified":"2023-10-16T12:58:56.089924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6834/621867052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":621867052},{"type":"v1","addr":"172.21.15.192:6834","nonce":621867052}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-16T12:58:58.174 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.171+0000 7f2c55eae700 1 -- 172.21.15.124:0/4042707593 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f2c3c06af00 msgr2=0x7f2c3c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:58.174 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.171+0000 7f2c55eae700 1 --2- 172.21.15.124:0/4042707593 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f2c3c06af00 0x7f2c3c06d3c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009c30 tx=0x7f2c40008040 comp rx=0 tx=0).stop 2023-10-16T12:58:58.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.171+0000 7f2c55eae700 1 -- 172.21.15.124:0/4042707593 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2c500cb8d0 msgr2=0x7f2c500b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:58.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.171+0000 7f2c55eae700 1 --2- 172.21.15.124:0/4042707593 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2c500cb8d0 0x7f2c500b5de0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400e960 tx=0x7f2c4400ed20 comp rx=0 tx=0).stop 2023-10-16T12:58:58.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.171+0000 7f2c55eae700 1 -- 172.21.15.124:0/4042707593 shutdown_connections 2023-10-16T12:58:58.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.171+0000 7f2c55eae700 1 --2- 172.21.15.124:0/4042707593 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f2c3c06af00 0x7f2c3c06d3c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:58.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.171+0000 7f2c55eae700 1 --2- 172.21.15.124:0/4042707593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c50152470 0x7f2c500b6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:58.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.171+0000 7f2c55eae700 1 --2- 172.21.15.124:0/4042707593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c500b3240 0x7f2c501f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:58.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.171+0000 7f2c55eae700 1 --2- 172.21.15.124:0/4042707593 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2c500cb8d0 0x7f2c500b5de0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:58.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.171+0000 7f2c55eae700 1 -- 172.21.15.124:0/4042707593 >> 172.21.15.124:0/4042707593 conn(0x7f2c500cdd00 msgr2=0x7f2c500b2880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:58.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.171+0000 7f2c55eae700 1 -- 172.21.15.124:0/4042707593 shutdown_connections 2023-10-16T12:58:58.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.172+0000 7f2c55eae700 1 -- 172.21.15.124:0/4042707593 wait complete. 2023-10-16T12:58:58.177 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 7 2023-10-16T12:58:58.186 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:58:58.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.303+0000 7fc3634f2700 1 Processor -- start 2023-10-16T12:58:58.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.303+0000 7fc3634f2700 1 -- start start 2023-10-16T12:58:58.308 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.304+0000 7fc3634f2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc35c0b5700 0x7fc35c0cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:58.309 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.304+0000 7fc3634f2700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc35c0b9000 0x7fc35c0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:58.309 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.304+0000 7fc3634f2700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35c0d0010 con 0x7fc35c160b50 2023-10-16T12:58:58.309 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.304+0000 7fc3634f2700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35c0d02f0 con 0x7fc35c0b9000 2023-10-16T12:58:58.309 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.304+0000 7fc3634f2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35c0d05d0 con 0x7fc35c0b5700 2023-10-16T12:58:58.309 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.304+0000 7fc361a8f700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc35c0b9000 0x7fc35c0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:58.310 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.304+0000 7fc36128e700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fc35c160b50 0x7fc35c0b4ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:41818/0 (socket says 172.21.15.124:41818) 2023-10-16T12:58:58.310 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.304+0000 7fc36128e700 1 -- 172.21.15.124:0/4159887395 learned_addr learned my addr 172.21.15.124:0/4159887395 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:58:58.310 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.304+0000 7fc360a8d700 1 --2- 172.21.15.124:0/4159887395 >> v2:172.21.15.192:3300/0 conn(0x7fc35c0b5700 0x7fc35c0cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:58.310 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.305+0000 7fc361a8f700 1 -- 172.21.15.124:0/4159887395 >> v2:172.21.15.192:3300/0 conn(0x7fc35c0b5700 msgr2=0x7fc35c0cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:58.310 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.305+0000 7fc361a8f700 1 --2- 172.21.15.124:0/4159887395 >> v2:172.21.15.192:3300/0 conn(0x7fc35c0b5700 0x7fc35c0cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:58.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.305+0000 7fc361a8f700 1 -- 172.21.15.124:0/4159887395 >> v1:172.21.15.124:6789/0 conn(0x7fc35c160b50 legacy=0x7fc35c0b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:58.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.305+0000 7fc361a8f700 1 -- 172.21.15.124:0/4159887395 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c0ce160 con 0x7fc35c0b9000 2023-10-16T12:58:58.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.305+0000 7fc360a8d700 1 --2- 172.21.15.124:0/4159887395 >> v2:172.21.15.192:3300/0 conn(0x7fc35c0b5700 0x7fc35c0cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:58:58.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.305+0000 7fc361a8f700 1 --2- 172.21.15.124:0/4159887395 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc35c0b9000 0x7fc35c0ce680 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc35c162290 tx=0x7fc35400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e689b1c31db0cc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:58.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.305+0000 7fc353fff700 1 -- 172.21.15.124:0/4159887395 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35400e070 con 0x7fc35c0b9000 2023-10-16T12:58:58.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.305+0000 7fc353fff700 1 -- 172.21.15.124:0/4159887395 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35400bbd0 con 0x7fc35c0b9000 2023-10-16T12:58:58.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.305+0000 7fc353fff700 1 -- 172.21.15.124:0/4159887395 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354012430 con 0x7fc35c0b9000 2023-10-16T12:58:58.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.305+0000 7fc3634f2700 1 -- 172.21.15.124:0/4159887395 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc35c0b9000 msgr2=0x7fc35c0ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:58.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.305+0000 7fc3634f2700 1 --2- 172.21.15.124:0/4159887395 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc35c0b9000 0x7fc35c0ce680 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc35c162290 tx=0x7fc35400b330 comp rx=0 tx=0).stop 2023-10-16T12:58:58.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.305+0000 7fc3634f2700 1 -- 172.21.15.124:0/4159887395 shutdown_connections 2023-10-16T12:58:58.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.305+0000 7fc3634f2700 1 --2- 172.21.15.124:0/4159887395 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc35c0b9000 0x7fc35c0ce680 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:58.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.305+0000 7fc3634f2700 1 --2- 172.21.15.124:0/4159887395 >> v2:172.21.15.192:3300/0 conn(0x7fc35c0b5700 0x7fc35c0cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:58.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.305+0000 7fc3634f2700 1 -- 172.21.15.124:0/4159887395 >> 172.21.15.124:0/4159887395 conn(0x7fc35c06bc70 msgr2=0x7fc35c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:58.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.305+0000 7fc3634f2700 1 -- 172.21.15.124:0/4159887395 shutdown_connections 2023-10-16T12:58:58.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.306+0000 7fc3634f2700 1 -- 172.21.15.124:0/4159887395 wait complete. 2023-10-16T12:58:58.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.307+0000 7fc3634f2700 1 Processor -- start 2023-10-16T12:58:58.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.307+0000 7fc3634f2700 1 -- start start 2023-10-16T12:58:58.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.307+0000 7fc3634f2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc35c0b5700 0x7fc35c14b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:58.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.307+0000 7fc3634f2700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc35c0b9000 0x7fc35c147640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:58.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.307+0000 7fc3634f2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc35c160b50 0x7fc35c147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:58.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.307+0000 7fc3634f2700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c146f60 con 0x7fc35c0b9000 2023-10-16T12:58:58.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.307+0000 7fc3634f2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c147380 con 0x7fc35c160b50 2023-10-16T12:58:58.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.307+0000 7fc3634f2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c1462e0 con 0x7fc35c0b5700 2023-10-16T12:58:58.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.307+0000 7fc360a8d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc35c0b9000 0x7fc35c147640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:58.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.307+0000 7fc360a8d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc35c0b9000 0x7fc35c147640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53158/0 (socket says 172.21.15.124:53158) 2023-10-16T12:58:58.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.307+0000 7fc360a8d700 1 -- 172.21.15.124:0/176896636 learned_addr learned my addr 172.21.15.124:0/176896636 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:58.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.308+0000 7fc36128e700 1 --2- 172.21.15.124:0/176896636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc35c0b5700 0x7fc35c14b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:58.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.308+0000 7fc361a8f700 1 --2- 172.21.15.124:0/176896636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc35c160b50 0x7fc35c147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:58.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.308+0000 7fc360a8d700 1 -- 172.21.15.124:0/176896636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc35c0b5700 msgr2=0x7fc35c14b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:58.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.308+0000 7fc360a8d700 1 --2- 172.21.15.124:0/176896636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc35c0b5700 0x7fc35c14b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:58.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.308+0000 7fc360a8d700 1 -- 172.21.15.124:0/176896636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc35c160b50 msgr2=0x7fc35c147b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:58.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.308+0000 7fc360a8d700 1 --2- 172.21.15.124:0/176896636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc35c160b50 0x7fc35c147b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:58.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.308+0000 7fc360a8d700 1 -- 172.21.15.124:0/176896636 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc354009a70 con 0x7fc35c0b9000 2023-10-16T12:58:58.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.308+0000 7fc36128e700 1 --2- 172.21.15.124:0/176896636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc35c0b5700 0x7fc35c14b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:58:58.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.308+0000 7fc361a8f700 1 --2- 172.21.15.124:0/176896636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc35c160b50 0x7fc35c147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:58:58.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.308+0000 7fc360a8d700 1 --2- 172.21.15.124:0/176896636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc35c0b9000 0x7fc35c147640 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc35800c7f0 tx=0x7fc35800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:58.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.308+0000 7fc351ffb700 1 -- 172.21.15.124:0/176896636 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358011800 con 0x7fc35c0b9000 2023-10-16T12:58:58.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.308+0000 7fc351ffb700 1 -- 172.21.15.124:0/176896636 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc358011960 con 0x7fc35c0b9000 2023-10-16T12:58:58.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.308+0000 7fc3634f2700 1 -- 172.21.15.124:0/176896636 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35c1465c0 con 0x7fc35c0b9000 2023-10-16T12:58:58.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.308+0000 7fc351ffb700 1 -- 172.21.15.124:0/176896636 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358011d10 con 0x7fc35c0b9000 2023-10-16T12:58:58.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.308+0000 7fc3634f2700 1 -- 172.21.15.124:0/176896636 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35c146b80 con 0x7fc35c0b9000 2023-10-16T12:58:58.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.309+0000 7fc3634f2700 1 -- 172.21.15.124:0/176896636 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35c0b8630 con 0x7fc35c0b9000 2023-10-16T12:58:58.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.310+0000 7fc351ffb700 1 -- 172.21.15.124:0/176896636 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc358018360 con 0x7fc35c0b9000 2023-10-16T12:58:58.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.310+0000 7fc351ffb700 1 --2- 172.21.15.124:0/176896636 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fc34006af00 0x7fc34006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:58.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.310+0000 7fc351ffb700 1 -- 172.21.15.124:0/176896636 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc3580898e0 con 0x7fc35c0b9000 2023-10-16T12:58:58.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.310+0000 7fc36128e700 1 --2- 172.21.15.124:0/176896636 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fc34006af00 0x7fc34006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:58.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.310+0000 7fc36128e700 1 --2- 172.21.15.124:0/176896636 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fc34006af00 0x7fc34006d3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc34c005910 tx=0x7fc34c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:58.323 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.314+0000 7fc351ffb700 1 -- 172.21.15.124:0/176896636 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc3580546a0 con 0x7fc35c0b9000 2023-10-16T12:58:58.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.506+0000 7fc3634f2700 1 -- 172.21.15.124:0/176896636 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc35c04ebb0 con 0x7fc35c0b9000 2023-10-16T12:58:58.510 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.507+0000 7fc351ffb700 1 -- 172.21.15.124:0/176896636 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fc358057cc0 con 0x7fc35c0b9000 2023-10-16T12:58:58.510 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:58:58.511 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":24,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:58:56.089767+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:58:58.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.509+0000 7fc3634f2700 1 -- 172.21.15.124:0/176896636 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fc34006af00 msgr2=0x7fc34006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:58.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.509+0000 7fc3634f2700 1 --2- 172.21.15.124:0/176896636 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fc34006af00 0x7fc34006d3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc34c005910 tx=0x7fc34c009040 comp rx=0 tx=0).stop 2023-10-16T12:58:58.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.509+0000 7fc3634f2700 1 -- 172.21.15.124:0/176896636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc35c0b9000 msgr2=0x7fc35c147640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:58.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.509+0000 7fc3634f2700 1 --2- 172.21.15.124:0/176896636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc35c0b9000 0x7fc35c147640 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc35800c7f0 tx=0x7fc35800cbb0 comp rx=0 tx=0).stop 2023-10-16T12:58:58.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.509+0000 7fc3634f2700 1 -- 172.21.15.124:0/176896636 shutdown_connections 2023-10-16T12:58:58.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.509+0000 7fc3634f2700 1 --2- 172.21.15.124:0/176896636 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fc34006af00 0x7fc34006d3c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:58.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.509+0000 7fc3634f2700 1 --2- 172.21.15.124:0/176896636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc35c160b50 0x7fc35c147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:58.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.509+0000 7fc3634f2700 1 --2- 172.21.15.124:0/176896636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc35c0b5700 0x7fc35c14b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:58.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.509+0000 7fc3634f2700 1 --2- 172.21.15.124:0/176896636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc35c0b9000 0x7fc35c147640 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:58.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.509+0000 7fc3634f2700 1 -- 172.21.15.124:0/176896636 >> 172.21.15.124:0/176896636 conn(0x7fc35c06bc70 msgr2=0x7fc35c156bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:58.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.510+0000 7fc3634f2700 1 -- 172.21.15.124:0/176896636 shutdown_connections 2023-10-16T12:58:58.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:58.510+0000 7fc3634f2700 1 -- 172.21.15.124:0/176896636 wait complete. 2023-10-16T12:58:58.927 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T12:58:51.047667+0000', 'modified': '2023-10-16T12:58:56.089924+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.192:6834/621867052', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6832', 'nonce': 621867052}, {'type': 'v1', 'addr': '172.21.15.192:6834', 'nonce': 621867052}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-10-16T12:58:58.927 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T12:58:58.928 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-16T12:58:59.050 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.047+0000 7efedae8d700 1 Processor -- start 2023-10-16T12:58:59.050 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.047+0000 7efedae8d700 1 -- start start 2023-10-16T12:58:59.053 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.048+0000 7efedae8d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efed406a820 0x7efed40cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.053 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.048+0000 7efedae8d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7efed415e7f0 0x7efed406ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.053 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.048+0000 7efedae8d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efed40ca7d0 0x7efed4071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.054 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.048+0000 7efedae8d700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed40ce410 con 0x7efed415e7f0 2023-10-16T12:58:59.054 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.048+0000 7efedae8d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed40cfeb0 con 0x7efed406a820 2023-10-16T12:58:59.054 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.048+0000 7efedae8d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed415ec50 con 0x7efed40ca7d0 2023-10-16T12:58:59.054 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.048+0000 7efed3fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7efed415e7f0 0x7efed406ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:59.054 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.048+0000 7efed3fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7efed415e7f0 0x7efed406ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53168/0 (socket says 172.21.15.124:53168) 2023-10-16T12:58:59.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.048+0000 7efed3fff700 1 -- 172.21.15.124:0/2056340212 learned_addr learned my addr 172.21.15.124:0/2056340212 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:59.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.048+0000 7efed942a700 1 --2- 172.21.15.124:0/2056340212 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efed40ca7d0 0x7efed4071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:59.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.048+0000 7efed8c29700 1 --2- 172.21.15.124:0/2056340212 >> v2:172.21.15.192:3300/0 conn(0x7efed406a820 0x7efed40cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:59.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.049+0000 7efed3fff700 1 -- 172.21.15.124:0/2056340212 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efed40ca7d0 msgr2=0x7efed4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:59.056 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.049+0000 7efed3fff700 1 --2- 172.21.15.124:0/2056340212 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efed40ca7d0 0x7efed4071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.056 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.049+0000 7efed3fff700 1 -- 172.21.15.124:0/2056340212 >> v2:172.21.15.192:3300/0 conn(0x7efed406a820 msgr2=0x7efed40cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:59.056 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.049+0000 7efed3fff700 1 --2- 172.21.15.124:0/2056340212 >> v2:172.21.15.192:3300/0 conn(0x7efed406a820 0x7efed40cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.056 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.049+0000 7efed3fff700 1 -- 172.21.15.124:0/2056340212 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed40af9d0 con 0x7efed415e7f0 2023-10-16T12:58:59.056 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.049+0000 7efed3fff700 1 --2- 172.21.15.124:0/2056340212 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efed415e7f0 0x7efed406ac00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efed4067df0 tx=0x7efec0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a610c82e974c6079 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:59.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.049+0000 7efed37fe700 1 -- 172.21.15.124:0/2056340212 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec000b870 con 0x7efed415e7f0 2023-10-16T12:58:59.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.049+0000 7efed37fe700 1 -- 172.21.15.124:0/2056340212 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec000b9d0 con 0x7efed415e7f0 2023-10-16T12:58:59.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.049+0000 7efed37fe700 1 -- 172.21.15.124:0/2056340212 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec000bd60 con 0x7efed415e7f0 2023-10-16T12:58:59.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.049+0000 7efedae8d700 1 -- 172.21.15.124:0/2056340212 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efed415e7f0 msgr2=0x7efed406ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:59.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.049+0000 7efedae8d700 1 --2- 172.21.15.124:0/2056340212 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efed415e7f0 0x7efed406ac00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efed4067df0 tx=0x7efec0009bd0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.049+0000 7efedae8d700 1 -- 172.21.15.124:0/2056340212 shutdown_connections 2023-10-16T12:58:59.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.049+0000 7efedae8d700 1 --2- 172.21.15.124:0/2056340212 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efed40ca7d0 0x7efed4071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.049+0000 7efedae8d700 1 --2- 172.21.15.124:0/2056340212 >> v2:172.21.15.192:3300/0 conn(0x7efed406a820 0x7efed40cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.049+0000 7efedae8d700 1 --2- 172.21.15.124:0/2056340212 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efed415e7f0 0x7efed406ac00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.049+0000 7efedae8d700 1 -- 172.21.15.124:0/2056340212 >> 172.21.15.124:0/2056340212 conn(0x7efed40d0180 msgr2=0x7efed40d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:59.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.049+0000 7efedae8d700 1 -- 172.21.15.124:0/2056340212 shutdown_connections 2023-10-16T12:58:59.059 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.049+0000 7efedae8d700 1 -- 172.21.15.124:0/2056340212 wait complete. 2023-10-16T12:58:59.059 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.051+0000 7efedae8d700 1 Processor -- start 2023-10-16T12:58:59.059 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.051+0000 7efedae8d700 1 -- start start 2023-10-16T12:58:59.068 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.051+0000 7efedae8d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efed406a820 0x7efed41600d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.068 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.051+0000 7efedae8d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efed40ca7d0 0x7efed4158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.068 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.051+0000 7efedae8d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efed415e7f0 0x7efed41f7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.068 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.051+0000 7efedae8d700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed41f3280 con 0x7efed40ca7d0 2023-10-16T12:58:59.068 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.051+0000 7efedae8d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed41f76b0 con 0x7efed415e7f0 2023-10-16T12:58:59.069 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.051+0000 7efedae8d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed41f34f0 con 0x7efed406a820 2023-10-16T12:58:59.069 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.052+0000 7efed3fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efed40ca7d0 0x7efed4158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:59.069 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.052+0000 7efed3fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efed40ca7d0 0x7efed4158830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53172/0 (socket says 172.21.15.124:53172) 2023-10-16T12:58:59.069 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.052+0000 7efed3fff700 1 -- 172.21.15.124:0/3977973845 learned_addr learned my addr 172.21.15.124:0/3977973845 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:59.070 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.052+0000 7efed8c29700 1 --2- 172.21.15.124:0/3977973845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efed406a820 0x7efed41600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:59.070 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.052+0000 7efed942a700 1 --2- 172.21.15.124:0/3977973845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efed415e7f0 0x7efed41f7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:59.070 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.052+0000 7efed3fff700 1 -- 172.21.15.124:0/3977973845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efed406a820 msgr2=0x7efed41600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:59.070 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.052+0000 7efed3fff700 1 --2- 172.21.15.124:0/3977973845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efed406a820 0x7efed41600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.070 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.052+0000 7efed3fff700 1 -- 172.21.15.124:0/3977973845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efed415e7f0 msgr2=0x7efed41f7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:59.071 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.052+0000 7efed3fff700 1 --2- 172.21.15.124:0/3977973845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efed415e7f0 0x7efed41f7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.071 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.052+0000 7efed3fff700 1 -- 172.21.15.124:0/3977973845 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec0009550 con 0x7efed40ca7d0 2023-10-16T12:58:59.071 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.052+0000 7efed3fff700 1 --2- 172.21.15.124:0/3977973845 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efed40ca7d0 0x7efed4158830 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efec0000c00 tx=0x7efec0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:59.071 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.052+0000 7efed17fa700 1 -- 172.21.15.124:0/3977973845 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec0004310 con 0x7efed40ca7d0 2023-10-16T12:58:59.071 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.052+0000 7efed17fa700 1 -- 172.21.15.124:0/3977973845 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec001e070 con 0x7efed40ca7d0 2023-10-16T12:58:59.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.052+0000 7efedae8d700 1 -- 172.21.15.124:0/3977973845 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed41f37d0 con 0x7efed40ca7d0 2023-10-16T12:58:59.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.052+0000 7efed17fa700 1 -- 172.21.15.124:0/3977973845 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec00036a0 con 0x7efed40ca7d0 2023-10-16T12:58:59.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.052+0000 7efedae8d700 1 -- 172.21.15.124:0/3977973845 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed41f3d90 con 0x7efed40ca7d0 2023-10-16T12:58:59.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.053+0000 7efed17fa700 1 -- 172.21.15.124:0/3977973845 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efec0020030 con 0x7efed40ca7d0 2023-10-16T12:58:59.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.054+0000 7efed17fa700 1 --2- 172.21.15.124:0/3977973845 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7efeb806af00 0x7efeb806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.054+0000 7efed17fa700 1 -- 172.21.15.124:0/3977973845 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efec008a730 con 0x7efed40ca7d0 2023-10-16T12:58:59.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.054+0000 7efed8c29700 1 --2- 172.21.15.124:0/3977973845 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7efeb806af00 0x7efeb806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:59.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.054+0000 7efed8c29700 1 --2- 172.21.15.124:0/3977973845 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7efeb806af00 0x7efeb806d3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efed4161010 tx=0x7efec8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:59.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.056+0000 7efee7077b80 1 Processor -- start 2023-10-16T12:58:59.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.056+0000 7efee7077b80 1 -- start start 2023-10-16T12:58:59.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.057+0000 7efee7077b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e8aadc9220 0x55e8aadd0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.057+0000 7efee7077b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e8aadce630 0x55e8aadd0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.057+0000 7efee7077b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aada4010 0x55e8aada46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.057+0000 7efee7077b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8aad1ac20 con 0x55e8aada4010 2023-10-16T12:58:59.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.057+0000 7efee7077b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8aacffc10 con 0x55e8aadc9220 2023-10-16T12:58:59.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.057+0000 7efee7077b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e8aacfd530 con 0x55e8aadce630 2023-10-16T12:58:59.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.057+0000 7efed942a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aada4010 0x55e8aada46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:59.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.057+0000 7efed942a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aada4010 0x55e8aada46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53182/0 (socket says 172.21.15.124:53182) 2023-10-16T12:58:59.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.057+0000 7efed942a700 1 -- 172.21.15.124:0/2411842376 learned_addr learned my addr 172.21.15.124:0/2411842376 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:59.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.057+0000 7efed8c29700 1 --2- 172.21.15.124:0/2411842376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e8aadc9220 0x55e8aadd0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:59.076 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.057+0000 7efed3fff700 1 --2- 172.21.15.124:0/2411842376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e8aadce630 0x55e8aadd0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:59.076 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.057+0000 7efed942a700 1 -- 172.21.15.124:0/2411842376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e8aadce630 msgr2=0x55e8aadd0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:59.076 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.057+0000 7efed942a700 1 --2- 172.21.15.124:0/2411842376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e8aadce630 0x55e8aadd0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.076 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.057+0000 7efed942a700 1 -- 172.21.15.124:0/2411842376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e8aadc9220 msgr2=0x55e8aadd0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:59.076 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.057+0000 7efed942a700 1 --2- 172.21.15.124:0/2411842376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e8aadc9220 0x55e8aadd0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.077 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.057+0000 7efed942a700 1 -- 172.21.15.124:0/2411842376 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8aacb63a0 con 0x55e8aada4010 2023-10-16T12:58:59.077 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.057+0000 7efed942a700 1 --2- 172.21.15.124:0/2411842376 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aada4010 0x55e8aada46c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efecc009f00 tx=0x7efecc003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee392ab61d65411a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:59.077 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.057+0000 7efebe7fc700 1 -- 172.21.15.124:0/2411842376 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc004530 con 0x55e8aada4010 2023-10-16T12:58:59.077 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.057+0000 7efebe7fc700 1 -- 172.21.15.124:0/2411842376 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc004690 con 0x55e8aada4010 2023-10-16T12:58:59.077 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.057+0000 7efebe7fc700 1 -- 172.21.15.124:0/2411842376 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc015420 con 0x55e8aada4010 2023-10-16T12:58:59.077 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.058+0000 7efee7077b80 1 -- 172.21.15.124:0/2411842376 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aada4010 msgr2=0x55e8aada46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:59.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.058+0000 7efee7077b80 1 --2- 172.21.15.124:0/2411842376 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aada4010 0x55e8aada46c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efecc009f00 tx=0x7efecc003d50 comp rx=0 tx=0).stop 2023-10-16T12:58:59.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.058+0000 7efee7077b80 1 -- 172.21.15.124:0/2411842376 shutdown_connections 2023-10-16T12:58:59.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.058+0000 7efee7077b80 1 --2- 172.21.15.124:0/2411842376 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aada4010 0x55e8aada46c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.058+0000 7efee7077b80 1 --2- 172.21.15.124:0/2411842376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e8aadc9220 0x55e8aadd0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.058+0000 7efee7077b80 1 --2- 172.21.15.124:0/2411842376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e8aadce630 0x55e8aadd0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.058+0000 7efee7077b80 1 -- 172.21.15.124:0/2411842376 >> 172.21.15.124:0/2411842376 conn(0x55e8aacd3d80 msgr2=0x55e8aadeeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:59.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.058+0000 7efee7077b80 1 -- 172.21.15.124:0/2411842376 shutdown_connections 2023-10-16T12:58:59.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.058+0000 7efee7077b80 1 -- 172.21.15.124:0/2411842376 wait complete. 2023-10-16T12:58:59.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.058+0000 7efee7077b80 1 -- start start 2023-10-16T12:58:59.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.059+0000 7efee7077b80 1 Processor -- start 2023-10-16T12:58:59.080 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.060+0000 7efee7077b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aada4010 0x55e8aadca980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.080 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.060+0000 7efee7077b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e8aadc9220 0x55e8aadc96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.080 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.060+0000 7efee7077b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e8aadce630 0x55e8aadcfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.080 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.060+0000 7efee7077b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8aacf8e20 con 0x55e8aada4010 2023-10-16T12:58:59.080 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.060+0000 7efee7077b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8aac956c0 con 0x55e8aadce630 2023-10-16T12:58:59.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.060+0000 7efee7077b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e8aac95360 con 0x55e8aadc9220 2023-10-16T12:58:59.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.060+0000 7efed8c29700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aada4010 0x55e8aadca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:59.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.060+0000 7efee7077b80 10 client.0 _ll_register_callbacks cb 0x55e8aaaf27b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T12:58:59.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.060+0000 7efed8c29700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aada4010 0x55e8aadca980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53184/0 (socket says 172.21.15.124:53184) 2023-10-16T12:58:59.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.060+0000 7efed8c29700 1 -- 172.21.15.124:0/2769085533 learned_addr learned my addr 172.21.15.124:0/2769085533 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:59.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.060+0000 7efed942a700 1 --2- 172.21.15.124:0/2769085533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e8aadce630 0x55e8aadcfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:59.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.060+0000 7efed3fff700 1 --2- 172.21.15.124:0/2769085533 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e8aadc9220 0x55e8aadc96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:59.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.060+0000 7efed8c29700 1 -- 172.21.15.124:0/2769085533 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e8aadc9220 msgr2=0x55e8aadc96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:59.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.060+0000 7efed8c29700 1 --2- 172.21.15.124:0/2769085533 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e8aadc9220 0x55e8aadc96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.060+0000 7efed8c29700 1 -- 172.21.15.124:0/2769085533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e8aadce630 msgr2=0x55e8aadcfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:59.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.060+0000 7efed8c29700 1 --2- 172.21.15.124:0/2769085533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e8aadce630 0x55e8aadcfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.060+0000 7efed8c29700 1 -- 172.21.15.124:0/2769085533 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efecc011040 con 0x55e8aada4010 2023-10-16T12:58:59.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.060+0000 7efed942a700 1 --2- 172.21.15.124:0/2769085533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e8aadce630 0x55e8aadcfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:58:59.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.060+0000 7efed8c29700 1 --2- 172.21.15.124:0/2769085533 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aada4010 0x55e8aadca980 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efec80156f0 tx=0x7efec8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6a086838f5af92 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:59.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.060+0000 7efeb37fe700 10 client.0 ms_handle_connect on v2:172.21.15.124:3300/0 2023-10-16T12:58:59.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.061+0000 7efeb37fe700 1 -- 172.21.15.124:0/2769085533 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec802a600 con 0x55e8aada4010 2023-10-16T12:58:59.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.061+0000 7efeb37fe700 1 -- 172.21.15.124:0/2769085533 <== mon.0 v2:172.21.15.124:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efec8011e50 con 0x55e8aada4010 2023-10-16T12:58:59.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.061+0000 7efee7077b80 1 -- 172.21.15.124:0/2769085533 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e8aad995b0 con 0x55e8aada4010 2023-10-16T12:58:59.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.061+0000 7efeb37fe700 1 -- 172.21.15.124:0/2769085533 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7efec802da50 con 0x55e8aada4010 2023-10-16T12:58:59.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.061+0000 7efee7077b80 10 client.4434 fetch_fsmap learned FSMap version 7 2023-10-16T12:58:59.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.061+0000 7efee7077b80 1 -- 172.21.15.124:0/2769085533 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55e8aab23d90 con 0x55e8aada4010 2023-10-16T12:58:59.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.061+0000 7efeb37fe700 1 -- 172.21.15.124:0/2769085533 <== mon.0 v2:172.21.15.124:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e8aad995b0 con 0x55e8aada4010 2023-10-16T12:58:59.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.061+0000 7efeb37fe700 1 -- 172.21.15.124:0/2769085533 <== mon.0 v2:172.21.15.124:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7efec8028020 con 0x55e8aada4010 2023-10-16T12:58:59.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.061+0000 7efee7077b80 10 client.4434 fetch_fsmap finished waiting for FSMap version 7 2023-10-16T12:58:59.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.061+0000 7efee7077b80 10 client.4434 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-16T12:58:59.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.061+0000 7efee7077b80 20 client.4434 populate_metadata read hostname 'smithi124' 2023-10-16T12:58:59.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.061+0000 7efee7077b80 1 --2- 172.21.15.124:0/2769085533 >> [v2:172.21.15.192:6832/621867052,v1:172.21.15.192:6834/621867052] conn(0x55e8aadfeaa0 0x55e8aadfee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.061+0000 7efee7077b80 4 client.4434 mds_command: new command op to 4291 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T12:58:59.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.061+0000 7efee7077b80 1 -- 172.21.15.124:0/2769085533 --> [v2:172.21.15.192:6832/621867052,v1:172.21.15.192:6834/621867052] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e8aacf1e00 con 0x55e8aadfeaa0 2023-10-16T12:58:59.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.061+0000 7efed3fff700 1 --2- 172.21.15.124:0/2769085533 >> [v2:172.21.15.192:6832/621867052,v1:172.21.15.192:6834/621867052] conn(0x55e8aadfeaa0 0x55e8aadfee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:59.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.062+0000 7efeb37fe700 10 client.4434 ms_handle_connect on v2:172.21.15.192:6832/621867052 2023-10-16T12:58:59.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.062+0000 7efed3fff700 1 --2- 172.21.15.124:0/2769085533 >> [v2:172.21.15.192:6832/621867052,v1:172.21.15.192:6834/621867052] conn(0x55e8aadfeaa0 0x55e8aadfee80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f5b977a0efdeb24 server_cookie=757b4261889ad56f in_seq=0 out_seq=0 2023-10-16T12:58:59.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.062+0000 7efeb37fe700 1 -- 172.21.15.124:0/2769085533 <== mds.0 v2:172.21.15.192:6832/621867052 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e8aacf1e00 con 0x55e8aadfeaa0 2023-10-16T12:58:59.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.062+0000 7efeb37fe700 10 client.4434 handle_command_reply: tid=0 2023-10-16T12:58:59.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.062+0000 7efee7077b80 1 client.4434 shutdown 2023-10-16T12:58:59.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.062+0000 7efee7077b80 1 -- 172.21.15.124:0/2769085533 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aada4010 msgr2=0x55e8aadca980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:59.088 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.062+0000 7efee7077b80 1 --2- 172.21.15.124:0/2769085533 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aada4010 0x55e8aadca980 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efec80156f0 tx=0x7efec8004750 comp rx=0 tx=0).stop 2023-10-16T12:58:59.088 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.063+0000 7efee7077b80 1 -- 172.21.15.124:0/2769085533 shutdown_connections 2023-10-16T12:58:59.088 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.063+0000 7efee7077b80 1 --2- 172.21.15.124:0/2769085533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e8aadce630 0x55e8aadcfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.088 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.063+0000 7efee7077b80 1 --2- 172.21.15.124:0/2769085533 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aada4010 0x55e8aadca980 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.088 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.063+0000 7efee7077b80 1 --2- 172.21.15.124:0/2769085533 >> [v2:172.21.15.192:6832/621867052,v1:172.21.15.192:6834/621867052] conn(0x55e8aadfeaa0 0x55e8aadfee80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.063+0000 7efee7077b80 1 --2- 172.21.15.124:0/2769085533 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e8aadc9220 0x55e8aadc96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.063+0000 7efeb37fe700 0 client.4434 ms_handle_reset on v2:172.21.15.192:6832/621867052 2023-10-16T12:58:59.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.063+0000 7efee7077b80 1 -- 172.21.15.124:0/2769085533 >> 172.21.15.124:0/2769085533 conn(0x55e8aacd3d80 msgr2=0x55e8aadec450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:59.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.063+0000 7efee7077b80 1 -- 172.21.15.124:0/2769085533 shutdown_connections 2023-10-16T12:58:59.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.063+0000 7efee7077b80 1 -- 172.21.15.124:0/2769085533 wait complete. 2023-10-16T12:58:59.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.063+0000 7efee7077b80 20 client.4434 trim_cache size 0 max 16384 2023-10-16T12:58:59.095 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.080+0000 7efee7077b80 1 Processor -- start 2023-10-16T12:58:59.095 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.080+0000 7efee7077b80 1 -- start start 2023-10-16T12:58:59.095 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.081+0000 7efee7077b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e8aada4010 0x55e8aadeb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.081+0000 7efee7077b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aadc9220 0x55e8aadeb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.081+0000 7efee7077b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e8aadce630 0x55e8aae04eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.081+0000 7efee7077b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8aab798d0 con 0x55e8aadc9220 2023-10-16T12:58:59.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.081+0000 7efee7077b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8aadd0d50 con 0x55e8aadce630 2023-10-16T12:58:59.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.081+0000 7efee7077b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e8aad834c0 con 0x55e8aada4010 2023-10-16T12:58:59.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.081+0000 7efed3fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aadc9220 0x55e8aadeb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:59.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.081+0000 7efed3fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aadc9220 0x55e8aadeb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53194/0 (socket says 172.21.15.124:53194) 2023-10-16T12:58:59.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.081+0000 7efed3fff700 1 -- 172.21.15.124:0/1700843762 learned_addr learned my addr 172.21.15.124:0/1700843762 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:59.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.081+0000 7efed3fff700 1 -- 172.21.15.124:0/1700843762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e8aada4010 msgr2=0x55e8aadeb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:59.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.081+0000 7efed3fff700 1 --2- 172.21.15.124:0/1700843762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e8aada4010 0x55e8aadeb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.081+0000 7efed3fff700 1 -- 172.21.15.124:0/1700843762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e8aadce630 msgr2=0x55e8aae04eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:59.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.081+0000 7efed3fff700 1 --2- 172.21.15.124:0/1700843762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e8aadce630 0x55e8aae04eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.082+0000 7efed3fff700 1 -- 172.21.15.124:0/1700843762 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8aab0cc10 con 0x55e8aadc9220 2023-10-16T12:58:59.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.082+0000 7efed3fff700 1 --2- 172.21.15.124:0/1700843762 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aadc9220 0x55e8aadeb7d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efec0088a00 tx=0x7efec00092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cda87792a824c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:59.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.082+0000 7efebeffd700 1 -- 172.21.15.124:0/1700843762 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec0059240 con 0x55e8aadc9220 2023-10-16T12:58:59.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.082+0000 7efebeffd700 1 -- 172.21.15.124:0/1700843762 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec005d390 con 0x55e8aadc9220 2023-10-16T12:58:59.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.082+0000 7efebeffd700 1 -- 172.21.15.124:0/1700843762 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec0061540 con 0x55e8aadc9220 2023-10-16T12:58:59.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.082+0000 7efee7077b80 1 -- 172.21.15.124:0/1700843762 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aadc9220 msgr2=0x55e8aadeb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:59.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.082+0000 7efee7077b80 1 --2- 172.21.15.124:0/1700843762 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aadc9220 0x55e8aadeb7d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efec0088a00 tx=0x7efec00092c0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.082+0000 7efee7077b80 1 -- 172.21.15.124:0/1700843762 shutdown_connections 2023-10-16T12:58:59.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.082+0000 7efee7077b80 1 --2- 172.21.15.124:0/1700843762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e8aadce630 0x55e8aae04eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.082+0000 7efee7077b80 1 --2- 172.21.15.124:0/1700843762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e8aada4010 0x55e8aadeb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.082+0000 7efee7077b80 1 --2- 172.21.15.124:0/1700843762 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aadc9220 0x55e8aadeb7d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.082+0000 7efee7077b80 1 -- 172.21.15.124:0/1700843762 >> 172.21.15.124:0/1700843762 conn(0x55e8aacd3d80 msgr2=0x55e8aadcdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:59.101 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.082+0000 7efee7077b80 1 -- 172.21.15.124:0/1700843762 shutdown_connections 2023-10-16T12:58:59.101 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.082+0000 7efee7077b80 1 -- 172.21.15.124:0/1700843762 wait complete. 2023-10-16T12:58:59.101 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.083+0000 7efee7077b80 1 -- start start 2023-10-16T12:58:59.101 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.083+0000 7efee7077b80 1 Processor -- start 2023-10-16T12:58:59.101 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.084+0000 7efee7077b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e8aada4010 0x55e8aae4fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.084+0000 7efee7077b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aadc9220 0x55e8aae53a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.084+0000 7efee7077b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e8aadce630 0x55e8aae04eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.084+0000 7efee7077b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8aadd4cd0 con 0x55e8aadc9220 2023-10-16T12:58:59.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.084+0000 7efee7077b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8aada2eb0 con 0x55e8aadce630 2023-10-16T12:58:59.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.084+0000 7efee7077b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e8aadcec40 con 0x55e8aada4010 2023-10-16T12:58:59.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.084+0000 7efee7077b80 10 client.0 _ll_register_callbacks cb 0x7efec8011cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T12:58:59.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.084+0000 7efed3fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aadc9220 0x55e8aae53a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:59.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.084+0000 7efed3fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aadc9220 0x55e8aae53a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53200/0 (socket says 172.21.15.124:53200) 2023-10-16T12:58:59.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.084+0000 7efed3fff700 1 -- 172.21.15.124:0/4271290243 learned_addr learned my addr 172.21.15.124:0/4271290243 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:59.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.084+0000 7efed3fff700 1 -- 172.21.15.124:0/4271290243 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e8aada4010 msgr2=0x55e8aae4fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:59.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.084+0000 7efed3fff700 1 --2- 172.21.15.124:0/4271290243 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e8aada4010 0x55e8aae4fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.084+0000 7efed3fff700 1 -- 172.21.15.124:0/4271290243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e8aadce630 msgr2=0x55e8aae04eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:59.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.084+0000 7efed3fff700 1 --2- 172.21.15.124:0/4271290243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e8aadce630 0x55e8aae04eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.084+0000 7efed3fff700 1 -- 172.21.15.124:0/4271290243 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed41f3d90 con 0x55e8aadc9220 2023-10-16T12:58:59.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.084+0000 7efed3fff700 1 --2- 172.21.15.124:0/4271290243 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aadc9220 0x55e8aae53a30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efec0055740 tx=0x7efec0025040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1750faeb304849 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:59.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.084+0000 7efeb37fe700 10 client.0 ms_handle_connect on v2:172.21.15.124:3300/0 2023-10-16T12:58:59.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.084+0000 7efeb37fe700 1 -- 172.21.15.124:0/4271290243 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec00575e0 con 0x55e8aadc9220 2023-10-16T12:58:59.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.084+0000 7efeb37fe700 1 -- 172.21.15.124:0/4271290243 <== mon.0 v2:172.21.15.124:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efec005d0b0 con 0x55e8aadc9220 2023-10-16T12:58:59.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.084+0000 7efee7077b80 1 -- 172.21.15.124:0/4271290243 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efecc004690 con 0x55e8aadc9220 2023-10-16T12:58:59.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.085+0000 7efeb37fe700 1 -- 172.21.15.124:0/4271290243 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7efec00594a0 con 0x55e8aadc9220 2023-10-16T12:58:59.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.085+0000 7efee7077b80 10 client.4440 fetch_fsmap learned FSMap version 7 2023-10-16T12:58:59.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.085+0000 7efee7077b80 1 -- 172.21.15.124:0/4271290243 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55e8aab4a200 con 0x55e8aadc9220 2023-10-16T12:58:59.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.085+0000 7efeb37fe700 1 -- 172.21.15.124:0/4271290243 <== mon.0 v2:172.21.15.124:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc004690 con 0x55e8aadc9220 2023-10-16T12:58:59.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.085+0000 7efeb37fe700 1 -- 172.21.15.124:0/4271290243 <== mon.0 v2:172.21.15.124:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7efec0058730 con 0x55e8aadc9220 2023-10-16T12:58:59.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.085+0000 7efee7077b80 10 client.4440 fetch_fsmap finished waiting for FSMap version 7 2023-10-16T12:58:59.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.085+0000 7efee7077b80 10 client.4440 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-16T12:58:59.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.085+0000 7efee7077b80 20 client.4440 populate_metadata read hostname 'smithi124' 2023-10-16T12:58:59.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.085+0000 7efee7077b80 1 --2- 172.21.15.124:0/4271290243 >> [v2:172.21.15.192:6832/621867052,v1:172.21.15.192:6834/621867052] conn(0x55e8aadcf0d0 0x55e8aadcf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.085+0000 7efee7077b80 4 client.4440 mds_command: new command op to 4291 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T12:58:59.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.085+0000 7efee7077b80 1 -- 172.21.15.124:0/4271290243 --> [v2:172.21.15.192:6832/621867052,v1:172.21.15.192:6834/621867052] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e8aacf1b20 con 0x55e8aadcf0d0 2023-10-16T12:58:59.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.085+0000 7efed8c29700 1 --2- 172.21.15.124:0/4271290243 >> [v2:172.21.15.192:6832/621867052,v1:172.21.15.192:6834/621867052] conn(0x55e8aadcf0d0 0x55e8aadcf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:59.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.085+0000 7efeb37fe700 10 client.4440 ms_handle_connect on v2:172.21.15.192:6832/621867052 2023-10-16T12:58:59.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.085+0000 7efed8c29700 1 --2- 172.21.15.124:0/4271290243 >> [v2:172.21.15.192:6832/621867052,v1:172.21.15.192:6834/621867052] conn(0x55e8aadcf0d0 0x55e8aadcf4b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6081495c0e283dd server_cookie=74577d69e6793e39 in_seq=0 out_seq=0 2023-10-16T12:58:59.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efeb37fe700 1 -- 172.21.15.124:0/4271290243 <== mds.0 v2:172.21.15.192:6832/621867052 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55e8aacf1b20 con 0x55e8aadcf0d0 2023-10-16T12:58:59.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efeb37fe700 10 client.4440 handle_command_reply: tid=0 2023-10-16T12:58:59.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efee7077b80 1 client.4440 shutdown 2023-10-16T12:58:59.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efee7077b80 1 -- 172.21.15.124:0/4271290243 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aadc9220 msgr2=0x55e8aae53a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:59.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efee7077b80 1 --2- 172.21.15.124:0/4271290243 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aadc9220 0x55e8aae53a30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efec0055740 tx=0x7efec0025040 comp rx=0 tx=0).stop 2023-10-16T12:58:59.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efee7077b80 1 -- 172.21.15.124:0/4271290243 shutdown_connections 2023-10-16T12:58:59.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efee7077b80 1 --2- 172.21.15.124:0/4271290243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e8aadce630 0x55e8aae04eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efee7077b80 1 --2- 172.21.15.124:0/4271290243 >> [v2:172.21.15.192:6832/621867052,v1:172.21.15.192:6834/621867052] conn(0x55e8aadcf0d0 0x55e8aadcf4b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efee7077b80 1 --2- 172.21.15.124:0/4271290243 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e8aada4010 0x55e8aae4fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efee7077b80 1 --2- 172.21.15.124:0/4271290243 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55e8aadc9220 0x55e8aae53a30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efeb37fe700 0 client.4440 ms_handle_reset on v2:172.21.15.192:6832/621867052 2023-10-16T12:58:59.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efee7077b80 1 -- 172.21.15.124:0/4271290243 >> 172.21.15.124:0/4271290243 conn(0x55e8aacd3d80 msgr2=0x55e8aada4480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:59.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efee7077b80 1 -- 172.21.15.124:0/4271290243 shutdown_connections 2023-10-16T12:58:59.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efee7077b80 1 -- 172.21.15.124:0/4271290243 wait complete. 2023-10-16T12:58:59.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efee7077b80 20 client.4440 trim_cache size 0 max 16384 2023-10-16T12:58:59.111 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2023-10-16T12:58:59.111 INFO:teuthology.orchestra.run.smithi124.stdout: "cluster_fsid": "4cfd077b-2400-4ae1-a7e8-14265fee7113", 2023-10-16T12:58:59.112 INFO:teuthology.orchestra.run.smithi124.stdout: "whoami": 0, 2023-10-16T12:58:59.112 INFO:teuthology.orchestra.run.smithi124.stdout: "id": 4291, 2023-10-16T12:58:59.112 INFO:teuthology.orchestra.run.smithi124.stdout: "want_state": "up:active", 2023-10-16T12:58:59.112 INFO:teuthology.orchestra.run.smithi124.stdout: "state": "up:active", 2023-10-16T12:58:59.112 INFO:teuthology.orchestra.run.smithi124.stdout: "fs_name": "cephfs", 2023-10-16T12:58:59.112 INFO:teuthology.orchestra.run.smithi124.stdout: "rank_uptime": 7.4309419410000004, 2023-10-16T12:58:59.113 INFO:teuthology.orchestra.run.smithi124.stdout: "mdsmap_epoch": 7, 2023-10-16T12:58:59.113 INFO:teuthology.orchestra.run.smithi124.stdout: "osdmap_epoch": 24, 2023-10-16T12:58:59.113 INFO:teuthology.orchestra.run.smithi124.stdout: "osdmap_epoch_barrier": 24, 2023-10-16T12:58:59.113 INFO:teuthology.orchestra.run.smithi124.stdout: "uptime": 14.246914173 2023-10-16T12:58:59.113 INFO:teuthology.orchestra.run.smithi124.stdout:} 2023-10-16T12:58:59.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efedae8d700 1 -- 172.21.15.124:0/3977973845 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7efeb806af00 msgr2=0x7efeb806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:59.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efedae8d700 1 --2- 172.21.15.124:0/3977973845 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7efeb806af00 0x7efeb806d3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efed4161010 tx=0x7efec8008040 comp rx=0 tx=0).stop 2023-10-16T12:58:59.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efedae8d700 1 -- 172.21.15.124:0/3977973845 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efed40ca7d0 msgr2=0x7efed4158830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:59.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efedae8d700 1 --2- 172.21.15.124:0/3977973845 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efed40ca7d0 0x7efed4158830 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efec0000c00 tx=0x7efec0004750 comp rx=0 tx=0).stop 2023-10-16T12:58:59.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efedae8d700 1 -- 172.21.15.124:0/3977973845 shutdown_connections 2023-10-16T12:58:59.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efedae8d700 1 --2- 172.21.15.124:0/3977973845 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7efeb806af00 0x7efeb806d3c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efedae8d700 1 --2- 172.21.15.124:0/3977973845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efed415e7f0 0x7efed41f7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efedae8d700 1 --2- 172.21.15.124:0/3977973845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efed406a820 0x7efed41600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efedae8d700 1 --2- 172.21.15.124:0/3977973845 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efed40ca7d0 0x7efed4158830 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efedae8d700 1 -- 172.21.15.124:0/3977973845 >> 172.21.15.124:0/3977973845 conn(0x7efed40d0180 msgr2=0x7efed4071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:59.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efedae8d700 1 -- 172.21.15.124:0/3977973845 shutdown_connections 2023-10-16T12:58:59.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.086+0000 7efedae8d700 1 -- 172.21.15.124:0/3977973845 wait complete. 2023-10-16T12:58:59.117 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T12:58:59.118 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-16T12:58:59.119 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T12:58:59.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.236+0000 7f4503b38700 1 Processor -- start 2023-10-16T12:58:59.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.237+0000 7f4503b38700 1 -- start start 2023-10-16T12:58:59.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.237+0000 7f4503b38700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44fc06a820 0x7f44fc0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.237+0000 7f4503b38700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f44fc0ca7d0 0x7f44fc071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.237+0000 7f4503b38700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44fc0cfeb0 con 0x7f44fc15e7f0 2023-10-16T12:58:59.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.237+0000 7f4503b38700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44fc0ce410 con 0x7f44fc0ca7d0 2023-10-16T12:58:59.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.237+0000 7f4503b38700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc15ec70 con 0x7f44fc06a820 2023-10-16T12:58:59.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.238+0000 7f45020d5700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f44fc0ca7d0 0x7f44fc071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:59.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.238+0000 7f45010d3700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f44fc15e7f0 0x7f44fc06ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:41874/0 (socket says 172.21.15.124:41874) 2023-10-16T12:58:59.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.238+0000 7f45010d3700 1 -- 172.21.15.124:0/718271595 learned_addr learned my addr 172.21.15.124:0/718271595 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:58:59.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.238+0000 7f45018d4700 1 --2- 172.21.15.124:0/718271595 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44fc06a820 0x7f44fc0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:59.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.238+0000 7f45020d5700 1 -- 172.21.15.124:0/718271595 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44fc06a820 msgr2=0x7f44fc0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:58:59.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.238+0000 7f45020d5700 1 --2- 172.21.15.124:0/718271595 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44fc06a820 0x7f44fc0cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.238+0000 7f45020d5700 1 -- 172.21.15.124:0/718271595 >> v1:172.21.15.124:6789/0 conn(0x7f44fc15e7f0 legacy=0x7f44fc06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:59.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.238+0000 7f45008d2700 1 -- 172.21.15.124:0/718271595 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834111350 0 0) 0x7f44fc0cfeb0 con 0x7f44fc15e7f0 2023-10-16T12:58:59.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.238+0000 7f45020d5700 1 -- 172.21.15.124:0/718271595 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc0af9d0 con 0x7f44fc0ca7d0 2023-10-16T12:58:59.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.238+0000 7f45020d5700 1 --2- 172.21.15.124:0/718271595 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44fc0ca7d0 0x7f44fc071ea0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009d90 tx=0x7f44f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798b1ec0d2f56bb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:59.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.238+0000 7f45008d2700 1 -- 172.21.15.124:0/718271595 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f400e070 con 0x7f44fc0ca7d0 2023-10-16T12:58:59.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.238+0000 7f45008d2700 1 -- 172.21.15.124:0/718271595 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f400bb20 con 0x7f44fc0ca7d0 2023-10-16T12:58:59.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.238+0000 7f45008d2700 1 -- 172.21.15.124:0/718271595 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f4012430 con 0x7f44fc0ca7d0 2023-10-16T12:58:59.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.239+0000 7f4503b38700 1 -- 172.21.15.124:0/718271595 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44fc0ca7d0 msgr2=0x7f44fc071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:59.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.239+0000 7f4503b38700 1 --2- 172.21.15.124:0/718271595 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44fc0ca7d0 0x7f44fc071ea0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009d90 tx=0x7f44f400b330 comp rx=0 tx=0).stop 2023-10-16T12:58:59.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.239+0000 7f4503b38700 1 -- 172.21.15.124:0/718271595 shutdown_connections 2023-10-16T12:58:59.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.239+0000 7f4503b38700 1 --2- 172.21.15.124:0/718271595 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44fc0ca7d0 0x7f44fc071ea0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.239+0000 7f4503b38700 1 --2- 172.21.15.124:0/718271595 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44fc06a820 0x7f44fc0cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.239+0000 7f4503b38700 1 -- 172.21.15.124:0/718271595 >> 172.21.15.124:0/718271595 conn(0x7f44fc0d0180 msgr2=0x7f44fc0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:59.247 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.239+0000 7f4503b38700 1 -- 172.21.15.124:0/718271595 shutdown_connections 2023-10-16T12:58:59.247 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.239+0000 7f4503b38700 1 -- 172.21.15.124:0/718271595 wait complete. 2023-10-16T12:58:59.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.240+0000 7f4503b38700 1 Processor -- start 2023-10-16T12:58:59.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.240+0000 7f4503b38700 1 -- start start 2023-10-16T12:58:59.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.241+0000 7f4503b38700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44fc06a820 0x7f44fc153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.241+0000 7f4503b38700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44fc0ca7d0 0x7f44fc159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.241+0000 7f4503b38700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44fc15e7f0 0x7f44fc159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.241+0000 7f4503b38700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc1542b0 con 0x7f44fc0ca7d0 2023-10-16T12:58:59.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.241+0000 7f4503b38700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc15a5e0 con 0x7f44fc15e7f0 2023-10-16T12:58:59.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.241+0000 7f4503b38700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc15bb40 con 0x7f44fc06a820 2023-10-16T12:58:59.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.241+0000 7f45010d3700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44fc0ca7d0 0x7f44fc159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:59.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.241+0000 7f45010d3700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44fc0ca7d0 0x7f44fc159760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53214/0 (socket says 172.21.15.124:53214) 2023-10-16T12:58:59.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.241+0000 7f45010d3700 1 -- 172.21.15.124:0/3070651406 learned_addr learned my addr 172.21.15.124:0/3070651406 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:58:59.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.241+0000 7f45020d5700 1 --2- 172.21.15.124:0/3070651406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44fc15e7f0 0x7f44fc159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:59.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.241+0000 7f45018d4700 1 --2- 172.21.15.124:0/3070651406 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44fc06a820 0x7f44fc153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:59.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.242+0000 7f45010d3700 1 -- 172.21.15.124:0/3070651406 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44fc06a820 msgr2=0x7f44fc153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:59.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.242+0000 7f45010d3700 1 --2- 172.21.15.124:0/3070651406 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44fc06a820 0x7f44fc153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.242+0000 7f45010d3700 1 -- 172.21.15.124:0/3070651406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44fc15e7f0 msgr2=0x7f44fc159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:59.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.242+0000 7f45010d3700 1 --2- 172.21.15.124:0/3070651406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44fc15e7f0 0x7f44fc159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.242+0000 7f45010d3700 1 -- 172.21.15.124:0/3070651406 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f4009a70 con 0x7f44fc0ca7d0 2023-10-16T12:58:59.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.242+0000 7f45010d3700 1 --2- 172.21.15.124:0/3070651406 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44fc0ca7d0 0x7f44fc159760 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f44f800c550 tx=0x7f44f800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:59.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.242+0000 7f44f27fc700 1 -- 172.21.15.124:0/3070651406 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8004c80 con 0x7f44fc0ca7d0 2023-10-16T12:58:59.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.242+0000 7f44f27fc700 1 -- 172.21.15.124:0/3070651406 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f8004e00 con 0x7f44fc0ca7d0 2023-10-16T12:58:59.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.242+0000 7f4503b38700 1 -- 172.21.15.124:0/3070651406 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44fc0ace90 con 0x7f44fc0ca7d0 2023-10-16T12:58:59.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.242+0000 7f44f27fc700 1 -- 172.21.15.124:0/3070651406 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8007310 con 0x7f44fc0ca7d0 2023-10-16T12:58:59.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.242+0000 7f4503b38700 1 -- 172.21.15.124:0/3070651406 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44fc0ad450 con 0x7f44fc0ca7d0 2023-10-16T12:58:59.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.243+0000 7f4503b38700 1 -- 172.21.15.124:0/3070651406 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44fc0ad670 con 0x7f44fc0ca7d0 2023-10-16T12:58:59.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.243+0000 7f44f27fc700 1 -- 172.21.15.124:0/3070651406 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f44f8007470 con 0x7f44fc0ca7d0 2023-10-16T12:58:59.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.243+0000 7f44f27fc700 1 --2- 172.21.15.124:0/3070651406 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f44e006af00 0x7f44e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:58:59.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.244+0000 7f45018d4700 1 --2- 172.21.15.124:0/3070651406 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f44e006af00 0x7f44e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:58:59.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.244+0000 7f44f27fc700 1 -- 172.21.15.124:0/3070651406 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f44f80895e0 con 0x7f44fc0ca7d0 2023-10-16T12:58:59.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.244+0000 7f45018d4700 1 --2- 172.21.15.124:0/3070651406 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f44e006af00 0x7f44e006d3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f44ec009b70 tx=0x7f44ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:58:59.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.248+0000 7f44f27fc700 1 -- 172.21.15.124:0/3070651406 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f44f80543a0 con 0x7f44fc0ca7d0 2023-10-16T12:58:59.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.482+0000 7f4503b38700 1 -- 172.21.15.124:0/3070651406 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f44fc04ebb0 con 0x7f44fc0ca7d0 2023-10-16T12:58:59.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.483+0000 7f44f27fc700 1 -- 172.21.15.124:0/3070651406 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f44f80579c0 con 0x7f44fc0ca7d0 2023-10-16T12:58:59.486 INFO:teuthology.orchestra.run.smithi124.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-16T12:58:59.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.485+0000 7f4503b38700 1 -- 172.21.15.124:0/3070651406 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f44e006af00 msgr2=0x7f44e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:59.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.485+0000 7f4503b38700 1 --2- 172.21.15.124:0/3070651406 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f44e006af00 0x7f44e006d3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f44ec009b70 tx=0x7f44ec008040 comp rx=0 tx=0).stop 2023-10-16T12:58:59.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.485+0000 7f4503b38700 1 -- 172.21.15.124:0/3070651406 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44fc0ca7d0 msgr2=0x7f44fc159760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:58:59.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.485+0000 7f4503b38700 1 --2- 172.21.15.124:0/3070651406 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44fc0ca7d0 0x7f44fc159760 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f44f800c550 tx=0x7f44f800c910 comp rx=0 tx=0).stop 2023-10-16T12:58:59.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.485+0000 7f4503b38700 1 -- 172.21.15.124:0/3070651406 shutdown_connections 2023-10-16T12:58:59.489 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.485+0000 7f4503b38700 1 --2- 172.21.15.124:0/3070651406 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f44e006af00 0x7f44e006d3c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.489 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.485+0000 7f4503b38700 1 --2- 172.21.15.124:0/3070651406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44fc15e7f0 0x7f44fc159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.489 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.485+0000 7f4503b38700 1 --2- 172.21.15.124:0/3070651406 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44fc06a820 0x7f44fc153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.489 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.485+0000 7f4503b38700 1 --2- 172.21.15.124:0/3070651406 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44fc0ca7d0 0x7f44fc159760 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:58:59.489 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.485+0000 7f4503b38700 1 -- 172.21.15.124:0/3070651406 >> 172.21.15.124:0/3070651406 conn(0x7f44fc0d0180 msgr2=0x7f44fc071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:58:59.490 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.485+0000 7f4503b38700 1 -- 172.21.15.124:0/3070651406 shutdown_connections 2023-10-16T12:58:59.490 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:58:59.485+0000 7f4503b38700 1 -- 172.21.15.124:0/3070651406 wait complete. 2023-10-16T12:58:59.499 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T12:58:59.499 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T12:58:59.500 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi124.front.sepia.ceph.com 2023-10-16T12:58:59.500 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-16T12:58:59.500 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-16T12:58:59.501 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T12:58:59.501 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T12:58:59.501 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T12:58:59.501 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-16T12:58:59.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:58:59.502 DEBUG:teuthology.orchestra.run.smithi124:> ip addr 2023-10-16T12:58:59.519 INFO:teuthology.orchestra.run.smithi124.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T12:58:59.520 INFO:teuthology.orchestra.run.smithi124.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T12:58:59.520 INFO:teuthology.orchestra.run.smithi124.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T12:58:59.520 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:58:59.520 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 ::1/128 scope host 2023-10-16T12:58:59.521 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:58:59.521 INFO:teuthology.orchestra.run.smithi124.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T12:58:59.521 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:d8:a1:a6 brd ff:ff:ff:ff:ff:ff 2023-10-16T12:58:59.521 INFO:teuthology.orchestra.run.smithi124.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T12:58:59.521 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:d8:a1:a7 brd ff:ff:ff:ff:ff:ff 2023-10-16T12:58:59.522 INFO:teuthology.orchestra.run.smithi124.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T12:58:59.522 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:8f:d5:c4 brd ff:ff:ff:ff:ff:ff 2023-10-16T12:58:59.522 INFO:teuthology.orchestra.run.smithi124.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T12:58:59.522 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:8f:d5:c5 brd ff:ff:ff:ff:ff:ff 2023-10-16T12:58:59.522 INFO:teuthology.orchestra.run.smithi124.stdout: inet 172.21.15.124/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T12:58:59.523 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft 42420sec preferred_lft 42420sec 2023-10-16T12:58:59.523 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::1cab:2850:a634:5e4f/64 scope link noprefixroute 2023-10-16T12:58:59.523 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:58:59.524 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-16T12:58:59.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:58:59.524 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-16T12:58:59.525 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-16T12:58:59.525 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link add name ceph-brx type bridge 2023-10-16T12:58:59.525 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip addr flush dev ceph-brx 2023-10-16T12:58:59.526 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set ceph-brx up 2023-10-16T12:58:59.526 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-16T12:58:59.526 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-16T12:58:59.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:58:59.699 DEBUG:teuthology.orchestra.run.smithi124:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T12:58:59.726 INFO:teuthology.orchestra.run.smithi124.stdout:1 2023-10-16T12:58:59.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:58:59.728 DEBUG:teuthology.orchestra.run.smithi124:> route 2023-10-16T12:58:59.796 INFO:teuthology.orchestra.run.smithi124.stdout:Kernel IP routing table 2023-10-16T12:58:59.796 INFO:teuthology.orchestra.run.smithi124.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T12:58:59.796 INFO:teuthology.orchestra.run.smithi124.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T12:58:59.796 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T12:58:59.796 INFO:teuthology.orchestra.run.smithi124.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T12:58:59.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:58:59.797 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-16T12:58:59.798 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-16T12:58:59.798 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T12:58:59.798 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T12:58:59.799 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T12:58:59.799 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-16T12:59:00.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:00.047 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list 2023-10-16T12:59:00.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:00.065 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list-id 2023-10-16T12:59:00.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:00.121 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-16T12:59:00.121 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-16T12:59:00.122 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T12:59:00.122 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-16T12:59:00.122 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-16T12:59:00.214 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-16T12:59:00.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:00.215 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-16T12:59:00.215 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-16T12:59:00.215 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-16T12:59:00.216 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-16T12:59:00.216 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-16T12:59:00.216 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-16T12:59:00.216 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-16T12:59:00.217 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-16T12:59:00.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:00.436 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-16T12:59:00.437 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-16T12:59:00.437 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set brx.0 up 2023-10-16T12:59:00.437 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set dev brx.0 master ceph-brx 2023-10-16T12:59:00.437 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-16T12:59:00.536 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-16T12:59:00.536 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T12:59:00.537 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-16T12:59:00.557 INFO:teuthology.orchestra.run.smithi124.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-16T12:59:00.558 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T12:59:00.558 DEBUG:teuthology.orchestra.run.smithi124:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-16T12:59:00.614 DEBUG:teuthology.orchestra.run.smithi124:> sudo modprobe fuse 2023-10-16T12:59:00.681 DEBUG:teuthology.orchestra.run.smithi124:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T12:59:00.739 INFO:teuthology.orchestra.run.smithi124.stdout:/sys 2023-10-16T12:59:00.739 INFO:teuthology.orchestra.run.smithi124.stdout:/proc 2023-10-16T12:59:00.739 INFO:teuthology.orchestra.run.smithi124.stdout:/dev 2023-10-16T12:59:00.740 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/kernel/security 2023-10-16T12:59:00.740 INFO:teuthology.orchestra.run.smithi124.stdout:/dev/shm 2023-10-16T12:59:00.740 INFO:teuthology.orchestra.run.smithi124.stdout:/dev/pts 2023-10-16T12:59:00.740 INFO:teuthology.orchestra.run.smithi124.stdout:/run 2023-10-16T12:59:00.740 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup 2023-10-16T12:59:00.741 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup/systemd 2023-10-16T12:59:00.741 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/pstore 2023-10-16T12:59:00.741 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/bpf 2023-10-16T12:59:00.741 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup/blkio 2023-10-16T12:59:00.741 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-16T12:59:00.741 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup/freezer 2023-10-16T12:59:00.742 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup/hugetlb 2023-10-16T12:59:00.742 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup/perf_event 2023-10-16T12:59:00.742 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup/devices 2023-10-16T12:59:00.742 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup/rdma 2023-10-16T12:59:00.743 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup/cpuset 2023-10-16T12:59:00.743 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-16T12:59:00.743 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup/pids 2023-10-16T12:59:00.743 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup/memory 2023-10-16T12:59:00.744 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/kernel/tracing 2023-10-16T12:59:00.744 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/kernel/config 2023-10-16T12:59:00.744 INFO:teuthology.orchestra.run.smithi124.stdout:/ 2023-10-16T12:59:00.744 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/selinux 2023-10-16T12:59:00.744 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/kernel/debug 2023-10-16T12:59:00.745 INFO:teuthology.orchestra.run.smithi124.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T12:59:00.745 INFO:teuthology.orchestra.run.smithi124.stdout:/dev/mqueue 2023-10-16T12:59:00.745 INFO:teuthology.orchestra.run.smithi124.stdout:/dev/hugepages 2023-10-16T12:59:00.745 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/fuse/connections 2023-10-16T12:59:00.745 INFO:teuthology.orchestra.run.smithi124.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T12:59:00.746 INFO:teuthology.orchestra.run.smithi124.stdout:/run/user/1000 2023-10-16T12:59:00.746 INFO:teuthology.orchestra.run.smithi124.stdout:/var/lib/ceph 2023-10-16T12:59:00.746 INFO:teuthology.orchestra.run.smithi124.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T12:59:00.746 INFO:teuthology.orchestra.run.smithi124.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T12:59:00.747 INFO:teuthology.orchestra.run.smithi124.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T12:59:00.747 INFO:teuthology.orchestra.run.smithi124.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T12:59:00.747 INFO:teuthology.orchestra.run.smithi124.stdout:/run/netns 2023-10-16T12:59:00.747 INFO:teuthology.orchestra.run.smithi124.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T12:59:00.747 INFO:teuthology.orchestra.run.smithi124.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T12:59:00.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:00.748 DEBUG:teuthology.orchestra.run.smithi124:> ls /sys/fs/fuse/connections 2023-10-16T12:59:00.796 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-16T12:59:00.797 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-16T12:59:00.839 DEBUG:teuthology.orchestra.run.smithi124:> sudo modprobe fuse 2023-10-16T12:59:00.866 DEBUG:teuthology.orchestra.run.smithi124:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T12:59:00.923 INFO:teuthology.orchestra.run.smithi124.stdout:/sys 2023-10-16T12:59:00.923 INFO:teuthology.orchestra.run.smithi124.stdout:/proc 2023-10-16T12:59:00.923 INFO:teuthology.orchestra.run.smithi124.stdout:/dev 2023-10-16T12:59:00.924 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/kernel/security 2023-10-16T12:59:00.924 INFO:teuthology.orchestra.run.smithi124.stdout:/dev/shm 2023-10-16T12:59:00.924 INFO:teuthology.orchestra.run.smithi124.stdout:/dev/pts 2023-10-16T12:59:00.924 INFO:teuthology.orchestra.run.smithi124.stdout:/run 2023-10-16T12:59:00.924 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup 2023-10-16T12:59:00.925 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup/systemd 2023-10-16T12:59:00.925 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/pstore 2023-10-16T12:59:00.925 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/bpf 2023-10-16T12:59:00.925 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup/blkio 2023-10-16T12:59:00.925 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-16T12:59:00.926 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup/freezer 2023-10-16T12:59:00.926 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup/hugetlb 2023-10-16T12:59:00.926 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup/perf_event 2023-10-16T12:59:00.926 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup/devices 2023-10-16T12:59:00.926 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup/rdma 2023-10-16T12:59:00.926 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup/cpuset 2023-10-16T12:59:00.927 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-16T12:59:00.927 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup/pids 2023-10-16T12:59:00.927 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/cgroup/memory 2023-10-16T12:59:00.927 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/kernel/tracing 2023-10-16T12:59:00.927 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/kernel/config 2023-10-16T12:59:00.928 INFO:teuthology.orchestra.run.smithi124.stdout:/ 2023-10-16T12:59:00.928 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/selinux 2023-10-16T12:59:00.928 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/kernel/debug 2023-10-16T12:59:00.928 INFO:teuthology.orchestra.run.smithi124.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T12:59:00.928 INFO:teuthology.orchestra.run.smithi124.stdout:/dev/mqueue 2023-10-16T12:59:00.928 INFO:teuthology.orchestra.run.smithi124.stdout:/dev/hugepages 2023-10-16T12:59:00.929 INFO:teuthology.orchestra.run.smithi124.stdout:/sys/fs/fuse/connections 2023-10-16T12:59:00.929 INFO:teuthology.orchestra.run.smithi124.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T12:59:00.929 INFO:teuthology.orchestra.run.smithi124.stdout:/run/user/1000 2023-10-16T12:59:00.929 INFO:teuthology.orchestra.run.smithi124.stdout:/var/lib/ceph 2023-10-16T12:59:00.929 INFO:teuthology.orchestra.run.smithi124.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T12:59:00.930 INFO:teuthology.orchestra.run.smithi124.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T12:59:00.930 INFO:teuthology.orchestra.run.smithi124.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T12:59:00.930 INFO:teuthology.orchestra.run.smithi124.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T12:59:00.930 INFO:teuthology.orchestra.run.smithi124.stdout:/run/netns 2023-10-16T12:59:00.930 INFO:teuthology.orchestra.run.smithi124.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T12:59:00.931 INFO:teuthology.orchestra.run.smithi124.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T12:59:00.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:00.931 DEBUG:teuthology.orchestra.run.smithi124:> ls /sys/fs/fuse/connections 2023-10-16T12:59:00.957 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi124.stderr:2023-10-16T12:59:00.954+0000 7fbd3fdc55c0 -1 init, newargv = 0x55b85b2cd550 newargc=15 2023-10-16T12:59:00.957 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi124.stderr:ceph-fuse[111768]: starting ceph client 2023-10-16T12:59:00.963 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi124.stderr:ceph-fuse[111768]: starting fuse 2023-10-16T12:59:00.974 INFO:teuthology.orchestra.run.smithi124.stdout:47 2023-10-16T12:59:00.974 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-16T12:59:00.975 DEBUG:teuthology.orchestra.run.smithi124:> sudo stdin-killer -- python3 -c ' 2023-10-16T12:59:00.976 DEBUG:teuthology.orchestra.run.smithi124:> import glob 2023-10-16T12:59:00.976 DEBUG:teuthology.orchestra.run.smithi124:> import re 2023-10-16T12:59:00.977 DEBUG:teuthology.orchestra.run.smithi124:> import os 2023-10-16T12:59:00.977 DEBUG:teuthology.orchestra.run.smithi124:> import subprocess 2023-10-16T12:59:00.978 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-16T12:59:00.978 DEBUG:teuthology.orchestra.run.smithi124:> def _find_admin_socket(client_name): 2023-10-16T12:59:00.979 DEBUG:teuthology.orchestra.run.smithi124:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-16T12:59:00.980 DEBUG:teuthology.orchestra.run.smithi124:> files = glob.glob(asok_path) 2023-10-16T12:59:00.980 DEBUG:teuthology.orchestra.run.smithi124:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-16T12:59:00.981 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-16T12:59:00.981 DEBUG:teuthology.orchestra.run.smithi124:> # Given a non-glob path, it better be there 2023-10-16T12:59:00.982 DEBUG:teuthology.orchestra.run.smithi124:> if "*" not in asok_path: 2023-10-16T12:59:00.982 DEBUG:teuthology.orchestra.run.smithi124:> assert(len(files) == 1) 2023-10-16T12:59:00.983 DEBUG:teuthology.orchestra.run.smithi124:> return files[0] 2023-10-16T12:59:00.983 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-16T12:59:00.983 DEBUG:teuthology.orchestra.run.smithi124:> for f in files: 2023-10-16T12:59:00.984 DEBUG:teuthology.orchestra.run.smithi124:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-16T12:59:00.984 DEBUG:teuthology.orchestra.run.smithi124:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-16T12:59:00.984 DEBUG:teuthology.orchestra.run.smithi124:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-16T12:59:00.985 DEBUG:teuthology.orchestra.run.smithi124:> contents = proc_f.read() 2023-10-16T12:59:00.985 DEBUG:teuthology.orchestra.run.smithi124:> if mountpoint in contents: 2023-10-16T12:59:00.986 DEBUG:teuthology.orchestra.run.smithi124:> return f 2023-10-16T12:59:00.986 DEBUG:teuthology.orchestra.run.smithi124:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-16T12:59:00.987 DEBUG:teuthology.orchestra.run.smithi124:> 2023-10-16T12:59:00.987 DEBUG:teuthology.orchestra.run.smithi124:> print(_find_admin_socket("client.admin")) 2023-10-16T12:59:00.987 DEBUG:teuthology.orchestra.run.smithi124:> ' 2023-10-16T12:59:01.097 INFO:teuthology.orchestra.run.smithi124.stdout:/var/run/ceph/ceph-client.admin.111768.asok 2023-10-16T12:59:01.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-16T12:59:01.106 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.111768.asok 2023-10-16T12:59:01.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:01.107 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.111768.asok status 2023-10-16T12:59:01.263 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2023-10-16T12:59:01.264 INFO:teuthology.orchestra.run.smithi124.stdout: "metadata": { 2023-10-16T12:59:01.264 INFO:teuthology.orchestra.run.smithi124.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-16T12:59:01.264 INFO:teuthology.orchestra.run.smithi124.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-16T12:59:01.264 INFO:teuthology.orchestra.run.smithi124.stdout: "entity_id": "admin", 2023-10-16T12:59:01.265 INFO:teuthology.orchestra.run.smithi124.stdout: "hostname": "smithi124", 2023-10-16T12:59:01.265 INFO:teuthology.orchestra.run.smithi124.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-16T12:59:01.265 INFO:teuthology.orchestra.run.smithi124.stdout: "pid": "111768", 2023-10-16T12:59:01.265 INFO:teuthology.orchestra.run.smithi124.stdout: "root": "/" 2023-10-16T12:59:01.265 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:01.266 INFO:teuthology.orchestra.run.smithi124.stdout: "dentry_count": 0, 2023-10-16T12:59:01.266 INFO:teuthology.orchestra.run.smithi124.stdout: "dentry_pinned_count": 0, 2023-10-16T12:59:01.266 INFO:teuthology.orchestra.run.smithi124.stdout: "id": 4458, 2023-10-16T12:59:01.266 INFO:teuthology.orchestra.run.smithi124.stdout: "inst": { 2023-10-16T12:59:01.266 INFO:teuthology.orchestra.run.smithi124.stdout: "name": { 2023-10-16T12:59:01.267 INFO:teuthology.orchestra.run.smithi124.stdout: "type": "client", 2023-10-16T12:59:01.267 INFO:teuthology.orchestra.run.smithi124.stdout: "num": 4458 2023-10-16T12:59:01.267 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:01.267 INFO:teuthology.orchestra.run.smithi124.stdout: "addr": { 2023-10-16T12:59:01.267 INFO:teuthology.orchestra.run.smithi124.stdout: "type": "v1", 2023-10-16T12:59:01.268 INFO:teuthology.orchestra.run.smithi124.stdout: "addr": "192.168.0.1:0", 2023-10-16T12:59:01.268 INFO:teuthology.orchestra.run.smithi124.stdout: "nonce": 2744859892 2023-10-16T12:59:01.268 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:01.268 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:01.268 INFO:teuthology.orchestra.run.smithi124.stdout: "addr": { 2023-10-16T12:59:01.269 INFO:teuthology.orchestra.run.smithi124.stdout: "type": "v1", 2023-10-16T12:59:01.269 INFO:teuthology.orchestra.run.smithi124.stdout: "addr": "192.168.0.1:0", 2023-10-16T12:59:01.269 INFO:teuthology.orchestra.run.smithi124.stdout: "nonce": 2744859892 2023-10-16T12:59:01.269 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:01.269 INFO:teuthology.orchestra.run.smithi124.stdout: "inst_str": "client.4458 192.168.0.1:0/2744859892", 2023-10-16T12:59:01.269 INFO:teuthology.orchestra.run.smithi124.stdout: "addr_str": "192.168.0.1:0/2744859892", 2023-10-16T12:59:01.270 INFO:teuthology.orchestra.run.smithi124.stdout: "inode_count": 1, 2023-10-16T12:59:01.270 INFO:teuthology.orchestra.run.smithi124.stdout: "mds_epoch": 7, 2023-10-16T12:59:01.270 INFO:teuthology.orchestra.run.smithi124.stdout: "osd_epoch": 24, 2023-10-16T12:59:01.270 INFO:teuthology.orchestra.run.smithi124.stdout: "osd_epoch_barrier": 0, 2023-10-16T12:59:01.271 INFO:teuthology.orchestra.run.smithi124.stdout: "blocklisted": false, 2023-10-16T12:59:01.271 INFO:teuthology.orchestra.run.smithi124.stdout: "fs_name": "cephfs" 2023-10-16T12:59:01.271 INFO:teuthology.orchestra.run.smithi124.stdout:} 2023-10-16T12:59:01.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:01.273 DEBUG:teuthology.orchestra.run.smithi124:> stat --file-system '--printf=%T 2023-10-16T12:59:01.274 DEBUG:teuthology.orchestra.run.smithi124:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-16T12:59:01.291 INFO:teuthology.orchestra.run.smithi124.stdout:fuseblk 2023-10-16T12:59:01.291 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-16T12:59:01.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:01.292 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-16T12:59:01.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:01.359 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-16T12:59:01.638 INFO:teuthology.orchestra.run.smithi124.stdout:# file: . 2023-10-16T12:59:01.638 INFO:teuthology.orchestra.run.smithi124.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-16T12:59:01.639 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:01.639 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:59:01.639 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:59:01.658 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:59:01.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.816+0000 7fca63ddc700 1 Processor -- start 2023-10-16T12:59:01.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.816+0000 7fca63ddc700 1 -- start start 2023-10-16T12:59:01.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.817+0000 7fca63ddc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fca5c0ced40 0x7fca5c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:01.823 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.817+0000 7fca63ddc700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca5c0cb3b0 con 0x7fca5c15dea0 2023-10-16T12:59:01.823 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.817+0000 7fca63ddc700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca5c0cb690 con 0x7fca5c0ce960 2023-10-16T12:59:01.823 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.817+0000 7fca63ddc700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca5c0cb970 con 0x7fca5c0ced40 2023-10-16T12:59:01.823 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.817+0000 7fca62379700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fca5c15dea0 0x7fca5c157510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:41910/0 (socket says 172.21.15.124:41910) 2023-10-16T12:59:01.823 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.817+0000 7fca62379700 1 -- 172.21.15.124:0/3555351178 learned_addr learned my addr 172.21.15.124:0/3555351178 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:01.824 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.817+0000 7fca61377700 1 --2- 172.21.15.124:0/3555351178 >> v2:172.21.15.192:3300/0 conn(0x7fca5c0ced40 0x7fca5c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:01.824 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca60b76700 1 -- 172.21.15.124:0/3555351178 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3065012924 0 0) 0x7fca5c0cb3b0 con 0x7fca5c15dea0 2023-10-16T12:59:01.824 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca60b76700 1 -- 172.21.15.124:0/3555351178 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca480035b0 con 0x7fca5c15dea0 2023-10-16T12:59:01.824 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca60b76700 1 -- 172.21.15.124:0/3555351178 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1372534738 0 0) 0x7fca480035b0 con 0x7fca5c15dea0 2023-10-16T12:59:01.824 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca60b76700 1 -- 172.21.15.124:0/3555351178 >> v2:172.21.15.192:3300/0 conn(0x7fca5c0ced40 msgr2=0x7fca5c06e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:01.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca60b76700 1 --2- 172.21.15.124:0/3555351178 >> v2:172.21.15.192:3300/0 conn(0x7fca5c0ced40 0x7fca5c06e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:01.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca60b76700 1 -- 172.21.15.124:0/3555351178 >> v1:172.21.15.192:6789/0 conn(0x7fca5c0ce960 legacy=0x7fca5c0cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:01.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca60b76700 1 -- 172.21.15.124:0/3555351178 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c0cbc50 con 0x7fca5c15dea0 2023-10-16T12:59:01.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca60b76700 1 -- 172.21.15.124:0/3555351178 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7fca540019f0 con 0x7fca5c15dea0 2023-10-16T12:59:01.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca60b76700 1 -- 172.21.15.124:0/3555351178 >> v1:172.21.15.124:6789/0 conn(0x7fca5c15dea0 legacy=0x7fca5c157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:01.826 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca60b76700 1 --2- 172.21.15.124:0/3555351178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca48003a00 0x7fca48003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:01.826 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca60b76700 1 --2- 172.21.15.124:0/3555351178 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca48004850 0x7fca48004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:01.826 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca60b76700 1 --2- 172.21.15.124:0/3555351178 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca48005210 0x7fca4800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:01.826 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca60b76700 1 -- 172.21.15.124:0/3555351178 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c0cb970 con 0x7fca48005210 2023-10-16T12:59:01.826 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca60b76700 1 -- 172.21.15.124:0/3555351178 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4800c0b0 con 0x7fca48003a00 2023-10-16T12:59:01.827 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca60b76700 1 -- 172.21.15.124:0/3555351178 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4800c270 con 0x7fca48004850 2023-10-16T12:59:01.827 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca62379700 1 --2- 172.21.15.124:0/3555351178 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca48005210 0x7fca4800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:01.827 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca61b78700 1 --2- 172.21.15.124:0/3555351178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca48003a00 0x7fca48003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:01.827 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca61377700 1 --2- 172.21.15.124:0/3555351178 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca48004850 0x7fca48004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:01.827 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca62379700 1 -- 172.21.15.124:0/3555351178 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca48004850 msgr2=0x7fca48004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:01.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca62379700 1 --2- 172.21.15.124:0/3555351178 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca48004850 0x7fca48004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:01.829 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca62379700 1 -- 172.21.15.124:0/3555351178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca48003a00 msgr2=0x7fca48003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:01.829 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca62379700 1 --2- 172.21.15.124:0/3555351178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca48003a00 0x7fca48003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:01.829 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca62379700 1 -- 172.21.15.124:0/3555351178 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca480035b0 con 0x7fca48005210 2023-10-16T12:59:01.830 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca62379700 1 -- 172.21.15.124:0/3555351178 reap_dead start 2023-10-16T12:59:01.830 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.818+0000 7fca62379700 1 --2- 172.21.15.124:0/3555351178 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca48005210 0x7fca4800ba10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fca5400a830 tx=0x7fca48005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf160400806c3ad7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:01.830 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.819+0000 7fca60b76700 1 -- 172.21.15.124:0/3555351178 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5400a2f0 con 0x7fca48005210 2023-10-16T12:59:01.830 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.819+0000 7fca60b76700 1 -- 172.21.15.124:0/3555351178 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca54012600 con 0x7fca48005210 2023-10-16T12:59:01.830 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.819+0000 7fca60b76700 1 -- 172.21.15.124:0/3555351178 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca540129b0 con 0x7fca48005210 2023-10-16T12:59:01.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.819+0000 7fca63ddc700 1 -- 172.21.15.124:0/3555351178 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca48005210 msgr2=0x7fca4800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:01.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.819+0000 7fca63ddc700 1 --2- 172.21.15.124:0/3555351178 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca48005210 0x7fca4800ba10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fca5400a830 tx=0x7fca48005880 comp rx=0 tx=0).stop 2023-10-16T12:59:01.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.819+0000 7fca63ddc700 1 -- 172.21.15.124:0/3555351178 shutdown_connections 2023-10-16T12:59:01.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.819+0000 7fca63ddc700 1 --2- 172.21.15.124:0/3555351178 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca48005210 0x7fca4800ba10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:01.831 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.819+0000 7fca63ddc700 1 -- 172.21.15.124:0/3555351178 >> 172.21.15.124:0/3555351178 conn(0x7fca5c0cfcd0 msgr2=0x7fca5c0d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:01.832 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.819+0000 7fca63ddc700 1 -- 172.21.15.124:0/3555351178 shutdown_connections 2023-10-16T12:59:01.832 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.819+0000 7fca63ddc700 1 -- 172.21.15.124:0/3555351178 wait complete. 2023-10-16T12:59:01.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.820+0000 7fca63ddc700 1 Processor -- start 2023-10-16T12:59:01.835 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.820+0000 7fca63ddc700 1 -- start start 2023-10-16T12:59:01.835 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.821+0000 7fca63ddc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca48005210 0x7fca5c0a93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:01.835 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.821+0000 7fca63ddc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca5c1f4990 0x7fca5c0c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:01.835 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.821+0000 7fca63ddc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca5c0add40 0x7fca5c14e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:01.835 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.821+0000 7fca63ddc700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c1f4ee0 con 0x7fca5c1f4990 2023-10-16T12:59:01.836 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.821+0000 7fca63ddc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c1f51c0 con 0x7fca48005210 2023-10-16T12:59:01.836 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.821+0000 7fca63ddc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c1f54a0 con 0x7fca5c0add40 2023-10-16T12:59:01.836 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.821+0000 7fca61377700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca5c1f4990 0x7fca5c0c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:01.836 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.821+0000 7fca61377700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca5c1f4990 0x7fca5c0c90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53252/0 (socket says 172.21.15.124:53252) 2023-10-16T12:59:01.836 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.821+0000 7fca61377700 1 -- 172.21.15.124:0/75379033 learned_addr learned my addr 172.21.15.124:0/75379033 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:01.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.821+0000 7fca62379700 1 --2- 172.21.15.124:0/75379033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca5c0add40 0x7fca5c14e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:01.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.821+0000 7fca61b78700 1 --2- 172.21.15.124:0/75379033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca48005210 0x7fca5c0a93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:01.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.821+0000 7fca61377700 1 -- 172.21.15.124:0/75379033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca5c0add40 msgr2=0x7fca5c14e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:01.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.821+0000 7fca61377700 1 --2- 172.21.15.124:0/75379033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca5c0add40 0x7fca5c14e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:01.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.821+0000 7fca61377700 1 -- 172.21.15.124:0/75379033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca48005210 msgr2=0x7fca5c0a93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:01.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.821+0000 7fca61377700 1 --2- 172.21.15.124:0/75379033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca48005210 0x7fca5c0a93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:01.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.821+0000 7fca61377700 1 -- 172.21.15.124:0/75379033 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c1f5780 con 0x7fca5c1f4990 2023-10-16T12:59:01.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.822+0000 7fca61377700 1 --2- 172.21.15.124:0/75379033 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca5c1f4990 0x7fca5c0c90c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fca58010840 tx=0x7fca58010b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:01.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.822+0000 7fca527fc700 1 -- 172.21.15.124:0/75379033 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca58016670 con 0x7fca5c1f4990 2023-10-16T12:59:01.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.822+0000 7fca527fc700 1 -- 172.21.15.124:0/75379033 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca580167d0 con 0x7fca5c1f4990 2023-10-16T12:59:01.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.822+0000 7fca527fc700 1 -- 172.21.15.124:0/75379033 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca58016b40 con 0x7fca5c1f4990 2023-10-16T12:59:01.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.822+0000 7fca63ddc700 1 -- 172.21.15.124:0/75379033 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca5c1f13a0 con 0x7fca5c1f4990 2023-10-16T12:59:01.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.822+0000 7fca63ddc700 1 -- 172.21.15.124:0/75379033 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca5c0a9ac0 con 0x7fca5c1f4990 2023-10-16T12:59:01.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.823+0000 7fca63ddc700 1 -- 172.21.15.124:0/75379033 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca5c1f1780 con 0x7fca5c1f4990 2023-10-16T12:59:01.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.823+0000 7fca527fc700 1 -- 172.21.15.124:0/75379033 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fca58016ca0 con 0x7fca5c1f4990 2023-10-16T12:59:01.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.824+0000 7fca527fc700 1 --2- 172.21.15.124:0/75379033 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fca4006af00 0x7fca4006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:01.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.824+0000 7fca61b78700 1 --2- 172.21.15.124:0/75379033 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fca4006af00 0x7fca4006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:01.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.824+0000 7fca527fc700 1 -- 172.21.15.124:0/75379033 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fca580899b0 con 0x7fca5c1f4990 2023-10-16T12:59:01.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.824+0000 7fca61b78700 1 --2- 172.21.15.124:0/75379033 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fca4006af00 0x7fca4006d3c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fca4c000c00 tx=0x7fca4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:01.840 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:01.828+0000 7fca527fc700 1 -- 172.21.15.124:0/75379033 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fca580546d0 con 0x7fca5c1f4990 2023-10-16T12:59:02.024 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.021+0000 7fca63ddc700 1 -- 172.21.15.124:0/75379033 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca5c0a9ac0 con 0x7fca5c1f4990 2023-10-16T12:59:02.025 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.022+0000 7fca527fc700 1 -- 172.21.15.124:0/75379033 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fca5c0a9ac0 con 0x7fca5c1f4990 2023-10-16T12:59:02.025 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:02.026 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":24,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:58:56.089767+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:59:02.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.025+0000 7fca63ddc700 1 -- 172.21.15.124:0/75379033 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fca4006af00 msgr2=0x7fca4006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:02.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.025+0000 7fca63ddc700 1 --2- 172.21.15.124:0/75379033 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fca4006af00 0x7fca4006d3c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fca4c000c00 tx=0x7fca4c009040 comp rx=0 tx=0).stop 2023-10-16T12:59:02.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.025+0000 7fca63ddc700 1 -- 172.21.15.124:0/75379033 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca5c1f4990 msgr2=0x7fca5c0c90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:02.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.025+0000 7fca63ddc700 1 --2- 172.21.15.124:0/75379033 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca5c1f4990 0x7fca5c0c90c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fca58010840 tx=0x7fca58010b50 comp rx=0 tx=0).stop 2023-10-16T12:59:02.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.025+0000 7fca63ddc700 1 -- 172.21.15.124:0/75379033 shutdown_connections 2023-10-16T12:59:02.029 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.025+0000 7fca63ddc700 1 --2- 172.21.15.124:0/75379033 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fca4006af00 0x7fca4006d3c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:02.029 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.025+0000 7fca63ddc700 1 --2- 172.21.15.124:0/75379033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca5c0add40 0x7fca5c14e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:02.029 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.025+0000 7fca63ddc700 1 --2- 172.21.15.124:0/75379033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca48005210 0x7fca5c0a93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:02.029 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.025+0000 7fca63ddc700 1 --2- 172.21.15.124:0/75379033 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca5c1f4990 0x7fca5c0c90c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:02.029 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.025+0000 7fca63ddc700 1 -- 172.21.15.124:0/75379033 >> 172.21.15.124:0/75379033 conn(0x7fca5c0cfcd0 msgr2=0x7fca5c15cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:02.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.025+0000 7fca63ddc700 1 -- 172.21.15.124:0/75379033 shutdown_connections 2023-10-16T12:59:02.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.025+0000 7fca63ddc700 1 -- 172.21.15.124:0/75379033 wait complete. 2023-10-16T12:59:02.039 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T12:58:38.667813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T12:58:49.562073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T12:58:50.011419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T12:58:53.692890+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T12:59:02.040 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T12:59:02.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.160+0000 7efc6f76b700 1 Processor -- start 2023-10-16T12:59:02.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.161+0000 7efc6f76b700 1 -- start start 2023-10-16T12:59:02.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.161+0000 7efc6f76b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7efc680ce440 0x7efc6815dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:02.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.161+0000 7efc6f76b700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc68161360 con 0x7efc6806a820 2023-10-16T12:59:02.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.161+0000 7efc6f76b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc6806b750 con 0x7efc6806b370 2023-10-16T12:59:02.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.161+0000 7efc6f76b700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6806dcc0 con 0x7efc680ce440 2023-10-16T12:59:02.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.162+0000 7efc6cd06700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7efc6806a820 0x7efc680cdd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:41928/0 (socket says 172.21.15.124:41928) 2023-10-16T12:59:02.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.162+0000 7efc6dd08700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7efc680ce440 0x7efc6815dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:02.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.162+0000 7efc6cd06700 1 -- 172.21.15.124:0/1327681625 learned_addr learned my addr 172.21.15.124:0/1327681625 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:02.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.162+0000 7efc6dd08700 1 -- 172.21.15.124:0/1327681625 >> v1:172.21.15.192:6789/0 conn(0x7efc6806b370 legacy=0x7efc6806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:02.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.162+0000 7efc6dd08700 1 -- 172.21.15.124:0/1327681625 >> v1:172.21.15.124:6789/0 conn(0x7efc6806a820 legacy=0x7efc680cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:02.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.162+0000 7efc5ffff700 1 -- 172.21.15.124:0/1327681625 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152783971 0 0) 0x7efc68161360 con 0x7efc6806a820 2023-10-16T12:59:02.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.162+0000 7efc6dd08700 1 -- 172.21.15.124:0/1327681625 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6815e300 con 0x7efc680ce440 2023-10-16T12:59:02.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.162+0000 7efc6dd08700 1 --2- 172.21.15.124:0/1327681625 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc680ce440 0x7efc6815dcb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efc60009dc0 tx=0x7efc6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed829e42fec1ce21 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:02.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.162+0000 7efc5ffff700 1 -- 172.21.15.124:0/1327681625 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6000e070 con 0x7efc680ce440 2023-10-16T12:59:02.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.162+0000 7efc5ffff700 1 -- 172.21.15.124:0/1327681625 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6000bb50 con 0x7efc680ce440 2023-10-16T12:59:02.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.162+0000 7efc5ffff700 1 -- 172.21.15.124:0/1327681625 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc60003a20 con 0x7efc680ce440 2023-10-16T12:59:02.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.163+0000 7efc6f76b700 1 -- 172.21.15.124:0/1327681625 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc680ce440 msgr2=0x7efc6815dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:02.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.163+0000 7efc6f76b700 1 --2- 172.21.15.124:0/1327681625 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc680ce440 0x7efc6815dcb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efc60009dc0 tx=0x7efc6000b330 comp rx=0 tx=0).stop 2023-10-16T12:59:02.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.163+0000 7efc6f76b700 1 -- 172.21.15.124:0/1327681625 shutdown_connections 2023-10-16T12:59:02.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.163+0000 7efc6f76b700 1 --2- 172.21.15.124:0/1327681625 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc680ce440 0x7efc6815dcb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:02.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.163+0000 7efc6f76b700 1 -- 172.21.15.124:0/1327681625 >> 172.21.15.124:0/1327681625 conn(0x7efc680ccbe0 msgr2=0x7efc680ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:02.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.163+0000 7efc6f76b700 1 -- 172.21.15.124:0/1327681625 shutdown_connections 2023-10-16T12:59:02.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.163+0000 7efc6f76b700 1 -- 172.21.15.124:0/1327681625 wait complete. 2023-10-16T12:59:02.172 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.164+0000 7efc6f76b700 1 Processor -- start 2023-10-16T12:59:02.172 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.164+0000 7efc6f76b700 1 -- start start 2023-10-16T12:59:02.172 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.165+0000 7efc6f76b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc6806a820 0x7efc681567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:02.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.165+0000 7efc6f76b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc6806b370 0x7efc680b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:02.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.165+0000 7efc6f76b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc680ce440 0x7efc680cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:02.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.165+0000 7efc6f76b700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc680b5190 con 0x7efc6806a820 2023-10-16T12:59:02.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.165+0000 7efc6f76b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc680b3cf0 con 0x7efc6806b370 2023-10-16T12:59:02.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.165+0000 7efc6f76b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6815f830 con 0x7efc680ce440 2023-10-16T12:59:02.174 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.165+0000 7efc6d507700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc6806a820 0x7efc681567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:02.174 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.165+0000 7efc6d507700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc6806a820 0x7efc681567f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53264/0 (socket says 172.21.15.124:53264) 2023-10-16T12:59:02.174 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.165+0000 7efc6d507700 1 -- 172.21.15.124:0/3787590612 learned_addr learned my addr 172.21.15.124:0/3787590612 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:02.174 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.165+0000 7efc6cd06700 1 --2- 172.21.15.124:0/3787590612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc6806b370 0x7efc680b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:02.174 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.165+0000 7efc6dd08700 1 --2- 172.21.15.124:0/3787590612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc680ce440 0x7efc680cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:02.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.165+0000 7efc6d507700 1 -- 172.21.15.124:0/3787590612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc680ce440 msgr2=0x7efc680cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:02.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.165+0000 7efc6d507700 1 --2- 172.21.15.124:0/3787590612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc680ce440 0x7efc680cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:02.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.165+0000 7efc6d507700 1 -- 172.21.15.124:0/3787590612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc6806b370 msgr2=0x7efc680b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:02.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.165+0000 7efc6d507700 1 --2- 172.21.15.124:0/3787590612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc6806b370 0x7efc680b37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:02.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.165+0000 7efc6d507700 1 -- 172.21.15.124:0/3787590612 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc60009a70 con 0x7efc6806a820 2023-10-16T12:59:02.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.165+0000 7efc6dd08700 1 --2- 172.21.15.124:0/3787590612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc680ce440 0x7efc680cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:02.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.165+0000 7efc6d507700 1 --2- 172.21.15.124:0/3787590612 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc6806a820 0x7efc681567f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efc5800b4a0 tx=0x7efc5800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:02.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.165+0000 7efc5dffb700 1 -- 172.21.15.124:0/3787590612 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc58011830 con 0x7efc6806a820 2023-10-16T12:59:02.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.165+0000 7efc5dffb700 1 -- 172.21.15.124:0/3787590612 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc58011990 con 0x7efc6806a820 2023-10-16T12:59:02.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.165+0000 7efc5dffb700 1 -- 172.21.15.124:0/3787590612 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc58011d40 con 0x7efc6806a820 2023-10-16T12:59:02.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.165+0000 7efc6f76b700 1 -- 172.21.15.124:0/3787590612 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc680b4580 con 0x7efc6806a820 2023-10-16T12:59:02.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.166+0000 7efc6f76b700 1 -- 172.21.15.124:0/3787590612 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc680b4b40 con 0x7efc6806a820 2023-10-16T12:59:02.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.167+0000 7efc6f76b700 1 -- 172.21.15.124:0/3787590612 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc68072d10 con 0x7efc6806a820 2023-10-16T12:59:02.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.167+0000 7efc5dffb700 1 -- 172.21.15.124:0/3787590612 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efc5801a400 con 0x7efc6806a820 2023-10-16T12:59:02.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.167+0000 7efc5dffb700 1 --2- 172.21.15.124:0/3787590612 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7efc4c06af30 0x7efc4c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:02.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.167+0000 7efc5dffb700 1 -- 172.21.15.124:0/3787590612 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efc58089520 con 0x7efc6806a820 2023-10-16T12:59:02.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.167+0000 7efc6cd06700 1 --2- 172.21.15.124:0/3787590612 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7efc4c06af30 0x7efc4c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:02.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.168+0000 7efc6cd06700 1 --2- 172.21.15.124:0/3787590612 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7efc4c06af30 0x7efc4c06d3f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efc64000f60 tx=0x7efc64007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:02.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.172+0000 7efc5dffb700 1 -- 172.21.15.124:0/3787590612 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efc58054390 con 0x7efc6806a820 2023-10-16T12:59:02.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.362+0000 7efc6f76b700 1 -- 172.21.15.124:0/3787590612 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efc6804ebb0 con 0x7efc6806a820 2023-10-16T12:59:02.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.362+0000 7efc5dffb700 1 -- 172.21.15.124:0/3787590612 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7efc580579b0 con 0x7efc6806a820 2023-10-16T12:59:02.365 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-16T12:59:02.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.364+0000 7efc6f76b700 1 -- 172.21.15.124:0/3787590612 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7efc4c06af30 msgr2=0x7efc4c06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:02.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.364+0000 7efc6f76b700 1 --2- 172.21.15.124:0/3787590612 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7efc4c06af30 0x7efc4c06d3f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efc64000f60 tx=0x7efc64007e70 comp rx=0 tx=0).stop 2023-10-16T12:59:02.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.364+0000 7efc6f76b700 1 -- 172.21.15.124:0/3787590612 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc6806a820 msgr2=0x7efc681567f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:02.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.364+0000 7efc6f76b700 1 --2- 172.21.15.124:0/3787590612 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc6806a820 0x7efc681567f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efc5800b4a0 tx=0x7efc5800b7b0 comp rx=0 tx=0).stop 2023-10-16T12:59:02.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.364+0000 7efc6f76b700 1 -- 172.21.15.124:0/3787590612 shutdown_connections 2023-10-16T12:59:02.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.364+0000 7efc6f76b700 1 --2- 172.21.15.124:0/3787590612 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7efc4c06af30 0x7efc4c06d3f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:02.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.365+0000 7efc6f76b700 1 --2- 172.21.15.124:0/3787590612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc680ce440 0x7efc680cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:02.368 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.365+0000 7efc6f76b700 1 --2- 172.21.15.124:0/3787590612 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efc6806a820 0x7efc681567f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:02.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.365+0000 7efc6f76b700 1 --2- 172.21.15.124:0/3787590612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc6806b370 0x7efc680b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:02.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.365+0000 7efc6f76b700 1 -- 172.21.15.124:0/3787590612 >> 172.21.15.124:0/3787590612 conn(0x7efc680ccbe0 msgr2=0x7efc68071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:02.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.365+0000 7efc6f76b700 1 -- 172.21.15.124:0/3787590612 shutdown_connections 2023-10-16T12:59:02.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.365+0000 7efc6f76b700 1 -- 172.21.15.124:0/3787590612 wait complete. 2023-10-16T12:59:02.379 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T12:59:02.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.499+0000 7f49146eb700 1 Processor -- start 2023-10-16T12:59:02.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.499+0000 7f49146eb700 1 -- start start 2023-10-16T12:59:02.504 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.500+0000 7f49146eb700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f490c0b33f0 0x7f490c06f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:02.504 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.500+0000 7f49146eb700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f490c0cd770 0x7f490c0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:02.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.500+0000 7f49146eb700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f490c070620 con 0x7f490c15b4e0 2023-10-16T12:59:02.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.500+0000 7f49146eb700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f490c070900 con 0x7f490c0cd770 2023-10-16T12:59:02.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.500+0000 7f49146eb700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f490c070be0 con 0x7f490c0b33f0 2023-10-16T12:59:02.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.500+0000 7f4912c88700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f490c0cd770 0x7f490c0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:02.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.500+0000 7f4912c88700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f490c0cd770 0x7f490c0b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53276/0 (socket says 172.21.15.124:53276) 2023-10-16T12:59:02.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.501+0000 7f4912c88700 1 -- 172.21.15.124:0/2300564115 learned_addr learned my addr 172.21.15.124:0/2300564115 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:02.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.501+0000 7f4911c86700 1 --2- 172.21.15.124:0/2300564115 >> v2:172.21.15.192:3300/0 conn(0x7f490c0b33f0 0x7f490c06f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:02.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.501+0000 7f4912c88700 1 -- 172.21.15.124:0/2300564115 >> v2:172.21.15.192:3300/0 conn(0x7f490c0b33f0 msgr2=0x7f490c06f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:02.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.501+0000 7f4912c88700 1 --2- 172.21.15.124:0/2300564115 >> v2:172.21.15.192:3300/0 conn(0x7f490c0b33f0 0x7f490c06f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:02.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.501+0000 7f4912c88700 1 -- 172.21.15.124:0/2300564115 >> v1:172.21.15.192:6789/0 conn(0x7f490c15b4e0 legacy=0x7f490c0b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:02.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.501+0000 7f4912c88700 1 -- 172.21.15.124:0/2300564115 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490c070ec0 con 0x7f490c0cd770 2023-10-16T12:59:02.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.501+0000 7f4912c88700 1 --2- 172.21.15.124:0/2300564115 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f490c0cd770 0x7f490c0b4450 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4904009e50 tx=0x7f490400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcee9dfcb7d5f7b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:02.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.501+0000 7f4911485700 1 -- 172.21.15.124:0/2300564115 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490400e070 con 0x7f490c0cd770 2023-10-16T12:59:02.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.501+0000 7f4911485700 1 -- 172.21.15.124:0/2300564115 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490400b8d0 con 0x7f490c0cd770 2023-10-16T12:59:02.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.501+0000 7f4911485700 1 -- 172.21.15.124:0/2300564115 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490400bc80 con 0x7f490c0cd770 2023-10-16T12:59:02.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.502+0000 7f49146eb700 1 -- 172.21.15.124:0/2300564115 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f490c0cd770 msgr2=0x7f490c0b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:02.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.502+0000 7f49146eb700 1 --2- 172.21.15.124:0/2300564115 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f490c0cd770 0x7f490c0b4450 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4904009e50 tx=0x7f490400b330 comp rx=0 tx=0).stop 2023-10-16T12:59:02.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.502+0000 7f49146eb700 1 -- 172.21.15.124:0/2300564115 shutdown_connections 2023-10-16T12:59:02.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.502+0000 7f49146eb700 1 --2- 172.21.15.124:0/2300564115 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f490c0cd770 0x7f490c0b4450 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:02.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.502+0000 7f49146eb700 1 --2- 172.21.15.124:0/2300564115 >> v2:172.21.15.192:3300/0 conn(0x7f490c0b33f0 0x7f490c06f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:02.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.502+0000 7f49146eb700 1 -- 172.21.15.124:0/2300564115 >> 172.21.15.124:0/2300564115 conn(0x7f490c0cdce0 msgr2=0x7f490c0ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:02.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.502+0000 7f49146eb700 1 -- 172.21.15.124:0/2300564115 shutdown_connections 2023-10-16T12:59:02.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.502+0000 7f49146eb700 1 -- 172.21.15.124:0/2300564115 wait complete. 2023-10-16T12:59:02.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.503+0000 7f49146eb700 1 Processor -- start 2023-10-16T12:59:02.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.503+0000 7f49146eb700 1 -- start start 2023-10-16T12:59:02.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.504+0000 7f49146eb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f490c0b33f0 0x7f490c1e4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:02.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.504+0000 7f49146eb700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f490c0cd770 0x7f490c157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:02.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.504+0000 7f49146eb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f490c15b4e0 0x7f490c1e3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:02.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.504+0000 7f49146eb700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490c1e3df0 con 0x7f490c0cd770 2023-10-16T12:59:02.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.504+0000 7f49146eb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490c1e40d0 con 0x7f490c0b33f0 2023-10-16T12:59:02.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.504+0000 7f49146eb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490c1e43b0 con 0x7f490c15b4e0 2023-10-16T12:59:02.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.504+0000 7f4911c86700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f490c0cd770 0x7f490c157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:02.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.504+0000 7f4911c86700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f490c0cd770 0x7f490c157db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53280/0 (socket says 172.21.15.124:53280) 2023-10-16T12:59:02.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.504+0000 7f4911c86700 1 -- 172.21.15.124:0/3937831818 learned_addr learned my addr 172.21.15.124:0/3937831818 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:02.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.504+0000 7f4912487700 1 --2- 172.21.15.124:0/3937831818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f490c0b33f0 0x7f490c1e4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:02.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.504+0000 7f4912c88700 1 --2- 172.21.15.124:0/3937831818 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f490c15b4e0 0x7f490c1e3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:02.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.504+0000 7f4911c86700 1 -- 172.21.15.124:0/3937831818 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f490c15b4e0 msgr2=0x7f490c1e3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:02.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.504+0000 7f4911c86700 1 --2- 172.21.15.124:0/3937831818 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f490c15b4e0 0x7f490c1e3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:02.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.504+0000 7f4911c86700 1 -- 172.21.15.124:0/3937831818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f490c0b33f0 msgr2=0x7f490c1e4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:02.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.504+0000 7f4911c86700 1 --2- 172.21.15.124:0/3937831818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f490c0b33f0 0x7f490c1e4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:02.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.504+0000 7f4911c86700 1 -- 172.21.15.124:0/3937831818 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4904009b30 con 0x7f490c0cd770 2023-10-16T12:59:02.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.504+0000 7f4912c88700 1 --2- 172.21.15.124:0/3937831818 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f490c15b4e0 0x7f490c1e3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:02.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.504+0000 7f4911c86700 1 --2- 172.21.15.124:0/3937831818 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f490c0cd770 0x7f490c157db0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f490800e980 tx=0x7f490800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:02.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.504+0000 7f4902ffd700 1 -- 172.21.15.124:0/3937831818 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4908009710 con 0x7f490c0cd770 2023-10-16T12:59:02.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.504+0000 7f4902ffd700 1 -- 172.21.15.124:0/3937831818 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490800eed0 con 0x7f490c0cd770 2023-10-16T12:59:02.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.504+0000 7f49146eb700 1 -- 172.21.15.124:0/3937831818 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f490c1e4690 con 0x7f490c0cd770 2023-10-16T12:59:02.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.504+0000 7f4902ffd700 1 -- 172.21.15.124:0/3937831818 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490800ca70 con 0x7f490c0cd770 2023-10-16T12:59:02.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.504+0000 7f49146eb700 1 -- 172.21.15.124:0/3937831818 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f490c1582f0 con 0x7f490c0cd770 2023-10-16T12:59:02.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.505+0000 7f49146eb700 1 -- 172.21.15.124:0/3937831818 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f490c0c4830 con 0x7f490c0cd770 2023-10-16T12:59:02.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.506+0000 7f4902ffd700 1 -- 172.21.15.124:0/3937831818 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f490800cbd0 con 0x7f490c0cd770 2023-10-16T12:59:02.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.506+0000 7f4902ffd700 1 --2- 172.21.15.124:0/3937831818 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f48f006af00 0x7f48f006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:02.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.506+0000 7f4912487700 1 --2- 172.21.15.124:0/3937831818 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f48f006af00 0x7f48f006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:02.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.506+0000 7f4902ffd700 1 -- 172.21.15.124:0/3937831818 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4908089870 con 0x7f490c0cd770 2023-10-16T12:59:02.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.506+0000 7f4912487700 1 --2- 172.21.15.124:0/3937831818 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f48f006af00 0x7f48f006d3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f490c1f3fb0 tx=0x7f48fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:02.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.511+0000 7f4902ffd700 1 -- 172.21.15.124:0/3937831818 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f49080546c0 con 0x7f490c0cd770 2023-10-16T12:59:02.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.699+0000 7f49146eb700 1 -- 172.21.15.124:0/3937831818 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f490c04ebb0 con 0x7f490c0cd770 2023-10-16T12:59:02.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.700+0000 7f4902ffd700 1 -- 172.21.15.124:0/3937831818 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4908057ce0 con 0x7f490c0cd770 2023-10-16T12:59:02.703 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:02.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.702+0000 7f49146eb700 1 -- 172.21.15.124:0/3937831818 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f48f006af00 msgr2=0x7f48f006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:02.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.702+0000 7f49146eb700 1 --2- 172.21.15.124:0/3937831818 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f48f006af00 0x7f48f006d3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f490c1f3fb0 tx=0x7f48fc009040 comp rx=0 tx=0).stop 2023-10-16T12:59:02.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.702+0000 7f49146eb700 1 -- 172.21.15.124:0/3937831818 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f490c0cd770 msgr2=0x7f490c157db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:02.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.702+0000 7f49146eb700 1 --2- 172.21.15.124:0/3937831818 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f490c0cd770 0x7f490c157db0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f490800e980 tx=0x7f490800ec90 comp rx=0 tx=0).stop 2023-10-16T12:59:02.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.702+0000 7f49146eb700 1 -- 172.21.15.124:0/3937831818 shutdown_connections 2023-10-16T12:59:02.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.702+0000 7f49146eb700 1 --2- 172.21.15.124:0/3937831818 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f48f006af00 0x7f48f006d3c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:02.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.702+0000 7f49146eb700 1 --2- 172.21.15.124:0/3937831818 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f490c15b4e0 0x7f490c1e3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:02.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.702+0000 7f49146eb700 1 --2- 172.21.15.124:0/3937831818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f490c0b33f0 0x7f490c1e4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:02.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.702+0000 7f49146eb700 1 --2- 172.21.15.124:0/3937831818 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f490c0cd770 0x7f490c157db0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:02.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.702+0000 7f49146eb700 1 -- 172.21.15.124:0/3937831818 >> 172.21.15.124:0/3937831818 conn(0x7f490c0cdce0 msgr2=0x7f490c0c72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:02.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.702+0000 7f49146eb700 1 -- 172.21.15.124:0/3937831818 shutdown_connections 2023-10-16T12:59:02.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.702+0000 7f49146eb700 1 -- 172.21.15.124:0/3937831818 wait complete. 2023-10-16T12:59:02.716 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T12:59:02.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.838+0000 7f7e157d6700 1 Processor -- start 2023-10-16T12:59:02.841 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.838+0000 7f7e157d6700 1 -- start start 2023-10-16T12:59:02.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.839+0000 7f7e157d6700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7e1015d650 0x7f7e100b8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:02.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.839+0000 7f7e157d6700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e100cdc90 con 0x7f7e100ce670 2023-10-16T12:59:02.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.839+0000 7f7e157d6700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e100b6550 con 0x7f7e100cfe70 2023-10-16T12:59:02.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.839+0000 7f7e157d6700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e1015da30 con 0x7f7e1015d650 2023-10-16T12:59:02.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.839+0000 7f7e0effd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7e1015d650 0x7f7e100b8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:02.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.839+0000 7f7e0f7fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f7e100ce670 0x7f7e100cea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:41956/0 (socket says 172.21.15.124:41956) 2023-10-16T12:59:02.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.839+0000 7f7e0f7fe700 1 -- 172.21.15.124:0/735432258 learned_addr learned my addr 172.21.15.124:0/735432258 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:02.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.839+0000 7f7e0effd700 1 -- 172.21.15.124:0/735432258 >> v1:172.21.15.192:6789/0 conn(0x7f7e100cfe70 legacy=0x7f7e100d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:02.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.839+0000 7f7e0effd700 1 -- 172.21.15.124:0/735432258 >> v1:172.21.15.124:6789/0 conn(0x7f7e100ce670 legacy=0x7f7e100cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:02.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.839+0000 7f7e0effd700 1 -- 172.21.15.124:0/735432258 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e10161150 con 0x7f7e1015d650 2023-10-16T12:59:02.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.839+0000 7f7e0dffb700 1 -- 172.21.15.124:0/735432258 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1404869343 0 0) 0x7f7e100cdc90 con 0x7f7e100ce670 2023-10-16T12:59:02.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.839+0000 7f7e0effd700 1 --2- 172.21.15.124:0/735432258 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e1015d650 0x7f7e100b8dd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009840 tx=0x7f7e04009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f214abc88deb338 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:02.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.839+0000 7f7e0dffb700 1 -- 172.21.15.124:0/735432258 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04011830 con 0x7f7e1015d650 2023-10-16T12:59:02.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.840+0000 7f7e0dffb700 1 -- 172.21.15.124:0/735432258 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e04011990 con 0x7f7e1015d650 2023-10-16T12:59:02.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.840+0000 7f7e0dffb700 1 -- 172.21.15.124:0/735432258 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04011d20 con 0x7f7e1015d650 2023-10-16T12:59:02.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.840+0000 7f7e157d6700 1 -- 172.21.15.124:0/735432258 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e1015d650 msgr2=0x7f7e100b8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:02.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.840+0000 7f7e157d6700 1 --2- 172.21.15.124:0/735432258 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e1015d650 0x7f7e100b8dd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009840 tx=0x7f7e04009b50 comp rx=0 tx=0).stop 2023-10-16T12:59:02.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.840+0000 7f7e157d6700 1 -- 172.21.15.124:0/735432258 shutdown_connections 2023-10-16T12:59:02.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.840+0000 7f7e157d6700 1 --2- 172.21.15.124:0/735432258 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e1015d650 0x7f7e100b8dd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:02.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.840+0000 7f7e157d6700 1 -- 172.21.15.124:0/735432258 >> 172.21.15.124:0/735432258 conn(0x7f7e1006bc90 msgr2=0x7f7e1006c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:02.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.840+0000 7f7e157d6700 1 -- 172.21.15.124:0/735432258 shutdown_connections 2023-10-16T12:59:02.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.840+0000 7f7e157d6700 1 -- 172.21.15.124:0/735432258 wait complete. 2023-10-16T12:59:02.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.841+0000 7f7e157d6700 1 Processor -- start 2023-10-16T12:59:02.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.841+0000 7f7e157d6700 1 -- start start 2023-10-16T12:59:02.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.842+0000 7f7e157d6700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e100ce670 0x7f7e101f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:02.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.842+0000 7f7e157d6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e100cfe70 0x7f7e100cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:02.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.842+0000 7f7e157d6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e1015d650 0x7f7e100cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:02.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.842+0000 7f7e157d6700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e101f39c0 con 0x7f7e100ce670 2023-10-16T12:59:02.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.842+0000 7f7e157d6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e101f3ca0 con 0x7f7e100cfe70 2023-10-16T12:59:02.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.842+0000 7f7e157d6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e101f3f80 con 0x7f7e1015d650 2023-10-16T12:59:02.852 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.842+0000 7f7e0effd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e100ce670 0x7f7e101f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:02.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.842+0000 7f7e0effd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e100ce670 0x7f7e101f30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53292/0 (socket says 172.21.15.124:53292) 2023-10-16T12:59:02.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.842+0000 7f7e0effd700 1 -- 172.21.15.124:0/3608279967 learned_addr learned my addr 172.21.15.124:0/3608279967 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:02.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.842+0000 7f7e0effd700 1 -- 172.21.15.124:0/3608279967 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e1015d650 msgr2=0x7f7e100cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:02.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.842+0000 7f7e0effd700 1 --2- 172.21.15.124:0/3608279967 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e1015d650 0x7f7e100cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:02.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.842+0000 7f7e0effd700 1 -- 172.21.15.124:0/3608279967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e100cfe70 msgr2=0x7f7e100cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:02.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.842+0000 7f7e0effd700 1 --2- 172.21.15.124:0/3608279967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e100cfe70 0x7f7e100cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:02.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.842+0000 7f7e0effd700 1 -- 172.21.15.124:0/3608279967 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e040094a0 con 0x7f7e100ce670 2023-10-16T12:59:02.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.843+0000 7f7e0effd700 1 --2- 172.21.15.124:0/3608279967 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e100ce670 0x7f7e101f30c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009b90 tx=0x7f7e04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:02.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.843+0000 7f7df77fe700 1 -- 172.21.15.124:0/3608279967 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e040036a0 con 0x7f7e100ce670 2023-10-16T12:59:02.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.843+0000 7f7df77fe700 1 -- 172.21.15.124:0/3608279967 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0401e070 con 0x7f7e100ce670 2023-10-16T12:59:02.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.843+0000 7f7e157d6700 1 -- 172.21.15.124:0/3608279967 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e101f4260 con 0x7f7e100ce670 2023-10-16T12:59:02.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.843+0000 7f7df77fe700 1 -- 172.21.15.124:0/3608279967 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04003a00 con 0x7f7e100ce670 2023-10-16T12:59:02.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.843+0000 7f7e157d6700 1 -- 172.21.15.124:0/3608279967 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e101f3600 con 0x7f7e100ce670 2023-10-16T12:59:02.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.844+0000 7f7e157d6700 1 -- 172.21.15.124:0/3608279967 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e101f3790 con 0x7f7e100ce670 2023-10-16T12:59:02.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.844+0000 7f7df77fe700 1 -- 172.21.15.124:0/3608279967 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7e04003b60 con 0x7f7e100ce670 2023-10-16T12:59:02.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.844+0000 7f7df77fe700 1 --2- 172.21.15.124:0/3608279967 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f7dfc06af00 0x7f7dfc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:02.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.844+0000 7f7df77fe700 1 -- 172.21.15.124:0/3608279967 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7e0408a9d0 con 0x7f7e100ce670 2023-10-16T12:59:02.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.844+0000 7f7e0e7fc700 1 --2- 172.21.15.124:0/3608279967 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f7dfc06af00 0x7f7dfc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:02.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.845+0000 7f7e0e7fc700 1 --2- 172.21.15.124:0/3608279967 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f7dfc06af00 0x7f7dfc06d3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7e00000f60 tx=0x7f7e00007a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:02.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:02.849+0000 7f7df77fe700 1 -- 172.21.15.124:0/3608279967 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7e04055820 con 0x7f7e100ce670 2023-10-16T12:59:03.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.037+0000 7f7e157d6700 1 -- 172.21.15.124:0/3608279967 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7e101f4780 con 0x7f7e100ce670 2023-10-16T12:59:03.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.037+0000 7f7df77fe700 1 -- 172.21.15.124:0/3608279967 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7e101f4780 con 0x7f7e100ce670 2023-10-16T12:59:03.040 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2023-10-16T12:59:03.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.039+0000 7f7e157d6700 1 -- 172.21.15.124:0/3608279967 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f7dfc06af00 msgr2=0x7f7dfc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:03.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.039+0000 7f7e157d6700 1 --2- 172.21.15.124:0/3608279967 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f7dfc06af00 0x7f7dfc06d3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7e00000f60 tx=0x7f7e00007a40 comp rx=0 tx=0).stop 2023-10-16T12:59:03.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.039+0000 7f7e157d6700 1 -- 172.21.15.124:0/3608279967 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e100ce670 msgr2=0x7f7e101f30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:03.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.039+0000 7f7e157d6700 1 --2- 172.21.15.124:0/3608279967 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e100ce670 0x7f7e101f30c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009b90 tx=0x7f7e04004750 comp rx=0 tx=0).stop 2023-10-16T12:59:03.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.039+0000 7f7e157d6700 1 -- 172.21.15.124:0/3608279967 shutdown_connections 2023-10-16T12:59:03.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.039+0000 7f7e157d6700 1 --2- 172.21.15.124:0/3608279967 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f7dfc06af00 0x7f7dfc06d3c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:03.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.039+0000 7f7e157d6700 1 --2- 172.21.15.124:0/3608279967 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e1015d650 0x7f7e100cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:03.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.039+0000 7f7e157d6700 1 --2- 172.21.15.124:0/3608279967 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e100ce670 0x7f7e101f30c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:03.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.039+0000 7f7e157d6700 1 --2- 172.21.15.124:0/3608279967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e100cfe70 0x7f7e100cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:03.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.039+0000 7f7e157d6700 1 -- 172.21.15.124:0/3608279967 >> 172.21.15.124:0/3608279967 conn(0x7f7e1006bc90 msgr2=0x7f7e10160920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:03.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.039+0000 7f7e157d6700 1 -- 172.21.15.124:0/3608279967 shutdown_connections 2023-10-16T12:59:03.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.039+0000 7f7e157d6700 1 -- 172.21.15.124:0/3608279967 wait complete. 2023-10-16T12:59:03.054 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T12:59:03.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.174+0000 7fa3cf4a7700 1 Processor -- start 2023-10-16T12:59:03.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.174+0000 7fa3cf4a7700 1 -- start start 2023-10-16T12:59:03.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.175+0000 7fa3cf4a7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3c815b8b0 0x7fa3c806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:03.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.175+0000 7fa3cf4a7700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c80cb9b0 con 0x7fa3c80717e0 2023-10-16T12:59:03.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.175+0000 7fa3cf4a7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c80cbc90 con 0x7fa3c80af290 2023-10-16T12:59:03.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.175+0000 7fa3cf4a7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c80cbf70 con 0x7fa3c815b8b0 2023-10-16T12:59:03.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.175+0000 7fa3cd243700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fa3c80717e0 0x7fa3c8071bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:41968/0 (socket says 172.21.15.124:41968) 2023-10-16T12:59:03.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.175+0000 7fa3cd243700 1 -- 172.21.15.124:0/2123944910 learned_addr learned my addr 172.21.15.124:0/2123944910 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:03.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.175+0000 7fa3cda44700 1 --2- 172.21.15.124:0/2123944910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3c815b8b0 0x7fa3c806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:03.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.175+0000 7fa3bffff700 1 -- 172.21.15.124:0/2123944910 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2026400144 0 0) 0x7fa3c80cb9b0 con 0x7fa3c80717e0 2023-10-16T12:59:03.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.175+0000 7fa3bffff700 1 -- 172.21.15.124:0/2123944910 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3b40035b0 con 0x7fa3c80717e0 2023-10-16T12:59:03.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.175+0000 7fa3bffff700 1 -- 172.21.15.124:0/2123944910 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 274952255 0 0) 0x7fa3c80cbc90 con 0x7fa3c80af290 2023-10-16T12:59:03.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.175+0000 7fa3bffff700 1 -- 172.21.15.124:0/2123944910 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3c80cb9b0 con 0x7fa3c80af290 2023-10-16T12:59:03.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.175+0000 7fa3cda44700 1 -- 172.21.15.124:0/2123944910 >> v1:172.21.15.192:6789/0 conn(0x7fa3c80af290 legacy=0x7fa3c815b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:03.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.175+0000 7fa3cda44700 1 -- 172.21.15.124:0/2123944910 >> v1:172.21.15.124:6789/0 conn(0x7fa3c80717e0 legacy=0x7fa3c8071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:03.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.175+0000 7fa3cda44700 1 -- 172.21.15.124:0/2123944910 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c815ac80 con 0x7fa3c815b8b0 2023-10-16T12:59:03.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.176+0000 7fa3cda44700 1 --2- 172.21.15.124:0/2123944910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3c815b8b0 0x7fa3c806df10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0009dc0 tx=0x7fa3c000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61b10b1ed5df7ec4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:03.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.176+0000 7fa3bffff700 1 -- 172.21.15.124:0/2123944910 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c000e070 con 0x7fa3c815b8b0 2023-10-16T12:59:03.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.176+0000 7fa3bffff700 1 -- 172.21.15.124:0/2123944910 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c000bb20 con 0x7fa3c815b8b0 2023-10-16T12:59:03.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.176+0000 7fa3bffff700 1 -- 172.21.15.124:0/2123944910 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0012430 con 0x7fa3c815b8b0 2023-10-16T12:59:03.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.176+0000 7fa3cf4a7700 1 -- 172.21.15.124:0/2123944910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3c815b8b0 msgr2=0x7fa3c806df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:03.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.176+0000 7fa3cf4a7700 1 --2- 172.21.15.124:0/2123944910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3c815b8b0 0x7fa3c806df10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0009dc0 tx=0x7fa3c000b330 comp rx=0 tx=0).stop 2023-10-16T12:59:03.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.176+0000 7fa3cf4a7700 1 -- 172.21.15.124:0/2123944910 shutdown_connections 2023-10-16T12:59:03.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.176+0000 7fa3cf4a7700 1 --2- 172.21.15.124:0/2123944910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3c815b8b0 0x7fa3c806df10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:03.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.176+0000 7fa3cf4a7700 1 -- 172.21.15.124:0/2123944910 >> 172.21.15.124:0/2123944910 conn(0x7fa3c80d0180 msgr2=0x7fa3c80d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:03.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.176+0000 7fa3cf4a7700 1 -- 172.21.15.124:0/2123944910 shutdown_connections 2023-10-16T12:59:03.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.176+0000 7fa3cf4a7700 1 -- 172.21.15.124:0/2123944910 wait complete. 2023-10-16T12:59:03.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.178+0000 7fa3cf4a7700 1 Processor -- start 2023-10-16T12:59:03.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.178+0000 7fa3cf4a7700 1 -- start start 2023-10-16T12:59:03.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.178+0000 7fa3cf4a7700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3c80717e0 0x7fa3c81eff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:03.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.178+0000 7fa3cf4a7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3c80af290 0x7fa3c80b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:03.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.178+0000 7fa3cf4a7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3c80b0cf0 0x7fa3c81f37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:03.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.178+0000 7fa3cf4a7700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c80b1170 con 0x7fa3c80717e0 2023-10-16T12:59:03.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.178+0000 7fa3cf4a7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c81f04b0 con 0x7fa3c80af290 2023-10-16T12:59:03.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.178+0000 7fa3cf4a7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c81f06e0 con 0x7fa3c80b0cf0 2023-10-16T12:59:03.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.178+0000 7fa3cd243700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3c80717e0 0x7fa3c81eff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:03.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.178+0000 7fa3cd243700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3c80717e0 0x7fa3c81eff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53306/0 (socket says 172.21.15.124:53306) 2023-10-16T12:59:03.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.178+0000 7fa3cd243700 1 -- 172.21.15.124:0/2938875683 learned_addr learned my addr 172.21.15.124:0/2938875683 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:03.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.179+0000 7fa3cda44700 1 --2- 172.21.15.124:0/2938875683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3c80b0cf0 0x7fa3c81f37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:03.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.179+0000 7fa3cca42700 1 --2- 172.21.15.124:0/2938875683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3c80af290 0x7fa3c80b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:03.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.179+0000 7fa3cd243700 1 -- 172.21.15.124:0/2938875683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3c80b0cf0 msgr2=0x7fa3c81f37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:03.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.179+0000 7fa3cd243700 1 --2- 172.21.15.124:0/2938875683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3c80b0cf0 0x7fa3c81f37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:03.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.179+0000 7fa3cd243700 1 -- 172.21.15.124:0/2938875683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3c80af290 msgr2=0x7fa3c80b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:03.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.179+0000 7fa3cd243700 1 --2- 172.21.15.124:0/2938875683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3c80af290 0x7fa3c80b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:03.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.179+0000 7fa3cd243700 1 -- 172.21.15.124:0/2938875683 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c0009a70 con 0x7fa3c80717e0 2023-10-16T12:59:03.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.179+0000 7fa3cda44700 1 --2- 172.21.15.124:0/2938875683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3c80b0cf0 0x7fa3c81f37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:03.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.179+0000 7fa3cca42700 1 --2- 172.21.15.124:0/2938875683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3c80af290 0x7fa3c80b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:03.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.179+0000 7fa3cd243700 1 --2- 172.21.15.124:0/2938875683 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3c80717e0 0x7fa3c81eff70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa3c400c700 tx=0x7fa3c400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:03.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.179+0000 7fa3bdffb700 1 -- 172.21.15.124:0/2938875683 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c4005d70 con 0x7fa3c80717e0 2023-10-16T12:59:03.192 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.179+0000 7fa3bdffb700 1 -- 172.21.15.124:0/2938875683 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c40070d0 con 0x7fa3c80717e0 2023-10-16T12:59:03.192 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.179+0000 7fa3cf4a7700 1 -- 172.21.15.124:0/2938875683 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c81f09c0 con 0x7fa3c80717e0 2023-10-16T12:59:03.192 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.179+0000 7fa3bdffb700 1 -- 172.21.15.124:0/2938875683 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c4007460 con 0x7fa3c80717e0 2023-10-16T12:59:03.192 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.179+0000 7fa3cf4a7700 1 -- 172.21.15.124:0/2938875683 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c80b2f20 con 0x7fa3c80717e0 2023-10-16T12:59:03.192 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.180+0000 7fa3cf4a7700 1 -- 172.21.15.124:0/2938875683 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c81f0ee0 con 0x7fa3c80717e0 2023-10-16T12:59:03.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.180+0000 7fa3bdffb700 1 -- 172.21.15.124:0/2938875683 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa3c40075c0 con 0x7fa3c80717e0 2023-10-16T12:59:03.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.181+0000 7fa3bdffb700 1 --2- 172.21.15.124:0/2938875683 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa3ac06af00 0x7fa3ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:03.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.181+0000 7fa3bdffb700 1 -- 172.21.15.124:0/2938875683 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa3c4088ea0 con 0x7fa3c80717e0 2023-10-16T12:59:03.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.181+0000 7fa3cca42700 1 --2- 172.21.15.124:0/2938875683 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa3ac06af00 0x7fa3ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:03.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.181+0000 7fa3cca42700 1 --2- 172.21.15.124:0/2938875683 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa3ac06af00 0x7fa3ac06d3c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa3c809e0f0 tx=0x7fa3b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:03.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.185+0000 7fa3bdffb700 1 -- 172.21.15.124:0/2938875683 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa3c4053c70 con 0x7fa3c80717e0 2023-10-16T12:59:03.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.373+0000 7fa3cf4a7700 1 -- 172.21.15.124:0/2938875683 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa3c80b3140 con 0x7fa3c80717e0 2023-10-16T12:59:03.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.373+0000 7fa3bdffb700 1 -- 172.21.15.124:0/2938875683 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa3c4057290 con 0x7fa3c80717e0 2023-10-16T12:59:03.376 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:03.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.376+0000 7fa3cf4a7700 1 -- 172.21.15.124:0/2938875683 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa3ac06af00 msgr2=0x7fa3ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:03.379 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.376+0000 7fa3cf4a7700 1 --2- 172.21.15.124:0/2938875683 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa3ac06af00 0x7fa3ac06d3c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa3c809e0f0 tx=0x7fa3b8009040 comp rx=0 tx=0).stop 2023-10-16T12:59:03.379 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.376+0000 7fa3cf4a7700 1 -- 172.21.15.124:0/2938875683 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3c80717e0 msgr2=0x7fa3c81eff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:03.379 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.376+0000 7fa3cf4a7700 1 --2- 172.21.15.124:0/2938875683 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3c80717e0 0x7fa3c81eff70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa3c400c700 tx=0x7fa3c400cac0 comp rx=0 tx=0).stop 2023-10-16T12:59:03.379 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.376+0000 7fa3cf4a7700 1 -- 172.21.15.124:0/2938875683 shutdown_connections 2023-10-16T12:59:03.379 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.376+0000 7fa3cf4a7700 1 --2- 172.21.15.124:0/2938875683 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa3ac06af00 0x7fa3ac06d3c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:03.380 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.376+0000 7fa3cf4a7700 1 --2- 172.21.15.124:0/2938875683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3c80b0cf0 0x7fa3c81f37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:03.380 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.376+0000 7fa3cf4a7700 1 --2- 172.21.15.124:0/2938875683 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3c80717e0 0x7fa3c81eff70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:03.380 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.376+0000 7fa3cf4a7700 1 --2- 172.21.15.124:0/2938875683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3c80af290 0x7fa3c80b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:03.380 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.376+0000 7fa3cf4a7700 1 -- 172.21.15.124:0/2938875683 >> 172.21.15.124:0/2938875683 conn(0x7fa3c80d0180 msgr2=0x7fa3c815b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:03.380 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.376+0000 7fa3cf4a7700 1 -- 172.21.15.124:0/2938875683 shutdown_connections 2023-10-16T12:59:03.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.376+0000 7fa3cf4a7700 1 -- 172.21.15.124:0/2938875683 wait complete. 2023-10-16T12:59:03.390 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T12:59:03.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.509+0000 7f86644ff700 1 Processor -- start 2023-10-16T12:59:03.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.509+0000 7f86644ff700 1 -- start start 2023-10-16T12:59:03.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.510+0000 7f86644ff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f865c071cb0 0x7f865c06d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:03.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.510+0000 7f86644ff700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f865c15ed10 con 0x7f865c15daa0 2023-10-16T12:59:03.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.510+0000 7f86644ff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f865c15de80 con 0x7f865c071850 2023-10-16T12:59:03.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.510+0000 7f86644ff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f865c15e100 con 0x7f865c071cb0 2023-10-16T12:59:03.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.511+0000 7f866229b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f865c15daa0 0x7f865c0af020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:41982/0 (socket says 172.21.15.124:41982) 2023-10-16T12:59:03.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.511+0000 7f866229b700 1 -- 172.21.15.124:0/531337011 learned_addr learned my addr 172.21.15.124:0/531337011 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:03.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.511+0000 7f8662a9c700 1 --2- 172.21.15.124:0/531337011 >> v2:172.21.15.192:3300/0 conn(0x7f865c071cb0 0x7f865c06d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:03.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.511+0000 7f8661299700 1 -- 172.21.15.124:0/531337011 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190865221 0 0) 0x7f865c15ed10 con 0x7f865c15daa0 2023-10-16T12:59:03.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.511+0000 7f8661299700 1 -- 172.21.15.124:0/531337011 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86480035b0 con 0x7f865c15daa0 2023-10-16T12:59:03.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.511+0000 7f8662a9c700 1 -- 172.21.15.124:0/531337011 >> v1:172.21.15.192:6789/0 conn(0x7f865c071850 legacy=0x7f865c06d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:03.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.511+0000 7f8662a9c700 1 -- 172.21.15.124:0/531337011 >> v1:172.21.15.124:6789/0 conn(0x7f865c15daa0 legacy=0x7f865c0af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:03.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.511+0000 7f8662a9c700 1 -- 172.21.15.124:0/531337011 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c15e3e0 con 0x7f865c071cb0 2023-10-16T12:59:03.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.511+0000 7f8662a9c700 1 --2- 172.21.15.124:0/531337011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f865c071cb0 0x7f865c06d810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8654009d90 tx=0x7f865400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4246f67578d4274 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:03.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.511+0000 7f8661299700 1 -- 172.21.15.124:0/531337011 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865400e070 con 0x7f865c071cb0 2023-10-16T12:59:03.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.511+0000 7f8661299700 1 -- 172.21.15.124:0/531337011 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865400bb20 con 0x7f865c071cb0 2023-10-16T12:59:03.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.511+0000 7f8661299700 1 -- 172.21.15.124:0/531337011 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654012430 con 0x7f865c071cb0 2023-10-16T12:59:03.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.512+0000 7f86644ff700 1 -- 172.21.15.124:0/531337011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f865c071cb0 msgr2=0x7f865c06d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:03.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.512+0000 7f86644ff700 1 --2- 172.21.15.124:0/531337011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f865c071cb0 0x7f865c06d810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8654009d90 tx=0x7f865400b330 comp rx=0 tx=0).stop 2023-10-16T12:59:03.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.512+0000 7f86644ff700 1 -- 172.21.15.124:0/531337011 shutdown_connections 2023-10-16T12:59:03.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.512+0000 7f86644ff700 1 --2- 172.21.15.124:0/531337011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f865c071cb0 0x7f865c06d810 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:03.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.512+0000 7f86644ff700 1 -- 172.21.15.124:0/531337011 >> 172.21.15.124:0/531337011 conn(0x7f865c0d0180 msgr2=0x7f865c0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:03.519 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.512+0000 7f86644ff700 1 -- 172.21.15.124:0/531337011 shutdown_connections 2023-10-16T12:59:03.519 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.512+0000 7f86644ff700 1 -- 172.21.15.124:0/531337011 wait complete. 2023-10-16T12:59:03.525 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.513+0000 7f86644ff700 1 Processor -- start 2023-10-16T12:59:03.525 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.513+0000 7f86644ff700 1 -- start start 2023-10-16T12:59:03.525 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.514+0000 7f86644ff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f865c071850 0x7f865c1568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:03.526 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.514+0000 7f86644ff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f865c071cb0 0x7f865c0c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:03.526 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.514+0000 7f86644ff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f865c15daa0 0x7f865c1582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:03.526 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.514+0000 7f86644ff700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c15a680 con 0x7f865c071850 2023-10-16T12:59:03.526 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.514+0000 7f86644ff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c0c95c0 con 0x7f865c15daa0 2023-10-16T12:59:03.527 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.514+0000 7f86644ff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865c156de0 con 0x7f865c071cb0 2023-10-16T12:59:03.527 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.514+0000 7f866229b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f865c071850 0x7f865c1568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:03.527 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.514+0000 7f866229b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f865c071850 0x7f865c1568a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53320/0 (socket says 172.21.15.124:53320) 2023-10-16T12:59:03.527 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.514+0000 7f866229b700 1 -- 172.21.15.124:0/3415257099 learned_addr learned my addr 172.21.15.124:0/3415257099 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:03.527 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.515+0000 7f8662a9c700 1 --2- 172.21.15.124:0/3415257099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f865c15daa0 0x7f865c1582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:03.528 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.515+0000 7f8661a9a700 1 --2- 172.21.15.124:0/3415257099 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f865c071cb0 0x7f865c0c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:03.528 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.515+0000 7f866229b700 1 -- 172.21.15.124:0/3415257099 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f865c071cb0 msgr2=0x7f865c0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:03.528 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.515+0000 7f866229b700 1 --2- 172.21.15.124:0/3415257099 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f865c071cb0 0x7f865c0c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:03.528 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.515+0000 7f866229b700 1 -- 172.21.15.124:0/3415257099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f865c15daa0 msgr2=0x7f865c1582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:03.529 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.515+0000 7f866229b700 1 --2- 172.21.15.124:0/3415257099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f865c15daa0 0x7f865c1582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:03.529 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.515+0000 7f866229b700 1 -- 172.21.15.124:0/3415257099 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8654009a70 con 0x7f865c071850 2023-10-16T12:59:03.529 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.515+0000 7f8661a9a700 1 --2- 172.21.15.124:0/3415257099 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f865c071cb0 0x7f865c0c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:03.529 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.515+0000 7f866229b700 1 --2- 172.21.15.124:0/3415257099 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f865c071850 0x7f865c1568a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f864c00e910 tx=0x7f864c00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:03.530 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.515+0000 7f8652ffd700 1 -- 172.21.15.124:0/3415257099 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c005b40 con 0x7f865c071850 2023-10-16T12:59:03.530 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.515+0000 7f8652ffd700 1 -- 172.21.15.124:0/3415257099 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c005ca0 con 0x7f865c071850 2023-10-16T12:59:03.530 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.515+0000 7f86644ff700 1 -- 172.21.15.124:0/3415257099 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f865c0c7790 con 0x7f865c071850 2023-10-16T12:59:03.531 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.515+0000 7f8652ffd700 1 -- 172.21.15.124:0/3415257099 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c00ca20 con 0x7f865c071850 2023-10-16T12:59:03.531 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.515+0000 7f86644ff700 1 -- 172.21.15.124:0/3415257099 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f865c0c7d10 con 0x7f865c071850 2023-10-16T12:59:03.531 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.516+0000 7f86644ff700 1 -- 172.21.15.124:0/3415257099 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f865c04ebb0 con 0x7f865c071850 2023-10-16T12:59:03.531 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.517+0000 7f8652ffd700 1 -- 172.21.15.124:0/3415257099 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f864c00cb80 con 0x7f865c071850 2023-10-16T12:59:03.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.517+0000 7f8652ffd700 1 --2- 172.21.15.124:0/3415257099 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f864006af00 0x7f864006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:03.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.517+0000 7f8652ffd700 1 -- 172.21.15.124:0/3415257099 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f864c08ba60 con 0x7f865c071850 2023-10-16T12:59:03.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.517+0000 7f8661a9a700 1 --2- 172.21.15.124:0/3415257099 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f864006af00 0x7f864006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:03.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.517+0000 7f8661a9a700 1 --2- 172.21.15.124:0/3415257099 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f864006af00 0x7f864006d3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f865c0b59b0 tx=0x7f8658009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:03.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.521+0000 7f8652ffd700 1 -- 172.21.15.124:0/3415257099 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f864c056820 con 0x7f865c071850 2023-10-16T12:59:03.735 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.733+0000 7f86644ff700 1 -- 172.21.15.124:0/3415257099 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f865c0cf6e0 con 0x7f865c071850 2023-10-16T12:59:03.736 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.733+0000 7f8652ffd700 1 -- 172.21.15.124:0/3415257099 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f864c059e40 con 0x7f865c071850 2023-10-16T12:59:03.738 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.735+0000 7f86644ff700 1 -- 172.21.15.124:0/3415257099 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f864006af00 msgr2=0x7f864006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:03.738 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.735+0000 7f86644ff700 1 --2- 172.21.15.124:0/3415257099 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f864006af00 0x7f864006d3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f865c0b59b0 tx=0x7f8658009040 comp rx=0 tx=0).stop 2023-10-16T12:59:03.739 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.735+0000 7f86644ff700 1 -- 172.21.15.124:0/3415257099 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f865c071850 msgr2=0x7f865c1568a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:03.739 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.735+0000 7f86644ff700 1 --2- 172.21.15.124:0/3415257099 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f865c071850 0x7f865c1568a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f864c00e910 tx=0x7f864c00ec20 comp rx=0 tx=0).stop 2023-10-16T12:59:03.739 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.735+0000 7f86644ff700 1 -- 172.21.15.124:0/3415257099 shutdown_connections 2023-10-16T12:59:03.739 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.735+0000 7f86644ff700 1 --2- 172.21.15.124:0/3415257099 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f864006af00 0x7f864006d3c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:03.740 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.735+0000 7f86644ff700 1 --2- 172.21.15.124:0/3415257099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f865c15daa0 0x7f865c1582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:03.740 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.735+0000 7f86644ff700 1 --2- 172.21.15.124:0/3415257099 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f865c071850 0x7f865c1568a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:03.740 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.735+0000 7f86644ff700 1 --2- 172.21.15.124:0/3415257099 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f865c071cb0 0x7f865c0c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:03.740 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.736+0000 7f86644ff700 1 -- 172.21.15.124:0/3415257099 >> 172.21.15.124:0/3415257099 conn(0x7f865c0d0180 msgr2=0x7f865c0cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:03.740 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.736+0000 7f86644ff700 1 -- 172.21.15.124:0/3415257099 shutdown_connections 2023-10-16T12:59:03.741 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.736+0000 7f86644ff700 1 -- 172.21.15.124:0/3415257099 wait complete. 2023-10-16T12:59:03.741 INFO:teuthology.orchestra.run.smithi124.stderr:listed 0 entries 2023-10-16T12:59:03.750 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:59:03.751 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:59:03.768 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:59:03.928 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.925+0000 7f3ff0c97700 1 Processor -- start 2023-10-16T12:59:03.928 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.925+0000 7f3ff0c97700 1 -- start start 2023-10-16T12:59:03.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.926+0000 7f3ff0c97700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fec06a820 0x7f3fec0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:03.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.926+0000 7f3ff0c97700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3fec15e7f0 0x7f3fec06ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:03.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.926+0000 7f3ff0c97700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fec0cfeb0 con 0x7f3fec0ca7d0 2023-10-16T12:59:03.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.926+0000 7f3ff0c97700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fec0ce410 con 0x7f3fec15e7f0 2023-10-16T12:59:03.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.926+0000 7f3ff0c97700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec15ec70 con 0x7f3fec06a820 2023-10-16T12:59:03.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.926+0000 7f3fe9d9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3fec15e7f0 0x7f3fec06ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:03.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.926+0000 7f3fead9d700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f3fec0ca7d0 0x7f3fec071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42004/0 (socket says 172.21.15.124:42004) 2023-10-16T12:59:03.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.926+0000 7f3fe9d9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3fec15e7f0 0x7f3fec06ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53332/0 (socket says 172.21.15.124:53332) 2023-10-16T12:59:03.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.926+0000 7f3fead9d700 1 -- 172.21.15.124:0/3862027346 learned_addr learned my addr 172.21.15.124:0/3862027346 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:03.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.926+0000 7f3fea59c700 1 --2- 172.21.15.124:0/3862027346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fec06a820 0x7f3fec0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:03.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.926+0000 7f3fe9d9b700 1 -- 172.21.15.124:0/3862027346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fec06a820 msgr2=0x7f3fec0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:03.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.926+0000 7f3fe9d9b700 1 --2- 172.21.15.124:0/3862027346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fec06a820 0x7f3fec0cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:03.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.926+0000 7f3fe9d9b700 1 -- 172.21.15.124:0/3862027346 >> v1:172.21.15.124:6789/0 conn(0x7f3fec0ca7d0 legacy=0x7f3fec071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:03.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.926+0000 7f3fe959a700 1 -- 172.21.15.124:0/3862027346 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226537694 0 0) 0x7f3fec0cfeb0 con 0x7f3fec0ca7d0 2023-10-16T12:59:03.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.927+0000 7f3fe9d9b700 1 -- 172.21.15.124:0/3862027346 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec0af9d0 con 0x7f3fec15e7f0 2023-10-16T12:59:03.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.927+0000 7f3fe9d9b700 1 --2- 172.21.15.124:0/3862027346 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fec15e7f0 0x7f3fec06ac00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc009840 tx=0x7f3fdc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc787d21a2df6058 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:03.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.927+0000 7f3fe959a700 1 -- 172.21.15.124:0/3862027346 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc011830 con 0x7f3fec15e7f0 2023-10-16T12:59:03.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.927+0000 7f3fe959a700 1 -- 172.21.15.124:0/3862027346 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc011990 con 0x7f3fec15e7f0 2023-10-16T12:59:03.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.927+0000 7f3fe959a700 1 -- 172.21.15.124:0/3862027346 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc011d20 con 0x7f3fec15e7f0 2023-10-16T12:59:03.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.927+0000 7f3ff0c97700 1 -- 172.21.15.124:0/3862027346 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fec15e7f0 msgr2=0x7f3fec06ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:03.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.927+0000 7f3ff0c97700 1 --2- 172.21.15.124:0/3862027346 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fec15e7f0 0x7f3fec06ac00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc009840 tx=0x7f3fdc009b50 comp rx=0 tx=0).stop 2023-10-16T12:59:03.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.927+0000 7f3ff0c97700 1 -- 172.21.15.124:0/3862027346 shutdown_connections 2023-10-16T12:59:03.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.927+0000 7f3ff0c97700 1 --2- 172.21.15.124:0/3862027346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fec06a820 0x7f3fec0cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:03.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.927+0000 7f3ff0c97700 1 --2- 172.21.15.124:0/3862027346 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fec15e7f0 0x7f3fec06ac00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:03.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.927+0000 7f3ff0c97700 1 -- 172.21.15.124:0/3862027346 >> 172.21.15.124:0/3862027346 conn(0x7f3fec0d0180 msgr2=0x7f3fec0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:03.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.927+0000 7f3ff0c97700 1 -- 172.21.15.124:0/3862027346 shutdown_connections 2023-10-16T12:59:03.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.927+0000 7f3ff0c97700 1 -- 172.21.15.124:0/3862027346 wait complete. 2023-10-16T12:59:03.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.929+0000 7f3ff0c97700 1 Processor -- start 2023-10-16T12:59:03.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.929+0000 7f3ff0c97700 1 -- start start 2023-10-16T12:59:03.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.929+0000 7f3ff0c97700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fec06a820 0x7f3fec160b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:03.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.929+0000 7f3ff0c97700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fec0ca7d0 0x7f3fec156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:03.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.929+0000 7f3ff0c97700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fec15e7f0 0x7f3fec0b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:03.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.930+0000 7f3ff0c97700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec0ad8a0 con 0x7f3fec0ca7d0 2023-10-16T12:59:03.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.930+0000 7f3ff0c97700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec15fff0 con 0x7f3fec15e7f0 2023-10-16T12:59:03.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.930+0000 7f3ff0c97700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec0adb40 con 0x7f3fec06a820 2023-10-16T12:59:03.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.930+0000 7f3fe9d9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fec0ca7d0 0x7f3fec156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:03.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.930+0000 7f3fe9d9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fec0ca7d0 0x7f3fec156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53340/0 (socket says 172.21.15.124:53340) 2023-10-16T12:59:03.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.930+0000 7f3fe9d9b700 1 -- 172.21.15.124:0/2218555063 learned_addr learned my addr 172.21.15.124:0/2218555063 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:03.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.930+0000 7f3fea59c700 1 --2- 172.21.15.124:0/2218555063 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fec06a820 0x7f3fec160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:03.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.930+0000 7f3fead9d700 1 --2- 172.21.15.124:0/2218555063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fec15e7f0 0x7f3fec0b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:03.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.930+0000 7f3fe9d9b700 1 -- 172.21.15.124:0/2218555063 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fec06a820 msgr2=0x7f3fec160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:03.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.930+0000 7f3fe9d9b700 1 --2- 172.21.15.124:0/2218555063 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fec06a820 0x7f3fec160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:03.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.930+0000 7f3fe9d9b700 1 -- 172.21.15.124:0/2218555063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fec15e7f0 msgr2=0x7f3fec0b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:03.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.930+0000 7f3fe9d9b700 1 --2- 172.21.15.124:0/2218555063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fec15e7f0 0x7f3fec0b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:03.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.930+0000 7f3fe9d9b700 1 -- 172.21.15.124:0/2218555063 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc0094a0 con 0x7f3fec0ca7d0 2023-10-16T12:59:03.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.930+0000 7f3fea59c700 1 --2- 172.21.15.124:0/2218555063 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fec06a820 0x7f3fec160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:03.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.930+0000 7f3fead9d700 1 --2- 172.21.15.124:0/2218555063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fec15e7f0 0x7f3fec0b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:03.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.930+0000 7f3fe9d9b700 1 --2- 172.21.15.124:0/2218555063 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fec0ca7d0 0x7f3fec156aa0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc014040 tx=0x7f3fdc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:03.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.930+0000 7f3fdaffd700 1 -- 172.21.15.124:0/2218555063 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0038a0 con 0x7f3fec0ca7d0 2023-10-16T12:59:03.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.930+0000 7f3fdaffd700 1 -- 172.21.15.124:0/2218555063 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc01e070 con 0x7f3fec0ca7d0 2023-10-16T12:59:03.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.930+0000 7f3ff0c97700 1 -- 172.21.15.124:0/2218555063 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fec0ade20 con 0x7f3fec0ca7d0 2023-10-16T12:59:03.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.930+0000 7f3fdaffd700 1 -- 172.21.15.124:0/2218555063 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc003c20 con 0x7f3fec0ca7d0 2023-10-16T12:59:03.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.930+0000 7f3ff0c97700 1 -- 172.21.15.124:0/2218555063 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fec156fe0 con 0x7f3fec0ca7d0 2023-10-16T12:59:03.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.931+0000 7f3ff0c97700 1 -- 172.21.15.124:0/2218555063 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fec04ebb0 con 0x7f3fec0ca7d0 2023-10-16T12:59:03.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.932+0000 7f3fdaffd700 1 -- 172.21.15.124:0/2218555063 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3fdc02d450 con 0x7f3fec0ca7d0 2023-10-16T12:59:03.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.932+0000 7f3fdaffd700 1 --2- 172.21.15.124:0/2218555063 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f3fcc06af00 0x7f3fcc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:03.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.932+0000 7f3fdaffd700 1 -- 172.21.15.124:0/2218555063 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3fdc08a900 con 0x7f3fec0ca7d0 2023-10-16T12:59:03.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.932+0000 7f3fea59c700 1 --2- 172.21.15.124:0/2218555063 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f3fcc06af00 0x7f3fcc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:03.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.933+0000 7f3fea59c700 1 --2- 172.21.15.124:0/2218555063 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f3fcc06af00 0x7f3fcc06d3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00099f0 tx=0x7f3fe0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:03.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:03.936+0000 7f3fdaffd700 1 -- 172.21.15.124:0/2218555063 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3fdc055750 con 0x7f3fec0ca7d0 2023-10-16T12:59:04.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.128+0000 7f3ff0c97700 1 -- 172.21.15.124:0/2218555063 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fec06b490 con 0x7f3fec0ca7d0 2023-10-16T12:59:04.132 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.129+0000 7f3fdaffd700 1 -- 172.21.15.124:0/2218555063 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f3fdc020090 con 0x7f3fec0ca7d0 2023-10-16T12:59:04.132 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:04.132 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":24,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:58:56.089767+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:59:04.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.131+0000 7f3ff0c97700 1 -- 172.21.15.124:0/2218555063 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f3fcc06af00 msgr2=0x7f3fcc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:04.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.131+0000 7f3ff0c97700 1 --2- 172.21.15.124:0/2218555063 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f3fcc06af00 0x7f3fcc06d3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00099f0 tx=0x7f3fe0008040 comp rx=0 tx=0).stop 2023-10-16T12:59:04.135 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.131+0000 7f3ff0c97700 1 -- 172.21.15.124:0/2218555063 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fec0ca7d0 msgr2=0x7f3fec156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:04.135 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.131+0000 7f3ff0c97700 1 --2- 172.21.15.124:0/2218555063 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fec0ca7d0 0x7f3fec156aa0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc014040 tx=0x7f3fdc004750 comp rx=0 tx=0).stop 2023-10-16T12:59:04.135 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.131+0000 7f3ff0c97700 1 -- 172.21.15.124:0/2218555063 shutdown_connections 2023-10-16T12:59:04.135 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.131+0000 7f3ff0c97700 1 --2- 172.21.15.124:0/2218555063 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f3fcc06af00 0x7f3fcc06d3c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.135 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.131+0000 7f3ff0c97700 1 --2- 172.21.15.124:0/2218555063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fec15e7f0 0x7f3fec0b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.131+0000 7f3ff0c97700 1 --2- 172.21.15.124:0/2218555063 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fec06a820 0x7f3fec160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.131+0000 7f3ff0c97700 1 --2- 172.21.15.124:0/2218555063 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fec0ca7d0 0x7f3fec156aa0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.131+0000 7f3ff0c97700 1 -- 172.21.15.124:0/2218555063 >> 172.21.15.124:0/2218555063 conn(0x7f3fec0d0180 msgr2=0x7f3fec0cb680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:04.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.131+0000 7f3ff0c97700 1 -- 172.21.15.124:0/2218555063 shutdown_connections 2023-10-16T12:59:04.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.131+0000 7f3ff0c97700 1 -- 172.21.15.124:0/2218555063 wait complete. 2023-10-16T12:59:04.146 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T12:58:38.667813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T12:58:49.562073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T12:58:50.011419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T12:58:53.692890+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T12:59:04.147 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T12:59:04.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.267+0000 7f5a2a873700 1 Processor -- start 2023-10-16T12:59:04.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.267+0000 7f5a2a873700 1 -- start start 2023-10-16T12:59:04.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.268+0000 7f5a2a873700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a240ce440 0x7f5a2415dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:04.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.268+0000 7f5a2a873700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a24161360 con 0x7f5a2406a820 2023-10-16T12:59:04.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.268+0000 7f5a2a873700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a2406b750 con 0x7f5a2406b370 2023-10-16T12:59:04.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.268+0000 7f5a2a873700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2406dcc0 con 0x7f5a240ce440 2023-10-16T12:59:04.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.268+0000 7f5a237fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f5a2406a820 0x7f5a240cdd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42014/0 (socket says 172.21.15.124:42014) 2023-10-16T12:59:04.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.268+0000 7f5a237fe700 1 -- 172.21.15.124:0/4003637196 learned_addr learned my addr 172.21.15.124:0/4003637196 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:04.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.268+0000 7f5a22ffd700 1 -- 172.21.15.124:0/4003637196 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2533476538 0 0) 0x7f5a24161360 con 0x7f5a2406a820 2023-10-16T12:59:04.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.268+0000 7f5a28e10700 1 --2- 172.21.15.124:0/4003637196 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a240ce440 0x7f5a2415dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:04.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.268+0000 7f5a22ffd700 1 -- 172.21.15.124:0/4003637196 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a100035b0 con 0x7f5a2406a820 2023-10-16T12:59:04.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a22ffd700 1 -- 172.21.15.124:0/4003637196 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1311686923 0 0) 0x7f5a100035b0 con 0x7f5a2406a820 2023-10-16T12:59:04.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a22ffd700 1 -- 172.21.15.124:0/4003637196 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a240ce440 msgr2=0x7f5a2415dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:04.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a22ffd700 1 --2- 172.21.15.124:0/4003637196 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a240ce440 0x7f5a2415dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a22ffd700 1 -- 172.21.15.124:0/4003637196 >> v1:172.21.15.192:6789/0 conn(0x7f5a2406b370 legacy=0x7f5a2406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:04.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a22ffd700 1 -- 172.21.15.124:0/4003637196 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2415e300 con 0x7f5a2406a820 2023-10-16T12:59:04.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a22ffd700 1 -- 172.21.15.124:0/4003637196 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f5a14001670 con 0x7f5a2406a820 2023-10-16T12:59:04.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a22ffd700 1 -- 172.21.15.124:0/4003637196 >> v1:172.21.15.124:6789/0 conn(0x7f5a2406a820 legacy=0x7f5a240cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:04.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a22ffd700 1 --2- 172.21.15.124:0/4003637196 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5a10003a30 0x7f5a10003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:04.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a22ffd700 1 --2- 172.21.15.124:0/4003637196 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a240ce440 0x7f5a10004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:04.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a22ffd700 1 --2- 172.21.15.124:0/4003637196 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a10004d90 0x7f5a10005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:04.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a22ffd700 1 -- 172.21.15.124:0/4003637196 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2406dcc0 con 0x7f5a10003a30 2023-10-16T12:59:04.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a22ffd700 1 -- 172.21.15.124:0/4003637196 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1000baf0 con 0x7f5a10004d90 2023-10-16T12:59:04.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a22ffd700 1 -- 172.21.15.124:0/4003637196 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1000bcb0 con 0x7f5a240ce440 2023-10-16T12:59:04.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a23fff700 1 --2- 172.21.15.124:0/4003637196 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5a10003a30 0x7f5a10003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:04.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a237fe700 1 --2- 172.21.15.124:0/4003637196 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a240ce440 0x7f5a10004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:04.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a28e10700 1 --2- 172.21.15.124:0/4003637196 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a10004d90 0x7f5a10005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:04.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a23fff700 1 -- 172.21.15.124:0/4003637196 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a240ce440 msgr2=0x7f5a10004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:04.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a23fff700 1 --2- 172.21.15.124:0/4003637196 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a240ce440 0x7f5a10004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a23fff700 1 -- 172.21.15.124:0/4003637196 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a10004d90 msgr2=0x7f5a10005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:04.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a23fff700 1 --2- 172.21.15.124:0/4003637196 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a10004d90 0x7f5a10005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a23fff700 1 -- 172.21.15.124:0/4003637196 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a100035b0 con 0x7f5a10003a30 2023-10-16T12:59:04.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a23fff700 1 --2- 172.21.15.124:0/4003637196 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5a10003a30 0x7f5a10003e50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c007fd0 tx=0x7f5a10005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d7a7ac57268307 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:04.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a22ffd700 1 -- 172.21.15.124:0/4003637196 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c0012f0 con 0x7f5a10003a30 2023-10-16T12:59:04.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a22ffd700 1 -- 172.21.15.124:0/4003637196 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0c0052f0 con 0x7f5a10003a30 2023-10-16T12:59:04.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.269+0000 7f5a22ffd700 1 -- 172.21.15.124:0/4003637196 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c006860 con 0x7f5a10003a30 2023-10-16T12:59:04.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.270+0000 7f5a2a873700 1 -- 172.21.15.124:0/4003637196 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5a10003a30 msgr2=0x7f5a10003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:04.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.270+0000 7f5a2a873700 1 --2- 172.21.15.124:0/4003637196 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5a10003a30 0x7f5a10003e50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c007fd0 tx=0x7f5a10005880 comp rx=0 tx=0).stop 2023-10-16T12:59:04.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.270+0000 7f5a28e10700 1 -- 172.21.15.124:0/4003637196 reap_dead start 2023-10-16T12:59:04.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.270+0000 7f5a2a873700 1 -- 172.21.15.124:0/4003637196 shutdown_connections 2023-10-16T12:59:04.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.270+0000 7f5a2a873700 1 -- 172.21.15.124:0/4003637196 >> 172.21.15.124:0/4003637196 conn(0x7f5a240ccbe0 msgr2=0x7f5a240ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:04.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.270+0000 7f5a2a873700 1 -- 172.21.15.124:0/4003637196 shutdown_connections 2023-10-16T12:59:04.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.270+0000 7f5a2a873700 1 -- 172.21.15.124:0/4003637196 wait complete. 2023-10-16T12:59:04.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.271+0000 7f5a2a873700 1 Processor -- start 2023-10-16T12:59:04.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.271+0000 7f5a2a873700 1 -- start start 2023-10-16T12:59:04.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.272+0000 7f5a2a873700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a10003a30 0x7f5a24155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:04.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.272+0000 7f5a2a873700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5a240b55c0 0x7f5a241e7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:04.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.272+0000 7f5a2a873700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a241e7a70 0x7f5a2415d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:04.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.272+0000 7f5a2a873700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a241e7f20 con 0x7f5a240b55c0 2023-10-16T12:59:04.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.272+0000 7f5a2a873700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a24156d10 con 0x7f5a241e7a70 2023-10-16T12:59:04.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.272+0000 7f5a2a873700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a240b4520 con 0x7f5a10003a30 2023-10-16T12:59:04.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.272+0000 7f5a237fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5a240b55c0 0x7f5a241e7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:04.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.272+0000 7f5a237fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5a240b55c0 0x7f5a241e7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53362/0 (socket says 172.21.15.124:53362) 2023-10-16T12:59:04.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.272+0000 7f5a237fe700 1 -- 172.21.15.124:0/2986627537 learned_addr learned my addr 172.21.15.124:0/2986627537 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:04.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.272+0000 7f5a28e10700 1 --2- 172.21.15.124:0/2986627537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a241e7a70 0x7f5a2415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:04.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.272+0000 7f5a23fff700 1 --2- 172.21.15.124:0/2986627537 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a10003a30 0x7f5a24155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:04.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.273+0000 7f5a237fe700 1 -- 172.21.15.124:0/2986627537 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a10003a30 msgr2=0x7f5a24155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:04.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.273+0000 7f5a237fe700 1 --2- 172.21.15.124:0/2986627537 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a10003a30 0x7f5a24155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.273+0000 7f5a237fe700 1 -- 172.21.15.124:0/2986627537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a241e7a70 msgr2=0x7f5a2415d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:04.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.273+0000 7f5a237fe700 1 --2- 172.21.15.124:0/2986627537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a241e7a70 0x7f5a2415d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.273+0000 7f5a237fe700 1 -- 172.21.15.124:0/2986627537 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a240b4800 con 0x7f5a240b55c0 2023-10-16T12:59:04.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.273+0000 7f5a23fff700 1 --2- 172.21.15.124:0/2986627537 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a10003a30 0x7f5a24155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:04.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.273+0000 7f5a237fe700 1 --2- 172.21.15.124:0/2986627537 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5a240b55c0 0x7f5a241e7530 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5a14007290 tx=0x7f5a140075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:04.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.273+0000 7f5a20ff9700 1 -- 172.21.15.124:0/2986627537 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14007780 con 0x7f5a240b55c0 2023-10-16T12:59:04.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.273+0000 7f5a20ff9700 1 -- 172.21.15.124:0/2986627537 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1400f7f0 con 0x7f5a240b55c0 2023-10-16T12:59:04.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.273+0000 7f5a2a873700 1 -- 172.21.15.124:0/2986627537 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a240b4ae0 con 0x7f5a240b55c0 2023-10-16T12:59:04.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.273+0000 7f5a20ff9700 1 -- 172.21.15.124:0/2986627537 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1400fba0 con 0x7f5a240b55c0 2023-10-16T12:59:04.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.273+0000 7f5a2a873700 1 -- 172.21.15.124:0/2986627537 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a240b50a0 con 0x7f5a240b55c0 2023-10-16T12:59:04.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.274+0000 7f5a2a873700 1 -- 172.21.15.124:0/2986627537 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a24072d10 con 0x7f5a240b55c0 2023-10-16T12:59:04.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.274+0000 7f5a20ff9700 1 -- 172.21.15.124:0/2986627537 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5a1400fd00 con 0x7f5a240b55c0 2023-10-16T12:59:04.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.275+0000 7f5a20ff9700 1 --2- 172.21.15.124:0/2986627537 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5a0406af00 0x7f5a0406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:04.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.275+0000 7f5a20ff9700 1 -- 172.21.15.124:0/2986627537 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5a14089850 con 0x7f5a240b55c0 2023-10-16T12:59:04.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.275+0000 7f5a23fff700 1 --2- 172.21.15.124:0/2986627537 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5a0406af00 0x7f5a0406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:04.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.275+0000 7f5a23fff700 1 --2- 172.21.15.124:0/2986627537 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5a0406af00 0x7f5a0406d3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c014040 tx=0x7f5a0c011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:04.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.279+0000 7f5a20ff9700 1 -- 172.21.15.124:0/2986627537 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5a140546c0 con 0x7f5a240b55c0 2023-10-16T12:59:04.469 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.466+0000 7f5a2a873700 1 -- 172.21.15.124:0/2986627537 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5a2404ebb0 con 0x7f5a240b55c0 2023-10-16T12:59:04.469 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.467+0000 7f5a20ff9700 1 -- 172.21.15.124:0/2986627537 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5a14057ce0 con 0x7f5a240b55c0 2023-10-16T12:59:04.470 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-16T12:59:04.472 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.469+0000 7f5a2a873700 1 -- 172.21.15.124:0/2986627537 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5a0406af00 msgr2=0x7f5a0406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:04.472 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.469+0000 7f5a2a873700 1 --2- 172.21.15.124:0/2986627537 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5a0406af00 0x7f5a0406d3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c014040 tx=0x7f5a0c011000 comp rx=0 tx=0).stop 2023-10-16T12:59:04.472 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.469+0000 7f5a2a873700 1 -- 172.21.15.124:0/2986627537 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5a240b55c0 msgr2=0x7f5a241e7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:04.472 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.469+0000 7f5a2a873700 1 --2- 172.21.15.124:0/2986627537 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5a240b55c0 0x7f5a241e7530 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5a14007290 tx=0x7f5a140075a0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.469+0000 7f5a2a873700 1 -- 172.21.15.124:0/2986627537 shutdown_connections 2023-10-16T12:59:04.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.469+0000 7f5a2a873700 1 --2- 172.21.15.124:0/2986627537 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5a0406af00 0x7f5a0406d3c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.469+0000 7f5a2a873700 1 --2- 172.21.15.124:0/2986627537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a241e7a70 0x7f5a2415d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.469+0000 7f5a2a873700 1 --2- 172.21.15.124:0/2986627537 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a10003a30 0x7f5a24155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.469+0000 7f5a2a873700 1 --2- 172.21.15.124:0/2986627537 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5a240b55c0 0x7f5a241e7530 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.469+0000 7f5a2a873700 1 -- 172.21.15.124:0/2986627537 >> 172.21.15.124:0/2986627537 conn(0x7f5a240ccbe0 msgr2=0x7f5a2406d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:04.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.469+0000 7f5a2a873700 1 -- 172.21.15.124:0/2986627537 shutdown_connections 2023-10-16T12:59:04.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.469+0000 7f5a2a873700 1 -- 172.21.15.124:0/2986627537 wait complete. 2023-10-16T12:59:04.483 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T12:59:04.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.603+0000 7f7b85729700 1 Processor -- start 2023-10-16T12:59:04.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.603+0000 7f7b85729700 1 -- start start 2023-10-16T12:59:04.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.604+0000 7f7b85729700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7b8015b3f0 0x7f7b800d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:04.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.604+0000 7f7b85729700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b8015b7d0 con 0x7f7b800b3400 2023-10-16T12:59:04.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.604+0000 7f7b85729700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b80070390 con 0x7f7b800d0a80 2023-10-16T12:59:04.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.604+0000 7f7b85729700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b80071150 con 0x7f7b8015b3f0 2023-10-16T12:59:04.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.604+0000 7f7b7effd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7b8015b3f0 0x7f7b800d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:04.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.604+0000 7f7b7f7fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f7b800b3400 0x7f7b800b40c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42038/0 (socket says 172.21.15.124:42038) 2023-10-16T12:59:04.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.604+0000 7f7b7f7fe700 1 -- 172.21.15.124:0/1235474564 learned_addr learned my addr 172.21.15.124:0/1235474564 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:04.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.604+0000 7f7b7effd700 1 -- 172.21.15.124:0/1235474564 >> v1:172.21.15.192:6789/0 conn(0x7f7b800d0a80 legacy=0x7f7b800b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:04.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.605+0000 7f7b7effd700 1 -- 172.21.15.124:0/1235474564 >> v1:172.21.15.124:6789/0 conn(0x7f7b800b3400 legacy=0x7f7b800b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:04.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.605+0000 7f7b7effd700 1 -- 172.21.15.124:0/1235474564 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b80070670 con 0x7f7b8015b3f0 2023-10-16T12:59:04.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.605+0000 7f7b7effd700 1 --2- 172.21.15.124:0/1235474564 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7b8015b3f0 0x7f7b800d0540 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7b74009840 tx=0x7f7b74009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aecf35ed9080dfa7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:04.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.605+0000 7f7b7dffb700 1 -- 172.21.15.124:0/1235474564 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b74004230 con 0x7f7b8015b3f0 2023-10-16T12:59:04.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.605+0000 7f7b7dffb700 1 -- 172.21.15.124:0/1235474564 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b74004390 con 0x7f7b8015b3f0 2023-10-16T12:59:04.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.605+0000 7f7b7dffb700 1 -- 172.21.15.124:0/1235474564 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b740036a0 con 0x7f7b8015b3f0 2023-10-16T12:59:04.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.605+0000 7f7b85729700 1 -- 172.21.15.124:0/1235474564 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7b8015b3f0 msgr2=0x7f7b800d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:04.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.605+0000 7f7b85729700 1 --2- 172.21.15.124:0/1235474564 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7b8015b3f0 0x7f7b800d0540 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7b74009840 tx=0x7f7b74009b50 comp rx=0 tx=0).stop 2023-10-16T12:59:04.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.605+0000 7f7b85729700 1 -- 172.21.15.124:0/1235474564 shutdown_connections 2023-10-16T12:59:04.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.605+0000 7f7b85729700 1 --2- 172.21.15.124:0/1235474564 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7b8015b3f0 0x7f7b800d0540 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.605+0000 7f7b85729700 1 -- 172.21.15.124:0/1235474564 >> 172.21.15.124:0/1235474564 conn(0x7f7b800cdcf0 msgr2=0x7f7b800ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:04.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.605+0000 7f7b85729700 1 -- 172.21.15.124:0/1235474564 shutdown_connections 2023-10-16T12:59:04.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.605+0000 7f7b85729700 1 -- 172.21.15.124:0/1235474564 wait complete. 2023-10-16T12:59:04.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.607+0000 7f7b85729700 1 Processor -- start 2023-10-16T12:59:04.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.607+0000 7f7b85729700 1 -- start start 2023-10-16T12:59:04.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.607+0000 7f7b85729700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7b800b3400 0x7f7b801f2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:04.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.607+0000 7f7b85729700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b800d0a80 0x7f7b801f33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:04.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.607+0000 7f7b85729700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b8015b3f0 0x7f7b8006b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:04.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.607+0000 7f7b85729700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b800c4a40 con 0x7f7b800b3400 2023-10-16T12:59:04.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.607+0000 7f7b85729700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b801f3900 con 0x7f7b800d0a80 2023-10-16T12:59:04.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.607+0000 7f7b85729700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b800b6170 con 0x7f7b8015b3f0 2023-10-16T12:59:04.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.607+0000 7f7b7effd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7b800b3400 0x7f7b801f2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:04.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.607+0000 7f7b7effd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7b800b3400 0x7f7b801f2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53372/0 (socket says 172.21.15.124:53372) 2023-10-16T12:59:04.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.607+0000 7f7b7effd700 1 -- 172.21.15.124:0/1515588614 learned_addr learned my addr 172.21.15.124:0/1515588614 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:04.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.608+0000 7f7b7e7fc700 1 --2- 172.21.15.124:0/1515588614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b800d0a80 0x7f7b801f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:04.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.608+0000 7f7b7f7fe700 1 --2- 172.21.15.124:0/1515588614 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b8015b3f0 0x7f7b8006b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:04.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.608+0000 7f7b7effd700 1 -- 172.21.15.124:0/1515588614 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b8015b3f0 msgr2=0x7f7b8006b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:04.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.608+0000 7f7b7effd700 1 --2- 172.21.15.124:0/1515588614 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b8015b3f0 0x7f7b8006b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.608+0000 7f7b7effd700 1 -- 172.21.15.124:0/1515588614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b800d0a80 msgr2=0x7f7b801f33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:04.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.608+0000 7f7b7effd700 1 --2- 172.21.15.124:0/1515588614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b800d0a80 0x7f7b801f33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.608+0000 7f7b7effd700 1 -- 172.21.15.124:0/1515588614 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b740094a0 con 0x7f7b800b3400 2023-10-16T12:59:04.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.608+0000 7f7b7effd700 1 --2- 172.21.15.124:0/1515588614 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7b800b3400 0x7f7b801f2380 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7b800714c0 tx=0x7f7b740047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:04.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.608+0000 7f7b677fe700 1 -- 172.21.15.124:0/1515588614 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b74003e60 con 0x7f7b800b3400 2023-10-16T12:59:04.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.608+0000 7f7b677fe700 1 -- 172.21.15.124:0/1515588614 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b74011630 con 0x7f7b800b3400 2023-10-16T12:59:04.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.608+0000 7f7b85729700 1 -- 172.21.15.124:0/1515588614 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b800c4c90 con 0x7f7b800b3400 2023-10-16T12:59:04.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.608+0000 7f7b677fe700 1 -- 172.21.15.124:0/1515588614 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b740119c0 con 0x7f7b800b3400 2023-10-16T12:59:04.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.608+0000 7f7b85729700 1 -- 172.21.15.124:0/1515588614 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b800c5250 con 0x7f7b800b3400 2023-10-16T12:59:04.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.609+0000 7f7b85729700 1 -- 172.21.15.124:0/1515588614 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8004ebb0 con 0x7f7b800b3400 2023-10-16T12:59:04.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.610+0000 7f7b677fe700 1 -- 172.21.15.124:0/1515588614 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7b74011b20 con 0x7f7b800b3400 2023-10-16T12:59:04.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.610+0000 7f7b677fe700 1 --2- 172.21.15.124:0/1515588614 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f7b6c06af00 0x7f7b6c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:04.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.610+0000 7f7b677fe700 1 -- 172.21.15.124:0/1515588614 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7b7408b0e0 con 0x7f7b800b3400 2023-10-16T12:59:04.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.610+0000 7f7b7e7fc700 1 --2- 172.21.15.124:0/1515588614 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f7b6c06af00 0x7f7b6c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:04.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.610+0000 7f7b7e7fc700 1 --2- 172.21.15.124:0/1515588614 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f7b6c06af00 0x7f7b6c06d3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b800b2210 tx=0x7f7b70007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:04.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.614+0000 7f7b677fe700 1 -- 172.21.15.124:0/1515588614 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7b74056050 con 0x7f7b800b3400 2023-10-16T12:59:04.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.805+0000 7f7b85729700 1 -- 172.21.15.124:0/1515588614 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7b8004ebb0 con 0x7f7b800b3400 2023-10-16T12:59:04.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.806+0000 7f7b677fe700 1 -- 172.21.15.124:0/1515588614 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7b74059670 con 0x7f7b800b3400 2023-10-16T12:59:04.809 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:04.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.808+0000 7f7b85729700 1 -- 172.21.15.124:0/1515588614 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f7b6c06af00 msgr2=0x7f7b6c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:04.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.808+0000 7f7b85729700 1 --2- 172.21.15.124:0/1515588614 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f7b6c06af00 0x7f7b6c06d3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b800b2210 tx=0x7f7b70007ec0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.808+0000 7f7b85729700 1 -- 172.21.15.124:0/1515588614 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7b800b3400 msgr2=0x7f7b801f2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:04.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.808+0000 7f7b85729700 1 --2- 172.21.15.124:0/1515588614 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7b800b3400 0x7f7b801f2380 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7b800714c0 tx=0x7f7b740047c0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.808+0000 7f7b85729700 1 -- 172.21.15.124:0/1515588614 shutdown_connections 2023-10-16T12:59:04.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.808+0000 7f7b85729700 1 --2- 172.21.15.124:0/1515588614 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f7b6c06af00 0x7f7b6c06d3c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.808+0000 7f7b85729700 1 --2- 172.21.15.124:0/1515588614 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b8015b3f0 0x7f7b8006b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.808+0000 7f7b85729700 1 --2- 172.21.15.124:0/1515588614 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7b800b3400 0x7f7b801f2380 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.808+0000 7f7b85729700 1 --2- 172.21.15.124:0/1515588614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b800d0a80 0x7f7b801f33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.808+0000 7f7b85729700 1 -- 172.21.15.124:0/1515588614 >> 172.21.15.124:0/1515588614 conn(0x7f7b800cdcf0 msgr2=0x7f7b8015a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:04.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.808+0000 7f7b85729700 1 -- 172.21.15.124:0/1515588614 shutdown_connections 2023-10-16T12:59:04.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.808+0000 7f7b85729700 1 -- 172.21.15.124:0/1515588614 wait complete. 2023-10-16T12:59:04.822 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T12:59:04.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.942+0000 7fb181cf0700 1 Processor -- start 2023-10-16T12:59:04.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.942+0000 7fb181cf0700 1 -- start start 2023-10-16T12:59:04.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.943+0000 7fb181cf0700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb17c0ce440 0x7fb17c15dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:04.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.943+0000 7fb181cf0700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17c161360 con 0x7fb17c06b370 2023-10-16T12:59:04.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.943+0000 7fb181cf0700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17c06b750 con 0x7fb17c06a820 2023-10-16T12:59:04.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.943+0000 7fb181cf0700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17c06dcc0 con 0x7fb17c0ce440 2023-10-16T12:59:04.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.943+0000 7fb17bfff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb17c0ce440 0x7fb17c15dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:04.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.943+0000 7fb17b7fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fb17c06b370 0x7fb17c06d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42048/0 (socket says 172.21.15.124:42048) 2023-10-16T12:59:04.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.943+0000 7fb17bfff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb17c0ce440 0x7fb17c15dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53382/0 (socket says 172.21.15.124:53382) 2023-10-16T12:59:04.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.943+0000 7fb17b7fe700 1 -- 172.21.15.124:0/2246275855 learned_addr learned my addr 172.21.15.124:0/2246275855 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:04.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.943+0000 7fb17bfff700 1 -- 172.21.15.124:0/2246275855 >> v1:172.21.15.192:6789/0 conn(0x7fb17c06a820 legacy=0x7fb17c0cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:04.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.943+0000 7fb17bfff700 1 -- 172.21.15.124:0/2246275855 >> v1:172.21.15.124:6789/0 conn(0x7fb17c06b370 legacy=0x7fb17c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:04.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.943+0000 7fb17bfff700 1 -- 172.21.15.124:0/2246275855 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c15e300 con 0x7fb17c0ce440 2023-10-16T12:59:04.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.943+0000 7fb17a7fc700 1 -- 172.21.15.124:0/2246275855 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372981713 0 0) 0x7fb17c161360 con 0x7fb17c06b370 2023-10-16T12:59:04.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.944+0000 7fb17bfff700 1 --2- 172.21.15.124:0/2246275855 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb17c0ce440 0x7fb17c15dcb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb174009dc0 tx=0x7fb17400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ce253e12a93fe2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:04.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.944+0000 7fb17a7fc700 1 -- 172.21.15.124:0/2246275855 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17400e070 con 0x7fb17c0ce440 2023-10-16T12:59:04.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.944+0000 7fb17a7fc700 1 -- 172.21.15.124:0/2246275855 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17400bb50 con 0x7fb17c0ce440 2023-10-16T12:59:04.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.944+0000 7fb17a7fc700 1 -- 172.21.15.124:0/2246275855 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb174003a20 con 0x7fb17c0ce440 2023-10-16T12:59:04.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.944+0000 7fb181cf0700 1 -- 172.21.15.124:0/2246275855 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb17c0ce440 msgr2=0x7fb17c15dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:04.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.944+0000 7fb181cf0700 1 --2- 172.21.15.124:0/2246275855 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb17c0ce440 0x7fb17c15dcb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb174009dc0 tx=0x7fb17400b330 comp rx=0 tx=0).stop 2023-10-16T12:59:04.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.944+0000 7fb181cf0700 1 -- 172.21.15.124:0/2246275855 shutdown_connections 2023-10-16T12:59:04.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.944+0000 7fb181cf0700 1 --2- 172.21.15.124:0/2246275855 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb17c0ce440 0x7fb17c15dcb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.944+0000 7fb181cf0700 1 -- 172.21.15.124:0/2246275855 >> 172.21.15.124:0/2246275855 conn(0x7fb17c0ccbe0 msgr2=0x7fb17c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:04.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.944+0000 7fb181cf0700 1 -- 172.21.15.124:0/2246275855 shutdown_connections 2023-10-16T12:59:04.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.944+0000 7fb181cf0700 1 -- 172.21.15.124:0/2246275855 wait complete. 2023-10-16T12:59:04.954 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.946+0000 7fb181cf0700 1 Processor -- start 2023-10-16T12:59:04.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.946+0000 7fb181cf0700 1 -- start start 2023-10-16T12:59:04.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.947+0000 7fb181cf0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb17c06a820 0x7fb17c154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:04.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.947+0000 7fb181cf0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb17c06b370 0x7fb17c0b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:04.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.947+0000 7fb181cf0700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb17c0ce440 0x7fb17c15a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:04.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.947+0000 7fb181cf0700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c0b5cc0 con 0x7fb17c0ce440 2023-10-16T12:59:04.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.947+0000 7fb181cf0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c15b8d0 con 0x7fb17c06b370 2023-10-16T12:59:04.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.947+0000 7fb181cf0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c0b5420 con 0x7fb17c06a820 2023-10-16T12:59:04.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.947+0000 7fb17bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb17c0ce440 0x7fb17c15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:04.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.947+0000 7fb17bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb17c0ce440 0x7fb17c15a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53388/0 (socket says 172.21.15.124:53388) 2023-10-16T12:59:04.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.947+0000 7fb17bfff700 1 -- 172.21.15.124:0/3436286334 learned_addr learned my addr 172.21.15.124:0/3436286334 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:04.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.947+0000 7fb17affd700 1 --2- 172.21.15.124:0/3436286334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb17c06b370 0x7fb17c0b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:04.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.947+0000 7fb17b7fe700 1 --2- 172.21.15.124:0/3436286334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb17c06a820 0x7fb17c154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:04.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.947+0000 7fb17bfff700 1 -- 172.21.15.124:0/3436286334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb17c06a820 msgr2=0x7fb17c154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:04.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.947+0000 7fb17bfff700 1 --2- 172.21.15.124:0/3436286334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb17c06a820 0x7fb17c154c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.947+0000 7fb17bfff700 1 -- 172.21.15.124:0/3436286334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb17c06b370 msgr2=0x7fb17c0b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:04.958 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.947+0000 7fb17bfff700 1 --2- 172.21.15.124:0/3436286334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb17c06b370 0x7fb17c0b4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:04.958 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.947+0000 7fb17bfff700 1 -- 172.21.15.124:0/3436286334 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb174009a70 con 0x7fb17c0ce440 2023-10-16T12:59:04.958 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.947+0000 7fb17affd700 1 --2- 172.21.15.124:0/3436286334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb17c06b370 0x7fb17c0b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:04.958 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.948+0000 7fb17bfff700 1 --2- 172.21.15.124:0/3436286334 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb17c0ce440 0x7fb17c15a440 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb17400b370 tx=0x7fb174004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:04.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.948+0000 7fb163fff700 1 -- 172.21.15.124:0/3436286334 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb174012630 con 0x7fb17c0ce440 2023-10-16T12:59:04.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.948+0000 7fb163fff700 1 -- 172.21.15.124:0/3436286334 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1740127b0 con 0x7fb17c0ce440 2023-10-16T12:59:04.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.948+0000 7fb181cf0700 1 -- 172.21.15.124:0/3436286334 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17c0b5700 con 0x7fb17c0ce440 2023-10-16T12:59:04.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.948+0000 7fb163fff700 1 -- 172.21.15.124:0/3436286334 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb174012b60 con 0x7fb17c0ce440 2023-10-16T12:59:04.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.948+0000 7fb181cf0700 1 -- 172.21.15.124:0/3436286334 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17c15bae0 con 0x7fb17c0ce440 2023-10-16T12:59:04.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.949+0000 7fb181cf0700 1 -- 172.21.15.124:0/3436286334 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17c072d10 con 0x7fb17c0ce440 2023-10-16T12:59:04.960 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.949+0000 7fb163fff700 1 -- 172.21.15.124:0/3436286334 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb174012cc0 con 0x7fb17c0ce440 2023-10-16T12:59:04.960 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.949+0000 7fb163fff700 1 --2- 172.21.15.124:0/3436286334 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb16806af00 0x7fb16806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:04.960 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.950+0000 7fb163fff700 1 -- 172.21.15.124:0/3436286334 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb17408bfa0 con 0x7fb17c0ce440 2023-10-16T12:59:04.960 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.950+0000 7fb17b7fe700 1 --2- 172.21.15.124:0/3436286334 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb16806af00 0x7fb16806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:04.960 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.950+0000 7fb17b7fe700 1 --2- 172.21.15.124:0/3436286334 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb16806af00 0x7fb16806d3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb170000f60 tx=0x7fb170009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:04.961 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:04.954+0000 7fb163fff700 1 -- 172.21.15.124:0/3436286334 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1740beca0 con 0x7fb17c0ce440 2023-10-16T12:59:05.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.141+0000 7fb181cf0700 1 -- 172.21.15.124:0/3436286334 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb17c15e890 con 0x7fb17c0ce440 2023-10-16T12:59:05.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.141+0000 7fb163fff700 1 -- 172.21.15.124:0/3436286334 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb17405a880 con 0x7fb17c0ce440 2023-10-16T12:59:05.145 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2023-10-16T12:59:05.146 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.143+0000 7fb181cf0700 1 -- 172.21.15.124:0/3436286334 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb16806af00 msgr2=0x7fb16806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:05.146 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.143+0000 7fb181cf0700 1 --2- 172.21.15.124:0/3436286334 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb16806af00 0x7fb16806d3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb170000f60 tx=0x7fb170009040 comp rx=0 tx=0).stop 2023-10-16T12:59:05.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.143+0000 7fb181cf0700 1 -- 172.21.15.124:0/3436286334 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb17c0ce440 msgr2=0x7fb17c15a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:05.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.143+0000 7fb181cf0700 1 --2- 172.21.15.124:0/3436286334 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb17c0ce440 0x7fb17c15a440 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb17400b370 tx=0x7fb174004ad0 comp rx=0 tx=0).stop 2023-10-16T12:59:05.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.143+0000 7fb181cf0700 1 -- 172.21.15.124:0/3436286334 shutdown_connections 2023-10-16T12:59:05.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.143+0000 7fb181cf0700 1 --2- 172.21.15.124:0/3436286334 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb16806af00 0x7fb16806d3c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:05.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.143+0000 7fb181cf0700 1 --2- 172.21.15.124:0/3436286334 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb17c0ce440 0x7fb17c15a440 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:05.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.143+0000 7fb181cf0700 1 --2- 172.21.15.124:0/3436286334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb17c06a820 0x7fb17c154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:05.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.143+0000 7fb181cf0700 1 --2- 172.21.15.124:0/3436286334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb17c06b370 0x7fb17c0b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:05.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.143+0000 7fb181cf0700 1 -- 172.21.15.124:0/3436286334 >> 172.21.15.124:0/3436286334 conn(0x7fb17c0ccbe0 msgr2=0x7fb17c06de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:05.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.144+0000 7fb181cf0700 1 -- 172.21.15.124:0/3436286334 shutdown_connections 2023-10-16T12:59:05.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.144+0000 7fb181cf0700 1 -- 172.21.15.124:0/3436286334 wait complete. 2023-10-16T12:59:05.158 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T12:59:05.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.278+0000 7fefe751e700 1 Processor -- start 2023-10-16T12:59:05.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.278+0000 7fefe751e700 1 -- start start 2023-10-16T12:59:05.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.279+0000 7fefe751e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fefe006b370 0x7fefe015dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:05.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.279+0000 7fefe751e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fefe00cdd30 0x7fefe00ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:05.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.279+0000 7fefe751e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe0161360 con 0x7fefe006a820 2023-10-16T12:59:05.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.279+0000 7fefe751e700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe00ce720 con 0x7fefe006b370 2023-10-16T12:59:05.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.279+0000 7fefe751e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe006b750 con 0x7fefe00cdd30 2023-10-16T12:59:05.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.279+0000 7fefe52ba700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fefe006b370 0x7fefe015dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:05.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.279+0000 7fefe52ba700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fefe006b370 0x7fefe015dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53392/0 (socket says 172.21.15.124:53392) 2023-10-16T12:59:05.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.279+0000 7fefe52ba700 1 -- 172.21.15.124:0/3681848168 learned_addr learned my addr 172.21.15.124:0/3681848168 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:05.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.279+0000 7fefe5abb700 1 --2- 172.21.15.124:0/3681848168 >> v2:172.21.15.192:3300/0 conn(0x7fefe00cdd30 0x7fefe00ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:05.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.280+0000 7fefe52ba700 1 -- 172.21.15.124:0/3681848168 >> v2:172.21.15.192:3300/0 conn(0x7fefe00cdd30 msgr2=0x7fefe00ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:05.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.280+0000 7fefe52ba700 1 --2- 172.21.15.124:0/3681848168 >> v2:172.21.15.192:3300/0 conn(0x7fefe00cdd30 0x7fefe00ce1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:05.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.280+0000 7fefe52ba700 1 -- 172.21.15.124:0/3681848168 >> v1:172.21.15.192:6789/0 conn(0x7fefe006a820 legacy=0x7fefe006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:05.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.280+0000 7fefe52ba700 1 -- 172.21.15.124:0/3681848168 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe006dcc0 con 0x7fefe006b370 2023-10-16T12:59:05.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.280+0000 7fefe5abb700 1 --2- 172.21.15.124:0/3681848168 >> v2:172.21.15.192:3300/0 conn(0x7fefe00cdd30 0x7fefe00ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:05.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.280+0000 7fefe52ba700 1 --2- 172.21.15.124:0/3681848168 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fefe006b370 0x7fefe015dcb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fefe015b880 tx=0x7fefd0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef137e051522c3d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:05.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.280+0000 7fefd7fff700 1 -- 172.21.15.124:0/3681848168 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd000b870 con 0x7fefe006b370 2023-10-16T12:59:05.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.280+0000 7fefd7fff700 1 -- 172.21.15.124:0/3681848168 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd000b9d0 con 0x7fefe006b370 2023-10-16T12:59:05.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.280+0000 7fefd7fff700 1 -- 172.21.15.124:0/3681848168 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd000bd60 con 0x7fefe006b370 2023-10-16T12:59:05.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.280+0000 7fefe751e700 1 -- 172.21.15.124:0/3681848168 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fefe006b370 msgr2=0x7fefe015dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:05.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.280+0000 7fefe751e700 1 --2- 172.21.15.124:0/3681848168 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fefe006b370 0x7fefe015dcb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fefe015b880 tx=0x7fefd0009bd0 comp rx=0 tx=0).stop 2023-10-16T12:59:05.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.280+0000 7fefe751e700 1 -- 172.21.15.124:0/3681848168 shutdown_connections 2023-10-16T12:59:05.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.280+0000 7fefe751e700 1 --2- 172.21.15.124:0/3681848168 >> v2:172.21.15.192:3300/0 conn(0x7fefe00cdd30 0x7fefe00ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:05.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.280+0000 7fefe751e700 1 --2- 172.21.15.124:0/3681848168 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fefe006b370 0x7fefe015dcb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:05.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.280+0000 7fefe751e700 1 -- 172.21.15.124:0/3681848168 >> 172.21.15.124:0/3681848168 conn(0x7fefe00ccbe0 msgr2=0x7fefe00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:05.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.281+0000 7fefe751e700 1 -- 172.21.15.124:0/3681848168 shutdown_connections 2023-10-16T12:59:05.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.281+0000 7fefe751e700 1 -- 172.21.15.124:0/3681848168 wait complete. 2023-10-16T12:59:05.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.282+0000 7fefe751e700 1 Processor -- start 2023-10-16T12:59:05.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.282+0000 7fefe751e700 1 -- start start 2023-10-16T12:59:05.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.282+0000 7fefe751e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fefe006a820 0x7fefe01f2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:05.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.282+0000 7fefe751e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefe006b370 0x7fefe00b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:05.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.282+0000 7fefe751e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefe00cdd30 0x7fefe00b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:05.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.282+0000 7fefe751e700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe014a0d0 con 0x7fefe006a820 2023-10-16T12:59:05.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.282+0000 7fefe751e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe01494c0 con 0x7fefe006b370 2023-10-16T12:59:05.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.282+0000 7fefe751e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe01497a0 con 0x7fefe00cdd30 2023-10-16T12:59:05.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.283+0000 7fefe52ba700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fefe006a820 0x7fefe01f2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:05.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.283+0000 7fefe52ba700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fefe006a820 0x7fefe01f2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53396/0 (socket says 172.21.15.124:53396) 2023-10-16T12:59:05.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.283+0000 7fefe52ba700 1 -- 172.21.15.124:0/2598434279 learned_addr learned my addr 172.21.15.124:0/2598434279 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:05.296 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.283+0000 7fefe4ab9700 1 --2- 172.21.15.124:0/2598434279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefe006b370 0x7fefe00b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:05.296 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.283+0000 7fefe5abb700 1 --2- 172.21.15.124:0/2598434279 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefe00cdd30 0x7fefe00b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:05.296 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.283+0000 7fefe52ba700 1 -- 172.21.15.124:0/2598434279 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefe00cdd30 msgr2=0x7fefe00b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:05.296 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.283+0000 7fefe52ba700 1 --2- 172.21.15.124:0/2598434279 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefe00cdd30 0x7fefe00b52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:05.296 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.283+0000 7fefe52ba700 1 -- 172.21.15.124:0/2598434279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefe006b370 msgr2=0x7fefe00b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:05.297 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.283+0000 7fefe52ba700 1 --2- 172.21.15.124:0/2598434279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefe006b370 0x7fefe00b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:05.297 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.283+0000 7fefe52ba700 1 -- 172.21.15.124:0/2598434279 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd0009550 con 0x7fefe006a820 2023-10-16T12:59:05.297 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.283+0000 7fefe4ab9700 1 --2- 172.21.15.124:0/2598434279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefe006b370 0x7fefe00b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:05.297 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.283+0000 7fefe5abb700 1 --2- 172.21.15.124:0/2598434279 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefe00cdd30 0x7fefe00b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:05.297 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.283+0000 7fefe52ba700 1 --2- 172.21.15.124:0/2598434279 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fefe006a820 0x7fefe01f2b60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fefe0067ec0 tx=0x7fefd0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:05.298 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.283+0000 7fefd5ffb700 1 -- 172.21.15.124:0/2598434279 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0004310 con 0x7fefe006a820 2023-10-16T12:59:05.298 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.283+0000 7fefd5ffb700 1 -- 172.21.15.124:0/2598434279 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd001f070 con 0x7fefe006a820 2023-10-16T12:59:05.298 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.283+0000 7fefe751e700 1 -- 172.21.15.124:0/2598434279 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe0149a80 con 0x7fefe006a820 2023-10-16T12:59:05.298 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.283+0000 7fefd5ffb700 1 -- 172.21.15.124:0/2598434279 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd00036a0 con 0x7fefe006a820 2023-10-16T12:59:05.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.283+0000 7fefe751e700 1 -- 172.21.15.124:0/2598434279 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe01f30a0 con 0x7fefe006a820 2023-10-16T12:59:05.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.284+0000 7fefe751e700 1 -- 172.21.15.124:0/2598434279 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe01f3230 con 0x7fefe006a820 2023-10-16T12:59:05.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.285+0000 7fefd5ffb700 1 -- 172.21.15.124:0/2598434279 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fefd0021030 con 0x7fefe006a820 2023-10-16T12:59:05.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.285+0000 7fefd5ffb700 1 --2- 172.21.15.124:0/2598434279 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fefc406af00 0x7fefc406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:05.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.285+0000 7fefd5ffb700 1 -- 172.21.15.124:0/2598434279 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fefd008ab90 con 0x7fefe006a820 2023-10-16T12:59:05.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.285+0000 7fefe4ab9700 1 --2- 172.21.15.124:0/2598434279 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fefc406af00 0x7fefc406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:05.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.285+0000 7fefe4ab9700 1 --2- 172.21.15.124:0/2598434279 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fefc406af00 0x7fefc406d3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fefe00afae0 tx=0x7fefdc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:05.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.290+0000 7fefd5ffb700 1 -- 172.21.15.124:0/2598434279 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fefd0055950 con 0x7fefe006a820 2023-10-16T12:59:05.479 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.476+0000 7fefe751e700 1 -- 172.21.15.124:0/2598434279 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fefe0072d10 con 0x7fefe006a820 2023-10-16T12:59:05.479 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.477+0000 7fefd5ffb700 1 -- 172.21.15.124:0/2598434279 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fefd0029070 con 0x7fefe006a820 2023-10-16T12:59:05.480 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:05.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.478+0000 7fefe751e700 1 -- 172.21.15.124:0/2598434279 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fefc406af00 msgr2=0x7fefc406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:05.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.478+0000 7fefe751e700 1 --2- 172.21.15.124:0/2598434279 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fefc406af00 0x7fefc406d3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fefe00afae0 tx=0x7fefdc009040 comp rx=0 tx=0).stop 2023-10-16T12:59:05.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.479+0000 7fefe751e700 1 -- 172.21.15.124:0/2598434279 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fefe006a820 msgr2=0x7fefe01f2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:05.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.479+0000 7fefe751e700 1 --2- 172.21.15.124:0/2598434279 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fefe006a820 0x7fefe01f2b60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fefe0067ec0 tx=0x7fefd0004750 comp rx=0 tx=0).stop 2023-10-16T12:59:05.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.479+0000 7fefe751e700 1 -- 172.21.15.124:0/2598434279 shutdown_connections 2023-10-16T12:59:05.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.479+0000 7fefe751e700 1 --2- 172.21.15.124:0/2598434279 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fefc406af00 0x7fefc406d3c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:05.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.479+0000 7fefe751e700 1 --2- 172.21.15.124:0/2598434279 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefe00cdd30 0x7fefe00b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:05.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.479+0000 7fefe751e700 1 --2- 172.21.15.124:0/2598434279 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fefe006a820 0x7fefe01f2b60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:05.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.479+0000 7fefe751e700 1 --2- 172.21.15.124:0/2598434279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefe006b370 0x7fefe00b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:05.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.479+0000 7fefe751e700 1 -- 172.21.15.124:0/2598434279 >> 172.21.15.124:0/2598434279 conn(0x7fefe00ccbe0 msgr2=0x7fefe00b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:05.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.479+0000 7fefe751e700 1 -- 172.21.15.124:0/2598434279 shutdown_connections 2023-10-16T12:59:05.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.479+0000 7fefe751e700 1 -- 172.21.15.124:0/2598434279 wait complete. 2023-10-16T12:59:05.493 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T12:59:05.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.611+0000 7feacc2e9700 1 Processor -- start 2023-10-16T12:59:05.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.611+0000 7feacc2e9700 1 -- start start 2023-10-16T12:59:05.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.612+0000 7feacc2e9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feac4152470 0x7feac40cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:05.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.612+0000 7feacc2e9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feac40cb8d0 0x7feac40b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:05.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.612+0000 7feacc2e9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac4070d70 con 0x7feac40b3240 2023-10-16T12:59:05.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.612+0000 7feacc2e9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac40b36d0 con 0x7feac4152470 2023-10-16T12:59:05.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.612+0000 7feacc2e9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac4071200 con 0x7feac40cb8d0 2023-10-16T12:59:05.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.613+0000 7feac9884700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feac40cb8d0 0x7feac40b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:05.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.613+0000 7feaca085700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feac4152470 0x7feac40cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:05.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.613+0000 7feac9884700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feac40cb8d0 0x7feac40b2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:39484/0 (socket says 172.21.15.124:39484) 2023-10-16T12:59:05.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.613+0000 7feaca085700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feac4152470 0x7feac40cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:33570/0 (socket says 172.21.15.124:33570) 2023-10-16T12:59:05.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.613+0000 7feac9884700 1 -- 172.21.15.124:0/1260344164 learned_addr learned my addr 172.21.15.124:0/1260344164 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:05.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.613+0000 7feaca085700 1 -- 172.21.15.124:0/1260344164 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feac40cb8d0 msgr2=0x7feac40b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:05.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.613+0000 7feaca085700 1 --2- 172.21.15.124:0/1260344164 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feac40cb8d0 0x7feac40b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:05.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.613+0000 7feaca085700 1 -- 172.21.15.124:0/1260344164 >> v1:172.21.15.192:6789/0 conn(0x7feac40b3240 legacy=0x7feac40b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:05.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.613+0000 7feaca085700 1 -- 172.21.15.124:0/1260344164 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac4070440 con 0x7feac4152470 2023-10-16T12:59:05.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.613+0000 7feaca085700 1 --2- 172.21.15.124:0/1260344164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feac4152470 0x7feac40cd570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feab4009840 tx=0x7feab4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6b2ce94cf69c542 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:05.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.613+0000 7feac9083700 1 -- 172.21.15.124:0/1260344164 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab4011830 con 0x7feac4152470 2023-10-16T12:59:05.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.613+0000 7feac9083700 1 -- 172.21.15.124:0/1260344164 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab4011990 con 0x7feac4152470 2023-10-16T12:59:05.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.613+0000 7feac9083700 1 -- 172.21.15.124:0/1260344164 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab4011d20 con 0x7feac4152470 2023-10-16T12:59:05.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.614+0000 7feacc2e9700 1 -- 172.21.15.124:0/1260344164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feac4152470 msgr2=0x7feac40cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:05.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.614+0000 7feacc2e9700 1 --2- 172.21.15.124:0/1260344164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feac4152470 0x7feac40cd570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feab4009840 tx=0x7feab4009b50 comp rx=0 tx=0).stop 2023-10-16T12:59:05.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.614+0000 7feacc2e9700 1 -- 172.21.15.124:0/1260344164 shutdown_connections 2023-10-16T12:59:05.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.614+0000 7feacc2e9700 1 --2- 172.21.15.124:0/1260344164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feac4152470 0x7feac40cd570 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:05.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.614+0000 7feacc2e9700 1 --2- 172.21.15.124:0/1260344164 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feac40cb8d0 0x7feac40b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:05.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.614+0000 7feacc2e9700 1 -- 172.21.15.124:0/1260344164 >> 172.21.15.124:0/1260344164 conn(0x7feac40cdd00 msgr2=0x7feac40ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:05.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.614+0000 7feacc2e9700 1 -- 172.21.15.124:0/1260344164 shutdown_connections 2023-10-16T12:59:05.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.614+0000 7feacc2e9700 1 -- 172.21.15.124:0/1260344164 wait complete. 2023-10-16T12:59:05.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.615+0000 7feacc2e9700 1 Processor -- start 2023-10-16T12:59:05.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.615+0000 7feacc2e9700 1 -- start start 2023-10-16T12:59:05.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.616+0000 7feacc2e9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feac40b3240 0x7feac41f0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:05.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.616+0000 7feacc2e9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feac40cb8d0 0x7feac41f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:05.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.616+0000 7feacc2e9700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feac4152470 0x7feac41544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:05.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.616+0000 7feacc2e9700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac40c4ee0 con 0x7feac4152470 2023-10-16T12:59:05.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.616+0000 7feacc2e9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac41f15a0 con 0x7feac40cb8d0 2023-10-16T12:59:05.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.616+0000 7feacc2e9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac41f1880 con 0x7feac40b3240 2023-10-16T12:59:05.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.616+0000 7feaca886700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feac4152470 0x7feac41544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:05.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.616+0000 7feaca886700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feac4152470 0x7feac41544c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53414/0 (socket says 172.21.15.124:53414) 2023-10-16T12:59:05.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.616+0000 7feaca886700 1 -- 172.21.15.124:0/2824804071 learned_addr learned my addr 172.21.15.124:0/2824804071 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:05.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.616+0000 7feac9884700 1 --2- 172.21.15.124:0/2824804071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feac40cb8d0 0x7feac41f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:05.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.616+0000 7feaca085700 1 --2- 172.21.15.124:0/2824804071 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feac40b3240 0x7feac41f0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:05.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.616+0000 7feaca886700 1 -- 172.21.15.124:0/2824804071 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feac40b3240 msgr2=0x7feac41f0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:05.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.616+0000 7feaca886700 1 --2- 172.21.15.124:0/2824804071 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feac40b3240 0x7feac41f0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:05.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.616+0000 7feaca886700 1 -- 172.21.15.124:0/2824804071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feac40cb8d0 msgr2=0x7feac41f3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:05.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.616+0000 7feaca886700 1 --2- 172.21.15.124:0/2824804071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feac40cb8d0 0x7feac41f3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:05.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.616+0000 7feaca886700 1 -- 172.21.15.124:0/2824804071 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab40094a0 con 0x7feac4152470 2023-10-16T12:59:05.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.616+0000 7feaca886700 1 --2- 172.21.15.124:0/2824804071 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feac4152470 0x7feac41544c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7feabc00cc50 tx=0x7feabc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:05.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.616+0000 7feabaffd700 1 -- 172.21.15.124:0/2824804071 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc00ad80 con 0x7feac4152470 2023-10-16T12:59:05.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.617+0000 7feabaffd700 1 -- 172.21.15.124:0/2824804071 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feabc00ce50 con 0x7feac4152470 2023-10-16T12:59:05.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.617+0000 7feacc2e9700 1 -- 172.21.15.124:0/2824804071 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac41f1b60 con 0x7feac4152470 2023-10-16T12:59:05.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.617+0000 7feabaffd700 1 -- 172.21.15.124:0/2824804071 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc003c40 con 0x7feac4152470 2023-10-16T12:59:05.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.617+0000 7feacc2e9700 1 -- 172.21.15.124:0/2824804071 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac41f20a0 con 0x7feac4152470 2023-10-16T12:59:05.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.618+0000 7feacc2e9700 1 -- 172.21.15.124:0/2824804071 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feac40c5050 con 0x7feac4152470 2023-10-16T12:59:05.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.618+0000 7feabaffd700 1 -- 172.21.15.124:0/2824804071 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7feabc0050d0 con 0x7feac4152470 2023-10-16T12:59:05.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.618+0000 7feabaffd700 1 --2- 172.21.15.124:0/2824804071 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7feaa806af00 0x7feaa806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:05.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.618+0000 7feabaffd700 1 -- 172.21.15.124:0/2824804071 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feabc089910 con 0x7feac4152470 2023-10-16T12:59:05.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.618+0000 7feaca085700 1 --2- 172.21.15.124:0/2824804071 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7feaa806af00 0x7feaa806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:05.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.619+0000 7feaca085700 1 --2- 172.21.15.124:0/2824804071 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7feaa806af00 0x7feaa806d3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7feab4009fd0 tx=0x7feab401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:05.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.623+0000 7feabaffd700 1 -- 172.21.15.124:0/2824804071 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feabc054760 con 0x7feac4152470 2023-10-16T12:59:05.834 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.832+0000 7feacc2e9700 1 -- 172.21.15.124:0/2824804071 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7feac404ebb0 con 0x7feac4152470 2023-10-16T12:59:05.835 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.832+0000 7feabaffd700 1 -- 172.21.15.124:0/2824804071 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7feabc057d80 con 0x7feac4152470 2023-10-16T12:59:05.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.834+0000 7feacc2e9700 1 -- 172.21.15.124:0/2824804071 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7feaa806af00 msgr2=0x7feaa806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:05.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.834+0000 7feacc2e9700 1 --2- 172.21.15.124:0/2824804071 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7feaa806af00 0x7feaa806d3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7feab4009fd0 tx=0x7feab401c040 comp rx=0 tx=0).stop 2023-10-16T12:59:05.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.834+0000 7feacc2e9700 1 -- 172.21.15.124:0/2824804071 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feac4152470 msgr2=0x7feac41544c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:05.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.834+0000 7feacc2e9700 1 --2- 172.21.15.124:0/2824804071 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feac4152470 0x7feac41544c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7feabc00cc50 tx=0x7feabc00a340 comp rx=0 tx=0).stop 2023-10-16T12:59:05.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.834+0000 7feacc2e9700 1 -- 172.21.15.124:0/2824804071 shutdown_connections 2023-10-16T12:59:05.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.834+0000 7feacc2e9700 1 --2- 172.21.15.124:0/2824804071 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7feaa806af00 0x7feaa806d3c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:05.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.834+0000 7feacc2e9700 1 --2- 172.21.15.124:0/2824804071 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feac4152470 0x7feac41544c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:05.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.834+0000 7feacc2e9700 1 --2- 172.21.15.124:0/2824804071 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feac40b3240 0x7feac41f0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:05.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.834+0000 7feacc2e9700 1 --2- 172.21.15.124:0/2824804071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feac40cb8d0 0x7feac41f3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:05.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.834+0000 7feacc2e9700 1 -- 172.21.15.124:0/2824804071 >> 172.21.15.124:0/2824804071 conn(0x7feac40cdd00 msgr2=0x7feac40b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:05.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.834+0000 7feacc2e9700 1 -- 172.21.15.124:0/2824804071 shutdown_connections 2023-10-16T12:59:05.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:05.834+0000 7feacc2e9700 1 -- 172.21.15.124:0/2824804071 wait complete. 2023-10-16T12:59:05.840 INFO:teuthology.orchestra.run.smithi124.stderr:listed 0 entries 2023-10-16T12:59:05.848 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi124.front.sepia.ceph.com... 2023-10-16T12:59:05.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:05.849 DEBUG:teuthology.orchestra.run.smithi124:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-16T12:59:05.892 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi124.stderr:ceph-fuse[111768]: fuse finished with error 0 and tester_r 0 2023-10-16T12:59:05.893 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T12:59:05.951 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi124.front.sepia.ceph.com 2023-10-16T12:59:05.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:05.952 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-16T12:59:05.994 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:59:06.154 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.151+0000 7f2540330700 1 Processor -- start 2023-10-16T12:59:06.154 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.151+0000 7f2540330700 1 -- start start 2023-10-16T12:59:06.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.152+0000 7f2540330700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f253806d0c0 0x7f253806d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:06.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.152+0000 7f2540330700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25381615b0 con 0x7f25380b3410 2023-10-16T12:59:06.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.152+0000 7f2540330700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2538161890 con 0x7f253815e540 2023-10-16T12:59:06.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.152+0000 7f2540330700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253806d9e0 con 0x7f253806d0c0 2023-10-16T12:59:06.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.152+0000 7f253e0cc700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f253806d0c0 0x7f253806d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:06.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.152+0000 7f253e8cd700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f25380b3410 0x7f2538157750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42090/0 (socket says 172.21.15.124:42090) 2023-10-16T12:59:06.158 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.152+0000 7f253e8cd700 1 -- 172.21.15.124:0/1846335983 learned_addr learned my addr 172.21.15.124:0/1846335983 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:06.158 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.153+0000 7f253e0cc700 1 -- 172.21.15.124:0/1846335983 >> v1:172.21.15.192:6789/0 conn(0x7f253815e540 legacy=0x7f25380b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:06.158 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.153+0000 7f253e0cc700 1 -- 172.21.15.124:0/1846335983 >> v1:172.21.15.124:6789/0 conn(0x7f25380b3410 legacy=0x7f2538157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:06.158 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.153+0000 7f253e0cc700 1 -- 172.21.15.124:0/1846335983 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2538161b70 con 0x7f253806d0c0 2023-10-16T12:59:06.159 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.153+0000 7f253e0cc700 1 --2- 172.21.15.124:0/1846335983 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f253806d0c0 0x7f253806d4a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2528009840 tx=0x7f2528009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e9b192ad6bf2f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:06.159 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.153+0000 7f253d0ca700 1 -- 172.21.15.124:0/1846335983 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2528011830 con 0x7f253806d0c0 2023-10-16T12:59:06.159 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.153+0000 7f253d0ca700 1 -- 172.21.15.124:0/1846335983 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2528011990 con 0x7f253806d0c0 2023-10-16T12:59:06.159 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.153+0000 7f253d0ca700 1 -- 172.21.15.124:0/1846335983 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2528011d20 con 0x7f253806d0c0 2023-10-16T12:59:06.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.153+0000 7f2540330700 1 -- 172.21.15.124:0/1846335983 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f253806d0c0 msgr2=0x7f253806d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:06.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.153+0000 7f2540330700 1 --2- 172.21.15.124:0/1846335983 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f253806d0c0 0x7f253806d4a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2528009840 tx=0x7f2528009b50 comp rx=0 tx=0).stop 2023-10-16T12:59:06.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.154+0000 7f2540330700 1 -- 172.21.15.124:0/1846335983 shutdown_connections 2023-10-16T12:59:06.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.154+0000 7f2540330700 1 --2- 172.21.15.124:0/1846335983 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f253806d0c0 0x7f253806d4a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:06.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.154+0000 7f2540330700 1 -- 172.21.15.124:0/1846335983 >> 172.21.15.124:0/1846335983 conn(0x7f25380cdd00 msgr2=0x7f25380ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:06.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.154+0000 7f2540330700 1 -- 172.21.15.124:0/1846335983 shutdown_connections 2023-10-16T12:59:06.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.154+0000 7f2540330700 1 -- 172.21.15.124:0/1846335983 wait complete. 2023-10-16T12:59:06.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.155+0000 7f2540330700 1 Processor -- start 2023-10-16T12:59:06.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.155+0000 7f2540330700 1 -- start start 2023-10-16T12:59:06.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.156+0000 7f2540330700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f253806d0c0 0x7f25380c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:06.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.156+0000 7f2540330700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25380b3410 0x7f253814f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:06.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.156+0000 7f2540330700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f253815e540 0x7f25380adf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:06.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.156+0000 7f2540330700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253815a220 con 0x7f253815e540 2023-10-16T12:59:06.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.156+0000 7f2540330700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25380c58c0 con 0x7f253806d0c0 2023-10-16T12:59:06.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.156+0000 7f2540330700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25380c5ba0 con 0x7f25380b3410 2023-10-16T12:59:06.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.156+0000 7f253e8cd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f253815e540 0x7f25380adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:06.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.156+0000 7f253e8cd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f253815e540 0x7f25380adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53428/0 (socket says 172.21.15.124:53428) 2023-10-16T12:59:06.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.156+0000 7f253e8cd700 1 -- 172.21.15.124:0/3777305990 learned_addr learned my addr 172.21.15.124:0/3777305990 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:06.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.156+0000 7f253e0cc700 1 --2- 172.21.15.124:0/3777305990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f253806d0c0 0x7f25380c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:06.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.156+0000 7f253d8cb700 1 --2- 172.21.15.124:0/3777305990 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25380b3410 0x7f253814f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:06.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.157+0000 7f253e8cd700 1 -- 172.21.15.124:0/3777305990 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25380b3410 msgr2=0x7f253814f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:06.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.157+0000 7f253e8cd700 1 --2- 172.21.15.124:0/3777305990 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25380b3410 0x7f253814f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:06.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.157+0000 7f253e8cd700 1 -- 172.21.15.124:0/3777305990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f253806d0c0 msgr2=0x7f25380c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:06.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.157+0000 7f253e8cd700 1 --2- 172.21.15.124:0/3777305990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f253806d0c0 0x7f25380c5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:06.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.157+0000 7f253e8cd700 1 -- 172.21.15.124:0/3777305990 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25280094a0 con 0x7f253815e540 2023-10-16T12:59:06.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.157+0000 7f253e8cd700 1 --2- 172.21.15.124:0/3777305990 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f253815e540 0x7f25380adf10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f253000caf0 tx=0x7f253000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:06.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.157+0000 7f252effd700 1 -- 172.21.15.124:0/3777305990 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253000aad0 con 0x7f253815e540 2023-10-16T12:59:06.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.157+0000 7f252effd700 1 -- 172.21.15.124:0/3777305990 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253000ac30 con 0x7f253815e540 2023-10-16T12:59:06.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.157+0000 7f2540330700 1 -- 172.21.15.124:0/3777305990 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25380c5e80 con 0x7f253815e540 2023-10-16T12:59:06.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.157+0000 7f252effd700 1 -- 172.21.15.124:0/3777305990 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2530012400 con 0x7f253815e540 2023-10-16T12:59:06.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.157+0000 7f2540330700 1 -- 172.21.15.124:0/3777305990 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25380c6440 con 0x7f253815e540 2023-10-16T12:59:06.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.158+0000 7f2540330700 1 -- 172.21.15.124:0/3777305990 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25380c6660 con 0x7f253815e540 2023-10-16T12:59:06.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.158+0000 7f252effd700 1 -- 172.21.15.124:0/3777305990 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f253001b3b0 con 0x7f253815e540 2023-10-16T12:59:06.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.158+0000 7f252effd700 1 --2- 172.21.15.124:0/3777305990 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f251c06af00 0x7f251c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:06.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.159+0000 7f252effd700 1 -- 172.21.15.124:0/3777305990 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2530089540 con 0x7f253815e540 2023-10-16T12:59:06.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.159+0000 7f253e0cc700 1 --2- 172.21.15.124:0/3777305990 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f251c06af00 0x7f251c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:06.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.159+0000 7f253e0cc700 1 --2- 172.21.15.124:0/3777305990 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f251c06af00 0x7f251c06d3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f25280090b0 tx=0x7f2528008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:06.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.163+0000 7f252effd700 1 -- 172.21.15.124:0/3777305990 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2530054320 con 0x7f253815e540 2023-10-16T12:59:06.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.355+0000 7f2540330700 1 -- 172.21.15.124:0/3777305990 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f253804ebb0 con 0x7f253815e540 2023-10-16T12:59:06.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.356+0000 7f252effd700 1 -- 172.21.15.124:0/3777305990 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f2530057940 con 0x7f253815e540 2023-10-16T12:59:06.360 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:06.360 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":24,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:58:56.089767+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:59:06.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.358+0000 7f2540330700 1 -- 172.21.15.124:0/3777305990 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f251c06af00 msgr2=0x7f251c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:06.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.358+0000 7f2540330700 1 --2- 172.21.15.124:0/3777305990 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f251c06af00 0x7f251c06d3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f25280090b0 tx=0x7f2528008030 comp rx=0 tx=0).stop 2023-10-16T12:59:06.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.358+0000 7f2540330700 1 -- 172.21.15.124:0/3777305990 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f253815e540 msgr2=0x7f25380adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:06.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.358+0000 7f2540330700 1 --2- 172.21.15.124:0/3777305990 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f253815e540 0x7f25380adf10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f253000caf0 tx=0x7f253000ceb0 comp rx=0 tx=0).stop 2023-10-16T12:59:06.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.358+0000 7f2540330700 1 -- 172.21.15.124:0/3777305990 shutdown_connections 2023-10-16T12:59:06.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.358+0000 7f2540330700 1 --2- 172.21.15.124:0/3777305990 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f251c06af00 0x7f251c06d3c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:06.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.358+0000 7f2540330700 1 --2- 172.21.15.124:0/3777305990 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f253815e540 0x7f25380adf10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:06.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.358+0000 7f2540330700 1 --2- 172.21.15.124:0/3777305990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f253806d0c0 0x7f25380c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:06.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.358+0000 7f2540330700 1 --2- 172.21.15.124:0/3777305990 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25380b3410 0x7f253814f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:06.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.358+0000 7f2540330700 1 -- 172.21.15.124:0/3777305990 >> 172.21.15.124:0/3777305990 conn(0x7f25380cdd00 msgr2=0x7f25380b2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:06.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.358+0000 7f2540330700 1 -- 172.21.15.124:0/3777305990 shutdown_connections 2023-10-16T12:59:06.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.358+0000 7f2540330700 1 -- 172.21.15.124:0/3777305990 wait complete. 2023-10-16T12:59:06.373 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:59:06.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.491+0000 7fd8cea40700 1 Processor -- start 2023-10-16T12:59:06.494 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.491+0000 7fd8cea40700 1 -- start start 2023-10-16T12:59:06.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8cea40700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd8c8152470 0x7fd8c80cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:06.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8cea40700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8c80b3410 0x7fd8c80b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:06.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8cea40700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c8070d70 con 0x7fd8c80cb8d0 2023-10-16T12:59:06.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8cea40700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c8071200 con 0x7fd8c8152470 2023-10-16T12:59:06.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8cea40700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c80cbd80 con 0x7fd8c80b3410 2023-10-16T12:59:06.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8c77fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fd8c80cb8d0 0x7fd8c80b2d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42104/0 (socket says 172.21.15.124:42104) 2023-10-16T12:59:06.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8c77fe700 1 -- 172.21.15.124:0/1971710909 learned_addr learned my addr 172.21.15.124:0/1971710909 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:06.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8ccfdd700 1 --2- 172.21.15.124:0/1971710909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8c80b3410 0x7fd8c80b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:06.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8c7fff700 1 --2- 172.21.15.124:0/1971710909 >> v2:172.21.15.192:3300/0 conn(0x7fd8c8152470 0x7fd8c80cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:06.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8c6ffd700 1 -- 172.21.15.124:0/1971710909 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352564193 0 0) 0x7fd8c8070d70 con 0x7fd8c80cb8d0 2023-10-16T12:59:06.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8c6ffd700 1 -- 172.21.15.124:0/1971710909 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8b00035b0 con 0x7fd8c80cb8d0 2023-10-16T12:59:06.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8c6ffd700 1 -- 172.21.15.124:0/1971710909 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3997530054 0 0) 0x7fd8b00035b0 con 0x7fd8c80cb8d0 2023-10-16T12:59:06.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8c6ffd700 1 -- 172.21.15.124:0/1971710909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8c80b3410 msgr2=0x7fd8c80b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:06.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8c6ffd700 1 --2- 172.21.15.124:0/1971710909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8c80b3410 0x7fd8c80b60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:06.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8c6ffd700 1 -- 172.21.15.124:0/1971710909 >> v2:172.21.15.192:3300/0 conn(0x7fd8c8152470 msgr2=0x7fd8c80cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:06.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8c6ffd700 1 --2- 172.21.15.124:0/1971710909 >> v2:172.21.15.192:3300/0 conn(0x7fd8c8152470 0x7fd8c80cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:06.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8c6ffd700 1 -- 172.21.15.124:0/1971710909 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c8070440 con 0x7fd8c80cb8d0 2023-10-16T12:59:06.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8c6ffd700 1 -- 172.21.15.124:0/1971710909 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7fd8b8001670 con 0x7fd8c80cb8d0 2023-10-16T12:59:06.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8c6ffd700 1 -- 172.21.15.124:0/1971710909 >> v1:172.21.15.124:6789/0 conn(0x7fd8c80cb8d0 legacy=0x7fd8c80b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:06.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8c6ffd700 1 --2- 172.21.15.124:0/1971710909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8c80b3410 0x7fd8b0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:06.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8c6ffd700 1 --2- 172.21.15.124:0/1971710909 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8b0003f80 0x7fd8b0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:06.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8c6ffd700 1 --2- 172.21.15.124:0/1971710909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8b0004d90 0x7fd8b0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:06.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8c6ffd700 1 -- 172.21.15.124:0/1971710909 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c8071200 con 0x7fd8b0003f80 2023-10-16T12:59:06.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8c6ffd700 1 -- 172.21.15.124:0/1971710909 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c80cbd80 con 0x7fd8b0004d90 2023-10-16T12:59:06.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8c6ffd700 1 -- 172.21.15.124:0/1971710909 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b0009ae0 con 0x7fd8c80b3410 2023-10-16T12:59:06.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8c7fff700 1 --2- 172.21.15.124:0/1971710909 >> v2:172.21.15.192:3300/0 conn(0x7fd8c8152470 0x7fd8c80cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:59:06.503 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.492+0000 7fd8c77fe700 1 --2- 172.21.15.124:0/1971710909 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8b0003f80 0x7fd8b0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:06.503 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.493+0000 7fd8ccfdd700 1 --2- 172.21.15.124:0/1971710909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8b0004d90 0x7fd8b0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:06.503 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.493+0000 7fd8c7fff700 1 --2- 172.21.15.124:0/1971710909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8c80b3410 0x7fd8b0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:06.503 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.493+0000 7fd8c77fe700 1 -- 172.21.15.124:0/1971710909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8c80b3410 msgr2=0x7fd8b0003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:06.503 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.493+0000 7fd8c77fe700 1 --2- 172.21.15.124:0/1971710909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8c80b3410 0x7fd8b0003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:06.504 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.493+0000 7fd8c77fe700 1 -- 172.21.15.124:0/1971710909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8b0004d90 msgr2=0x7fd8b0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:06.504 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.493+0000 7fd8c77fe700 1 --2- 172.21.15.124:0/1971710909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8b0004d90 0x7fd8b0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:06.504 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.493+0000 7fd8c77fe700 1 -- 172.21.15.124:0/1971710909 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b00035b0 con 0x7fd8b0003f80 2023-10-16T12:59:06.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.493+0000 7fd8ccfdd700 1 --2- 172.21.15.124:0/1971710909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8b0004d90 0x7fd8b0005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:06.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.493+0000 7fd8c77fe700 1 --2- 172.21.15.124:0/1971710909 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8b0003f80 0x7fd8b0004850 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800c320 tx=0x7fd8b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d42decced581065 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:06.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.493+0000 7fd8c6ffd700 1 -- 172.21.15.124:0/1971710909 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b800ce60 con 0x7fd8b0003f80 2023-10-16T12:59:06.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.493+0000 7fd8c6ffd700 1 -- 172.21.15.124:0/1971710909 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b8005960 con 0x7fd8b0003f80 2023-10-16T12:59:06.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.493+0000 7fd8c6ffd700 1 -- 172.21.15.124:0/1971710909 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8005d10 con 0x7fd8b0003f80 2023-10-16T12:59:06.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.494+0000 7fd8cea40700 1 -- 172.21.15.124:0/1971710909 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8b0003f80 msgr2=0x7fd8b0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:06.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.494+0000 7fd8cea40700 1 --2- 172.21.15.124:0/1971710909 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8b0003f80 0x7fd8b0004850 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800c320 tx=0x7fd8b0005880 comp rx=0 tx=0).stop 2023-10-16T12:59:06.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.494+0000 7fd8ccfdd700 1 -- 172.21.15.124:0/1971710909 reap_dead start 2023-10-16T12:59:06.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.494+0000 7fd8cea40700 1 -- 172.21.15.124:0/1971710909 shutdown_connections 2023-10-16T12:59:06.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.494+0000 7fd8cea40700 1 -- 172.21.15.124:0/1971710909 >> 172.21.15.124:0/1971710909 conn(0x7fd8c80cdd00 msgr2=0x7fd8c80ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:06.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.494+0000 7fd8cea40700 1 -- 172.21.15.124:0/1971710909 shutdown_connections 2023-10-16T12:59:06.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.494+0000 7fd8cea40700 1 -- 172.21.15.124:0/1971710909 wait complete. 2023-10-16T12:59:06.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.495+0000 7fd8cea40700 1 Processor -- start 2023-10-16T12:59:06.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.495+0000 7fd8cea40700 1 -- start start 2023-10-16T12:59:06.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.496+0000 7fd8cea40700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8b0003f80 0x7fd8c81ee500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:06.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.496+0000 7fd8cea40700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8c80c4db0 0x7fd8c813cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:06.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.496+0000 7fd8cea40700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8c813d2a0 0x7fd8c815c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:06.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.496+0000 7fd8cea40700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c813d720 con 0x7fd8b0003f80 2023-10-16T12:59:06.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.496+0000 7fd8cea40700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c814fb40 con 0x7fd8c813d2a0 2023-10-16T12:59:06.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.496+0000 7fd8cea40700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c80c7c50 con 0x7fd8c80c4db0 2023-10-16T12:59:06.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.496+0000 7fd8c7fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8b0003f80 0x7fd8c81ee500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:06.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.496+0000 7fd8c7fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8b0003f80 0x7fd8c81ee500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53444/0 (socket says 172.21.15.124:53444) 2023-10-16T12:59:06.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.496+0000 7fd8c7fff700 1 -- 172.21.15.124:0/245572537 learned_addr learned my addr 172.21.15.124:0/245572537 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:06.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.496+0000 7fd8c77fe700 1 --2- 172.21.15.124:0/245572537 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8c80c4db0 0x7fd8c813cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:06.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.496+0000 7fd8ccfdd700 1 --2- 172.21.15.124:0/245572537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8c813d2a0 0x7fd8c815c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:06.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.496+0000 7fd8c7fff700 1 -- 172.21.15.124:0/245572537 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8c80c4db0 msgr2=0x7fd8c813cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:06.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.496+0000 7fd8c7fff700 1 --2- 172.21.15.124:0/245572537 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8c80c4db0 0x7fd8c813cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:06.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.496+0000 7fd8c7fff700 1 -- 172.21.15.124:0/245572537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8c813d2a0 msgr2=0x7fd8c815c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:06.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.496+0000 7fd8c7fff700 1 --2- 172.21.15.124:0/245572537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8c813d2a0 0x7fd8c815c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:06.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.496+0000 7fd8c7fff700 1 -- 172.21.15.124:0/245572537 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c814fe00 con 0x7fd8b0003f80 2023-10-16T12:59:06.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.496+0000 7fd8c77fe700 1 --2- 172.21.15.124:0/245572537 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8c80c4db0 0x7fd8c813cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:06.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.496+0000 7fd8ccfdd700 1 --2- 172.21.15.124:0/245572537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8c813d2a0 0x7fd8c815c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:06.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.496+0000 7fd8c7fff700 1 --2- 172.21.15.124:0/245572537 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8b0003f80 0x7fd8c81ee500 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc011900 tx=0x7fd8bc011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:06.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.496+0000 7fd8c4ff9700 1 -- 172.21.15.124:0/245572537 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc00fae0 con 0x7fd8b0003f80 2023-10-16T12:59:06.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.496+0000 7fd8c4ff9700 1 -- 172.21.15.124:0/245572537 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8bc00fc40 con 0x7fd8b0003f80 2023-10-16T12:59:06.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.496+0000 7fd8cea40700 1 -- 172.21.15.124:0/245572537 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c81500e0 con 0x7fd8b0003f80 2023-10-16T12:59:06.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.496+0000 7fd8c4ff9700 1 -- 172.21.15.124:0/245572537 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc011ea0 con 0x7fd8b0003f80 2023-10-16T12:59:06.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.496+0000 7fd8cea40700 1 -- 172.21.15.124:0/245572537 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c80c5230 con 0x7fd8b0003f80 2023-10-16T12:59:06.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.497+0000 7fd8cea40700 1 -- 172.21.15.124:0/245572537 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c8150600 con 0x7fd8b0003f80 2023-10-16T12:59:06.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.498+0000 7fd8c4ff9700 1 -- 172.21.15.124:0/245572537 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd8bc015460 con 0x7fd8b0003f80 2023-10-16T12:59:06.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.498+0000 7fd8c4ff9700 1 --2- 172.21.15.124:0/245572537 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd8b406af00 0x7fd8b406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:06.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.498+0000 7fd8c77fe700 1 --2- 172.21.15.124:0/245572537 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd8b406af00 0x7fd8b406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:06.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.498+0000 7fd8c4ff9700 1 -- 172.21.15.124:0/245572537 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd8bc089ea0 con 0x7fd8b0003f80 2023-10-16T12:59:06.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.499+0000 7fd8c77fe700 1 --2- 172.21.15.124:0/245572537 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd8b406af00 0x7fd8b406d3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8000c00 tx=0x7fd8b800a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:06.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.503+0000 7fd8c4ff9700 1 -- 172.21.15.124:0/245572537 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd8c8150600 con 0x7fd8b0003f80 2023-10-16T12:59:06.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.695+0000 7fd8cea40700 1 -- 172.21.15.124:0/245572537 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8c8150600 con 0x7fd8b0003f80 2023-10-16T12:59:06.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.696+0000 7fd8c4ff9700 1 -- 172.21.15.124:0/245572537 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fd8c8150600 con 0x7fd8b0003f80 2023-10-16T12:59:06.701 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:06.701 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":24,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:58:56.089767+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:59:06.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.698+0000 7fd8cea40700 1 -- 172.21.15.124:0/245572537 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd8b406af00 msgr2=0x7fd8b406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:06.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.698+0000 7fd8cea40700 1 --2- 172.21.15.124:0/245572537 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd8b406af00 0x7fd8b406d3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8000c00 tx=0x7fd8b800a000 comp rx=0 tx=0).stop 2023-10-16T12:59:06.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.698+0000 7fd8cea40700 1 -- 172.21.15.124:0/245572537 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8b0003f80 msgr2=0x7fd8c81ee500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:06.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.698+0000 7fd8cea40700 1 --2- 172.21.15.124:0/245572537 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8b0003f80 0x7fd8c81ee500 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc011900 tx=0x7fd8bc011cc0 comp rx=0 tx=0).stop 2023-10-16T12:59:06.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.698+0000 7fd8cea40700 1 -- 172.21.15.124:0/245572537 shutdown_connections 2023-10-16T12:59:06.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.698+0000 7fd8cea40700 1 --2- 172.21.15.124:0/245572537 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd8b406af00 0x7fd8b406d3c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:06.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.698+0000 7fd8cea40700 1 --2- 172.21.15.124:0/245572537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8c813d2a0 0x7fd8c815c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:06.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.698+0000 7fd8cea40700 1 --2- 172.21.15.124:0/245572537 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8b0003f80 0x7fd8c81ee500 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:06.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.698+0000 7fd8cea40700 1 --2- 172.21.15.124:0/245572537 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8c80c4db0 0x7fd8c813cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:06.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.698+0000 7fd8cea40700 1 -- 172.21.15.124:0/245572537 >> 172.21.15.124:0/245572537 conn(0x7fd8c80cdd00 msgr2=0x7fd8c806ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:06.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.698+0000 7fd8cea40700 1 -- 172.21.15.124:0/245572537 shutdown_connections 2023-10-16T12:59:06.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.698+0000 7fd8cea40700 1 -- 172.21.15.124:0/245572537 wait complete. 2023-10-16T12:59:06.713 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-16T12:59:06.837 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.834+0000 7f2c0bfdd700 1 Processor -- start 2023-10-16T12:59:06.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.834+0000 7f2c0bfdd700 1 -- start start 2023-10-16T12:59:06.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.835+0000 7f2c0bfdd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c0406dcc0 0x7f2c040cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:06.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.835+0000 7f2c0bfdd700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c040cba90 con 0x7f2c0415a250 2023-10-16T12:59:06.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.835+0000 7f2c0bfdd700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c0415ee40 con 0x7f2c0415dec0 2023-10-16T12:59:06.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.835+0000 7f2c0bfdd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c040cb510 con 0x7f2c0406dcc0 2023-10-16T12:59:06.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.835+0000 7f2c09d79700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f2c0415a250 0x7f2c040717b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42120/0 (socket says 172.21.15.124:42120) 2023-10-16T12:59:06.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.835+0000 7f2c09d79700 1 -- 172.21.15.124:0/2793964872 learned_addr learned my addr 172.21.15.124:0/2793964872 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:06.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.835+0000 7f2c0a57a700 1 --2- 172.21.15.124:0/2793964872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c0406dcc0 0x7f2c040cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:06.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.835+0000 7f2c08d77700 1 -- 172.21.15.124:0/2793964872 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243863609 0 0) 0x7f2c040cba90 con 0x7f2c0415a250 2023-10-16T12:59:06.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.835+0000 7f2c08d77700 1 -- 172.21.15.124:0/2793964872 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bf00035b0 con 0x7f2c0415a250 2023-10-16T12:59:06.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c08d77700 1 -- 172.21.15.124:0/2793964872 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3631526430 0 0) 0x7f2bf00035b0 con 0x7f2c0415a250 2023-10-16T12:59:06.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c08d77700 1 -- 172.21.15.124:0/2793964872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c0406dcc0 msgr2=0x7f2c040cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:06.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c08d77700 1 --2- 172.21.15.124:0/2793964872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c0406dcc0 0x7f2c040cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:06.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c08d77700 1 -- 172.21.15.124:0/2793964872 >> v1:172.21.15.192:6789/0 conn(0x7f2c0415dec0 legacy=0x7f2c0406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:06.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c08d77700 1 -- 172.21.15.124:0/2793964872 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0415e880 con 0x7f2c0415a250 2023-10-16T12:59:06.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c08d77700 1 -- 172.21.15.124:0/2793964872 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f2bf4001670 con 0x7f2c0415a250 2023-10-16T12:59:06.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c08d77700 1 -- 172.21.15.124:0/2793964872 >> v1:172.21.15.124:6789/0 conn(0x7f2c0415a250 legacy=0x7f2c040717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:06.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c08d77700 1 --2- 172.21.15.124:0/2793964872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bf0003a30 0x7f2bf0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:06.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c08d77700 1 --2- 172.21.15.124:0/2793964872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c0406dcc0 0x7f2bf0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:06.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c08d77700 1 --2- 172.21.15.124:0/2793964872 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2bf0004d90 0x7f2bf0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:06.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c08d77700 1 -- 172.21.15.124:0/2793964872 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c040cb510 con 0x7f2bf0004d90 2023-10-16T12:59:06.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c08d77700 1 -- 172.21.15.124:0/2793964872 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf000baf0 con 0x7f2bf0003a30 2023-10-16T12:59:06.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c08d77700 1 -- 172.21.15.124:0/2793964872 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf000bcb0 con 0x7f2c0406dcc0 2023-10-16T12:59:06.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c0a57a700 1 --2- 172.21.15.124:0/2793964872 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2bf0004d90 0x7f2bf0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:06.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c09d79700 1 --2- 172.21.15.124:0/2793964872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bf0003a30 0x7f2bf0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:06.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c09578700 1 --2- 172.21.15.124:0/2793964872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c0406dcc0 0x7f2bf0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:06.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c0a57a700 1 -- 172.21.15.124:0/2793964872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c0406dcc0 msgr2=0x7f2bf0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:06.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c0a57a700 1 --2- 172.21.15.124:0/2793964872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c0406dcc0 0x7f2bf0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:06.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c0a57a700 1 -- 172.21.15.124:0/2793964872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bf0003a30 msgr2=0x7f2bf0003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:06.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c0a57a700 1 --2- 172.21.15.124:0/2793964872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bf0003a30 0x7f2bf0003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:06.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c0a57a700 1 -- 172.21.15.124:0/2793964872 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf00035b0 con 0x7f2bf0004d90 2023-10-16T12:59:06.852 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c0a57a700 1 --2- 172.21.15.124:0/2793964872 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2bf0004d90 0x7f2bf0005210 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2c04067ae0 tx=0x7f2bf0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e159c1841344b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:06.852 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c08d77700 1 -- 172.21.15.124:0/2793964872 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc00ebd0 con 0x7f2bf0004d90 2023-10-16T12:59:06.852 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c08d77700 1 -- 172.21.15.124:0/2793964872 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bfc00f040 con 0x7f2bf0004d90 2023-10-16T12:59:06.852 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.836+0000 7f2c08d77700 1 -- 172.21.15.124:0/2793964872 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc014480 con 0x7f2bf0004d90 2023-10-16T12:59:06.852 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.837+0000 7f2c0bfdd700 1 -- 172.21.15.124:0/2793964872 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2bf0004d90 msgr2=0x7f2bf0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:06.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.837+0000 7f2c0bfdd700 1 --2- 172.21.15.124:0/2793964872 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2bf0004d90 0x7f2bf0005210 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2c04067ae0 tx=0x7f2bf0005880 comp rx=0 tx=0).stop 2023-10-16T12:59:06.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.837+0000 7f2c0a57a700 1 -- 172.21.15.124:0/2793964872 reap_dead start 2023-10-16T12:59:06.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.837+0000 7f2c0bfdd700 1 -- 172.21.15.124:0/2793964872 shutdown_connections 2023-10-16T12:59:06.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.837+0000 7f2c0bfdd700 1 -- 172.21.15.124:0/2793964872 >> 172.21.15.124:0/2793964872 conn(0x7f2c040ccbe0 msgr2=0x7f2c040ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:06.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.837+0000 7f2c0bfdd700 1 -- 172.21.15.124:0/2793964872 shutdown_connections 2023-10-16T12:59:06.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.837+0000 7f2c0bfdd700 1 -- 172.21.15.124:0/2793964872 wait complete. 2023-10-16T12:59:06.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.838+0000 7f2c0bfdd700 1 Processor -- start 2023-10-16T12:59:06.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.838+0000 7f2c0bfdd700 1 -- start start 2023-10-16T12:59:06.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.839+0000 7f2c0bfdd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c040b54d0 0x7f2c040b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:06.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.839+0000 7f2c0bfdd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c040b58b0 0x7f2c040b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:06.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.839+0000 7f2c0bfdd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2c0415c1f0 0x7f2c0415c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:06.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.839+0000 7f2c0bfdd700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c040b4770 con 0x7f2c0415c1f0 2023-10-16T12:59:06.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.839+0000 7f2c0bfdd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c040b3bf0 con 0x7f2c040b54d0 2023-10-16T12:59:06.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.839+0000 7f2c0bfdd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c040b3ed0 con 0x7f2c040b58b0 2023-10-16T12:59:06.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.839+0000 7f2c0a57a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2c0415c1f0 0x7f2c0415c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:06.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.839+0000 7f2c0a57a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2c0415c1f0 0x7f2c0415c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53468/0 (socket says 172.21.15.124:53468) 2023-10-16T12:59:06.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.839+0000 7f2c0a57a700 1 -- 172.21.15.124:0/1468413405 learned_addr learned my addr 172.21.15.124:0/1468413405 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:06.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.839+0000 7f2c09578700 1 --2- 172.21.15.124:0/1468413405 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c040b58b0 0x7f2c040b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:06.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.839+0000 7f2c0a57a700 1 -- 172.21.15.124:0/1468413405 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c040b58b0 msgr2=0x7f2c040b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:06.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.839+0000 7f2c09d79700 1 --2- 172.21.15.124:0/1468413405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c040b54d0 0x7f2c040b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:06.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.839+0000 7f2c0a57a700 1 --2- 172.21.15.124:0/1468413405 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c040b58b0 0x7f2c040b33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:06.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.839+0000 7f2c0a57a700 1 -- 172.21.15.124:0/1468413405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c040b54d0 msgr2=0x7f2c040b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:06.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.839+0000 7f2c0a57a700 1 --2- 172.21.15.124:0/1468413405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c040b54d0 0x7f2c040b2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:06.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.839+0000 7f2c0a57a700 1 -- 172.21.15.124:0/1468413405 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c040b41b0 con 0x7f2c0415c1f0 2023-10-16T12:59:06.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.840+0000 7f2c0a57a700 1 --2- 172.21.15.124:0/1468413405 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2c0415c1f0 0x7f2c0415c650 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc015000 tx=0x7f2bfc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:06.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.840+0000 7f2bfa7fc700 1 -- 172.21.15.124:0/1468413405 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc007000 con 0x7f2c0415c1f0 2023-10-16T12:59:06.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.840+0000 7f2bfa7fc700 1 -- 172.21.15.124:0/1468413405 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bfc014d60 con 0x7f2c0415c1f0 2023-10-16T12:59:06.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.840+0000 7f2c0bfdd700 1 -- 172.21.15.124:0/1468413405 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c040b4490 con 0x7f2c0415c1f0 2023-10-16T12:59:06.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.840+0000 7f2bfa7fc700 1 -- 172.21.15.124:0/1468413405 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc003c60 con 0x7f2c0415c1f0 2023-10-16T12:59:06.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.840+0000 7f2c0bfdd700 1 -- 172.21.15.124:0/1468413405 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c0415cb90 con 0x7f2c0415c1f0 2023-10-16T12:59:06.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.841+0000 7f2c0bfdd700 1 -- 172.21.15.124:0/1468413405 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c0404ebb0 con 0x7f2c0415c1f0 2023-10-16T12:59:06.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.841+0000 7f2bfa7fc700 1 -- 172.21.15.124:0/1468413405 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2bfc004020 con 0x7f2c0415c1f0 2023-10-16T12:59:06.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.842+0000 7f2bfa7fc700 1 --2- 172.21.15.124:0/1468413405 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f2be806af00 0x7f2be806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:06.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.842+0000 7f2c09d79700 1 --2- 172.21.15.124:0/1468413405 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f2be806af00 0x7f2be806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:06.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.842+0000 7f2bfa7fc700 1 -- 172.21.15.124:0/1468413405 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2bfc08b0c0 con 0x7f2c0415c1f0 2023-10-16T12:59:06.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.842+0000 7f2c09d79700 1 --2- 172.21.15.124:0/1468413405 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f2be806af00 0x7f2be806d3c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4007cf0 tx=0x7f2bf4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:06.860 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:06.846+0000 7f2bfa7fc700 1 -- 172.21.15.124:0/1468413405 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2bfc055fc0 con 0x7f2c0415c1f0 2023-10-16T12:59:07.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.082+0000 7f2c0bfdd700 1 -- 172.21.15.124:0/1468413405 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2c040b60e0 con 0x7f2c0415c1f0 2023-10-16T12:59:07.738 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.735+0000 7f2bfa7fc700 1 -- 172.21.15.124:0/1468413405 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2bfc0595e0 con 0x7f2c0415c1f0 2023-10-16T12:59:07.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.739+0000 7f2c0bfdd700 1 -- 172.21.15.124:0/1468413405 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f2be806af00 msgr2=0x7f2be806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:07.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.739+0000 7f2c0bfdd700 1 --2- 172.21.15.124:0/1468413405 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f2be806af00 0x7f2be806d3c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4007cf0 tx=0x7f2bf4009040 comp rx=0 tx=0).stop 2023-10-16T12:59:07.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.739+0000 7f2c0bfdd700 1 -- 172.21.15.124:0/1468413405 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2c0415c1f0 msgr2=0x7f2c0415c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:07.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.739+0000 7f2c0bfdd700 1 --2- 172.21.15.124:0/1468413405 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2c0415c1f0 0x7f2c0415c650 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc015000 tx=0x7f2bfc009750 comp rx=0 tx=0).stop 2023-10-16T12:59:07.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.739+0000 7f2c0bfdd700 1 -- 172.21.15.124:0/1468413405 shutdown_connections 2023-10-16T12:59:07.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.739+0000 7f2c0bfdd700 1 --2- 172.21.15.124:0/1468413405 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f2be806af00 0x7f2be806d3c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:07.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.739+0000 7f2c0bfdd700 1 --2- 172.21.15.124:0/1468413405 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2c0415c1f0 0x7f2c0415c650 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:07.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.739+0000 7f2c0bfdd700 1 --2- 172.21.15.124:0/1468413405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c040b54d0 0x7f2c040b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:07.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.739+0000 7f2c0bfdd700 1 --2- 172.21.15.124:0/1468413405 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c040b58b0 0x7f2c040b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:07.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.739+0000 7f2c0bfdd700 1 -- 172.21.15.124:0/1468413405 >> 172.21.15.124:0/1468413405 conn(0x7f2c040ccbe0 msgr2=0x7f2c04071790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:07.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.739+0000 7f2c0bfdd700 1 -- 172.21.15.124:0/1468413405 shutdown_connections 2023-10-16T12:59:07.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.739+0000 7f2c0bfdd700 1 -- 172.21.15.124:0/1468413405 wait complete. 2023-10-16T12:59:07.758 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-10-16T12:59:07.759 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-16T12:59:07.887 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.885+0000 7fb027b52700 1 Processor -- start 2023-10-16T12:59:07.888 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.885+0000 7fb027b52700 1 -- start start 2023-10-16T12:59:07.890 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.886+0000 7fb027b52700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb02015b210 0x7fb0200b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:07.890 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.886+0000 7fb027b52700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb020161f30 0x7fb0200cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:07.890 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.886+0000 7fb027b52700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0200b3220 con 0x7fb020143ae0 2023-10-16T12:59:07.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.886+0000 7fb027b52700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb020161240 con 0x7fb02015b210 2023-10-16T12:59:07.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.886+0000 7fb027b52700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0200b34f0 con 0x7fb020161f30 2023-10-16T12:59:07.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.886+0000 7fb0258ee700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb02015b210 0x7fb0200b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:07.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.886+0000 7fb0260ef700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fb020143ae0 0x7fb0200702f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42144/0 (socket says 172.21.15.124:42144) 2023-10-16T12:59:07.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.886+0000 7fb0260ef700 1 -- 172.21.15.124:0/3838522312 learned_addr learned my addr 172.21.15.124:0/3838522312 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:07.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.886+0000 7fb0258ee700 1 -- 172.21.15.124:0/3838522312 >> v2:172.21.15.192:3300/0 conn(0x7fb020161f30 msgr2=0x7fb0200cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:07.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.886+0000 7fb0250ed700 1 --2- 172.21.15.124:0/3838522312 >> v2:172.21.15.192:3300/0 conn(0x7fb020161f30 0x7fb0200cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:07.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.886+0000 7fb0258ee700 1 --2- 172.21.15.124:0/3838522312 >> v2:172.21.15.192:3300/0 conn(0x7fb020161f30 0x7fb0200cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:07.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.886+0000 7fb0258ee700 1 -- 172.21.15.124:0/3838522312 >> v1:172.21.15.124:6789/0 conn(0x7fb020143ae0 legacy=0x7fb0200702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:07.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.886+0000 7fb0248ec700 1 -- 172.21.15.124:0/3838522312 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 62625330 0 0) 0x7fb0200b3220 con 0x7fb020143ae0 2023-10-16T12:59:07.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.886+0000 7fb0258ee700 1 -- 172.21.15.124:0/3838522312 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb020161450 con 0x7fb02015b210 2023-10-16T12:59:07.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.886+0000 7fb0258ee700 1 --2- 172.21.15.124:0/3838522312 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb02015b210 0x7fb0200b2ce0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb01c009840 tx=0x7fb01c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bece1a5a9f34569 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:07.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.887+0000 7fb0248ec700 1 -- 172.21.15.124:0/3838522312 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c011830 con 0x7fb02015b210 2023-10-16T12:59:07.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.887+0000 7fb0248ec700 1 -- 172.21.15.124:0/3838522312 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c011990 con 0x7fb02015b210 2023-10-16T12:59:07.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.887+0000 7fb0248ec700 1 -- 172.21.15.124:0/3838522312 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c011d20 con 0x7fb02015b210 2023-10-16T12:59:07.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.887+0000 7fb027b52700 1 -- 172.21.15.124:0/3838522312 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb02015b210 msgr2=0x7fb0200b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:07.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.887+0000 7fb027b52700 1 --2- 172.21.15.124:0/3838522312 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb02015b210 0x7fb0200b2ce0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb01c009840 tx=0x7fb01c009b50 comp rx=0 tx=0).stop 2023-10-16T12:59:07.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.887+0000 7fb027b52700 1 -- 172.21.15.124:0/3838522312 shutdown_connections 2023-10-16T12:59:07.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.887+0000 7fb027b52700 1 --2- 172.21.15.124:0/3838522312 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb02015b210 0x7fb0200b2ce0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:07.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.887+0000 7fb027b52700 1 --2- 172.21.15.124:0/3838522312 >> v2:172.21.15.192:3300/0 conn(0x7fb020161f30 0x7fb0200cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:07.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.887+0000 7fb027b52700 1 -- 172.21.15.124:0/3838522312 >> 172.21.15.124:0/3838522312 conn(0x7fb0200cdce0 msgr2=0x7fb0200ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:07.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.887+0000 7fb027b52700 1 -- 172.21.15.124:0/3838522312 shutdown_connections 2023-10-16T12:59:07.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.887+0000 7fb027b52700 1 -- 172.21.15.124:0/3838522312 wait complete. 2023-10-16T12:59:07.898 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.888+0000 7fb027b52700 1 Processor -- start 2023-10-16T12:59:07.898 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.888+0000 7fb027b52700 1 -- start start 2023-10-16T12:59:07.898 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.889+0000 7fb027b52700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb020143ae0 0x7fb0200ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:07.899 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.889+0000 7fb027b52700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb02015b210 0x7fb0200ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:07.899 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.889+0000 7fb027b52700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb020161f30 0x7fb0200b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:07.899 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.889+0000 7fb027b52700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0200b68d0 con 0x7fb02015b210 2023-10-16T12:59:07.899 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.889+0000 7fb027b52700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0201f45a0 con 0x7fb020143ae0 2023-10-16T12:59:07.899 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.889+0000 7fb027b52700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0201f4880 con 0x7fb020161f30 2023-10-16T12:59:07.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.889+0000 7fb0250ed700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb02015b210 0x7fb0200ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:07.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.889+0000 7fb0250ed700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb02015b210 0x7fb0200ca880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53480/0 (socket says 172.21.15.124:53480) 2023-10-16T12:59:07.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.889+0000 7fb0250ed700 1 -- 172.21.15.124:0/1108114120 learned_addr learned my addr 172.21.15.124:0/1108114120 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:07.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.889+0000 7fb0260ef700 1 --2- 172.21.15.124:0/1108114120 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb020161f30 0x7fb0200b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:07.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.889+0000 7fb0258ee700 1 --2- 172.21.15.124:0/1108114120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb020143ae0 0x7fb0200ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:07.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.889+0000 7fb0250ed700 1 -- 172.21.15.124:0/1108114120 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb020161f30 msgr2=0x7fb0200b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:07.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.889+0000 7fb0250ed700 1 --2- 172.21.15.124:0/1108114120 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb020161f30 0x7fb0200b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:07.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.889+0000 7fb0250ed700 1 -- 172.21.15.124:0/1108114120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb020143ae0 msgr2=0x7fb0200ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:07.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.889+0000 7fb0250ed700 1 --2- 172.21.15.124:0/1108114120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb020143ae0 0x7fb0200ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:07.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.889+0000 7fb0250ed700 1 -- 172.21.15.124:0/1108114120 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c0094a0 con 0x7fb02015b210 2023-10-16T12:59:07.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.890+0000 7fb0250ed700 1 --2- 172.21.15.124:0/1108114120 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb02015b210 0x7fb0200ca880 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb01000c7f0 tx=0x7fb01000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:07.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.890+0000 7fb0167fc700 1 -- 172.21.15.124:0/1108114120 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb010011800 con 0x7fb02015b210 2023-10-16T12:59:07.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.890+0000 7fb0167fc700 1 -- 172.21.15.124:0/1108114120 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb010011960 con 0x7fb02015b210 2023-10-16T12:59:07.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.890+0000 7fb0167fc700 1 -- 172.21.15.124:0/1108114120 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb010011d10 con 0x7fb02015b210 2023-10-16T12:59:07.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.890+0000 7fb027b52700 1 -- 172.21.15.124:0/1108114120 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0201f4b60 con 0x7fb02015b210 2023-10-16T12:59:07.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.890+0000 7fb027b52700 1 -- 172.21.15.124:0/1108114120 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0200b5b70 con 0x7fb02015b210 2023-10-16T12:59:07.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.891+0000 7fb027b52700 1 -- 172.21.15.124:0/1108114120 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0201f4da0 con 0x7fb02015b210 2023-10-16T12:59:07.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.891+0000 7fb0167fc700 1 -- 172.21.15.124:0/1108114120 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb010018360 con 0x7fb02015b210 2023-10-16T12:59:07.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.892+0000 7fb0167fc700 1 --2- 172.21.15.124:0/1108114120 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb00406af00 0x7fb00406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:07.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.892+0000 7fb0167fc700 1 -- 172.21.15.124:0/1108114120 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb0100896f0 con 0x7fb02015b210 2023-10-16T12:59:07.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.892+0000 7fb0258ee700 1 --2- 172.21.15.124:0/1108114120 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb00406af00 0x7fb00406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:07.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.892+0000 7fb0258ee700 1 --2- 172.21.15.124:0/1108114120 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb00406af00 0x7fb00406d3c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0090b0 tx=0x7fb01c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:07.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:07.896+0000 7fb0167fc700 1 -- 172.21.15.124:0/1108114120 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb0201f4da0 con 0x7fb02015b210 2023-10-16T12:59:08.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.132+0000 7fb027b52700 1 -- 172.21.15.124:0/1108114120 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb0201f4da0 con 0x7fb02015b210 2023-10-16T12:59:08.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.749+0000 7fb0167fc700 1 -- 172.21.15.124:0/1108114120 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb0201f4da0 con 0x7fb02015b210 2023-10-16T12:59:08.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.752+0000 7fb027b52700 1 -- 172.21.15.124:0/1108114120 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb00406af00 msgr2=0x7fb00406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:08.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.752+0000 7fb027b52700 1 --2- 172.21.15.124:0/1108114120 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb00406af00 0x7fb00406d3c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0090b0 tx=0x7fb01c008030 comp rx=0 tx=0).stop 2023-10-16T12:59:08.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.752+0000 7fb027b52700 1 -- 172.21.15.124:0/1108114120 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb02015b210 msgr2=0x7fb0200ca880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:08.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.752+0000 7fb027b52700 1 --2- 172.21.15.124:0/1108114120 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb02015b210 0x7fb0200ca880 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb01000c7f0 tx=0x7fb01000cbb0 comp rx=0 tx=0).stop 2023-10-16T12:59:08.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.752+0000 7fb027b52700 1 -- 172.21.15.124:0/1108114120 shutdown_connections 2023-10-16T12:59:08.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.752+0000 7fb027b52700 1 --2- 172.21.15.124:0/1108114120 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb00406af00 0x7fb00406d3c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:08.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.752+0000 7fb027b52700 1 --2- 172.21.15.124:0/1108114120 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb020161f30 0x7fb0200b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:08.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.752+0000 7fb027b52700 1 --2- 172.21.15.124:0/1108114120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb020143ae0 0x7fb0200ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:08.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.752+0000 7fb027b52700 1 --2- 172.21.15.124:0/1108114120 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb02015b210 0x7fb0200ca880 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:08.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.752+0000 7fb027b52700 1 -- 172.21.15.124:0/1108114120 >> 172.21.15.124:0/1108114120 conn(0x7fb0200cdce0 msgr2=0x7fb0200cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:08.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.752+0000 7fb027b52700 1 -- 172.21.15.124:0/1108114120 shutdown_connections 2023-10-16T12:59:08.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.752+0000 7fb027b52700 1 -- 172.21.15.124:0/1108114120 wait complete. 2023-10-16T12:59:08.769 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-16T12:59:08.770 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T12:59:08.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.892+0000 7f042b987700 1 Processor -- start 2023-10-16T12:59:08.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.893+0000 7f042b987700 1 -- start start 2023-10-16T12:59:08.898 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.893+0000 7f042b987700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04240cf7d0 0x7f042415e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:08.898 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.893+0000 7f042b987700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f04240ca7d0 0x7f0424071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:08.898 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.893+0000 7f042b987700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04240cfeb0 con 0x7f042406a820 2023-10-16T12:59:08.899 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.893+0000 7f042b987700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04240ce410 con 0x7f04240ca7d0 2023-10-16T12:59:08.899 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.893+0000 7f042b987700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04240cfc30 con 0x7f04240cf7d0 2023-10-16T12:59:08.899 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.894+0000 7f0428f22700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04240cf7d0 0x7f042415e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:08.899 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.894+0000 7f0429f24700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f04240ca7d0 0x7f0424071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:08.899 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.894+0000 7f0428f22700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04240cf7d0 0x7f042415e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:39566/0 (socket says 172.21.15.124:39566) 2023-10-16T12:59:08.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.894+0000 7f0428f22700 1 -- 172.21.15.124:0/391121453 learned_addr learned my addr 172.21.15.124:0/391121453 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:08.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.894+0000 7f0429f24700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f04240ca7d0 0x7f0424071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:33656/0 (socket says 172.21.15.124:33656) 2023-10-16T12:59:08.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.894+0000 7f0429f24700 1 -- 172.21.15.124:0/391121453 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04240cf7d0 msgr2=0x7f042415e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:08.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.894+0000 7f0429f24700 1 --2- 172.21.15.124:0/391121453 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04240cf7d0 0x7f042415e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:08.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.894+0000 7f0429f24700 1 -- 172.21.15.124:0/391121453 >> v1:172.21.15.192:6789/0 conn(0x7f042406a820 legacy=0x7f042406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:08.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.894+0000 7f0429f24700 1 -- 172.21.15.124:0/391121453 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04240af9d0 con 0x7f04240ca7d0 2023-10-16T12:59:08.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.894+0000 7f0428f22700 1 --2- 172.21.15.124:0/391121453 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04240cf7d0 0x7f042415e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:59:08.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.894+0000 7f0429f24700 1 --2- 172.21.15.124:0/391121453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04240ca7d0 0x7f0424071ea0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f041c009d90 tx=0x7f041c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e301ff73a46ffca server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:08.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.894+0000 7f041bfff700 1 -- 172.21.15.124:0/391121453 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c00e070 con 0x7f04240ca7d0 2023-10-16T12:59:08.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.895+0000 7f041bfff700 1 -- 172.21.15.124:0/391121453 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041c00bb20 con 0x7f04240ca7d0 2023-10-16T12:59:08.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.895+0000 7f041bfff700 1 -- 172.21.15.124:0/391121453 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c012430 con 0x7f04240ca7d0 2023-10-16T12:59:08.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.895+0000 7f042b987700 1 -- 172.21.15.124:0/391121453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04240ca7d0 msgr2=0x7f0424071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:08.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.895+0000 7f042b987700 1 --2- 172.21.15.124:0/391121453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04240ca7d0 0x7f0424071ea0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f041c009d90 tx=0x7f041c00b330 comp rx=0 tx=0).stop 2023-10-16T12:59:08.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.895+0000 7f042b987700 1 -- 172.21.15.124:0/391121453 shutdown_connections 2023-10-16T12:59:08.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.895+0000 7f042b987700 1 --2- 172.21.15.124:0/391121453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04240ca7d0 0x7f0424071ea0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:08.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.895+0000 7f042b987700 1 --2- 172.21.15.124:0/391121453 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04240cf7d0 0x7f042415e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:08.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.895+0000 7f042b987700 1 -- 172.21.15.124:0/391121453 >> 172.21.15.124:0/391121453 conn(0x7f04240d0180 msgr2=0x7f04240d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:08.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.895+0000 7f042b987700 1 -- 172.21.15.124:0/391121453 shutdown_connections 2023-10-16T12:59:08.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.895+0000 7f042b987700 1 -- 172.21.15.124:0/391121453 wait complete. 2023-10-16T12:59:08.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.896+0000 7f042b987700 1 Processor -- start 2023-10-16T12:59:08.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.896+0000 7f042b987700 1 -- start start 2023-10-16T12:59:08.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.897+0000 7f042b987700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f042406a820 0x7f04241f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:08.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.897+0000 7f042b987700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04240ca7d0 0x7f04240c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:08.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.897+0000 7f042b987700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04240cf7d0 0x7f04240c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:08.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.897+0000 7f042b987700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04241f2fb0 con 0x7f042406a820 2023-10-16T12:59:08.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.897+0000 7f042b987700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04240c7f30 con 0x7f04240ca7d0 2023-10-16T12:59:08.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.897+0000 7f042b987700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04240c8210 con 0x7f04240cf7d0 2023-10-16T12:59:08.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.897+0000 7f0429723700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f042406a820 0x7f04241f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:08.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.897+0000 7f0429723700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f042406a820 0x7f04241f2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53492/0 (socket says 172.21.15.124:53492) 2023-10-16T12:59:08.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.897+0000 7f0429723700 1 -- 172.21.15.124:0/4199192369 learned_addr learned my addr 172.21.15.124:0/4199192369 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:08.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.897+0000 7f0428f22700 1 --2- 172.21.15.124:0/4199192369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04240ca7d0 0x7f04240c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:08.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.897+0000 7f0429f24700 1 --2- 172.21.15.124:0/4199192369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04240cf7d0 0x7f04240c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:08.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.897+0000 7f0429723700 1 -- 172.21.15.124:0/4199192369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04240cf7d0 msgr2=0x7f04240c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:08.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.897+0000 7f0429723700 1 --2- 172.21.15.124:0/4199192369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04240cf7d0 0x7f04240c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:08.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.897+0000 7f0429723700 1 -- 172.21.15.124:0/4199192369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04240ca7d0 msgr2=0x7f04240c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:08.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.897+0000 7f0429723700 1 --2- 172.21.15.124:0/4199192369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04240ca7d0 0x7f04240c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:08.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.898+0000 7f0429723700 1 -- 172.21.15.124:0/4199192369 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0420009550 con 0x7f042406a820 2023-10-16T12:59:08.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.898+0000 7f0429723700 1 --2- 172.21.15.124:0/4199192369 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f042406a820 0x7f04241f2a70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f041400c4e0 tx=0x7f041400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:08.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.898+0000 7f0419ffb700 1 -- 172.21.15.124:0/4199192369 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04140052d0 con 0x7f042406a820 2023-10-16T12:59:08.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.898+0000 7f0419ffb700 1 -- 172.21.15.124:0/4199192369 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0414005430 con 0x7f042406a820 2023-10-16T12:59:08.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.898+0000 7f0419ffb700 1 -- 172.21.15.124:0/4199192369 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04140038c0 con 0x7f042406a820 2023-10-16T12:59:08.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.898+0000 7f042b987700 1 -- 172.21.15.124:0/4199192369 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041c009a70 con 0x7f042406a820 2023-10-16T12:59:08.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.898+0000 7f042b987700 1 -- 172.21.15.124:0/4199192369 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04240c87d0 con 0x7f042406a820 2023-10-16T12:59:08.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.899+0000 7f042b987700 1 -- 172.21.15.124:0/4199192369 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f042404ebb0 con 0x7f042406a820 2023-10-16T12:59:08.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.899+0000 7f0419ffb700 1 -- 172.21.15.124:0/4199192369 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0414003a20 con 0x7f042406a820 2023-10-16T12:59:08.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.900+0000 7f0419ffb700 1 --2- 172.21.15.124:0/4199192369 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f040806af00 0x7f040806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:08.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.900+0000 7f0419ffb700 1 -- 172.21.15.124:0/4199192369 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0414088de0 con 0x7f042406a820 2023-10-16T12:59:08.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.900+0000 7f0428f22700 1 --2- 172.21.15.124:0/4199192369 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f040806af00 0x7f040806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:08.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.900+0000 7f0428f22700 1 --2- 172.21.15.124:0/4199192369 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f040806af00 0x7f040806d3c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f042415cf90 tx=0x7f0420008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:08.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:08.904+0000 7f0419ffb700 1 -- 172.21.15.124:0/4199192369 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0414053ba0 con 0x7f042406a820 2023-10-16T12:59:09.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.136+0000 7f042b987700 1 -- 172.21.15.124:0/4199192369 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04240b0600 con 0x7f042406a820 2023-10-16T12:59:09.139 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.136+0000 7f0419ffb700 1 -- 172.21.15.124:0/4199192369 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4918 (secure 0 0 0) 0x7f0414017090 con 0x7f042406a820 2023-10-16T12:59:09.139 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:09.140 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1489119886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6833","nonce":1489119886},{"type":"v1","addr":"172.21.15.192:6835","nonce":1489119886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/2221949787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":2221949787},{"type":"v1","addr":"172.21.15.124:6836","nonce":2221949787}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1247092782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":1247092782},{"type":"v1","addr":"172.21.15.124:6837","nonce":1247092782}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T12:58:51.047667+0000","modified":"2023-10-16T12:59:08.133656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6834/621867052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":621867052},{"type":"v1","addr":"172.21.15.192:6834","nonce":621867052}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T12:59:09.141 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.139+0000 7f042b987700 1 -- 172.21.15.124:0/4199192369 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f040806af00 msgr2=0x7f040806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:09.142 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.139+0000 7f042b987700 1 --2- 172.21.15.124:0/4199192369 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f040806af00 0x7f040806d3c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f042415cf90 tx=0x7f0420008040 comp rx=0 tx=0).stop 2023-10-16T12:59:09.142 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.139+0000 7f042b987700 1 -- 172.21.15.124:0/4199192369 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f042406a820 msgr2=0x7f04241f2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:09.142 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.139+0000 7f042b987700 1 --2- 172.21.15.124:0/4199192369 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f042406a820 0x7f04241f2a70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f041400c4e0 tx=0x7f041400c8a0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.142 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.139+0000 7f042b987700 1 -- 172.21.15.124:0/4199192369 shutdown_connections 2023-10-16T12:59:09.142 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.139+0000 7f042b987700 1 --2- 172.21.15.124:0/4199192369 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f040806af00 0x7f040806d3c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.139+0000 7f042b987700 1 --2- 172.21.15.124:0/4199192369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04240cf7d0 0x7f04240c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.139+0000 7f042b987700 1 --2- 172.21.15.124:0/4199192369 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f042406a820 0x7f04241f2a70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.139+0000 7f042b987700 1 --2- 172.21.15.124:0/4199192369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04240ca7d0 0x7f04240c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.139+0000 7f042b987700 1 -- 172.21.15.124:0/4199192369 >> 172.21.15.124:0/4199192369 conn(0x7f04240d0180 msgr2=0x7f04240b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:09.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.139+0000 7f042b987700 1 -- 172.21.15.124:0/4199192369 shutdown_connections 2023-10-16T12:59:09.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.139+0000 7f042b987700 1 -- 172.21.15.124:0/4199192369 wait complete. 2023-10-16T12:59:09.144 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 9 2023-10-16T12:59:09.153 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:59:09.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.270+0000 7f48d3658700 1 Processor -- start 2023-10-16T12:59:09.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.270+0000 7f48d3658700 1 -- start start 2023-10-16T12:59:09.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.271+0000 7f48d3658700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f48cc15d890 0x7f48cc0ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:09.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.271+0000 7f48d3658700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48cc0ce610 0x7f48cc06b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:09.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.271+0000 7f48d3658700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f48cc06bd20 0x7f48cc0b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:09.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.271+0000 7f48d3658700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48cc06c170 con 0x7f48cc06bd20 2023-10-16T12:59:09.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.271+0000 7f48d3658700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48cc0ceab0 con 0x7f48cc15d890 2023-10-16T12:59:09.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.271+0000 7f48d3658700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc0ced90 con 0x7f48cc0ce610 2023-10-16T12:59:09.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.271+0000 7f48d1bf5700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f48cc06bd20 0x7f48cc0b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:09.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.271+0000 7f48d1bf5700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f48cc06bd20 0x7f48cc0b4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53504/0 (socket says 172.21.15.124:53504) 2023-10-16T12:59:09.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.271+0000 7f48d1bf5700 1 -- 172.21.15.124:0/3051743062 learned_addr learned my addr 172.21.15.124:0/3051743062 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:09.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.271+0000 7f48d0bf3700 1 --2- 172.21.15.124:0/3051743062 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48cc0ce610 0x7f48cc06b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:09.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.271+0000 7f48d13f4700 1 --2- 172.21.15.124:0/3051743062 >> v2:172.21.15.192:3300/0 conn(0x7f48cc15d890 0x7f48cc0ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:09.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.271+0000 7f48d1bf5700 1 -- 172.21.15.124:0/3051743062 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48cc0ce610 msgr2=0x7f48cc06b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:09.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.271+0000 7f48d1bf5700 1 --2- 172.21.15.124:0/3051743062 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48cc0ce610 0x7f48cc06b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.271+0000 7f48d1bf5700 1 -- 172.21.15.124:0/3051743062 >> v2:172.21.15.192:3300/0 conn(0x7f48cc15d890 msgr2=0x7f48cc0ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:09.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.271+0000 7f48d1bf5700 1 --2- 172.21.15.124:0/3051743062 >> v2:172.21.15.192:3300/0 conn(0x7f48cc15d890 0x7f48cc0ce0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.271+0000 7f48d1bf5700 1 -- 172.21.15.124:0/3051743062 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48cc0cf070 con 0x7f48cc06bd20 2023-10-16T12:59:09.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.272+0000 7f48d1bf5700 1 --2- 172.21.15.124:0/3051743062 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48cc06bd20 0x7f48cc0b4fb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f48cc0cff10 tx=0x7f48c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42209e274e5cf6b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:09.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.272+0000 7f48c3fff700 1 -- 172.21.15.124:0/3051743062 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c400e070 con 0x7f48cc06bd20 2023-10-16T12:59:09.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.272+0000 7f48c3fff700 1 -- 172.21.15.124:0/3051743062 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c400b9c0 con 0x7f48cc06bd20 2023-10-16T12:59:09.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.272+0000 7f48c3fff700 1 -- 172.21.15.124:0/3051743062 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c400bd70 con 0x7f48cc06bd20 2023-10-16T12:59:09.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.272+0000 7f48d3658700 1 -- 172.21.15.124:0/3051743062 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48cc06bd20 msgr2=0x7f48cc0b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:09.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.272+0000 7f48d3658700 1 --2- 172.21.15.124:0/3051743062 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48cc06bd20 0x7f48cc0b4fb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f48cc0cff10 tx=0x7f48c400b330 comp rx=0 tx=0).stop 2023-10-16T12:59:09.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.272+0000 7f48d3658700 1 -- 172.21.15.124:0/3051743062 shutdown_connections 2023-10-16T12:59:09.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.272+0000 7f48d3658700 1 --2- 172.21.15.124:0/3051743062 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48cc06bd20 0x7f48cc0b4fb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.272+0000 7f48d3658700 1 --2- 172.21.15.124:0/3051743062 >> v2:172.21.15.192:3300/0 conn(0x7f48cc15d890 0x7f48cc0ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.272+0000 7f48d3658700 1 --2- 172.21.15.124:0/3051743062 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48cc0ce610 0x7f48cc06b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.272+0000 7f48d3658700 1 -- 172.21.15.124:0/3051743062 >> 172.21.15.124:0/3051743062 conn(0x7f48cc072340 msgr2=0x7f48cc072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:09.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.272+0000 7f48d3658700 1 -- 172.21.15.124:0/3051743062 shutdown_connections 2023-10-16T12:59:09.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.272+0000 7f48d3658700 1 -- 172.21.15.124:0/3051743062 wait complete. 2023-10-16T12:59:09.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.274+0000 7f48d3658700 1 Processor -- start 2023-10-16T12:59:09.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.274+0000 7f48d3658700 1 -- start start 2023-10-16T12:59:09.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.275+0000 7f48d3658700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48cc06bd20 0x7f48cc14d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:09.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.275+0000 7f48d3658700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48cc0ce610 0x7f48cc0cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:09.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.275+0000 7f48d3658700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48cc15d890 0x7f48cc1f33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:09.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.275+0000 7f48d3658700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc14b4b0 con 0x7f48cc0ce610 2023-10-16T12:59:09.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.275+0000 7f48d3658700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc0ccc00 con 0x7f48cc06bd20 2023-10-16T12:59:09.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.275+0000 7f48d3658700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc14ced0 con 0x7f48cc15d890 2023-10-16T12:59:09.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.275+0000 7f48d0bf3700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48cc0ce610 0x7f48cc0cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:09.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.275+0000 7f48d0bf3700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48cc0ce610 0x7f48cc0cc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53508/0 (socket says 172.21.15.124:53508) 2023-10-16T12:59:09.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.275+0000 7f48d0bf3700 1 -- 172.21.15.124:0/3659577556 learned_addr learned my addr 172.21.15.124:0/3659577556 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:09.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.275+0000 7f48d1bf5700 1 --2- 172.21.15.124:0/3659577556 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48cc15d890 0x7f48cc1f33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:09.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.275+0000 7f48d13f4700 1 --2- 172.21.15.124:0/3659577556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48cc06bd20 0x7f48cc14d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:09.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.275+0000 7f48d0bf3700 1 -- 172.21.15.124:0/3659577556 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48cc15d890 msgr2=0x7f48cc1f33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:09.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.275+0000 7f48d0bf3700 1 --2- 172.21.15.124:0/3659577556 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48cc15d890 0x7f48cc1f33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.275+0000 7f48d0bf3700 1 -- 172.21.15.124:0/3659577556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48cc06bd20 msgr2=0x7f48cc14d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:09.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.275+0000 7f48d0bf3700 1 --2- 172.21.15.124:0/3659577556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48cc06bd20 0x7f48cc14d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.275+0000 7f48d0bf3700 1 -- 172.21.15.124:0/3659577556 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c4009b30 con 0x7f48cc0ce610 2023-10-16T12:59:09.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.275+0000 7f48d0bf3700 1 --2- 172.21.15.124:0/3659577556 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48cc0ce610 0x7f48cc0cc140 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f48c800e810 tx=0x7f48c800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:09.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.276+0000 7f48c1ffb700 1 -- 172.21.15.124:0/3659577556 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c800c070 con 0x7f48cc0ce610 2023-10-16T12:59:09.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.276+0000 7f48c1ffb700 1 -- 172.21.15.124:0/3659577556 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c8013610 con 0x7f48cc0ce610 2023-10-16T12:59:09.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.276+0000 7f48d3658700 1 -- 172.21.15.124:0/3659577556 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48cc14d1b0 con 0x7f48cc0ce610 2023-10-16T12:59:09.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.276+0000 7f48c1ffb700 1 -- 172.21.15.124:0/3659577556 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c80139a0 con 0x7f48cc0ce610 2023-10-16T12:59:09.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.276+0000 7f48d3658700 1 -- 172.21.15.124:0/3659577556 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48cc14caf0 con 0x7f48cc0ce610 2023-10-16T12:59:09.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.277+0000 7f48d3658700 1 -- 172.21.15.124:0/3659577556 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48cc14cd10 con 0x7f48cc0ce610 2023-10-16T12:59:09.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.277+0000 7f48c1ffb700 1 -- 172.21.15.124:0/3659577556 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f48c8013b00 con 0x7f48cc0ce610 2023-10-16T12:59:09.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.277+0000 7f48c1ffb700 1 --2- 172.21.15.124:0/3659577556 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f48b006af00 0x7f48b006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:09.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.277+0000 7f48c1ffb700 1 -- 172.21.15.124:0/3659577556 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f48c80894f0 con 0x7f48cc0ce610 2023-10-16T12:59:09.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.277+0000 7f48d13f4700 1 --2- 172.21.15.124:0/3659577556 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f48b006af00 0x7f48b006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:09.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.278+0000 7f48d13f4700 1 --2- 172.21.15.124:0/3659577556 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f48b006af00 0x7f48b006d3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f48bc006b20 tx=0x7f48bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:09.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.282+0000 7f48c1ffb700 1 -- 172.21.15.124:0/3659577556 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f48c8054340 con 0x7f48cc0ce610 2023-10-16T12:59:09.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.473+0000 7f48d3658700 1 -- 172.21.15.124:0/3659577556 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48cc04ebb0 con 0x7f48cc0ce610 2023-10-16T12:59:09.476 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.474+0000 7f48c1ffb700 1 -- 172.21.15.124:0/3659577556 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f48c8057960 con 0x7f48cc0ce610 2023-10-16T12:59:09.477 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:09.477 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":24,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:58:56.089767+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:59:09.479 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.476+0000 7f48d3658700 1 -- 172.21.15.124:0/3659577556 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f48b006af00 msgr2=0x7f48b006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:09.479 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.476+0000 7f48d3658700 1 --2- 172.21.15.124:0/3659577556 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f48b006af00 0x7f48b006d3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f48bc006b20 tx=0x7f48bc008040 comp rx=0 tx=0).stop 2023-10-16T12:59:09.479 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.476+0000 7f48d3658700 1 -- 172.21.15.124:0/3659577556 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48cc0ce610 msgr2=0x7f48cc0cc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:09.479 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.476+0000 7f48d3658700 1 --2- 172.21.15.124:0/3659577556 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48cc0ce610 0x7f48cc0cc140 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f48c800e810 tx=0x7f48c800eb20 comp rx=0 tx=0).stop 2023-10-16T12:59:09.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.476+0000 7f48d3658700 1 -- 172.21.15.124:0/3659577556 shutdown_connections 2023-10-16T12:59:09.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.476+0000 7f48d3658700 1 --2- 172.21.15.124:0/3659577556 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f48b006af00 0x7f48b006d3c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.476+0000 7f48d3658700 1 --2- 172.21.15.124:0/3659577556 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48cc15d890 0x7f48cc1f33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.476+0000 7f48d3658700 1 --2- 172.21.15.124:0/3659577556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48cc06bd20 0x7f48cc14d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.476+0000 7f48d3658700 1 --2- 172.21.15.124:0/3659577556 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48cc0ce610 0x7f48cc0cc140 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.476+0000 7f48d3658700 1 -- 172.21.15.124:0/3659577556 >> 172.21.15.124:0/3659577556 conn(0x7f48cc072340 msgr2=0x7f48cc152140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:09.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.476+0000 7f48d3658700 1 -- 172.21.15.124:0/3659577556 shutdown_connections 2023-10-16T12:59:09.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.476+0000 7f48d3658700 1 -- 172.21.15.124:0/3659577556 wait complete. 2023-10-16T12:59:09.491 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-16T12:59:09.491 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T12:59:09.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.608+0000 7f4643d5e700 1 Processor -- start 2023-10-16T12:59:09.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.608+0000 7f4643d5e700 1 -- start start 2023-10-16T12:59:09.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.609+0000 7f4643d5e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f463c152470 0x7f463c0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:09.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.609+0000 7f4643d5e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f463c0b3410 0x7f463c0b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:09.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.609+0000 7f4643d5e700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f463c070d70 con 0x7f463c0cb8d0 2023-10-16T12:59:09.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.609+0000 7f4643d5e700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f463c071200 con 0x7f463c152470 2023-10-16T12:59:09.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.609+0000 7f4643d5e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463c0cbd80 con 0x7f463c0b3410 2023-10-16T12:59:09.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.609+0000 7f4641afa700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f463c152470 0x7f463c0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:09.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.609+0000 7f46412f9700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f463c0cb8d0 0x7f463c0b2d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42182/0 (socket says 172.21.15.124:42182) 2023-10-16T12:59:09.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.609+0000 7f46412f9700 1 -- 172.21.15.124:0/3437179258 learned_addr learned my addr 172.21.15.124:0/3437179258 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:09.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.609+0000 7f4641afa700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f463c152470 0x7f463c0cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53514/0 (socket says 172.21.15.124:53514) 2023-10-16T12:59:09.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.609+0000 7f46422fb700 1 --2- 172.21.15.124:0/3437179258 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f463c0b3410 0x7f463c0b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:09.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.609+0000 7f4641afa700 1 -- 172.21.15.124:0/3437179258 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f463c0b3410 msgr2=0x7f463c0b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:09.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.609+0000 7f4641afa700 1 --2- 172.21.15.124:0/3437179258 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f463c0b3410 0x7f463c0b60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.609+0000 7f4640af8700 1 -- 172.21.15.124:0/3437179258 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2139330777 0 0) 0x7f463c070d70 con 0x7f463c0cb8d0 2023-10-16T12:59:09.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.609+0000 7f4641afa700 1 -- 172.21.15.124:0/3437179258 >> v1:172.21.15.124:6789/0 conn(0x7f463c0cb8d0 legacy=0x7f463c0b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:09.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.609+0000 7f4641afa700 1 -- 172.21.15.124:0/3437179258 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c070440 con 0x7f463c152470 2023-10-16T12:59:09.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.610+0000 7f4641afa700 1 --2- 172.21.15.124:0/3437179258 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f463c152470 0x7f463c0cd570 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f462c009840 tx=0x7f462c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5c83711601806a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:09.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.610+0000 7f4640af8700 1 -- 172.21.15.124:0/3437179258 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c011830 con 0x7f463c152470 2023-10-16T12:59:09.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.610+0000 7f4640af8700 1 -- 172.21.15.124:0/3437179258 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c011990 con 0x7f463c152470 2023-10-16T12:59:09.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.610+0000 7f4640af8700 1 -- 172.21.15.124:0/3437179258 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c011d20 con 0x7f463c152470 2023-10-16T12:59:09.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.610+0000 7f4643d5e700 1 -- 172.21.15.124:0/3437179258 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f463c152470 msgr2=0x7f463c0cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:09.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.610+0000 7f4643d5e700 1 --2- 172.21.15.124:0/3437179258 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f463c152470 0x7f463c0cd570 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f462c009840 tx=0x7f462c009b50 comp rx=0 tx=0).stop 2023-10-16T12:59:09.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.610+0000 7f4643d5e700 1 -- 172.21.15.124:0/3437179258 shutdown_connections 2023-10-16T12:59:09.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.610+0000 7f4643d5e700 1 --2- 172.21.15.124:0/3437179258 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f463c0b3410 0x7f463c0b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.610+0000 7f4643d5e700 1 --2- 172.21.15.124:0/3437179258 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f463c152470 0x7f463c0cd570 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.610+0000 7f4643d5e700 1 -- 172.21.15.124:0/3437179258 >> 172.21.15.124:0/3437179258 conn(0x7f463c0cdd00 msgr2=0x7f463c0ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:09.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.610+0000 7f4643d5e700 1 -- 172.21.15.124:0/3437179258 shutdown_connections 2023-10-16T12:59:09.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.610+0000 7f4643d5e700 1 -- 172.21.15.124:0/3437179258 wait complete. 2023-10-16T12:59:09.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.611+0000 7f4643d5e700 1 Processor -- start 2023-10-16T12:59:09.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.612+0000 7f4643d5e700 1 -- start start 2023-10-16T12:59:09.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.612+0000 7f4643d5e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f463c0b3410 0x7f463c156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:09.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.612+0000 7f4643d5e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f463c0cb8d0 0x7f463c14f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:09.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.612+0000 7f4643d5e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f463c152470 0x7f463c1f1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:09.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.612+0000 7f4643d5e700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c0c6ec0 con 0x7f463c0cb8d0 2023-10-16T12:59:09.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.612+0000 7f4643d5e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c14fb10 con 0x7f463c0b3410 2023-10-16T12:59:09.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.612+0000 7f4643d5e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463c1f1980 con 0x7f463c152470 2023-10-16T12:59:09.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.612+0000 7f46412f9700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f463c0cb8d0 0x7f463c14f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:09.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.612+0000 7f46412f9700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f463c0cb8d0 0x7f463c14f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53522/0 (socket says 172.21.15.124:53522) 2023-10-16T12:59:09.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.612+0000 7f46412f9700 1 -- 172.21.15.124:0/379606243 learned_addr learned my addr 172.21.15.124:0/379606243 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:09.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.612+0000 7f4641afa700 1 --2- 172.21.15.124:0/379606243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f463c0b3410 0x7f463c156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:09.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.612+0000 7f46422fb700 1 --2- 172.21.15.124:0/379606243 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f463c152470 0x7f463c1f1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:09.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.613+0000 7f46412f9700 1 -- 172.21.15.124:0/379606243 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f463c152470 msgr2=0x7f463c1f1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:09.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.613+0000 7f46412f9700 1 --2- 172.21.15.124:0/379606243 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f463c152470 0x7f463c1f1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.613+0000 7f46412f9700 1 -- 172.21.15.124:0/379606243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f463c0b3410 msgr2=0x7f463c156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:09.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.613+0000 7f46412f9700 1 --2- 172.21.15.124:0/379606243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f463c0b3410 0x7f463c156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.613+0000 7f46412f9700 1 -- 172.21.15.124:0/379606243 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c0094a0 con 0x7f463c0cb8d0 2023-10-16T12:59:09.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.613+0000 7f46412f9700 1 --2- 172.21.15.124:0/379606243 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f463c0cb8d0 0x7f463c14f5d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f46380011e0 tx=0x7f463800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:09.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.613+0000 7f46327fc700 1 -- 172.21.15.124:0/379606243 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4638004c80 con 0x7f463c0cb8d0 2023-10-16T12:59:09.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.613+0000 7f46327fc700 1 -- 172.21.15.124:0/379606243 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4638004e00 con 0x7f463c0cb8d0 2023-10-16T12:59:09.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.613+0000 7f4643d5e700 1 -- 172.21.15.124:0/379606243 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463c0c5f10 con 0x7f463c0cb8d0 2023-10-16T12:59:09.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.613+0000 7f46327fc700 1 -- 172.21.15.124:0/379606243 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4638007310 con 0x7f463c0cb8d0 2023-10-16T12:59:09.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.613+0000 7f4643d5e700 1 -- 172.21.15.124:0/379606243 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463c0cefa0 con 0x7f463c0cb8d0 2023-10-16T12:59:09.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.614+0000 7f4643d5e700 1 -- 172.21.15.124:0/379606243 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463c0cee00 con 0x7f463c0cb8d0 2023-10-16T12:59:09.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.614+0000 7f46327fc700 1 -- 172.21.15.124:0/379606243 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4638007470 con 0x7f463c0cb8d0 2023-10-16T12:59:09.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.615+0000 7f46327fc700 1 --2- 172.21.15.124:0/379606243 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f462006af00 0x7f462006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:09.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.615+0000 7f46327fc700 1 -- 172.21.15.124:0/379606243 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f46380895e0 con 0x7f463c0cb8d0 2023-10-16T12:59:09.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.615+0000 7f4641afa700 1 --2- 172.21.15.124:0/379606243 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f462006af00 0x7f462006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:09.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.615+0000 7f4641afa700 1 --2- 172.21.15.124:0/379606243 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f462006af00 0x7f462006d3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f462c0090b0 tx=0x7f462c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:09.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.619+0000 7f46327fc700 1 -- 172.21.15.124:0/379606243 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f463c0cee00 con 0x7f463c0cb8d0 2023-10-16T12:59:09.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.807+0000 7f4643d5e700 1 -- 172.21.15.124:0/379606243 --> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f463c070a00 con 0x7f462006af00 2023-10-16T12:59:09.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.817+0000 7f46327fc700 1 -- 172.21.15.124:0/379606243 <== mgr.4104 v2:172.21.15.124:6832/2391611330 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345300 (secure 0 0 0) 0x7f462c011c80 con 0x7f462006af00 2023-10-16T12:59:09.824 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:09.826 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.820+0000 7f4643d5e700 1 -- 172.21.15.124:0/379606243 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f462006af00 msgr2=0x7f462006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:09.827 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.820+0000 7f4643d5e700 1 --2- 172.21.15.124:0/379606243 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f462006af00 0x7f462006d3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f462c0090b0 tx=0x7f462c01c040 comp rx=0 tx=0).stop 2023-10-16T12:59:09.827 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.820+0000 7f4643d5e700 1 -- 172.21.15.124:0/379606243 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f463c0cb8d0 msgr2=0x7f463c14f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:09.827 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.820+0000 7f4643d5e700 1 --2- 172.21.15.124:0/379606243 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f463c0cb8d0 0x7f463c14f5d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f46380011e0 tx=0x7f463800cae0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.827 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.820+0000 7f4643d5e700 1 -- 172.21.15.124:0/379606243 shutdown_connections 2023-10-16T12:59:09.827 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.820+0000 7f4643d5e700 1 --2- 172.21.15.124:0/379606243 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f462006af00 0x7f462006d3c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.820+0000 7f4643d5e700 1 --2- 172.21.15.124:0/379606243 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f463c152470 0x7f463c1f1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.820+0000 7f4643d5e700 1 --2- 172.21.15.124:0/379606243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f463c0b3410 0x7f463c156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.820+0000 7f4643d5e700 1 --2- 172.21.15.124:0/379606243 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f463c0cb8d0 0x7f463c14f5d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:09.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.820+0000 7f4643d5e700 1 -- 172.21.15.124:0/379606243 >> 172.21.15.124:0/379606243 conn(0x7f463c0cdd00 msgr2=0x7f463c0d1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:09.829 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.821+0000 7f4643d5e700 1 -- 172.21.15.124:0/379606243 shutdown_connections 2023-10-16T12:59:09.829 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.821+0000 7f4643d5e700 1 -- 172.21.15.124:0/379606243 wait complete. 2023-10-16T12:59:09.829 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-16T12:59:09.836 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-10-16T12:59:08.623917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219380,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755340,"statfs":{"total":773094113280,"available":772869468160,"internally_reserved":0,"allocated":3284992,"data_stored":1987974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002750"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705875+0000","last_change":"2023-10-16T12:58:51.447948+0000","last_active":"2023-10-16T12:58:55.705875+0000","last_peered":"2023-10-16T12:58:55.705875+0000","last_clean":"2023-10-16T12:58:55.705875+0000","last_became_active":"2023-10-16T12:58:51.447661+0000","last_became_peered":"2023-10-16T12:58:51.447661+0000","last_unstale":"2023-10-16T12:58:55.705875+0000","last_undegraded":"2023-10-16T12:58:55.705875+0000","last_fullsized":"2023-10-16T12:58:55.705875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:29:07.394120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679949+0000","last_change":"2023-10-16T12:58:51.439340+0000","last_active":"2023-10-16T12:58:55.679949+0000","last_peered":"2023-10-16T12:58:55.679949+0000","last_clean":"2023-10-16T12:58:55.679949+0000","last_became_active":"2023-10-16T12:58:51.439064+0000","last_became_peered":"2023-10-16T12:58:51.439064+0000","last_unstale":"2023-10-16T12:58:55.679949+0000","last_undegraded":"2023-10-16T12:58:55.679949+0000","last_fullsized":"2023-10-16T12:58:55.679949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:51.422601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.689332+0000","last_change":"2023-10-16T12:58:51.441634+0000","last_active":"2023-10-16T12:58:55.689332+0000","last_peered":"2023-10-16T12:58:55.689332+0000","last_clean":"2023-10-16T12:58:55.689332+0000","last_became_active":"2023-10-16T12:58:51.441380+0000","last_became_peered":"2023-10-16T12:58:51.441380+0000","last_unstale":"2023-10-16T12:58:55.689332+0000","last_undegraded":"2023-10-16T12:58:55.689332+0000","last_fullsized":"2023-10-16T12:58:55.689332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:28:04.262253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679334+0000","last_change":"2023-10-16T12:58:51.442103+0000","last_active":"2023-10-16T12:58:55.679334+0000","last_peered":"2023-10-16T12:58:55.679334+0000","last_clean":"2023-10-16T12:58:55.679334+0000","last_became_active":"2023-10-16T12:58:51.438544+0000","last_became_peered":"2023-10-16T12:58:51.438544+0000","last_unstale":"2023-10-16T12:58:55.679334+0000","last_undegraded":"2023-10-16T12:58:55.679334+0000","last_fullsized":"2023-10-16T12:58:55.679334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:29:07.394120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705435+0000","last_change":"2023-10-16T12:58:51.447862+0000","last_active":"2023-10-16T12:58:55.705435+0000","last_peered":"2023-10-16T12:58:55.705435+0000","last_clean":"2023-10-16T12:58:55.705435+0000","last_became_active":"2023-10-16T12:58:51.447596+0000","last_became_peered":"2023-10-16T12:58:51.447596+0000","last_unstale":"2023-10-16T12:58:55.705435+0000","last_undegraded":"2023-10-16T12:58:55.705435+0000","last_fullsized":"2023-10-16T12:58:55.705435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:42:07.880003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679036+0000","last_change":"2023-10-16T12:58:51.439890+0000","last_active":"2023-10-16T12:58:55.679036+0000","last_peered":"2023-10-16T12:58:55.679036+0000","last_clean":"2023-10-16T12:58:55.679036+0000","last_became_active":"2023-10-16T12:58:51.439624+0000","last_became_peered":"2023-10-16T12:58:51.439624+0000","last_unstale":"2023-10-16T12:58:55.679036+0000","last_undegraded":"2023-10-16T12:58:55.679036+0000","last_fullsized":"2023-10-16T12:58:55.679036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:17:35.655947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705720+0000","last_change":"2023-10-16T12:58:51.446245+0000","last_active":"2023-10-16T12:58:55.705720+0000","last_peered":"2023-10-16T12:58:55.705720+0000","last_clean":"2023-10-16T12:58:55.705720+0000","last_became_active":"2023-10-16T12:58:51.445888+0000","last_became_peered":"2023-10-16T12:58:51.445888+0000","last_unstale":"2023-10-16T12:58:55.705720+0000","last_undegraded":"2023-10-16T12:58:55.705720+0000","last_fullsized":"2023-10-16T12:58:55.705720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:51.422601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688745+0000","last_change":"2023-10-16T12:58:51.444473+0000","last_active":"2023-10-16T12:58:55.688745+0000","last_peered":"2023-10-16T12:58:55.688745+0000","last_clean":"2023-10-16T12:58:55.688745+0000","last_became_active":"2023-10-16T12:58:51.444135+0000","last_became_peered":"2023-10-16T12:58:51.444135+0000","last_unstale":"2023-10-16T12:58:55.688745+0000","last_undegraded":"2023-10-16T12:58:55.688745+0000","last_fullsized":"2023-10-16T12:58:55.688745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:35.585161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705821+0000","last_change":"2023-10-16T12:58:51.450649+0000","last_active":"2023-10-16T12:58:55.705821+0000","last_peered":"2023-10-16T12:58:55.705821+0000","last_clean":"2023-10-16T12:58:55.705821+0000","last_became_active":"2023-10-16T12:58:51.450086+0000","last_became_peered":"2023-10-16T12:58:51.450086+0000","last_unstale":"2023-10-16T12:58:55.705821+0000","last_undegraded":"2023-10-16T12:58:55.705821+0000","last_fullsized":"2023-10-16T12:58:55.705821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:46:33.298597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686340+0000","last_change":"2023-10-16T12:58:51.443152+0000","last_active":"2023-10-16T12:58:55.686340+0000","last_peered":"2023-10-16T12:58:55.686340+0000","last_clean":"2023-10-16T12:58:55.686340+0000","last_became_active":"2023-10-16T12:58:51.442907+0000","last_became_peered":"2023-10-16T12:58:51.442907+0000","last_unstale":"2023-10-16T12:58:55.686340+0000","last_undegraded":"2023-10-16T12:58:55.686340+0000","last_fullsized":"2023-10-16T12:58:55.686340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:17:35.655947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686659+0000","last_change":"2023-10-16T12:58:51.445780+0000","last_active":"2023-10-16T12:58:55.686659+0000","last_peered":"2023-10-16T12:58:55.686659+0000","last_clean":"2023-10-16T12:58:55.686659+0000","last_became_active":"2023-10-16T12:58:51.445488+0000","last_became_peered":"2023-10-16T12:58:51.445488+0000","last_unstale":"2023-10-16T12:58:55.686659+0000","last_undegraded":"2023-10-16T12:58:55.686659+0000","last_fullsized":"2023-10-16T12:58:55.686659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:17.757203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.681164+0000","last_change":"2023-10-16T12:58:51.443335+0000","last_active":"2023-10-16T12:58:55.681164+0000","last_peered":"2023-10-16T12:58:55.681164+0000","last_clean":"2023-10-16T12:58:55.681164+0000","last_became_active":"2023-10-16T12:58:51.443022+0000","last_became_peered":"2023-10-16T12:58:51.443022+0000","last_unstale":"2023-10-16T12:58:55.681164+0000","last_undegraded":"2023-10-16T12:58:55.681164+0000","last_fullsized":"2023-10-16T12:58:55.681164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:21.517544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.683113+0000","last_change":"2023-10-16T12:58:51.442753+0000","last_active":"2023-10-16T12:58:55.683113+0000","last_peered":"2023-10-16T12:58:55.683113+0000","last_clean":"2023-10-16T12:58:55.683113+0000","last_became_active":"2023-10-16T12:58:51.442501+0000","last_became_peered":"2023-10-16T12:58:51.442501+0000","last_unstale":"2023-10-16T12:58:55.683113+0000","last_undegraded":"2023-10-16T12:58:55.683113+0000","last_fullsized":"2023-10-16T12:58:55.683113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:17.757203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.690094+0000","last_change":"2023-10-16T12:58:51.439019+0000","last_active":"2023-10-16T12:58:55.690094+0000","last_peered":"2023-10-16T12:58:55.690094+0000","last_clean":"2023-10-16T12:58:55.690094+0000","last_became_active":"2023-10-16T12:58:51.438742+0000","last_became_peered":"2023-10-16T12:58:51.438742+0000","last_unstale":"2023-10-16T12:58:55.690094+0000","last_undegraded":"2023-10-16T12:58:55.690094+0000","last_fullsized":"2023-10-16T12:58:55.690094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:35.585161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.678142+0000","last_change":"2023-10-16T12:58:51.431552+0000","last_active":"2023-10-16T12:58:55.678142+0000","last_peered":"2023-10-16T12:58:55.678142+0000","last_clean":"2023-10-16T12:58:55.678142+0000","last_became_active":"2023-10-16T12:58:51.431302+0000","last_became_peered":"2023-10-16T12:58:51.431302+0000","last_unstale":"2023-10-16T12:58:55.678142+0000","last_undegraded":"2023-10-16T12:58:55.678142+0000","last_fullsized":"2023-10-16T12:58:55.678142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:40:36.060468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.680089+0000","last_change":"2023-10-16T12:58:51.442937+0000","last_active":"2023-10-16T12:58:55.680089+0000","last_peered":"2023-10-16T12:58:55.680089+0000","last_clean":"2023-10-16T12:58:55.680089+0000","last_became_active":"2023-10-16T12:58:51.442503+0000","last_became_peered":"2023-10-16T12:58:51.442503+0000","last_unstale":"2023-10-16T12:58:55.680089+0000","last_undegraded":"2023-10-16T12:58:55.680089+0000","last_fullsized":"2023-10-16T12:58:55.680089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:51.422601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.678499+0000","last_change":"2023-10-16T12:58:51.447014+0000","last_active":"2023-10-16T12:58:55.678499+0000","last_peered":"2023-10-16T12:58:55.678499+0000","last_clean":"2023-10-16T12:58:55.678499+0000","last_became_active":"2023-10-16T12:58:51.446752+0000","last_became_peered":"2023-10-16T12:58:51.446752+0000","last_unstale":"2023-10-16T12:58:55.678499+0000","last_undegraded":"2023-10-16T12:58:55.678499+0000","last_fullsized":"2023-10-16T12:58:55.678499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:42:26.907121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686121+0000","last_change":"2023-10-16T12:58:51.442299+0000","last_active":"2023-10-16T12:58:55.686121+0000","last_peered":"2023-10-16T12:58:55.686121+0000","last_clean":"2023-10-16T12:58:55.686121+0000","last_became_active":"2023-10-16T12:58:51.442028+0000","last_became_peered":"2023-10-16T12:58:51.442028+0000","last_unstale":"2023-10-16T12:58:55.686121+0000","last_undegraded":"2023-10-16T12:58:55.686121+0000","last_fullsized":"2023-10-16T12:58:55.686121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:26:09.658750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.706083+0000","last_change":"2023-10-16T12:58:51.446159+0000","last_active":"2023-10-16T12:58:55.706083+0000","last_peered":"2023-10-16T12:58:55.706083+0000","last_clean":"2023-10-16T12:58:55.706083+0000","last_became_active":"2023-10-16T12:58:51.445862+0000","last_became_peered":"2023-10-16T12:58:51.445862+0000","last_unstale":"2023-10-16T12:58:55.706083+0000","last_undegraded":"2023-10-16T12:58:55.706083+0000","last_fullsized":"2023-10-16T12:58:55.706083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:41:33.353000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.074473+0000","last_change":"2023-10-16T12:58:55.710385+0000","last_active":"2023-10-16T12:58:57.074473+0000","last_peered":"2023-10-16T12:58:57.074473+0000","last_clean":"2023-10-16T12:58:57.074473+0000","last_became_active":"2023-10-16T12:58:55.709936+0000","last_became_peered":"2023-10-16T12:58:55.709936+0000","last_unstale":"2023-10-16T12:58:57.074473+0000","last_undegraded":"2023-10-16T12:58:57.074473+0000","last_fullsized":"2023-10-16T12:58:57.074473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:10:14.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684401+0000","last_change":"2023-10-16T12:58:50.682380+0000","last_active":"2023-10-16T12:58:55.684401+0000","last_peered":"2023-10-16T12:58:55.684401+0000","last_clean":"2023-10-16T12:58:55.684401+0000","last_became_active":"2023-10-16T12:58:50.682119+0000","last_became_peered":"2023-10-16T12:58:50.682119+0000","last_unstale":"2023-10-16T12:58:55.684401+0000","last_undegraded":"2023-10-16T12:58:55.684401+0000","last_fullsized":"2023-10-16T12:58:55.684401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:43:43.356254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688115+0000","last_change":"2023-10-16T12:58:51.442218+0000","last_active":"2023-10-16T12:58:55.688115+0000","last_peered":"2023-10-16T12:58:55.688115+0000","last_clean":"2023-10-16T12:58:55.688115+0000","last_became_active":"2023-10-16T12:58:51.441929+0000","last_became_peered":"2023-10-16T12:58:51.441929+0000","last_unstale":"2023-10-16T12:58:55.688115+0000","last_undegraded":"2023-10-16T12:58:55.688115+0000","last_fullsized":"2023-10-16T12:58:55.688115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:31:13.605999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.425885+0000","last_change":"2023-10-16T12:58:55.694446+0000","last_active":"2023-10-16T12:58:56.425885+0000","last_peered":"2023-10-16T12:58:56.425885+0000","last_clean":"2023-10-16T12:58:56.425885+0000","last_became_active":"2023-10-16T12:58:55.694006+0000","last_became_peered":"2023-10-16T12:58:55.694006+0000","last_unstale":"2023-10-16T12:58:56.425885+0000","last_undegraded":"2023-10-16T12:58:56.425885+0000","last_fullsized":"2023-10-16T12:58:56.425885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:42:11.902399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688217+0000","last_change":"2023-10-16T12:58:50.672891+0000","last_active":"2023-10-16T12:58:55.688217+0000","last_peered":"2023-10-16T12:58:55.688217+0000","last_clean":"2023-10-16T12:58:55.688217+0000","last_became_active":"2023-10-16T12:58:50.672632+0000","last_became_peered":"2023-10-16T12:58:50.672632+0000","last_unstale":"2023-10-16T12:58:55.688217+0000","last_undegraded":"2023-10-16T12:58:55.688217+0000","last_fullsized":"2023-10-16T12:58:55.688217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:00:22.709075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684236+0000","last_change":"2023-10-16T12:58:51.444115+0000","last_active":"2023-10-16T12:58:55.684236+0000","last_peered":"2023-10-16T12:58:55.684236+0000","last_clean":"2023-10-16T12:58:55.684236+0000","last_became_active":"2023-10-16T12:58:51.443884+0000","last_became_peered":"2023-10-16T12:58:51.443884+0000","last_unstale":"2023-10-16T12:58:55.684236+0000","last_undegraded":"2023-10-16T12:58:55.684236+0000","last_fullsized":"2023-10-16T12:58:55.684236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:32.084288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426516+0000","last_change":"2023-10-16T12:58:55.697719+0000","last_active":"2023-10-16T12:58:56.426516+0000","last_peered":"2023-10-16T12:58:56.426516+0000","last_clean":"2023-10-16T12:58:56.426516+0000","last_became_active":"2023-10-16T12:58:55.697330+0000","last_became_peered":"2023-10-16T12:58:55.697330+0000","last_unstale":"2023-10-16T12:58:56.426516+0000","last_undegraded":"2023-10-16T12:58:56.426516+0000","last_fullsized":"2023-10-16T12:58:56.426516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:30:02.068649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705908+0000","last_change":"2023-10-16T12:58:50.678753+0000","last_active":"2023-10-16T12:58:55.705908+0000","last_peered":"2023-10-16T12:58:55.705908+0000","last_clean":"2023-10-16T12:58:55.705908+0000","last_became_active":"2023-10-16T12:58:50.674216+0000","last_became_peered":"2023-10-16T12:58:50.674216+0000","last_unstale":"2023-10-16T12:58:55.705908+0000","last_undegraded":"2023-10-16T12:58:55.705908+0000","last_fullsized":"2023-10-16T12:58:55.705908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:34.579436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679582+0000","last_change":"2023-10-16T12:58:51.442758+0000","last_active":"2023-10-16T12:58:55.679582+0000","last_peered":"2023-10-16T12:58:55.679582+0000","last_clean":"2023-10-16T12:58:55.679582+0000","last_became_active":"2023-10-16T12:58:51.442485+0000","last_became_peered":"2023-10-16T12:58:51.442485+0000","last_unstale":"2023-10-16T12:58:55.679582+0000","last_undegraded":"2023-10-16T12:58:55.679582+0000","last_fullsized":"2023-10-16T12:58:55.679582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:18:46.943690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426512+0000","last_change":"2023-10-16T12:58:55.699182+0000","last_active":"2023-10-16T12:58:56.426512+0000","last_peered":"2023-10-16T12:58:56.426512+0000","last_clean":"2023-10-16T12:58:56.426512+0000","last_became_active":"2023-10-16T12:58:55.698738+0000","last_became_peered":"2023-10-16T12:58:55.698738+0000","last_unstale":"2023-10-16T12:58:56.426512+0000","last_undegraded":"2023-10-16T12:58:56.426512+0000","last_fullsized":"2023-10-16T12:58:56.426512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:41:37.375395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705027+0000","last_change":"2023-10-16T12:58:50.680255+0000","last_active":"2023-10-16T12:58:55.705027+0000","last_peered":"2023-10-16T12:58:55.705027+0000","last_clean":"2023-10-16T12:58:55.705027+0000","last_became_active":"2023-10-16T12:58:50.679975+0000","last_became_peered":"2023-10-16T12:58:50.679975+0000","last_unstale":"2023-10-16T12:58:55.705027+0000","last_undegraded":"2023-10-16T12:58:55.705027+0000","last_fullsized":"2023-10-16T12:58:55.705027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:10.863857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.681187+0000","last_change":"2023-10-16T12:58:51.443585+0000","last_active":"2023-10-16T12:58:55.681187+0000","last_peered":"2023-10-16T12:58:55.681187+0000","last_clean":"2023-10-16T12:58:55.681187+0000","last_became_active":"2023-10-16T12:58:51.443200+0000","last_became_peered":"2023-10-16T12:58:51.443200+0000","last_unstale":"2023-10-16T12:58:55.681187+0000","last_undegraded":"2023-10-16T12:58:55.681187+0000","last_fullsized":"2023-10-16T12:58:55.681187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:46:33.298597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.074615+0000","last_change":"2023-10-16T12:58:55.696218+0000","last_active":"2023-10-16T12:58:57.074615+0000","last_peered":"2023-10-16T12:58:57.074615+0000","last_clean":"2023-10-16T12:58:57.074615+0000","last_became_active":"2023-10-16T12:58:55.695835+0000","last_became_peered":"2023-10-16T12:58:55.695835+0000","last_unstale":"2023-10-16T12:58:57.074615+0000","last_undegraded":"2023-10-16T12:58:57.074615+0000","last_fullsized":"2023-10-16T12:58:57.074615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:51:25.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.683294+0000","last_change":"2023-10-16T12:58:50.675887+0000","last_active":"2023-10-16T12:58:55.683294+0000","last_peered":"2023-10-16T12:58:55.683294+0000","last_clean":"2023-10-16T12:58:55.683294+0000","last_became_active":"2023-10-16T12:58:50.675649+0000","last_became_peered":"2023-10-16T12:58:50.675649+0000","last_unstale":"2023-10-16T12:58:55.683294+0000","last_undegraded":"2023-10-16T12:58:55.683294+0000","last_fullsized":"2023-10-16T12:58:55.683294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:31.078563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.681802+0000","last_change":"2023-10-16T12:58:51.435387+0000","last_active":"2023-10-16T12:58:55.681802+0000","last_peered":"2023-10-16T12:58:55.681802+0000","last_clean":"2023-10-16T12:58:55.681802+0000","last_became_active":"2023-10-16T12:58:51.435106+0000","last_became_peered":"2023-10-16T12:58:51.435106+0000","last_unstale":"2023-10-16T12:58:55.681802+0000","last_undegraded":"2023-10-16T12:58:55.681802+0000","last_fullsized":"2023-10-16T12:58:55.681802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:56.488214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.424372+0000","last_change":"2023-10-16T12:58:55.699076+0000","last_active":"2023-10-16T12:58:56.424372+0000","last_peered":"2023-10-16T12:58:56.424372+0000","last_clean":"2023-10-16T12:58:56.424372+0000","last_became_active":"2023-10-16T12:58:55.698670+0000","last_became_peered":"2023-10-16T12:58:55.698670+0000","last_unstale":"2023-10-16T12:58:56.424372+0000","last_undegraded":"2023-10-16T12:58:56.424372+0000","last_fullsized":"2023-10-16T12:58:56.424372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:51.536207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.687076+0000","last_change":"2023-10-16T12:58:50.670932+0000","last_active":"2023-10-16T12:58:55.687076+0000","last_peered":"2023-10-16T12:58:55.687076+0000","last_clean":"2023-10-16T12:58:55.687076+0000","last_became_active":"2023-10-16T12:58:50.670622+0000","last_became_peered":"2023-10-16T12:58:50.670622+0000","last_unstale":"2023-10-16T12:58:55.687076+0000","last_undegraded":"2023-10-16T12:58:55.687076+0000","last_fullsized":"2023-10-16T12:58:55.687076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:31.078563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.692398+0000","last_change":"2023-10-16T12:58:51.440771+0000","last_active":"2023-10-16T12:58:55.692398+0000","last_peered":"2023-10-16T12:58:55.692398+0000","last_clean":"2023-10-16T12:58:55.692398+0000","last_became_active":"2023-10-16T12:58:51.440502+0000","last_became_peered":"2023-10-16T12:58:51.440502+0000","last_unstale":"2023-10-16T12:58:55.692398+0000","last_undegraded":"2023-10-16T12:58:55.692398+0000","last_fullsized":"2023-10-16T12:58:55.692398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:51.422601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426179+0000","last_change":"2023-10-16T12:58:55.703710+0000","last_active":"2023-10-16T12:58:56.426179+0000","last_peered":"2023-10-16T12:58:56.426179+0000","last_clean":"2023-10-16T12:58:56.426179+0000","last_became_active":"2023-10-16T12:58:55.702784+0000","last_became_peered":"2023-10-16T12:58:55.702784+0000","last_unstale":"2023-10-16T12:58:56.426179+0000","last_undegraded":"2023-10-16T12:58:56.426179+0000","last_fullsized":"2023-10-16T12:58:56.426179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:19.721283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688901+0000","last_change":"2023-10-16T12:58:50.670749+0000","last_active":"2023-10-16T12:58:55.688901+0000","last_peered":"2023-10-16T12:58:55.688901+0000","last_clean":"2023-10-16T12:58:55.688901+0000","last_became_active":"2023-10-16T12:58:50.670491+0000","last_became_peered":"2023-10-16T12:58:50.670491+0000","last_unstale":"2023-10-16T12:58:55.688901+0000","last_undegraded":"2023-10-16T12:58:55.688901+0000","last_fullsized":"2023-10-16T12:58:55.688901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:10.863857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684097+0000","last_change":"2023-10-16T12:58:51.441981+0000","last_active":"2023-10-16T12:58:55.684097+0000","last_peered":"2023-10-16T12:58:55.684097+0000","last_clean":"2023-10-16T12:58:55.684097+0000","last_became_active":"2023-10-16T12:58:51.441704+0000","last_became_peered":"2023-10-16T12:58:51.441704+0000","last_unstale":"2023-10-16T12:58:55.684097+0000","last_undegraded":"2023-10-16T12:58:55.684097+0000","last_fullsized":"2023-10-16T12:58:55.684097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:51.422601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072432+0000","last_change":"2023-10-16T12:58:55.709709+0000","last_active":"2023-10-16T12:58:57.072432+0000","last_peered":"2023-10-16T12:58:57.072432+0000","last_clean":"2023-10-16T12:58:57.072432+0000","last_became_active":"2023-10-16T12:58:55.709039+0000","last_became_peered":"2023-10-16T12:58:55.709039+0000","last_unstale":"2023-10-16T12:58:57.072432+0000","last_undegraded":"2023-10-16T12:58:57.072432+0000","last_fullsized":"2023-10-16T12:58:57.072432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:29:11.416516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.680211+0000","last_change":"2023-10-16T12:58:50.678872+0000","last_active":"2023-10-16T12:58:55.680211+0000","last_peered":"2023-10-16T12:58:55.680211+0000","last_clean":"2023-10-16T12:58:55.680211+0000","last_became_active":"2023-10-16T12:58:50.678579+0000","last_became_peered":"2023-10-16T12:58:50.678579+0000","last_unstale":"2023-10-16T12:58:55.680211+0000","last_undegraded":"2023-10-16T12:58:55.680211+0000","last_fullsized":"2023-10-16T12:58:55.680211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:26:08.653026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.677699+0000","last_change":"2023-10-16T12:58:51.437769+0000","last_active":"2023-10-16T12:58:55.677699+0000","last_peered":"2023-10-16T12:58:55.677699+0000","last_clean":"2023-10-16T12:58:55.677699+0000","last_became_active":"2023-10-16T12:58:51.437507+0000","last_became_peered":"2023-10-16T12:58:51.437507+0000","last_unstale":"2023-10-16T12:58:55.677699+0000","last_undegraded":"2023-10-16T12:58:55.677699+0000","last_fullsized":"2023-10-16T12:58:55.677699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:59.501942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.074906+0000","last_change":"2023-10-16T12:58:55.708558+0000","last_active":"2023-10-16T12:58:57.074906+0000","last_peered":"2023-10-16T12:58:57.074906+0000","last_clean":"2023-10-16T12:58:57.074906+0000","last_became_active":"2023-10-16T12:58:55.708150+0000","last_became_peered":"2023-10-16T12:58:55.708150+0000","last_unstale":"2023-10-16T12:58:57.074906+0000","last_undegraded":"2023-10-16T12:58:57.074906+0000","last_fullsized":"2023-10-16T12:58:57.074906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:44:45.372869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686651+0000","last_change":"2023-10-16T12:58:50.670702+0000","last_active":"2023-10-16T12:58:55.686651+0000","last_peered":"2023-10-16T12:58:55.686651+0000","last_clean":"2023-10-16T12:58:55.686651+0000","last_became_active":"2023-10-16T12:58:50.670419+0000","last_became_peered":"2023-10-16T12:58:50.670419+0000","last_unstale":"2023-10-16T12:58:55.686651+0000","last_undegraded":"2023-10-16T12:58:55.686651+0000","last_fullsized":"2023-10-16T12:58:55.686651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:34.579436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.680401+0000","last_change":"2023-10-16T12:58:51.449669+0000","last_active":"2023-10-16T12:58:55.680401+0000","last_peered":"2023-10-16T12:58:55.680401+0000","last_clean":"2023-10-16T12:58:55.680401+0000","last_became_active":"2023-10-16T12:58:51.449350+0000","last_became_peered":"2023-10-16T12:58:51.449350+0000","last_unstale":"2023-10-16T12:58:55.680401+0000","last_undegraded":"2023-10-16T12:58:55.680401+0000","last_fullsized":"2023-10-16T12:58:55.680401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:33.724803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.075082+0000","last_change":"2023-10-16T12:58:55.702198+0000","last_active":"2023-10-16T12:58:57.075082+0000","last_peered":"2023-10-16T12:58:57.075082+0000","last_clean":"2023-10-16T12:58:57.075082+0000","last_became_active":"2023-10-16T12:58:55.701858+0000","last_became_peered":"2023-10-16T12:58:55.701858+0000","last_unstale":"2023-10-16T12:58:57.075082+0000","last_undegraded":"2023-10-16T12:58:57.075082+0000","last_fullsized":"2023-10-16T12:58:57.075082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:44:31.688200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.680381+0000","last_change":"2023-10-16T12:58:50.676760+0000","last_active":"2023-10-16T12:58:55.680381+0000","last_peered":"2023-10-16T12:58:55.680381+0000","last_clean":"2023-10-16T12:58:55.680381+0000","last_became_active":"2023-10-16T12:58:50.676461+0000","last_became_peered":"2023-10-16T12:58:50.676461+0000","last_unstale":"2023-10-16T12:58:55.680381+0000","last_undegraded":"2023-10-16T12:58:55.680381+0000","last_fullsized":"2023-10-16T12:58:55.680381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:43:43.356254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684505+0000","last_change":"2023-10-16T12:58:51.444087+0000","last_active":"2023-10-16T12:58:55.684505+0000","last_peered":"2023-10-16T12:58:55.684505+0000","last_clean":"2023-10-16T12:58:55.684505+0000","last_became_active":"2023-10-16T12:58:51.443844+0000","last_became_peered":"2023-10-16T12:58:51.443844+0000","last_unstale":"2023-10-16T12:58:55.684505+0000","last_undegraded":"2023-10-16T12:58:55.684505+0000","last_fullsized":"2023-10-16T12:58:55.684505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:48:37.180712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426810+0000","last_change":"2023-10-16T12:58:55.688731+0000","last_active":"2023-10-16T12:58:56.426810+0000","last_peered":"2023-10-16T12:58:56.426810+0000","last_clean":"2023-10-16T12:58:56.426810+0000","last_became_active":"2023-10-16T12:58:55.688216+0000","last_became_peered":"2023-10-16T12:58:55.688216+0000","last_unstale":"2023-10-16T12:58:56.426810+0000","last_undegraded":"2023-10-16T12:58:56.426810+0000","last_fullsized":"2023-10-16T12:58:56.426810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:19.721283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679599+0000","last_change":"2023-10-16T12:58:50.679739+0000","last_active":"2023-10-16T12:58:55.679599+0000","last_peered":"2023-10-16T12:58:55.679599+0000","last_clean":"2023-10-16T12:58:55.679599+0000","last_became_active":"2023-10-16T12:58:50.679385+0000","last_became_peered":"2023-10-16T12:58:50.679385+0000","last_unstale":"2023-10-16T12:58:55.679599+0000","last_undegraded":"2023-10-16T12:58:55.679599+0000","last_fullsized":"2023-10-16T12:58:55.679599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:31.078563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.681075+0000","last_change":"2023-10-16T12:58:51.449711+0000","last_active":"2023-10-16T12:58:55.681075+0000","last_peered":"2023-10-16T12:58:55.681075+0000","last_clean":"2023-10-16T12:58:55.681075+0000","last_became_active":"2023-10-16T12:58:51.449453+0000","last_became_peered":"2023-10-16T12:58:51.449453+0000","last_unstale":"2023-10-16T12:58:55.681075+0000","last_undegraded":"2023-10-16T12:58:55.681075+0000","last_fullsized":"2023-10-16T12:58:55.681075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:11.869582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.073118+0000","last_change":"2023-10-16T12:58:55.696432+0000","last_active":"2023-10-16T12:58:57.073118+0000","last_peered":"2023-10-16T12:58:57.073118+0000","last_clean":"2023-10-16T12:58:57.073118+0000","last_became_active":"2023-10-16T12:58:55.696015+0000","last_became_peered":"2023-10-16T12:58:55.696015+0000","last_unstale":"2023-10-16T12:58:57.073118+0000","last_undegraded":"2023-10-16T12:58:57.073118+0000","last_fullsized":"2023-10-16T12:58:57.073118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:46:37.320993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:59:00.961243+0000","last_change":"2023-10-16T12:58:50.672122+0000","last_active":"2023-10-16T12:59:00.961243+0000","last_peered":"2023-10-16T12:59:00.961243+0000","last_clean":"2023-10-16T12:59:00.961243+0000","last_became_active":"2023-10-16T12:58:50.671817+0000","last_became_peered":"2023-10-16T12:58:50.671817+0000","last_unstale":"2023-10-16T12:59:00.961243+0000","last_undegraded":"2023-10-16T12:59:00.961243+0000","last_fullsized":"2023-10-16T12:59:00.961243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:46.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705985+0000","last_change":"2023-10-16T12:58:51.446766+0000","last_active":"2023-10-16T12:58:55.705985+0000","last_peered":"2023-10-16T12:58:55.705985+0000","last_clean":"2023-10-16T12:58:55.705985+0000","last_became_active":"2023-10-16T12:58:51.446573+0000","last_became_peered":"2023-10-16T12:58:51.446573+0000","last_unstale":"2023-10-16T12:58:55.705985+0000","last_undegraded":"2023-10-16T12:58:55.705985+0000","last_fullsized":"2023-10-16T12:58:55.705985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:18:46.943690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072803+0000","last_change":"2023-10-16T12:58:55.708591+0000","last_active":"2023-10-16T12:58:57.072803+0000","last_peered":"2023-10-16T12:58:57.072803+0000","last_clean":"2023-10-16T12:58:57.072803+0000","last_became_active":"2023-10-16T12:58:55.708210+0000","last_became_peered":"2023-10-16T12:58:55.708210+0000","last_unstale":"2023-10-16T12:58:57.072803+0000","last_undegraded":"2023-10-16T12:58:57.072803+0000","last_fullsized":"2023-10-16T12:58:57.072803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:51:25.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.692682+0000","last_change":"2023-10-16T12:58:50.671656+0000","last_active":"2023-10-16T12:58:55.692682+0000","last_peered":"2023-10-16T12:58:55.692682+0000","last_clean":"2023-10-16T12:58:55.692682+0000","last_became_active":"2023-10-16T12:58:50.671397+0000","last_became_peered":"2023-10-16T12:58:50.671397+0000","last_unstale":"2023-10-16T12:58:55.692682+0000","last_undegraded":"2023-10-16T12:58:55.692682+0000","last_fullsized":"2023-10-16T12:58:55.692682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:00:22.709075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.690350+0000","last_change":"2023-10-16T12:58:51.446368+0000","last_active":"2023-10-16T12:58:55.690350+0000","last_peered":"2023-10-16T12:58:55.690350+0000","last_clean":"2023-10-16T12:58:55.690350+0000","last_became_active":"2023-10-16T12:58:51.446071+0000","last_became_peered":"2023-10-16T12:58:51.446071+0000","last_unstale":"2023-10-16T12:58:55.690350+0000","last_undegraded":"2023-10-16T12:58:55.690350+0000","last_fullsized":"2023-10-16T12:58:55.690350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:48.087275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.074774+0000","last_change":"2023-10-16T12:58:55.705522+0000","last_active":"2023-10-16T12:58:57.074774+0000","last_peered":"2023-10-16T12:58:57.074774+0000","last_clean":"2023-10-16T12:58:57.074774+0000","last_became_active":"2023-10-16T12:58:55.705089+0000","last_became_peered":"2023-10-16T12:58:55.705089+0000","last_unstale":"2023-10-16T12:58:57.074774+0000","last_undegraded":"2023-10-16T12:58:57.074774+0000","last_fullsized":"2023-10-16T12:58:57.074774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:04:01.613449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.678720+0000","last_change":"2023-10-16T12:58:50.673340+0000","last_active":"2023-10-16T12:58:55.678720+0000","last_peered":"2023-10-16T12:58:55.678720+0000","last_clean":"2023-10-16T12:58:55.678720+0000","last_became_active":"2023-10-16T12:58:50.672323+0000","last_became_peered":"2023-10-16T12:58:50.672323+0000","last_unstale":"2023-10-16T12:58:55.678720+0000","last_undegraded":"2023-10-16T12:58:55.678720+0000","last_fullsized":"2023-10-16T12:58:55.678720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:31.078563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705522+0000","last_change":"2023-10-16T12:58:51.448920+0000","last_active":"2023-10-16T12:58:55.705522+0000","last_peered":"2023-10-16T12:58:55.705522+0000","last_clean":"2023-10-16T12:58:55.705522+0000","last_became_active":"2023-10-16T12:58:51.448634+0000","last_became_peered":"2023-10-16T12:58:51.448634+0000","last_unstale":"2023-10-16T12:58:55.705522+0000","last_undegraded":"2023-10-16T12:58:55.705522+0000","last_fullsized":"2023-10-16T12:58:55.705522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:31:13.605999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.075154+0000","last_change":"2023-10-16T12:58:55.713528+0000","last_active":"2023-10-16T12:58:57.075154+0000","last_peered":"2023-10-16T12:58:57.075154+0000","last_clean":"2023-10-16T12:58:57.075154+0000","last_became_active":"2023-10-16T12:58:55.712996+0000","last_became_peered":"2023-10-16T12:58:55.712996+0000","last_unstale":"2023-10-16T12:58:57.075154+0000","last_undegraded":"2023-10-16T12:58:57.075154+0000","last_fullsized":"2023-10-16T12:58:57.075154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:20.622883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686054+0000","last_change":"2023-10-16T12:58:50.667418+0000","last_active":"2023-10-16T12:58:55.686054+0000","last_peered":"2023-10-16T12:58:55.686054+0000","last_clean":"2023-10-16T12:58:55.686054+0000","last_became_active":"2023-10-16T12:58:50.667102+0000","last_became_peered":"2023-10-16T12:58:50.667102+0000","last_unstale":"2023-10-16T12:58:55.686054+0000","last_undegraded":"2023-10-16T12:58:55.686054+0000","last_fullsized":"2023-10-16T12:58:55.686054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:10.863857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.685920+0000","last_change":"2023-10-16T12:58:51.441514+0000","last_active":"2023-10-16T12:58:55.685920+0000","last_peered":"2023-10-16T12:58:55.685920+0000","last_clean":"2023-10-16T12:58:55.685920+0000","last_became_active":"2023-10-16T12:58:51.441211+0000","last_became_peered":"2023-10-16T12:58:51.441211+0000","last_unstale":"2023-10-16T12:58:55.685920+0000","last_undegraded":"2023-10-16T12:58:55.685920+0000","last_fullsized":"2023-10-16T12:58:55.685920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:28:04.262253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072161+0000","last_change":"2023-10-16T12:58:55.698601+0000","last_active":"2023-10-16T12:58:57.072161+0000","last_peered":"2023-10-16T12:58:57.072161+0000","last_clean":"2023-10-16T12:58:57.072161+0000","last_became_active":"2023-10-16T12:58:55.697802+0000","last_became_peered":"2023-10-16T12:58:55.697802+0000","last_unstale":"2023-10-16T12:58:57.072161+0000","last_undegraded":"2023-10-16T12:58:57.072161+0000","last_fullsized":"2023-10-16T12:58:57.072161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:19.721283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684515+0000","last_change":"2023-10-16T12:58:50.679915+0000","last_active":"2023-10-16T12:58:55.684515+0000","last_peered":"2023-10-16T12:58:55.684515+0000","last_clean":"2023-10-16T12:58:55.684515+0000","last_became_active":"2023-10-16T12:58:50.679550+0000","last_became_peered":"2023-10-16T12:58:50.679550+0000","last_unstale":"2023-10-16T12:58:55.684515+0000","last_undegraded":"2023-10-16T12:58:55.684515+0000","last_fullsized":"2023-10-16T12:58:55.684515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:33.218756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705896+0000","last_change":"2023-10-16T12:58:51.450989+0000","last_active":"2023-10-16T12:58:55.705896+0000","last_peered":"2023-10-16T12:58:55.705896+0000","last_clean":"2023-10-16T12:58:55.705896+0000","last_became_active":"2023-10-16T12:58:51.450681+0000","last_became_peered":"2023-10-16T12:58:51.450681+0000","last_unstale":"2023-10-16T12:58:55.705896+0000","last_undegraded":"2023-10-16T12:58:55.705896+0000","last_fullsized":"2023-10-16T12:58:55.705896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:17:35.655947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.425612+0000","last_change":"2023-10-16T12:58:55.694540+0000","last_active":"2023-10-16T12:58:56.425612+0000","last_peered":"2023-10-16T12:58:56.425612+0000","last_clean":"2023-10-16T12:58:56.425612+0000","last_became_active":"2023-10-16T12:58:55.694116+0000","last_became_peered":"2023-10-16T12:58:55.694116+0000","last_unstale":"2023-10-16T12:58:56.425612+0000","last_undegraded":"2023-10-16T12:58:56.425612+0000","last_fullsized":"2023-10-16T12:58:56.425612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:21.779599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.681959+0000","last_change":"2023-10-16T12:58:50.673412+0000","last_active":"2023-10-16T12:58:55.681959+0000","last_peered":"2023-10-16T12:58:55.681959+0000","last_clean":"2023-10-16T12:58:55.681959+0000","last_became_active":"2023-10-16T12:58:50.672849+0000","last_became_peered":"2023-10-16T12:58:50.672849+0000","last_unstale":"2023-10-16T12:58:55.681959+0000","last_undegraded":"2023-10-16T12:58:55.681959+0000","last_fullsized":"2023-10-16T12:58:55.681959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:35:18.620321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705273+0000","last_change":"2023-10-16T12:58:51.449246+0000","last_active":"2023-10-16T12:58:55.705273+0000","last_peered":"2023-10-16T12:58:55.705273+0000","last_clean":"2023-10-16T12:58:55.705273+0000","last_became_active":"2023-10-16T12:58:51.448956+0000","last_became_peered":"2023-10-16T12:58:51.448956+0000","last_unstale":"2023-10-16T12:58:55.705273+0000","last_undegraded":"2023-10-16T12:58:55.705273+0000","last_fullsized":"2023-10-16T12:58:55.705273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:29:58.046253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072974+0000","last_change":"2023-10-16T12:58:55.698954+0000","last_active":"2023-10-16T12:58:57.072974+0000","last_peered":"2023-10-16T12:58:57.072974+0000","last_clean":"2023-10-16T12:58:57.072974+0000","last_became_active":"2023-10-16T12:58:55.698587+0000","last_became_peered":"2023-10-16T12:58:55.698587+0000","last_unstale":"2023-10-16T12:58:57.072974+0000","last_undegraded":"2023-10-16T12:58:57.072974+0000","last_fullsized":"2023-10-16T12:58:57.072974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:37.747199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679241+0000","last_change":"2023-10-16T12:58:50.673554+0000","last_active":"2023-10-16T12:58:55.679241+0000","last_peered":"2023-10-16T12:58:55.679241+0000","last_clean":"2023-10-16T12:58:55.679241+0000","last_became_active":"2023-10-16T12:58:50.673154+0000","last_became_peered":"2023-10-16T12:58:50.673154+0000","last_unstale":"2023-10-16T12:58:55.679241+0000","last_undegraded":"2023-10-16T12:58:55.679241+0000","last_fullsized":"2023-10-16T12:58:55.679241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:34.579436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.681355+0000","last_change":"2023-10-16T12:58:51.439381+0000","last_active":"2023-10-16T12:58:55.681355+0000","last_peered":"2023-10-16T12:58:55.681355+0000","last_clean":"2023-10-16T12:58:55.681355+0000","last_became_active":"2023-10-16T12:58:51.439106+0000","last_became_peered":"2023-10-16T12:58:51.439106+0000","last_unstale":"2023-10-16T12:58:55.681355+0000","last_undegraded":"2023-10-16T12:58:55.681355+0000","last_fullsized":"2023-10-16T12:58:55.681355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:15.698887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072598+0000","last_change":"2023-10-16T12:58:55.703026+0000","last_active":"2023-10-16T12:58:57.072598+0000","last_peered":"2023-10-16T12:58:57.072598+0000","last_clean":"2023-10-16T12:58:57.072598+0000","last_became_active":"2023-10-16T12:58:55.702114+0000","last_became_peered":"2023-10-16T12:58:55.702114+0000","last_unstale":"2023-10-16T12:58:57.072598+0000","last_undegraded":"2023-10-16T12:58:57.072598+0000","last_fullsized":"2023-10-16T12:58:57.072598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:19.721283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.678615+0000","last_change":"2023-10-16T12:58:50.674212+0000","last_active":"2023-10-16T12:58:55.678615+0000","last_peered":"2023-10-16T12:58:55.678615+0000","last_clean":"2023-10-16T12:58:55.678615+0000","last_became_active":"2023-10-16T12:58:50.673650+0000","last_became_peered":"2023-10-16T12:58:50.673650+0000","last_unstale":"2023-10-16T12:58:55.678615+0000","last_undegraded":"2023-10-16T12:58:55.678615+0000","last_fullsized":"2023-10-16T12:58:55.678615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:46.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.683223+0000","last_change":"2023-10-16T12:58:51.438475+0000","last_active":"2023-10-16T12:58:55.683223+0000","last_peered":"2023-10-16T12:58:55.683223+0000","last_clean":"2023-10-16T12:58:55.683223+0000","last_became_active":"2023-10-16T12:58:51.438151+0000","last_became_peered":"2023-10-16T12:58:51.438151+0000","last_unstale":"2023-10-16T12:58:55.683223+0000","last_undegraded":"2023-10-16T12:58:55.683223+0000","last_fullsized":"2023-10-16T12:58:55.683223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:22:35.314558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.073288+0000","last_change":"2023-10-16T12:58:55.699995+0000","last_active":"2023-10-16T12:58:57.073288+0000","last_peered":"2023-10-16T12:58:57.073288+0000","last_clean":"2023-10-16T12:58:57.073288+0000","last_became_active":"2023-10-16T12:58:55.699645+0000","last_became_peered":"2023-10-16T12:58:55.699645+0000","last_unstale":"2023-10-16T12:58:57.073288+0000","last_undegraded":"2023-10-16T12:58:57.073288+0000","last_fullsized":"2023-10-16T12:58:57.073288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:29:11.416516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.677592+0000","last_change":"2023-10-16T12:58:51.438846+0000","last_active":"2023-10-16T12:58:55.677592+0000","last_peered":"2023-10-16T12:58:55.677592+0000","last_clean":"2023-10-16T12:58:55.677592+0000","last_became_active":"2023-10-16T12:58:51.438601+0000","last_became_peered":"2023-10-16T12:58:51.438601+0000","last_unstale":"2023-10-16T12:58:55.677592+0000","last_undegraded":"2023-10-16T12:58:55.677592+0000","last_fullsized":"2023-10-16T12:58:55.677592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:48:37.180712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684696+0000","last_change":"2023-10-16T12:58:50.685058+0000","last_active":"2023-10-16T12:58:55.684696+0000","last_peered":"2023-10-16T12:58:55.684696+0000","last_clean":"2023-10-16T12:58:55.684696+0000","last_became_active":"2023-10-16T12:58:50.684800+0000","last_became_peered":"2023-10-16T12:58:50.684800+0000","last_unstale":"2023-10-16T12:58:55.684696+0000","last_undegraded":"2023-10-16T12:58:55.684696+0000","last_fullsized":"2023-10-16T12:58:55.684696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:22:34.308834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426188+0000","last_change":"2023-10-16T12:58:55.705646+0000","last_active":"2023-10-16T12:58:56.426188+0000","last_peered":"2023-10-16T12:58:56.426188+0000","last_clean":"2023-10-16T12:58:56.426188+0000","last_became_active":"2023-10-16T12:58:55.705247+0000","last_became_peered":"2023-10-16T12:58:55.705247+0000","last_unstale":"2023-10-16T12:58:56.426188+0000","last_undegraded":"2023-10-16T12:58:56.426188+0000","last_fullsized":"2023-10-16T12:58:56.426188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:37.747199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.685428+0000","last_change":"2023-10-16T12:58:51.436519+0000","last_active":"2023-10-16T12:58:55.685428+0000","last_peered":"2023-10-16T12:58:55.685428+0000","last_clean":"2023-10-16T12:58:55.685428+0000","last_became_active":"2023-10-16T12:58:51.436320+0000","last_became_peered":"2023-10-16T12:58:51.436320+0000","last_unstale":"2023-10-16T12:58:55.685428+0000","last_undegraded":"2023-10-16T12:58:55.685428+0000","last_fullsized":"2023-10-16T12:58:55.685428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:48:37.180712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679659+0000","last_change":"2023-10-16T12:58:50.682408+0000","last_active":"2023-10-16T12:58:55.679659+0000","last_peered":"2023-10-16T12:58:55.679659+0000","last_clean":"2023-10-16T12:58:55.679659+0000","last_became_active":"2023-10-16T12:58:50.682084+0000","last_became_peered":"2023-10-16T12:58:50.682084+0000","last_unstale":"2023-10-16T12:58:55.679659+0000","last_undegraded":"2023-10-16T12:58:55.679659+0000","last_fullsized":"2023-10-16T12:58:55.679659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:20.511820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.704719+0000","last_change":"2023-10-16T12:58:40.198340+0000","last_active":"2023-10-16T12:58:55.704719+0000","last_peered":"2023-10-16T12:58:55.704719+0000","last_clean":"2023-10-16T12:58:55.704719+0000","last_became_active":"2023-10-16T12:58:40.197354+0000","last_became_peered":"2023-10-16T12:58:40.197354+0000","last_unstale":"2023-10-16T12:58:55.704719+0000","last_undegraded":"2023-10-16T12:58:55.704719+0000","last_fullsized":"2023-10-16T12:58:55.704719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:39.025347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:39.025347+0000","last_clean_scrub_stamp":"2023-10-16T12:58:39.025347+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:22:36.722419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072318+0000","last_change":"2023-10-16T12:58:55.709450+0000","last_active":"2023-10-16T12:58:57.072318+0000","last_peered":"2023-10-16T12:58:57.072318+0000","last_clean":"2023-10-16T12:58:57.072318+0000","last_became_active":"2023-10-16T12:58:55.708457+0000","last_became_peered":"2023-10-16T12:58:55.708457+0000","last_unstale":"2023-10-16T12:58:57.072318+0000","last_undegraded":"2023-10-16T12:58:57.072318+0000","last_fullsized":"2023-10-16T12:58:57.072318+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:46:37.320993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684401+0000","last_change":"2023-10-16T12:58:51.440843+0000","last_active":"2023-10-16T12:58:55.684401+0000","last_peered":"2023-10-16T12:58:55.684401+0000","last_clean":"2023-10-16T12:58:55.684401+0000","last_became_active":"2023-10-16T12:58:51.440584+0000","last_became_peered":"2023-10-16T12:58:51.440584+0000","last_unstale":"2023-10-16T12:58:55.684401+0000","last_undegraded":"2023-10-16T12:58:55.684401+0000","last_fullsized":"2023-10-16T12:58:55.684401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:47.513811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.704824+0000","last_change":"2023-10-16T12:58:50.672662+0000","last_active":"2023-10-16T12:58:55.704824+0000","last_peered":"2023-10-16T12:58:55.704824+0000","last_clean":"2023-10-16T12:58:55.704824+0000","last_became_active":"2023-10-16T12:58:50.672268+0000","last_became_peered":"2023-10-16T12:58:50.672268+0000","last_unstale":"2023-10-16T12:58:55.704824+0000","last_undegraded":"2023-10-16T12:58:55.704824+0000","last_fullsized":"2023-10-16T12:58:55.704824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:22:34.308834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072561+0000","last_change":"2023-10-16T12:58:55.708627+0000","last_active":"2023-10-16T12:58:57.072561+0000","last_peered":"2023-10-16T12:58:57.072561+0000","last_clean":"2023-10-16T12:58:57.072561+0000","last_became_active":"2023-10-16T12:58:55.708171+0000","last_became_peered":"2023-10-16T12:58:55.708171+0000","last_unstale":"2023-10-16T12:58:57.072561+0000","last_undegraded":"2023-10-16T12:58:57.072561+0000","last_fullsized":"2023-10-16T12:58:57.072561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:42:30.929517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705826+0000","last_change":"2023-10-16T12:58:50.678911+0000","last_active":"2023-10-16T12:58:55.705826+0000","last_peered":"2023-10-16T12:58:55.705826+0000","last_clean":"2023-10-16T12:58:55.705826+0000","last_became_active":"2023-10-16T12:58:50.678642+0000","last_became_peered":"2023-10-16T12:58:50.678642+0000","last_unstale":"2023-10-16T12:58:55.705826+0000","last_undegraded":"2023-10-16T12:58:55.705826+0000","last_fullsized":"2023-10-16T12:58:55.705826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:46.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.680176+0000","last_change":"2023-10-16T12:58:51.439513+0000","last_active":"2023-10-16T12:58:55.680176+0000","last_peered":"2023-10-16T12:58:55.680176+0000","last_clean":"2023-10-16T12:58:55.680176+0000","last_became_active":"2023-10-16T12:58:51.439294+0000","last_became_peered":"2023-10-16T12:58:51.439294+0000","last_unstale":"2023-10-16T12:58:55.680176+0000","last_undegraded":"2023-10-16T12:58:55.680176+0000","last_fullsized":"2023-10-16T12:58:55.680176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:17.757203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.074246+0000","last_change":"2023-10-16T12:58:55.709315+0000","last_active":"2023-10-16T12:58:57.074246+0000","last_peered":"2023-10-16T12:58:57.074246+0000","last_clean":"2023-10-16T12:58:57.074246+0000","last_became_active":"2023-10-16T12:58:55.708910+0000","last_became_peered":"2023-10-16T12:58:55.708910+0000","last_unstale":"2023-10-16T12:58:57.074246+0000","last_undegraded":"2023-10-16T12:58:57.074246+0000","last_fullsized":"2023-10-16T12:58:57.074246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:05:40.393225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679472+0000","last_change":"2023-10-16T12:58:50.673963+0000","last_active":"2023-10-16T12:58:55.679472+0000","last_peered":"2023-10-16T12:58:55.679472+0000","last_clean":"2023-10-16T12:58:55.679472+0000","last_became_active":"2023-10-16T12:58:50.673711+0000","last_became_peered":"2023-10-16T12:58:50.673711+0000","last_unstale":"2023-10-16T12:58:55.679472+0000","last_undegraded":"2023-10-16T12:58:55.679472+0000","last_fullsized":"2023-10-16T12:58:55.679472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:20.511820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688867+0000","last_change":"2023-10-16T12:58:51.446153+0000","last_active":"2023-10-16T12:58:55.688867+0000","last_peered":"2023-10-16T12:58:55.688867+0000","last_clean":"2023-10-16T12:58:55.688867+0000","last_became_active":"2023-10-16T12:58:51.445929+0000","last_became_peered":"2023-10-16T12:58:51.445929+0000","last_unstale":"2023-10-16T12:58:55.688867+0000","last_undegraded":"2023-10-16T12:58:55.688867+0000","last_fullsized":"2023-10-16T12:58:55.688867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:42:07.880003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.425788+0000","last_change":"2023-10-16T12:58:55.708698+0000","last_active":"2023-10-16T12:58:56.425788+0000","last_peered":"2023-10-16T12:58:56.425788+0000","last_clean":"2023-10-16T12:58:56.425788+0000","last_became_active":"2023-10-16T12:58:55.708320+0000","last_became_peered":"2023-10-16T12:58:55.708320+0000","last_unstale":"2023-10-16T12:58:56.425788+0000","last_undegraded":"2023-10-16T12:58:56.425788+0000","last_fullsized":"2023-10-16T12:58:56.425788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:55.444997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686576+0000","last_change":"2023-10-16T12:58:50.673507+0000","last_active":"2023-10-16T12:58:55.686576+0000","last_peered":"2023-10-16T12:58:55.686576+0000","last_clean":"2023-10-16T12:58:55.686576+0000","last_became_active":"2023-10-16T12:58:50.672980+0000","last_became_peered":"2023-10-16T12:58:50.672980+0000","last_unstale":"2023-10-16T12:58:55.686576+0000","last_undegraded":"2023-10-16T12:58:55.686576+0000","last_fullsized":"2023-10-16T12:58:55.686576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:33.218756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.692578+0000","last_change":"2023-10-16T12:58:51.439054+0000","last_active":"2023-10-16T12:58:55.692578+0000","last_peered":"2023-10-16T12:58:55.692578+0000","last_clean":"2023-10-16T12:58:55.692578+0000","last_became_active":"2023-10-16T12:58:51.438776+0000","last_became_peered":"2023-10-16T12:58:51.438776+0000","last_unstale":"2023-10-16T12:58:55.692578+0000","last_undegraded":"2023-10-16T12:58:55.692578+0000","last_fullsized":"2023-10-16T12:58:55.692578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:17.757203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.425860+0000","last_change":"2023-10-16T12:58:55.694414+0000","last_active":"2023-10-16T12:58:56.425860+0000","last_peered":"2023-10-16T12:58:56.425860+0000","last_clean":"2023-10-16T12:58:56.425860+0000","last_became_active":"2023-10-16T12:58:55.694003+0000","last_became_peered":"2023-10-16T12:58:55.694003+0000","last_unstale":"2023-10-16T12:58:56.425860+0000","last_undegraded":"2023-10-16T12:58:56.425860+0000","last_fullsized":"2023-10-16T12:58:56.425860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:17:39.678343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.704716+0000","last_change":"2023-10-16T12:58:50.678331+0000","last_active":"2023-10-16T12:58:55.704716+0000","last_peered":"2023-10-16T12:58:55.704716+0000","last_clean":"2023-10-16T12:58:55.704716+0000","last_became_active":"2023-10-16T12:58:50.674513+0000","last_became_peered":"2023-10-16T12:58:50.674513+0000","last_unstale":"2023-10-16T12:58:55.704716+0000","last_undegraded":"2023-10-16T12:58:55.704716+0000","last_fullsized":"2023-10-16T12:58:55.704716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:33.218756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.682143+0000","last_change":"2023-10-16T12:58:51.438953+0000","last_active":"2023-10-16T12:58:55.682143+0000","last_peered":"2023-10-16T12:58:55.682143+0000","last_clean":"2023-10-16T12:58:55.682143+0000","last_became_active":"2023-10-16T12:58:51.438670+0000","last_became_peered":"2023-10-16T12:58:51.438670+0000","last_unstale":"2023-10-16T12:58:55.682143+0000","last_undegraded":"2023-10-16T12:58:55.682143+0000","last_fullsized":"2023-10-16T12:58:55.682143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:34.224481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.073430+0000","last_change":"2023-10-16T12:58:55.711548+0000","last_active":"2023-10-16T12:58:57.073430+0000","last_peered":"2023-10-16T12:58:57.073430+0000","last_clean":"2023-10-16T12:58:57.073430+0000","last_became_active":"2023-10-16T12:58:55.711144+0000","last_became_peered":"2023-10-16T12:58:55.711144+0000","last_unstale":"2023-10-16T12:58:57.073430+0000","last_undegraded":"2023-10-16T12:58:57.073430+0000","last_fullsized":"2023-10-16T12:58:57.073430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:42:30.929517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.677592+0000","last_change":"2023-10-16T12:58:50.674933+0000","last_active":"2023-10-16T12:58:55.677592+0000","last_peered":"2023-10-16T12:58:55.677592+0000","last_clean":"2023-10-16T12:58:55.677592+0000","last_became_active":"2023-10-16T12:58:50.674678+0000","last_became_peered":"2023-10-16T12:58:50.674678+0000","last_unstale":"2023-10-16T12:58:55.677592+0000","last_undegraded":"2023-10-16T12:58:55.677592+0000","last_fullsized":"2023-10-16T12:58:55.677592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:22:34.308834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688629+0000","last_change":"2023-10-16T12:58:51.438422+0000","last_active":"2023-10-16T12:58:55.688629+0000","last_peered":"2023-10-16T12:58:55.688629+0000","last_clean":"2023-10-16T12:58:55.688629+0000","last_became_active":"2023-10-16T12:58:51.437341+0000","last_became_peered":"2023-10-16T12:58:51.437341+0000","last_unstale":"2023-10-16T12:58:55.688629+0000","last_undegraded":"2023-10-16T12:58:55.688629+0000","last_fullsized":"2023-10-16T12:58:55.688629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:59.501942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426422+0000","last_change":"2023-10-16T12:58:55.702372+0000","last_active":"2023-10-16T12:58:56.426422+0000","last_peered":"2023-10-16T12:58:56.426422+0000","last_clean":"2023-10-16T12:58:56.426422+0000","last_became_active":"2023-10-16T12:58:55.701933+0000","last_became_peered":"2023-10-16T12:58:55.701933+0000","last_unstale":"2023-10-16T12:58:56.426422+0000","last_undegraded":"2023-10-16T12:58:56.426422+0000","last_fullsized":"2023-10-16T12:58:56.426422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:18:50.966086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.677714+0000","last_change":"2023-10-16T12:58:50.669022+0000","last_active":"2023-10-16T12:58:55.677714+0000","last_peered":"2023-10-16T12:58:55.677714+0000","last_clean":"2023-10-16T12:58:55.677714+0000","last_became_active":"2023-10-16T12:58:50.668730+0000","last_became_peered":"2023-10-16T12:58:50.668730+0000","last_unstale":"2023-10-16T12:58:55.677714+0000","last_undegraded":"2023-10-16T12:58:55.677714+0000","last_fullsized":"2023-10-16T12:58:55.677714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:10.863857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.683389+0000","last_change":"2023-10-16T12:58:51.442613+0000","last_active":"2023-10-16T12:58:55.683389+0000","last_peered":"2023-10-16T12:58:55.683389+0000","last_clean":"2023-10-16T12:58:55.683389+0000","last_became_active":"2023-10-16T12:58:51.442369+0000","last_became_peered":"2023-10-16T12:58:51.442369+0000","last_unstale":"2023-10-16T12:58:55.683389+0000","last_undegraded":"2023-10-16T12:58:55.683389+0000","last_fullsized":"2023-10-16T12:58:55.683389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:40:36.060468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426204+0000","last_change":"2023-10-16T12:58:55.698038+0000","last_active":"2023-10-16T12:58:56.426204+0000","last_peered":"2023-10-16T12:58:56.426204+0000","last_clean":"2023-10-16T12:58:56.426204+0000","last_became_active":"2023-10-16T12:58:55.697543+0000","last_became_peered":"2023-10-16T12:58:55.697543+0000","last_unstale":"2023-10-16T12:58:56.426204+0000","last_undegraded":"2023-10-16T12:58:56.426204+0000","last_fullsized":"2023-10-16T12:58:56.426204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:31:17.628395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705613+0000","last_change":"2023-10-16T12:58:50.682262+0000","last_active":"2023-10-16T12:58:55.705613+0000","last_peered":"2023-10-16T12:58:55.705613+0000","last_clean":"2023-10-16T12:58:55.705613+0000","last_became_active":"2023-10-16T12:58:50.681971+0000","last_became_peered":"2023-10-16T12:58:50.681971+0000","last_unstale":"2023-10-16T12:58:55.705613+0000","last_undegraded":"2023-10-16T12:58:55.705613+0000","last_fullsized":"2023-10-16T12:58:55.705613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:48:36.174987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.687168+0000","last_change":"2023-10-16T12:58:51.444120+0000","last_active":"2023-10-16T12:58:55.687168+0000","last_peered":"2023-10-16T12:58:55.687168+0000","last_clean":"2023-10-16T12:58:55.687168+0000","last_became_active":"2023-10-16T12:58:51.443932+0000","last_became_peered":"2023-10-16T12:58:51.443932+0000","last_unstale":"2023-10-16T12:58:55.687168+0000","last_undegraded":"2023-10-16T12:58:55.687168+0000","last_fullsized":"2023-10-16T12:58:55.687168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:59.501942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.425527+0000","last_change":"2023-10-16T12:58:55.705568+0000","last_active":"2023-10-16T12:58:56.425527+0000","last_peered":"2023-10-16T12:58:56.425527+0000","last_clean":"2023-10-16T12:58:56.425527+0000","last_became_active":"2023-10-16T12:58:55.705195+0000","last_became_peered":"2023-10-16T12:58:55.705195+0000","last_unstale":"2023-10-16T12:58:56.425527+0000","last_undegraded":"2023-10-16T12:58:56.425527+0000","last_fullsized":"2023-10-16T12:58:56.425527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:30:02.068649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.685246+0000","last_change":"2023-10-16T12:58:50.680178+0000","last_active":"2023-10-16T12:58:55.685246+0000","last_peered":"2023-10-16T12:58:55.685246+0000","last_clean":"2023-10-16T12:58:55.685246+0000","last_became_active":"2023-10-16T12:58:50.679945+0000","last_became_peered":"2023-10-16T12:58:50.679945+0000","last_unstale":"2023-10-16T12:58:55.685246+0000","last_undegraded":"2023-10-16T12:58:55.685246+0000","last_fullsized":"2023-10-16T12:58:55.685246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:10.863857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.706307+0000","last_change":"2023-10-16T12:58:51.449653+0000","last_active":"2023-10-16T12:58:55.706307+0000","last_peered":"2023-10-16T12:58:55.706307+0000","last_clean":"2023-10-16T12:58:55.706307+0000","last_became_active":"2023-10-16T12:58:51.449109+0000","last_became_peered":"2023-10-16T12:58:51.449109+0000","last_unstale":"2023-10-16T12:58:55.706307+0000","last_undegraded":"2023-10-16T12:58:55.706307+0000","last_fullsized":"2023-10-16T12:58:55.706307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:15.698887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072205+0000","last_change":"2023-10-16T12:58:55.702012+0000","last_active":"2023-10-16T12:58:57.072205+0000","last_peered":"2023-10-16T12:58:57.072205+0000","last_clean":"2023-10-16T12:58:57.072205+0000","last_became_active":"2023-10-16T12:58:55.701622+0000","last_became_peered":"2023-10-16T12:58:55.701622+0000","last_unstale":"2023-10-16T12:58:57.072205+0000","last_undegraded":"2023-10-16T12:58:57.072205+0000","last_fullsized":"2023-10-16T12:58:57.072205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:37.747199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679482+0000","last_change":"2023-10-16T12:58:50.669769+0000","last_active":"2023-10-16T12:58:55.679482+0000","last_peered":"2023-10-16T12:58:55.679482+0000","last_clean":"2023-10-16T12:58:55.679482+0000","last_became_active":"2023-10-16T12:58:50.669513+0000","last_became_peered":"2023-10-16T12:58:50.669513+0000","last_unstale":"2023-10-16T12:58:55.679482+0000","last_undegraded":"2023-10-16T12:58:55.679482+0000","last_fullsized":"2023-10-16T12:58:55.679482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:00:22.709075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679131+0000","last_change":"2023-10-16T12:58:51.440492+0000","last_active":"2023-10-16T12:58:55.679131+0000","last_peered":"2023-10-16T12:58:55.679131+0000","last_clean":"2023-10-16T12:58:55.679131+0000","last_became_active":"2023-10-16T12:58:51.440223+0000","last_became_peered":"2023-10-16T12:58:51.440223+0000","last_unstale":"2023-10-16T12:58:55.679131+0000","last_undegraded":"2023-10-16T12:58:55.679131+0000","last_fullsized":"2023-10-16T12:58:55.679131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:29:58.046253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072507+0000","last_change":"2023-10-16T12:58:55.709910+0000","last_active":"2023-10-16T12:58:57.072507+0000","last_peered":"2023-10-16T12:58:57.072507+0000","last_clean":"2023-10-16T12:58:57.072507+0000","last_became_active":"2023-10-16T12:58:55.709448+0000","last_became_peered":"2023-10-16T12:58:55.709448+0000","last_unstale":"2023-10-16T12:58:57.072507+0000","last_undegraded":"2023-10-16T12:58:57.072507+0000","last_fullsized":"2023-10-16T12:58:57.072507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:10:14.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686015+0000","last_change":"2023-10-16T12:58:50.677056+0000","last_active":"2023-10-16T12:58:55.686015+0000","last_peered":"2023-10-16T12:58:55.686015+0000","last_clean":"2023-10-16T12:58:55.686015+0000","last_became_active":"2023-10-16T12:58:50.676784+0000","last_became_peered":"2023-10-16T12:58:50.676784+0000","last_unstale":"2023-10-16T12:58:55.686015+0000","last_undegraded":"2023-10-16T12:58:55.686015+0000","last_fullsized":"2023-10-16T12:58:55.686015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:20.511820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705640+0000","last_change":"2023-10-16T12:58:51.451103+0000","last_active":"2023-10-16T12:58:55.705640+0000","last_peered":"2023-10-16T12:58:55.705640+0000","last_clean":"2023-10-16T12:58:55.705640+0000","last_became_active":"2023-10-16T12:58:51.449605+0000","last_became_peered":"2023-10-16T12:58:51.449605+0000","last_unstale":"2023-10-16T12:58:55.705640+0000","last_undegraded":"2023-10-16T12:58:55.705640+0000","last_fullsized":"2023-10-16T12:58:55.705640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:33.724803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686013+0000","last_change":"2023-10-16T12:58:51.439877+0000","last_active":"2023-10-16T12:58:55.686013+0000","last_peered":"2023-10-16T12:58:55.686013+0000","last_clean":"2023-10-16T12:58:55.686013+0000","last_became_active":"2023-10-16T12:58:51.439574+0000","last_became_peered":"2023-10-16T12:58:51.439574+0000","last_unstale":"2023-10-16T12:58:55.686013+0000","last_undegraded":"2023-10-16T12:58:55.686013+0000","last_fullsized":"2023-10-16T12:58:55.686013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:40:36.060468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684614+0000","last_change":"2023-10-16T12:58:51.444297+0000","last_active":"2023-10-16T12:58:55.684614+0000","last_peered":"2023-10-16T12:58:55.684614+0000","last_clean":"2023-10-16T12:58:55.684614+0000","last_became_active":"2023-10-16T12:58:51.444044+0000","last_became_peered":"2023-10-16T12:58:51.444044+0000","last_unstale":"2023-10-16T12:58:55.684614+0000","last_undegraded":"2023-10-16T12:58:55.684614+0000","last_fullsized":"2023-10-16T12:58:55.684614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:56.488214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.678833+0000","last_change":"2023-10-16T12:58:51.438825+0000","last_active":"2023-10-16T12:58:55.678833+0000","last_peered":"2023-10-16T12:58:55.678833+0000","last_clean":"2023-10-16T12:58:55.678833+0000","last_became_active":"2023-10-16T12:58:51.438444+0000","last_became_peered":"2023-10-16T12:58:51.438444+0000","last_unstale":"2023-10-16T12:58:55.678833+0000","last_undegraded":"2023-10-16T12:58:55.678833+0000","last_fullsized":"2023-10-16T12:58:55.678833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:41:33.353000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.692498+0000","last_change":"2023-10-16T12:58:51.442368+0000","last_active":"2023-10-16T12:58:55.692498+0000","last_peered":"2023-10-16T12:58:55.692498+0000","last_clean":"2023-10-16T12:58:55.692498+0000","last_became_active":"2023-10-16T12:58:51.442108+0000","last_became_peered":"2023-10-16T12:58:51.442108+0000","last_unstale":"2023-10-16T12:58:55.692498+0000","last_undegraded":"2023-10-16T12:58:55.692498+0000","last_fullsized":"2023-10-16T12:58:55.692498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:59.501942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.693864+0000","last_change":"2023-10-16T12:58:51.441274+0000","last_active":"2023-10-16T12:58:55.693864+0000","last_peered":"2023-10-16T12:58:55.693864+0000","last_clean":"2023-10-16T12:58:55.693864+0000","last_became_active":"2023-10-16T12:58:51.441004+0000","last_became_peered":"2023-10-16T12:58:51.441004+0000","last_unstale":"2023-10-16T12:58:55.693864+0000","last_undegraded":"2023-10-16T12:58:55.693864+0000","last_fullsized":"2023-10-16T12:58:55.693864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:28:04.262253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679247+0000","last_change":"2023-10-16T12:58:51.437880+0000","last_active":"2023-10-16T12:58:55.679247+0000","last_peered":"2023-10-16T12:58:55.679247+0000","last_clean":"2023-10-16T12:58:55.679247+0000","last_became_active":"2023-10-16T12:58:51.437590+0000","last_became_peered":"2023-10-16T12:58:51.437590+0000","last_unstale":"2023-10-16T12:58:55.679247+0000","last_undegraded":"2023-10-16T12:58:55.679247+0000","last_fullsized":"2023-10-16T12:58:55.679247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:28:04.262253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686716+0000","last_change":"2023-10-16T12:58:51.447018+0000","last_active":"2023-10-16T12:58:55.686716+0000","last_peered":"2023-10-16T12:58:55.686716+0000","last_clean":"2023-10-16T12:58:55.686716+0000","last_became_active":"2023-10-16T12:58:51.446732+0000","last_became_peered":"2023-10-16T12:58:51.446732+0000","last_unstale":"2023-10-16T12:58:55.686716+0000","last_undegraded":"2023-10-16T12:58:55.686716+0000","last_fullsized":"2023-10-16T12:58:55.686716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:51.422601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688954+0000","last_change":"2023-10-16T12:58:51.441277+0000","last_active":"2023-10-16T12:58:55.688954+0000","last_peered":"2023-10-16T12:58:55.688954+0000","last_clean":"2023-10-16T12:58:55.688954+0000","last_became_active":"2023-10-16T12:58:51.441023+0000","last_became_peered":"2023-10-16T12:58:51.441023+0000","last_unstale":"2023-10-16T12:58:55.688954+0000","last_undegraded":"2023-10-16T12:58:55.688954+0000","last_fullsized":"2023-10-16T12:58:55.688954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:17:35.655947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.680294+0000","last_change":"2023-10-16T12:58:51.443020+0000","last_active":"2023-10-16T12:58:55.680294+0000","last_peered":"2023-10-16T12:58:55.680294+0000","last_clean":"2023-10-16T12:58:55.680294+0000","last_became_active":"2023-10-16T12:58:51.442541+0000","last_became_peered":"2023-10-16T12:58:51.442541+0000","last_unstale":"2023-10-16T12:58:55.680294+0000","last_undegraded":"2023-10-16T12:58:55.680294+0000","last_fullsized":"2023-10-16T12:58:55.680294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:31:13.605999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688993+0000","last_change":"2023-10-16T12:58:51.441436+0000","last_active":"2023-10-16T12:58:55.688993+0000","last_peered":"2023-10-16T12:58:55.688993+0000","last_clean":"2023-10-16T12:58:55.688993+0000","last_became_active":"2023-10-16T12:58:51.441145+0000","last_became_peered":"2023-10-16T12:58:51.441145+0000","last_unstale":"2023-10-16T12:58:55.688993+0000","last_undegraded":"2023-10-16T12:58:55.688993+0000","last_fullsized":"2023-10-16T12:58:55.688993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:48.087275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.678940+0000","last_change":"2023-10-16T12:58:51.449786+0000","last_active":"2023-10-16T12:58:55.678940+0000","last_peered":"2023-10-16T12:58:55.678940+0000","last_clean":"2023-10-16T12:58:55.678940+0000","last_became_active":"2023-10-16T12:58:51.449513+0000","last_became_peered":"2023-10-16T12:58:51.449513+0000","last_unstale":"2023-10-16T12:58:55.678940+0000","last_undegraded":"2023-10-16T12:58:55.678940+0000","last_fullsized":"2023-10-16T12:58:55.678940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:42:07.880003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.692580+0000","last_change":"2023-10-16T12:58:51.446178+0000","last_active":"2023-10-16T12:58:55.692580+0000","last_peered":"2023-10-16T12:58:55.692580+0000","last_clean":"2023-10-16T12:58:55.692580+0000","last_became_active":"2023-10-16T12:58:51.445995+0000","last_became_peered":"2023-10-16T12:58:51.445995+0000","last_unstale":"2023-10-16T12:58:55.692580+0000","last_undegraded":"2023-10-16T12:58:55.692580+0000","last_fullsized":"2023-10-16T12:58:55.692580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:40:36.060468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686445+0000","last_change":"2023-10-16T12:58:51.444064+0000","last_active":"2023-10-16T12:58:55.686445+0000","last_peered":"2023-10-16T12:58:55.686445+0000","last_clean":"2023-10-16T12:58:55.686445+0000","last_became_active":"2023-10-16T12:58:51.443873+0000","last_became_peered":"2023-10-16T12:58:51.443873+0000","last_unstale":"2023-10-16T12:58:55.686445+0000","last_undegraded":"2023-10-16T12:58:55.686445+0000","last_fullsized":"2023-10-16T12:58:55.686445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:48:37.180712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T12:59:09.844 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T12:59:09.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.994+0000 7fbe8e480700 1 Processor -- start 2023-10-16T12:59:09.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.994+0000 7fbe8e480700 1 -- start start 2023-10-16T12:59:10.004 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.995+0000 7fbe8e480700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe880b3410 0x7fbe880cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:10.004 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.995+0000 7fbe8e480700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fbe880cf4e0 0x7fbe8806bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:10.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.995+0000 7fbe8e480700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe88161180 con 0x7fbe8815b300 2023-10-16T12:59:10.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.995+0000 7fbe8e480700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe880cf990 con 0x7fbe880cf4e0 2023-10-16T12:59:10.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.995+0000 7fbe8e480700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe88161460 con 0x7fbe880b3410 2023-10-16T12:59:10.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.995+0000 7fbe8ca1d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fbe880cf4e0 0x7fbe8806bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:10.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.995+0000 7fbe87fff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fbe8815b300 0x7fbe880b2d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42196/0 (socket says 172.21.15.124:42196) 2023-10-16T12:59:10.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.995+0000 7fbe87fff700 1 -- 172.21.15.124:0/1694264159 learned_addr learned my addr 172.21.15.124:0/1694264159 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:10.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.995+0000 7fbe877fe700 1 --2- 172.21.15.124:0/1694264159 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe880b3410 0x7fbe880cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:10.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.995+0000 7fbe8ca1d700 1 -- 172.21.15.124:0/1694264159 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe880b3410 msgr2=0x7fbe880cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:10.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.995+0000 7fbe8ca1d700 1 --2- 172.21.15.124:0/1694264159 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe880b3410 0x7fbe880cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.995+0000 7fbe8ca1d700 1 -- 172.21.15.124:0/1694264159 >> v1:172.21.15.124:6789/0 conn(0x7fbe8815b300 legacy=0x7fbe880b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:10.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.995+0000 7fbe86ffd700 1 -- 172.21.15.124:0/1694264159 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2350001761 0 0) 0x7fbe88161180 con 0x7fbe8815b300 2023-10-16T12:59:10.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.995+0000 7fbe8ca1d700 1 -- 172.21.15.124:0/1694264159 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe88161740 con 0x7fbe880cf4e0 2023-10-16T12:59:10.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.995+0000 7fbe8ca1d700 1 --2- 172.21.15.124:0/1694264159 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbe880cf4e0 0x7fbe8806bbd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009d90 tx=0x7fbe8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60efd1e0bdef0bb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:10.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.995+0000 7fbe86ffd700 1 -- 172.21.15.124:0/1694264159 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8000e070 con 0x7fbe880cf4e0 2023-10-16T12:59:10.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.995+0000 7fbe86ffd700 1 -- 172.21.15.124:0/1694264159 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8000bbd0 con 0x7fbe880cf4e0 2023-10-16T12:59:10.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.995+0000 7fbe86ffd700 1 -- 172.21.15.124:0/1694264159 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe80012430 con 0x7fbe880cf4e0 2023-10-16T12:59:10.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.996+0000 7fbe8e480700 1 -- 172.21.15.124:0/1694264159 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbe880cf4e0 msgr2=0x7fbe8806bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:10.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.996+0000 7fbe8e480700 1 --2- 172.21.15.124:0/1694264159 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbe880cf4e0 0x7fbe8806bbd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009d90 tx=0x7fbe8000b330 comp rx=0 tx=0).stop 2023-10-16T12:59:10.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.996+0000 7fbe8e480700 1 -- 172.21.15.124:0/1694264159 shutdown_connections 2023-10-16T12:59:10.011 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.996+0000 7fbe8e480700 1 --2- 172.21.15.124:0/1694264159 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbe880cf4e0 0x7fbe8806bbd0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.011 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.996+0000 7fbe8e480700 1 --2- 172.21.15.124:0/1694264159 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe880b3410 0x7fbe880cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.011 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.996+0000 7fbe8e480700 1 -- 172.21.15.124:0/1694264159 >> 172.21.15.124:0/1694264159 conn(0x7fbe880cdd00 msgr2=0x7fbe880ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:10.012 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.996+0000 7fbe8e480700 1 -- 172.21.15.124:0/1694264159 shutdown_connections 2023-10-16T12:59:10.012 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.996+0000 7fbe8e480700 1 -- 172.21.15.124:0/1694264159 wait complete. 2023-10-16T12:59:10.012 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.997+0000 7fbe8e480700 1 Processor -- start 2023-10-16T12:59:10.012 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.997+0000 7fbe8e480700 1 -- start start 2023-10-16T12:59:10.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.998+0000 7fbe8e480700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe880b3410 0x7fbe880b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:10.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.998+0000 7fbe8e480700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbe880cf4e0 0x7fbe880c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:10.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.998+0000 7fbe8e480700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe8815b300 0x7fbe880c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:10.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.998+0000 7fbe8e480700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe880b5980 con 0x7fbe880cf4e0 2023-10-16T12:59:10.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.998+0000 7fbe8e480700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe880b5050 con 0x7fbe880b3410 2023-10-16T12:59:10.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.998+0000 7fbe8e480700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe880b5330 con 0x7fbe8815b300 2023-10-16T12:59:10.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.998+0000 7fbe877fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbe880cf4e0 0x7fbe880c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:10.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.998+0000 7fbe877fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbe880cf4e0 0x7fbe880c5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53536/0 (socket says 172.21.15.124:53536) 2023-10-16T12:59:10.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.998+0000 7fbe877fe700 1 -- 172.21.15.124:0/2600731714 learned_addr learned my addr 172.21.15.124:0/2600731714 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:10.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.998+0000 7fbe877fe700 1 -- 172.21.15.124:0/2600731714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe8815b300 msgr2=0x7fbe880c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:10.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.998+0000 7fbe877fe700 1 --2- 172.21.15.124:0/2600731714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe8815b300 0x7fbe880c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.998+0000 7fbe877fe700 1 -- 172.21.15.124:0/2600731714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe880b3410 msgr2=0x7fbe880b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:10.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.998+0000 7fbe877fe700 1 --2- 172.21.15.124:0/2600731714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe880b3410 0x7fbe880b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.998+0000 7fbe877fe700 1 -- 172.21.15.124:0/2600731714 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe80009a70 con 0x7fbe880cf4e0 2023-10-16T12:59:10.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.999+0000 7fbe877fe700 1 --2- 172.21.15.124:0/2600731714 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbe880cf4e0 0x7fbe880c5ae0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c00c7f0 tx=0x7fbe7c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:10.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.999+0000 7fbe84ff9700 1 -- 172.21.15.124:0/2600731714 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c011800 con 0x7fbe880cf4e0 2023-10-16T12:59:10.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.999+0000 7fbe84ff9700 1 -- 172.21.15.124:0/2600731714 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7c011960 con 0x7fbe880cf4e0 2023-10-16T12:59:10.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.999+0000 7fbe8e480700 1 -- 172.21.15.124:0/2600731714 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe880b5610 con 0x7fbe880cf4e0 2023-10-16T12:59:10.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.999+0000 7fbe84ff9700 1 -- 172.21.15.124:0/2600731714 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c011cf0 con 0x7fbe880cf4e0 2023-10-16T12:59:10.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:09.999+0000 7fbe8e480700 1 -- 172.21.15.124:0/2600731714 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe8815b950 con 0x7fbe880cf4e0 2023-10-16T12:59:10.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.000+0000 7fbe8e480700 1 -- 172.21.15.124:0/2600731714 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe8804ebb0 con 0x7fbe880cf4e0 2023-10-16T12:59:10.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.000+0000 7fbe84ff9700 1 -- 172.21.15.124:0/2600731714 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbe7c018360 con 0x7fbe880cf4e0 2023-10-16T12:59:10.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.001+0000 7fbe84ff9700 1 --2- 172.21.15.124:0/2600731714 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbe7406af30 0x7fbe7406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:10.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.001+0000 7fbe87fff700 1 --2- 172.21.15.124:0/2600731714 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbe7406af30 0x7fbe7406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:10.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.001+0000 7fbe84ff9700 1 -- 172.21.15.124:0/2600731714 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbe7c089890 con 0x7fbe880cf4e0 2023-10-16T12:59:10.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.001+0000 7fbe87fff700 1 --2- 172.21.15.124:0/2600731714 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbe7406af30 0x7fbe7406d3f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbe78001610 tx=0x7fbe780079f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:10.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.005+0000 7fbe84ff9700 1 -- 172.21.15.124:0/2600731714 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbe7c0545d0 con 0x7fbe880cf4e0 2023-10-16T12:59:10.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.191+0000 7fbe8e480700 1 -- 172.21.15.124:0/2600731714 --> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbe880b51c0 con 0x7fbe7406af30 2023-10-16T12:59:10.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.200+0000 7fbe84ff9700 1 -- 172.21.15.124:0/2600731714 <== mgr.4104 v2:172.21.15.124:6832/2391611330 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345300 (secure 0 0 0) 0x7fbe880b51c0 con 0x7fbe7406af30 2023-10-16T12:59:10.206 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:10.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.203+0000 7fbe8e480700 1 -- 172.21.15.124:0/2600731714 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbe7406af30 msgr2=0x7fbe7406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:10.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.203+0000 7fbe8e480700 1 --2- 172.21.15.124:0/2600731714 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbe7406af30 0x7fbe7406d3f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbe78001610 tx=0x7fbe780079f0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.203+0000 7fbe8e480700 1 -- 172.21.15.124:0/2600731714 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbe880cf4e0 msgr2=0x7fbe880c5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:10.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.203+0000 7fbe8e480700 1 --2- 172.21.15.124:0/2600731714 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbe880cf4e0 0x7fbe880c5ae0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c00c7f0 tx=0x7fbe7c00cbb0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.203+0000 7fbe8e480700 1 -- 172.21.15.124:0/2600731714 shutdown_connections 2023-10-16T12:59:10.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.203+0000 7fbe8e480700 1 --2- 172.21.15.124:0/2600731714 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbe7406af30 0x7fbe7406d3f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.203+0000 7fbe8e480700 1 --2- 172.21.15.124:0/2600731714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe8815b300 0x7fbe880c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.203+0000 7fbe8e480700 1 --2- 172.21.15.124:0/2600731714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe880b3410 0x7fbe880b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.203+0000 7fbe8e480700 1 --2- 172.21.15.124:0/2600731714 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbe880cf4e0 0x7fbe880c5ae0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.203+0000 7fbe8e480700 1 -- 172.21.15.124:0/2600731714 >> 172.21.15.124:0/2600731714 conn(0x7fbe880cdd00 msgr2=0x7fbe8815d050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:10.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.204+0000 7fbe8e480700 1 -- 172.21.15.124:0/2600731714 shutdown_connections 2023-10-16T12:59:10.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.204+0000 7fbe8e480700 1 -- 172.21.15.124:0/2600731714 wait complete. 2023-10-16T12:59:10.212 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-16T12:59:10.218 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-10-16T12:59:08.623917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219380,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755340,"statfs":{"total":773094113280,"available":772869468160,"internally_reserved":0,"allocated":3284992,"data_stored":1987974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002750"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705875+0000","last_change":"2023-10-16T12:58:51.447948+0000","last_active":"2023-10-16T12:58:55.705875+0000","last_peered":"2023-10-16T12:58:55.705875+0000","last_clean":"2023-10-16T12:58:55.705875+0000","last_became_active":"2023-10-16T12:58:51.447661+0000","last_became_peered":"2023-10-16T12:58:51.447661+0000","last_unstale":"2023-10-16T12:58:55.705875+0000","last_undegraded":"2023-10-16T12:58:55.705875+0000","last_fullsized":"2023-10-16T12:58:55.705875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:29:07.394120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679949+0000","last_change":"2023-10-16T12:58:51.439340+0000","last_active":"2023-10-16T12:58:55.679949+0000","last_peered":"2023-10-16T12:58:55.679949+0000","last_clean":"2023-10-16T12:58:55.679949+0000","last_became_active":"2023-10-16T12:58:51.439064+0000","last_became_peered":"2023-10-16T12:58:51.439064+0000","last_unstale":"2023-10-16T12:58:55.679949+0000","last_undegraded":"2023-10-16T12:58:55.679949+0000","last_fullsized":"2023-10-16T12:58:55.679949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:51.422601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.689332+0000","last_change":"2023-10-16T12:58:51.441634+0000","last_active":"2023-10-16T12:58:55.689332+0000","last_peered":"2023-10-16T12:58:55.689332+0000","last_clean":"2023-10-16T12:58:55.689332+0000","last_became_active":"2023-10-16T12:58:51.441380+0000","last_became_peered":"2023-10-16T12:58:51.441380+0000","last_unstale":"2023-10-16T12:58:55.689332+0000","last_undegraded":"2023-10-16T12:58:55.689332+0000","last_fullsized":"2023-10-16T12:58:55.689332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:28:04.262253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679334+0000","last_change":"2023-10-16T12:58:51.442103+0000","last_active":"2023-10-16T12:58:55.679334+0000","last_peered":"2023-10-16T12:58:55.679334+0000","last_clean":"2023-10-16T12:58:55.679334+0000","last_became_active":"2023-10-16T12:58:51.438544+0000","last_became_peered":"2023-10-16T12:58:51.438544+0000","last_unstale":"2023-10-16T12:58:55.679334+0000","last_undegraded":"2023-10-16T12:58:55.679334+0000","last_fullsized":"2023-10-16T12:58:55.679334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:29:07.394120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705435+0000","last_change":"2023-10-16T12:58:51.447862+0000","last_active":"2023-10-16T12:58:55.705435+0000","last_peered":"2023-10-16T12:58:55.705435+0000","last_clean":"2023-10-16T12:58:55.705435+0000","last_became_active":"2023-10-16T12:58:51.447596+0000","last_became_peered":"2023-10-16T12:58:51.447596+0000","last_unstale":"2023-10-16T12:58:55.705435+0000","last_undegraded":"2023-10-16T12:58:55.705435+0000","last_fullsized":"2023-10-16T12:58:55.705435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:42:07.880003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679036+0000","last_change":"2023-10-16T12:58:51.439890+0000","last_active":"2023-10-16T12:58:55.679036+0000","last_peered":"2023-10-16T12:58:55.679036+0000","last_clean":"2023-10-16T12:58:55.679036+0000","last_became_active":"2023-10-16T12:58:51.439624+0000","last_became_peered":"2023-10-16T12:58:51.439624+0000","last_unstale":"2023-10-16T12:58:55.679036+0000","last_undegraded":"2023-10-16T12:58:55.679036+0000","last_fullsized":"2023-10-16T12:58:55.679036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:17:35.655947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705720+0000","last_change":"2023-10-16T12:58:51.446245+0000","last_active":"2023-10-16T12:58:55.705720+0000","last_peered":"2023-10-16T12:58:55.705720+0000","last_clean":"2023-10-16T12:58:55.705720+0000","last_became_active":"2023-10-16T12:58:51.445888+0000","last_became_peered":"2023-10-16T12:58:51.445888+0000","last_unstale":"2023-10-16T12:58:55.705720+0000","last_undegraded":"2023-10-16T12:58:55.705720+0000","last_fullsized":"2023-10-16T12:58:55.705720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:51.422601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688745+0000","last_change":"2023-10-16T12:58:51.444473+0000","last_active":"2023-10-16T12:58:55.688745+0000","last_peered":"2023-10-16T12:58:55.688745+0000","last_clean":"2023-10-16T12:58:55.688745+0000","last_became_active":"2023-10-16T12:58:51.444135+0000","last_became_peered":"2023-10-16T12:58:51.444135+0000","last_unstale":"2023-10-16T12:58:55.688745+0000","last_undegraded":"2023-10-16T12:58:55.688745+0000","last_fullsized":"2023-10-16T12:58:55.688745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:35.585161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705821+0000","last_change":"2023-10-16T12:58:51.450649+0000","last_active":"2023-10-16T12:58:55.705821+0000","last_peered":"2023-10-16T12:58:55.705821+0000","last_clean":"2023-10-16T12:58:55.705821+0000","last_became_active":"2023-10-16T12:58:51.450086+0000","last_became_peered":"2023-10-16T12:58:51.450086+0000","last_unstale":"2023-10-16T12:58:55.705821+0000","last_undegraded":"2023-10-16T12:58:55.705821+0000","last_fullsized":"2023-10-16T12:58:55.705821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:46:33.298597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686340+0000","last_change":"2023-10-16T12:58:51.443152+0000","last_active":"2023-10-16T12:58:55.686340+0000","last_peered":"2023-10-16T12:58:55.686340+0000","last_clean":"2023-10-16T12:58:55.686340+0000","last_became_active":"2023-10-16T12:58:51.442907+0000","last_became_peered":"2023-10-16T12:58:51.442907+0000","last_unstale":"2023-10-16T12:58:55.686340+0000","last_undegraded":"2023-10-16T12:58:55.686340+0000","last_fullsized":"2023-10-16T12:58:55.686340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:17:35.655947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686659+0000","last_change":"2023-10-16T12:58:51.445780+0000","last_active":"2023-10-16T12:58:55.686659+0000","last_peered":"2023-10-16T12:58:55.686659+0000","last_clean":"2023-10-16T12:58:55.686659+0000","last_became_active":"2023-10-16T12:58:51.445488+0000","last_became_peered":"2023-10-16T12:58:51.445488+0000","last_unstale":"2023-10-16T12:58:55.686659+0000","last_undegraded":"2023-10-16T12:58:55.686659+0000","last_fullsized":"2023-10-16T12:58:55.686659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:17.757203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.681164+0000","last_change":"2023-10-16T12:58:51.443335+0000","last_active":"2023-10-16T12:58:55.681164+0000","last_peered":"2023-10-16T12:58:55.681164+0000","last_clean":"2023-10-16T12:58:55.681164+0000","last_became_active":"2023-10-16T12:58:51.443022+0000","last_became_peered":"2023-10-16T12:58:51.443022+0000","last_unstale":"2023-10-16T12:58:55.681164+0000","last_undegraded":"2023-10-16T12:58:55.681164+0000","last_fullsized":"2023-10-16T12:58:55.681164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:21.517544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.683113+0000","last_change":"2023-10-16T12:58:51.442753+0000","last_active":"2023-10-16T12:58:55.683113+0000","last_peered":"2023-10-16T12:58:55.683113+0000","last_clean":"2023-10-16T12:58:55.683113+0000","last_became_active":"2023-10-16T12:58:51.442501+0000","last_became_peered":"2023-10-16T12:58:51.442501+0000","last_unstale":"2023-10-16T12:58:55.683113+0000","last_undegraded":"2023-10-16T12:58:55.683113+0000","last_fullsized":"2023-10-16T12:58:55.683113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:17.757203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.690094+0000","last_change":"2023-10-16T12:58:51.439019+0000","last_active":"2023-10-16T12:58:55.690094+0000","last_peered":"2023-10-16T12:58:55.690094+0000","last_clean":"2023-10-16T12:58:55.690094+0000","last_became_active":"2023-10-16T12:58:51.438742+0000","last_became_peered":"2023-10-16T12:58:51.438742+0000","last_unstale":"2023-10-16T12:58:55.690094+0000","last_undegraded":"2023-10-16T12:58:55.690094+0000","last_fullsized":"2023-10-16T12:58:55.690094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:35.585161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.678142+0000","last_change":"2023-10-16T12:58:51.431552+0000","last_active":"2023-10-16T12:58:55.678142+0000","last_peered":"2023-10-16T12:58:55.678142+0000","last_clean":"2023-10-16T12:58:55.678142+0000","last_became_active":"2023-10-16T12:58:51.431302+0000","last_became_peered":"2023-10-16T12:58:51.431302+0000","last_unstale":"2023-10-16T12:58:55.678142+0000","last_undegraded":"2023-10-16T12:58:55.678142+0000","last_fullsized":"2023-10-16T12:58:55.678142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:40:36.060468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.680089+0000","last_change":"2023-10-16T12:58:51.442937+0000","last_active":"2023-10-16T12:58:55.680089+0000","last_peered":"2023-10-16T12:58:55.680089+0000","last_clean":"2023-10-16T12:58:55.680089+0000","last_became_active":"2023-10-16T12:58:51.442503+0000","last_became_peered":"2023-10-16T12:58:51.442503+0000","last_unstale":"2023-10-16T12:58:55.680089+0000","last_undegraded":"2023-10-16T12:58:55.680089+0000","last_fullsized":"2023-10-16T12:58:55.680089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:51.422601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.678499+0000","last_change":"2023-10-16T12:58:51.447014+0000","last_active":"2023-10-16T12:58:55.678499+0000","last_peered":"2023-10-16T12:58:55.678499+0000","last_clean":"2023-10-16T12:58:55.678499+0000","last_became_active":"2023-10-16T12:58:51.446752+0000","last_became_peered":"2023-10-16T12:58:51.446752+0000","last_unstale":"2023-10-16T12:58:55.678499+0000","last_undegraded":"2023-10-16T12:58:55.678499+0000","last_fullsized":"2023-10-16T12:58:55.678499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:42:26.907121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686121+0000","last_change":"2023-10-16T12:58:51.442299+0000","last_active":"2023-10-16T12:58:55.686121+0000","last_peered":"2023-10-16T12:58:55.686121+0000","last_clean":"2023-10-16T12:58:55.686121+0000","last_became_active":"2023-10-16T12:58:51.442028+0000","last_became_peered":"2023-10-16T12:58:51.442028+0000","last_unstale":"2023-10-16T12:58:55.686121+0000","last_undegraded":"2023-10-16T12:58:55.686121+0000","last_fullsized":"2023-10-16T12:58:55.686121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:26:09.658750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.706083+0000","last_change":"2023-10-16T12:58:51.446159+0000","last_active":"2023-10-16T12:58:55.706083+0000","last_peered":"2023-10-16T12:58:55.706083+0000","last_clean":"2023-10-16T12:58:55.706083+0000","last_became_active":"2023-10-16T12:58:51.445862+0000","last_became_peered":"2023-10-16T12:58:51.445862+0000","last_unstale":"2023-10-16T12:58:55.706083+0000","last_undegraded":"2023-10-16T12:58:55.706083+0000","last_fullsized":"2023-10-16T12:58:55.706083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:41:33.353000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.074473+0000","last_change":"2023-10-16T12:58:55.710385+0000","last_active":"2023-10-16T12:58:57.074473+0000","last_peered":"2023-10-16T12:58:57.074473+0000","last_clean":"2023-10-16T12:58:57.074473+0000","last_became_active":"2023-10-16T12:58:55.709936+0000","last_became_peered":"2023-10-16T12:58:55.709936+0000","last_unstale":"2023-10-16T12:58:57.074473+0000","last_undegraded":"2023-10-16T12:58:57.074473+0000","last_fullsized":"2023-10-16T12:58:57.074473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:10:14.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684401+0000","last_change":"2023-10-16T12:58:50.682380+0000","last_active":"2023-10-16T12:58:55.684401+0000","last_peered":"2023-10-16T12:58:55.684401+0000","last_clean":"2023-10-16T12:58:55.684401+0000","last_became_active":"2023-10-16T12:58:50.682119+0000","last_became_peered":"2023-10-16T12:58:50.682119+0000","last_unstale":"2023-10-16T12:58:55.684401+0000","last_undegraded":"2023-10-16T12:58:55.684401+0000","last_fullsized":"2023-10-16T12:58:55.684401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:43:43.356254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688115+0000","last_change":"2023-10-16T12:58:51.442218+0000","last_active":"2023-10-16T12:58:55.688115+0000","last_peered":"2023-10-16T12:58:55.688115+0000","last_clean":"2023-10-16T12:58:55.688115+0000","last_became_active":"2023-10-16T12:58:51.441929+0000","last_became_peered":"2023-10-16T12:58:51.441929+0000","last_unstale":"2023-10-16T12:58:55.688115+0000","last_undegraded":"2023-10-16T12:58:55.688115+0000","last_fullsized":"2023-10-16T12:58:55.688115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:31:13.605999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.425885+0000","last_change":"2023-10-16T12:58:55.694446+0000","last_active":"2023-10-16T12:58:56.425885+0000","last_peered":"2023-10-16T12:58:56.425885+0000","last_clean":"2023-10-16T12:58:56.425885+0000","last_became_active":"2023-10-16T12:58:55.694006+0000","last_became_peered":"2023-10-16T12:58:55.694006+0000","last_unstale":"2023-10-16T12:58:56.425885+0000","last_undegraded":"2023-10-16T12:58:56.425885+0000","last_fullsized":"2023-10-16T12:58:56.425885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:42:11.902399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688217+0000","last_change":"2023-10-16T12:58:50.672891+0000","last_active":"2023-10-16T12:58:55.688217+0000","last_peered":"2023-10-16T12:58:55.688217+0000","last_clean":"2023-10-16T12:58:55.688217+0000","last_became_active":"2023-10-16T12:58:50.672632+0000","last_became_peered":"2023-10-16T12:58:50.672632+0000","last_unstale":"2023-10-16T12:58:55.688217+0000","last_undegraded":"2023-10-16T12:58:55.688217+0000","last_fullsized":"2023-10-16T12:58:55.688217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:00:22.709075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684236+0000","last_change":"2023-10-16T12:58:51.444115+0000","last_active":"2023-10-16T12:58:55.684236+0000","last_peered":"2023-10-16T12:58:55.684236+0000","last_clean":"2023-10-16T12:58:55.684236+0000","last_became_active":"2023-10-16T12:58:51.443884+0000","last_became_peered":"2023-10-16T12:58:51.443884+0000","last_unstale":"2023-10-16T12:58:55.684236+0000","last_undegraded":"2023-10-16T12:58:55.684236+0000","last_fullsized":"2023-10-16T12:58:55.684236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:32.084288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426516+0000","last_change":"2023-10-16T12:58:55.697719+0000","last_active":"2023-10-16T12:58:56.426516+0000","last_peered":"2023-10-16T12:58:56.426516+0000","last_clean":"2023-10-16T12:58:56.426516+0000","last_became_active":"2023-10-16T12:58:55.697330+0000","last_became_peered":"2023-10-16T12:58:55.697330+0000","last_unstale":"2023-10-16T12:58:56.426516+0000","last_undegraded":"2023-10-16T12:58:56.426516+0000","last_fullsized":"2023-10-16T12:58:56.426516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:30:02.068649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705908+0000","last_change":"2023-10-16T12:58:50.678753+0000","last_active":"2023-10-16T12:58:55.705908+0000","last_peered":"2023-10-16T12:58:55.705908+0000","last_clean":"2023-10-16T12:58:55.705908+0000","last_became_active":"2023-10-16T12:58:50.674216+0000","last_became_peered":"2023-10-16T12:58:50.674216+0000","last_unstale":"2023-10-16T12:58:55.705908+0000","last_undegraded":"2023-10-16T12:58:55.705908+0000","last_fullsized":"2023-10-16T12:58:55.705908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:34.579436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679582+0000","last_change":"2023-10-16T12:58:51.442758+0000","last_active":"2023-10-16T12:58:55.679582+0000","last_peered":"2023-10-16T12:58:55.679582+0000","last_clean":"2023-10-16T12:58:55.679582+0000","last_became_active":"2023-10-16T12:58:51.442485+0000","last_became_peered":"2023-10-16T12:58:51.442485+0000","last_unstale":"2023-10-16T12:58:55.679582+0000","last_undegraded":"2023-10-16T12:58:55.679582+0000","last_fullsized":"2023-10-16T12:58:55.679582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:18:46.943690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426512+0000","last_change":"2023-10-16T12:58:55.699182+0000","last_active":"2023-10-16T12:58:56.426512+0000","last_peered":"2023-10-16T12:58:56.426512+0000","last_clean":"2023-10-16T12:58:56.426512+0000","last_became_active":"2023-10-16T12:58:55.698738+0000","last_became_peered":"2023-10-16T12:58:55.698738+0000","last_unstale":"2023-10-16T12:58:56.426512+0000","last_undegraded":"2023-10-16T12:58:56.426512+0000","last_fullsized":"2023-10-16T12:58:56.426512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:41:37.375395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705027+0000","last_change":"2023-10-16T12:58:50.680255+0000","last_active":"2023-10-16T12:58:55.705027+0000","last_peered":"2023-10-16T12:58:55.705027+0000","last_clean":"2023-10-16T12:58:55.705027+0000","last_became_active":"2023-10-16T12:58:50.679975+0000","last_became_peered":"2023-10-16T12:58:50.679975+0000","last_unstale":"2023-10-16T12:58:55.705027+0000","last_undegraded":"2023-10-16T12:58:55.705027+0000","last_fullsized":"2023-10-16T12:58:55.705027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:10.863857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.681187+0000","last_change":"2023-10-16T12:58:51.443585+0000","last_active":"2023-10-16T12:58:55.681187+0000","last_peered":"2023-10-16T12:58:55.681187+0000","last_clean":"2023-10-16T12:58:55.681187+0000","last_became_active":"2023-10-16T12:58:51.443200+0000","last_became_peered":"2023-10-16T12:58:51.443200+0000","last_unstale":"2023-10-16T12:58:55.681187+0000","last_undegraded":"2023-10-16T12:58:55.681187+0000","last_fullsized":"2023-10-16T12:58:55.681187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:46:33.298597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.074615+0000","last_change":"2023-10-16T12:58:55.696218+0000","last_active":"2023-10-16T12:58:57.074615+0000","last_peered":"2023-10-16T12:58:57.074615+0000","last_clean":"2023-10-16T12:58:57.074615+0000","last_became_active":"2023-10-16T12:58:55.695835+0000","last_became_peered":"2023-10-16T12:58:55.695835+0000","last_unstale":"2023-10-16T12:58:57.074615+0000","last_undegraded":"2023-10-16T12:58:57.074615+0000","last_fullsized":"2023-10-16T12:58:57.074615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:51:25.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.683294+0000","last_change":"2023-10-16T12:58:50.675887+0000","last_active":"2023-10-16T12:58:55.683294+0000","last_peered":"2023-10-16T12:58:55.683294+0000","last_clean":"2023-10-16T12:58:55.683294+0000","last_became_active":"2023-10-16T12:58:50.675649+0000","last_became_peered":"2023-10-16T12:58:50.675649+0000","last_unstale":"2023-10-16T12:58:55.683294+0000","last_undegraded":"2023-10-16T12:58:55.683294+0000","last_fullsized":"2023-10-16T12:58:55.683294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:31.078563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.681802+0000","last_change":"2023-10-16T12:58:51.435387+0000","last_active":"2023-10-16T12:58:55.681802+0000","last_peered":"2023-10-16T12:58:55.681802+0000","last_clean":"2023-10-16T12:58:55.681802+0000","last_became_active":"2023-10-16T12:58:51.435106+0000","last_became_peered":"2023-10-16T12:58:51.435106+0000","last_unstale":"2023-10-16T12:58:55.681802+0000","last_undegraded":"2023-10-16T12:58:55.681802+0000","last_fullsized":"2023-10-16T12:58:55.681802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:56.488214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.424372+0000","last_change":"2023-10-16T12:58:55.699076+0000","last_active":"2023-10-16T12:58:56.424372+0000","last_peered":"2023-10-16T12:58:56.424372+0000","last_clean":"2023-10-16T12:58:56.424372+0000","last_became_active":"2023-10-16T12:58:55.698670+0000","last_became_peered":"2023-10-16T12:58:55.698670+0000","last_unstale":"2023-10-16T12:58:56.424372+0000","last_undegraded":"2023-10-16T12:58:56.424372+0000","last_fullsized":"2023-10-16T12:58:56.424372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:51.536207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.687076+0000","last_change":"2023-10-16T12:58:50.670932+0000","last_active":"2023-10-16T12:58:55.687076+0000","last_peered":"2023-10-16T12:58:55.687076+0000","last_clean":"2023-10-16T12:58:55.687076+0000","last_became_active":"2023-10-16T12:58:50.670622+0000","last_became_peered":"2023-10-16T12:58:50.670622+0000","last_unstale":"2023-10-16T12:58:55.687076+0000","last_undegraded":"2023-10-16T12:58:55.687076+0000","last_fullsized":"2023-10-16T12:58:55.687076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:31.078563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.692398+0000","last_change":"2023-10-16T12:58:51.440771+0000","last_active":"2023-10-16T12:58:55.692398+0000","last_peered":"2023-10-16T12:58:55.692398+0000","last_clean":"2023-10-16T12:58:55.692398+0000","last_became_active":"2023-10-16T12:58:51.440502+0000","last_became_peered":"2023-10-16T12:58:51.440502+0000","last_unstale":"2023-10-16T12:58:55.692398+0000","last_undegraded":"2023-10-16T12:58:55.692398+0000","last_fullsized":"2023-10-16T12:58:55.692398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:51.422601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426179+0000","last_change":"2023-10-16T12:58:55.703710+0000","last_active":"2023-10-16T12:58:56.426179+0000","last_peered":"2023-10-16T12:58:56.426179+0000","last_clean":"2023-10-16T12:58:56.426179+0000","last_became_active":"2023-10-16T12:58:55.702784+0000","last_became_peered":"2023-10-16T12:58:55.702784+0000","last_unstale":"2023-10-16T12:58:56.426179+0000","last_undegraded":"2023-10-16T12:58:56.426179+0000","last_fullsized":"2023-10-16T12:58:56.426179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:19.721283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688901+0000","last_change":"2023-10-16T12:58:50.670749+0000","last_active":"2023-10-16T12:58:55.688901+0000","last_peered":"2023-10-16T12:58:55.688901+0000","last_clean":"2023-10-16T12:58:55.688901+0000","last_became_active":"2023-10-16T12:58:50.670491+0000","last_became_peered":"2023-10-16T12:58:50.670491+0000","last_unstale":"2023-10-16T12:58:55.688901+0000","last_undegraded":"2023-10-16T12:58:55.688901+0000","last_fullsized":"2023-10-16T12:58:55.688901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:10.863857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684097+0000","last_change":"2023-10-16T12:58:51.441981+0000","last_active":"2023-10-16T12:58:55.684097+0000","last_peered":"2023-10-16T12:58:55.684097+0000","last_clean":"2023-10-16T12:58:55.684097+0000","last_became_active":"2023-10-16T12:58:51.441704+0000","last_became_peered":"2023-10-16T12:58:51.441704+0000","last_unstale":"2023-10-16T12:58:55.684097+0000","last_undegraded":"2023-10-16T12:58:55.684097+0000","last_fullsized":"2023-10-16T12:58:55.684097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:51.422601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072432+0000","last_change":"2023-10-16T12:58:55.709709+0000","last_active":"2023-10-16T12:58:57.072432+0000","last_peered":"2023-10-16T12:58:57.072432+0000","last_clean":"2023-10-16T12:58:57.072432+0000","last_became_active":"2023-10-16T12:58:55.709039+0000","last_became_peered":"2023-10-16T12:58:55.709039+0000","last_unstale":"2023-10-16T12:58:57.072432+0000","last_undegraded":"2023-10-16T12:58:57.072432+0000","last_fullsized":"2023-10-16T12:58:57.072432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:29:11.416516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.680211+0000","last_change":"2023-10-16T12:58:50.678872+0000","last_active":"2023-10-16T12:58:55.680211+0000","last_peered":"2023-10-16T12:58:55.680211+0000","last_clean":"2023-10-16T12:58:55.680211+0000","last_became_active":"2023-10-16T12:58:50.678579+0000","last_became_peered":"2023-10-16T12:58:50.678579+0000","last_unstale":"2023-10-16T12:58:55.680211+0000","last_undegraded":"2023-10-16T12:58:55.680211+0000","last_fullsized":"2023-10-16T12:58:55.680211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:26:08.653026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.677699+0000","last_change":"2023-10-16T12:58:51.437769+0000","last_active":"2023-10-16T12:58:55.677699+0000","last_peered":"2023-10-16T12:58:55.677699+0000","last_clean":"2023-10-16T12:58:55.677699+0000","last_became_active":"2023-10-16T12:58:51.437507+0000","last_became_peered":"2023-10-16T12:58:51.437507+0000","last_unstale":"2023-10-16T12:58:55.677699+0000","last_undegraded":"2023-10-16T12:58:55.677699+0000","last_fullsized":"2023-10-16T12:58:55.677699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:59.501942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.074906+0000","last_change":"2023-10-16T12:58:55.708558+0000","last_active":"2023-10-16T12:58:57.074906+0000","last_peered":"2023-10-16T12:58:57.074906+0000","last_clean":"2023-10-16T12:58:57.074906+0000","last_became_active":"2023-10-16T12:58:55.708150+0000","last_became_peered":"2023-10-16T12:58:55.708150+0000","last_unstale":"2023-10-16T12:58:57.074906+0000","last_undegraded":"2023-10-16T12:58:57.074906+0000","last_fullsized":"2023-10-16T12:58:57.074906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:44:45.372869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686651+0000","last_change":"2023-10-16T12:58:50.670702+0000","last_active":"2023-10-16T12:58:55.686651+0000","last_peered":"2023-10-16T12:58:55.686651+0000","last_clean":"2023-10-16T12:58:55.686651+0000","last_became_active":"2023-10-16T12:58:50.670419+0000","last_became_peered":"2023-10-16T12:58:50.670419+0000","last_unstale":"2023-10-16T12:58:55.686651+0000","last_undegraded":"2023-10-16T12:58:55.686651+0000","last_fullsized":"2023-10-16T12:58:55.686651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:34.579436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.680401+0000","last_change":"2023-10-16T12:58:51.449669+0000","last_active":"2023-10-16T12:58:55.680401+0000","last_peered":"2023-10-16T12:58:55.680401+0000","last_clean":"2023-10-16T12:58:55.680401+0000","last_became_active":"2023-10-16T12:58:51.449350+0000","last_became_peered":"2023-10-16T12:58:51.449350+0000","last_unstale":"2023-10-16T12:58:55.680401+0000","last_undegraded":"2023-10-16T12:58:55.680401+0000","last_fullsized":"2023-10-16T12:58:55.680401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:33.724803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.075082+0000","last_change":"2023-10-16T12:58:55.702198+0000","last_active":"2023-10-16T12:58:57.075082+0000","last_peered":"2023-10-16T12:58:57.075082+0000","last_clean":"2023-10-16T12:58:57.075082+0000","last_became_active":"2023-10-16T12:58:55.701858+0000","last_became_peered":"2023-10-16T12:58:55.701858+0000","last_unstale":"2023-10-16T12:58:57.075082+0000","last_undegraded":"2023-10-16T12:58:57.075082+0000","last_fullsized":"2023-10-16T12:58:57.075082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:44:31.688200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.680381+0000","last_change":"2023-10-16T12:58:50.676760+0000","last_active":"2023-10-16T12:58:55.680381+0000","last_peered":"2023-10-16T12:58:55.680381+0000","last_clean":"2023-10-16T12:58:55.680381+0000","last_became_active":"2023-10-16T12:58:50.676461+0000","last_became_peered":"2023-10-16T12:58:50.676461+0000","last_unstale":"2023-10-16T12:58:55.680381+0000","last_undegraded":"2023-10-16T12:58:55.680381+0000","last_fullsized":"2023-10-16T12:58:55.680381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:43:43.356254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684505+0000","last_change":"2023-10-16T12:58:51.444087+0000","last_active":"2023-10-16T12:58:55.684505+0000","last_peered":"2023-10-16T12:58:55.684505+0000","last_clean":"2023-10-16T12:58:55.684505+0000","last_became_active":"2023-10-16T12:58:51.443844+0000","last_became_peered":"2023-10-16T12:58:51.443844+0000","last_unstale":"2023-10-16T12:58:55.684505+0000","last_undegraded":"2023-10-16T12:58:55.684505+0000","last_fullsized":"2023-10-16T12:58:55.684505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:48:37.180712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426810+0000","last_change":"2023-10-16T12:58:55.688731+0000","last_active":"2023-10-16T12:58:56.426810+0000","last_peered":"2023-10-16T12:58:56.426810+0000","last_clean":"2023-10-16T12:58:56.426810+0000","last_became_active":"2023-10-16T12:58:55.688216+0000","last_became_peered":"2023-10-16T12:58:55.688216+0000","last_unstale":"2023-10-16T12:58:56.426810+0000","last_undegraded":"2023-10-16T12:58:56.426810+0000","last_fullsized":"2023-10-16T12:58:56.426810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:19.721283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679599+0000","last_change":"2023-10-16T12:58:50.679739+0000","last_active":"2023-10-16T12:58:55.679599+0000","last_peered":"2023-10-16T12:58:55.679599+0000","last_clean":"2023-10-16T12:58:55.679599+0000","last_became_active":"2023-10-16T12:58:50.679385+0000","last_became_peered":"2023-10-16T12:58:50.679385+0000","last_unstale":"2023-10-16T12:58:55.679599+0000","last_undegraded":"2023-10-16T12:58:55.679599+0000","last_fullsized":"2023-10-16T12:58:55.679599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:31.078563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.681075+0000","last_change":"2023-10-16T12:58:51.449711+0000","last_active":"2023-10-16T12:58:55.681075+0000","last_peered":"2023-10-16T12:58:55.681075+0000","last_clean":"2023-10-16T12:58:55.681075+0000","last_became_active":"2023-10-16T12:58:51.449453+0000","last_became_peered":"2023-10-16T12:58:51.449453+0000","last_unstale":"2023-10-16T12:58:55.681075+0000","last_undegraded":"2023-10-16T12:58:55.681075+0000","last_fullsized":"2023-10-16T12:58:55.681075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:11.869582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.073118+0000","last_change":"2023-10-16T12:58:55.696432+0000","last_active":"2023-10-16T12:58:57.073118+0000","last_peered":"2023-10-16T12:58:57.073118+0000","last_clean":"2023-10-16T12:58:57.073118+0000","last_became_active":"2023-10-16T12:58:55.696015+0000","last_became_peered":"2023-10-16T12:58:55.696015+0000","last_unstale":"2023-10-16T12:58:57.073118+0000","last_undegraded":"2023-10-16T12:58:57.073118+0000","last_fullsized":"2023-10-16T12:58:57.073118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:46:37.320993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:59:00.961243+0000","last_change":"2023-10-16T12:58:50.672122+0000","last_active":"2023-10-16T12:59:00.961243+0000","last_peered":"2023-10-16T12:59:00.961243+0000","last_clean":"2023-10-16T12:59:00.961243+0000","last_became_active":"2023-10-16T12:58:50.671817+0000","last_became_peered":"2023-10-16T12:58:50.671817+0000","last_unstale":"2023-10-16T12:59:00.961243+0000","last_undegraded":"2023-10-16T12:59:00.961243+0000","last_fullsized":"2023-10-16T12:59:00.961243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:46.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705985+0000","last_change":"2023-10-16T12:58:51.446766+0000","last_active":"2023-10-16T12:58:55.705985+0000","last_peered":"2023-10-16T12:58:55.705985+0000","last_clean":"2023-10-16T12:58:55.705985+0000","last_became_active":"2023-10-16T12:58:51.446573+0000","last_became_peered":"2023-10-16T12:58:51.446573+0000","last_unstale":"2023-10-16T12:58:55.705985+0000","last_undegraded":"2023-10-16T12:58:55.705985+0000","last_fullsized":"2023-10-16T12:58:55.705985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:18:46.943690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072803+0000","last_change":"2023-10-16T12:58:55.708591+0000","last_active":"2023-10-16T12:58:57.072803+0000","last_peered":"2023-10-16T12:58:57.072803+0000","last_clean":"2023-10-16T12:58:57.072803+0000","last_became_active":"2023-10-16T12:58:55.708210+0000","last_became_peered":"2023-10-16T12:58:55.708210+0000","last_unstale":"2023-10-16T12:58:57.072803+0000","last_undegraded":"2023-10-16T12:58:57.072803+0000","last_fullsized":"2023-10-16T12:58:57.072803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:51:25.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.692682+0000","last_change":"2023-10-16T12:58:50.671656+0000","last_active":"2023-10-16T12:58:55.692682+0000","last_peered":"2023-10-16T12:58:55.692682+0000","last_clean":"2023-10-16T12:58:55.692682+0000","last_became_active":"2023-10-16T12:58:50.671397+0000","last_became_peered":"2023-10-16T12:58:50.671397+0000","last_unstale":"2023-10-16T12:58:55.692682+0000","last_undegraded":"2023-10-16T12:58:55.692682+0000","last_fullsized":"2023-10-16T12:58:55.692682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:00:22.709075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.690350+0000","last_change":"2023-10-16T12:58:51.446368+0000","last_active":"2023-10-16T12:58:55.690350+0000","last_peered":"2023-10-16T12:58:55.690350+0000","last_clean":"2023-10-16T12:58:55.690350+0000","last_became_active":"2023-10-16T12:58:51.446071+0000","last_became_peered":"2023-10-16T12:58:51.446071+0000","last_unstale":"2023-10-16T12:58:55.690350+0000","last_undegraded":"2023-10-16T12:58:55.690350+0000","last_fullsized":"2023-10-16T12:58:55.690350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:48.087275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.074774+0000","last_change":"2023-10-16T12:58:55.705522+0000","last_active":"2023-10-16T12:58:57.074774+0000","last_peered":"2023-10-16T12:58:57.074774+0000","last_clean":"2023-10-16T12:58:57.074774+0000","last_became_active":"2023-10-16T12:58:55.705089+0000","last_became_peered":"2023-10-16T12:58:55.705089+0000","last_unstale":"2023-10-16T12:58:57.074774+0000","last_undegraded":"2023-10-16T12:58:57.074774+0000","last_fullsized":"2023-10-16T12:58:57.074774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:04:01.613449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.678720+0000","last_change":"2023-10-16T12:58:50.673340+0000","last_active":"2023-10-16T12:58:55.678720+0000","last_peered":"2023-10-16T12:58:55.678720+0000","last_clean":"2023-10-16T12:58:55.678720+0000","last_became_active":"2023-10-16T12:58:50.672323+0000","last_became_peered":"2023-10-16T12:58:50.672323+0000","last_unstale":"2023-10-16T12:58:55.678720+0000","last_undegraded":"2023-10-16T12:58:55.678720+0000","last_fullsized":"2023-10-16T12:58:55.678720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:31.078563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705522+0000","last_change":"2023-10-16T12:58:51.448920+0000","last_active":"2023-10-16T12:58:55.705522+0000","last_peered":"2023-10-16T12:58:55.705522+0000","last_clean":"2023-10-16T12:58:55.705522+0000","last_became_active":"2023-10-16T12:58:51.448634+0000","last_became_peered":"2023-10-16T12:58:51.448634+0000","last_unstale":"2023-10-16T12:58:55.705522+0000","last_undegraded":"2023-10-16T12:58:55.705522+0000","last_fullsized":"2023-10-16T12:58:55.705522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:31:13.605999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.075154+0000","last_change":"2023-10-16T12:58:55.713528+0000","last_active":"2023-10-16T12:58:57.075154+0000","last_peered":"2023-10-16T12:58:57.075154+0000","last_clean":"2023-10-16T12:58:57.075154+0000","last_became_active":"2023-10-16T12:58:55.712996+0000","last_became_peered":"2023-10-16T12:58:55.712996+0000","last_unstale":"2023-10-16T12:58:57.075154+0000","last_undegraded":"2023-10-16T12:58:57.075154+0000","last_fullsized":"2023-10-16T12:58:57.075154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:20.622883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686054+0000","last_change":"2023-10-16T12:58:50.667418+0000","last_active":"2023-10-16T12:58:55.686054+0000","last_peered":"2023-10-16T12:58:55.686054+0000","last_clean":"2023-10-16T12:58:55.686054+0000","last_became_active":"2023-10-16T12:58:50.667102+0000","last_became_peered":"2023-10-16T12:58:50.667102+0000","last_unstale":"2023-10-16T12:58:55.686054+0000","last_undegraded":"2023-10-16T12:58:55.686054+0000","last_fullsized":"2023-10-16T12:58:55.686054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:10.863857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.685920+0000","last_change":"2023-10-16T12:58:51.441514+0000","last_active":"2023-10-16T12:58:55.685920+0000","last_peered":"2023-10-16T12:58:55.685920+0000","last_clean":"2023-10-16T12:58:55.685920+0000","last_became_active":"2023-10-16T12:58:51.441211+0000","last_became_peered":"2023-10-16T12:58:51.441211+0000","last_unstale":"2023-10-16T12:58:55.685920+0000","last_undegraded":"2023-10-16T12:58:55.685920+0000","last_fullsized":"2023-10-16T12:58:55.685920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:28:04.262253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072161+0000","last_change":"2023-10-16T12:58:55.698601+0000","last_active":"2023-10-16T12:58:57.072161+0000","last_peered":"2023-10-16T12:58:57.072161+0000","last_clean":"2023-10-16T12:58:57.072161+0000","last_became_active":"2023-10-16T12:58:55.697802+0000","last_became_peered":"2023-10-16T12:58:55.697802+0000","last_unstale":"2023-10-16T12:58:57.072161+0000","last_undegraded":"2023-10-16T12:58:57.072161+0000","last_fullsized":"2023-10-16T12:58:57.072161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:19.721283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684515+0000","last_change":"2023-10-16T12:58:50.679915+0000","last_active":"2023-10-16T12:58:55.684515+0000","last_peered":"2023-10-16T12:58:55.684515+0000","last_clean":"2023-10-16T12:58:55.684515+0000","last_became_active":"2023-10-16T12:58:50.679550+0000","last_became_peered":"2023-10-16T12:58:50.679550+0000","last_unstale":"2023-10-16T12:58:55.684515+0000","last_undegraded":"2023-10-16T12:58:55.684515+0000","last_fullsized":"2023-10-16T12:58:55.684515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:33.218756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705896+0000","last_change":"2023-10-16T12:58:51.450989+0000","last_active":"2023-10-16T12:58:55.705896+0000","last_peered":"2023-10-16T12:58:55.705896+0000","last_clean":"2023-10-16T12:58:55.705896+0000","last_became_active":"2023-10-16T12:58:51.450681+0000","last_became_peered":"2023-10-16T12:58:51.450681+0000","last_unstale":"2023-10-16T12:58:55.705896+0000","last_undegraded":"2023-10-16T12:58:55.705896+0000","last_fullsized":"2023-10-16T12:58:55.705896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:17:35.655947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.425612+0000","last_change":"2023-10-16T12:58:55.694540+0000","last_active":"2023-10-16T12:58:56.425612+0000","last_peered":"2023-10-16T12:58:56.425612+0000","last_clean":"2023-10-16T12:58:56.425612+0000","last_became_active":"2023-10-16T12:58:55.694116+0000","last_became_peered":"2023-10-16T12:58:55.694116+0000","last_unstale":"2023-10-16T12:58:56.425612+0000","last_undegraded":"2023-10-16T12:58:56.425612+0000","last_fullsized":"2023-10-16T12:58:56.425612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:21.779599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.681959+0000","last_change":"2023-10-16T12:58:50.673412+0000","last_active":"2023-10-16T12:58:55.681959+0000","last_peered":"2023-10-16T12:58:55.681959+0000","last_clean":"2023-10-16T12:58:55.681959+0000","last_became_active":"2023-10-16T12:58:50.672849+0000","last_became_peered":"2023-10-16T12:58:50.672849+0000","last_unstale":"2023-10-16T12:58:55.681959+0000","last_undegraded":"2023-10-16T12:58:55.681959+0000","last_fullsized":"2023-10-16T12:58:55.681959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:35:18.620321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705273+0000","last_change":"2023-10-16T12:58:51.449246+0000","last_active":"2023-10-16T12:58:55.705273+0000","last_peered":"2023-10-16T12:58:55.705273+0000","last_clean":"2023-10-16T12:58:55.705273+0000","last_became_active":"2023-10-16T12:58:51.448956+0000","last_became_peered":"2023-10-16T12:58:51.448956+0000","last_unstale":"2023-10-16T12:58:55.705273+0000","last_undegraded":"2023-10-16T12:58:55.705273+0000","last_fullsized":"2023-10-16T12:58:55.705273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:29:58.046253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072974+0000","last_change":"2023-10-16T12:58:55.698954+0000","last_active":"2023-10-16T12:58:57.072974+0000","last_peered":"2023-10-16T12:58:57.072974+0000","last_clean":"2023-10-16T12:58:57.072974+0000","last_became_active":"2023-10-16T12:58:55.698587+0000","last_became_peered":"2023-10-16T12:58:55.698587+0000","last_unstale":"2023-10-16T12:58:57.072974+0000","last_undegraded":"2023-10-16T12:58:57.072974+0000","last_fullsized":"2023-10-16T12:58:57.072974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:37.747199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679241+0000","last_change":"2023-10-16T12:58:50.673554+0000","last_active":"2023-10-16T12:58:55.679241+0000","last_peered":"2023-10-16T12:58:55.679241+0000","last_clean":"2023-10-16T12:58:55.679241+0000","last_became_active":"2023-10-16T12:58:50.673154+0000","last_became_peered":"2023-10-16T12:58:50.673154+0000","last_unstale":"2023-10-16T12:58:55.679241+0000","last_undegraded":"2023-10-16T12:58:55.679241+0000","last_fullsized":"2023-10-16T12:58:55.679241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:34.579436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.681355+0000","last_change":"2023-10-16T12:58:51.439381+0000","last_active":"2023-10-16T12:58:55.681355+0000","last_peered":"2023-10-16T12:58:55.681355+0000","last_clean":"2023-10-16T12:58:55.681355+0000","last_became_active":"2023-10-16T12:58:51.439106+0000","last_became_peered":"2023-10-16T12:58:51.439106+0000","last_unstale":"2023-10-16T12:58:55.681355+0000","last_undegraded":"2023-10-16T12:58:55.681355+0000","last_fullsized":"2023-10-16T12:58:55.681355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:15.698887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072598+0000","last_change":"2023-10-16T12:58:55.703026+0000","last_active":"2023-10-16T12:58:57.072598+0000","last_peered":"2023-10-16T12:58:57.072598+0000","last_clean":"2023-10-16T12:58:57.072598+0000","last_became_active":"2023-10-16T12:58:55.702114+0000","last_became_peered":"2023-10-16T12:58:55.702114+0000","last_unstale":"2023-10-16T12:58:57.072598+0000","last_undegraded":"2023-10-16T12:58:57.072598+0000","last_fullsized":"2023-10-16T12:58:57.072598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:19.721283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.678615+0000","last_change":"2023-10-16T12:58:50.674212+0000","last_active":"2023-10-16T12:58:55.678615+0000","last_peered":"2023-10-16T12:58:55.678615+0000","last_clean":"2023-10-16T12:58:55.678615+0000","last_became_active":"2023-10-16T12:58:50.673650+0000","last_became_peered":"2023-10-16T12:58:50.673650+0000","last_unstale":"2023-10-16T12:58:55.678615+0000","last_undegraded":"2023-10-16T12:58:55.678615+0000","last_fullsized":"2023-10-16T12:58:55.678615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:46.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.683223+0000","last_change":"2023-10-16T12:58:51.438475+0000","last_active":"2023-10-16T12:58:55.683223+0000","last_peered":"2023-10-16T12:58:55.683223+0000","last_clean":"2023-10-16T12:58:55.683223+0000","last_became_active":"2023-10-16T12:58:51.438151+0000","last_became_peered":"2023-10-16T12:58:51.438151+0000","last_unstale":"2023-10-16T12:58:55.683223+0000","last_undegraded":"2023-10-16T12:58:55.683223+0000","last_fullsized":"2023-10-16T12:58:55.683223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:22:35.314558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.073288+0000","last_change":"2023-10-16T12:58:55.699995+0000","last_active":"2023-10-16T12:58:57.073288+0000","last_peered":"2023-10-16T12:58:57.073288+0000","last_clean":"2023-10-16T12:58:57.073288+0000","last_became_active":"2023-10-16T12:58:55.699645+0000","last_became_peered":"2023-10-16T12:58:55.699645+0000","last_unstale":"2023-10-16T12:58:57.073288+0000","last_undegraded":"2023-10-16T12:58:57.073288+0000","last_fullsized":"2023-10-16T12:58:57.073288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:29:11.416516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.677592+0000","last_change":"2023-10-16T12:58:51.438846+0000","last_active":"2023-10-16T12:58:55.677592+0000","last_peered":"2023-10-16T12:58:55.677592+0000","last_clean":"2023-10-16T12:58:55.677592+0000","last_became_active":"2023-10-16T12:58:51.438601+0000","last_became_peered":"2023-10-16T12:58:51.438601+0000","last_unstale":"2023-10-16T12:58:55.677592+0000","last_undegraded":"2023-10-16T12:58:55.677592+0000","last_fullsized":"2023-10-16T12:58:55.677592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:48:37.180712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684696+0000","last_change":"2023-10-16T12:58:50.685058+0000","last_active":"2023-10-16T12:58:55.684696+0000","last_peered":"2023-10-16T12:58:55.684696+0000","last_clean":"2023-10-16T12:58:55.684696+0000","last_became_active":"2023-10-16T12:58:50.684800+0000","last_became_peered":"2023-10-16T12:58:50.684800+0000","last_unstale":"2023-10-16T12:58:55.684696+0000","last_undegraded":"2023-10-16T12:58:55.684696+0000","last_fullsized":"2023-10-16T12:58:55.684696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:22:34.308834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426188+0000","last_change":"2023-10-16T12:58:55.705646+0000","last_active":"2023-10-16T12:58:56.426188+0000","last_peered":"2023-10-16T12:58:56.426188+0000","last_clean":"2023-10-16T12:58:56.426188+0000","last_became_active":"2023-10-16T12:58:55.705247+0000","last_became_peered":"2023-10-16T12:58:55.705247+0000","last_unstale":"2023-10-16T12:58:56.426188+0000","last_undegraded":"2023-10-16T12:58:56.426188+0000","last_fullsized":"2023-10-16T12:58:56.426188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:37.747199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.685428+0000","last_change":"2023-10-16T12:58:51.436519+0000","last_active":"2023-10-16T12:58:55.685428+0000","last_peered":"2023-10-16T12:58:55.685428+0000","last_clean":"2023-10-16T12:58:55.685428+0000","last_became_active":"2023-10-16T12:58:51.436320+0000","last_became_peered":"2023-10-16T12:58:51.436320+0000","last_unstale":"2023-10-16T12:58:55.685428+0000","last_undegraded":"2023-10-16T12:58:55.685428+0000","last_fullsized":"2023-10-16T12:58:55.685428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:48:37.180712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679659+0000","last_change":"2023-10-16T12:58:50.682408+0000","last_active":"2023-10-16T12:58:55.679659+0000","last_peered":"2023-10-16T12:58:55.679659+0000","last_clean":"2023-10-16T12:58:55.679659+0000","last_became_active":"2023-10-16T12:58:50.682084+0000","last_became_peered":"2023-10-16T12:58:50.682084+0000","last_unstale":"2023-10-16T12:58:55.679659+0000","last_undegraded":"2023-10-16T12:58:55.679659+0000","last_fullsized":"2023-10-16T12:58:55.679659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:20.511820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.704719+0000","last_change":"2023-10-16T12:58:40.198340+0000","last_active":"2023-10-16T12:58:55.704719+0000","last_peered":"2023-10-16T12:58:55.704719+0000","last_clean":"2023-10-16T12:58:55.704719+0000","last_became_active":"2023-10-16T12:58:40.197354+0000","last_became_peered":"2023-10-16T12:58:40.197354+0000","last_unstale":"2023-10-16T12:58:55.704719+0000","last_undegraded":"2023-10-16T12:58:55.704719+0000","last_fullsized":"2023-10-16T12:58:55.704719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:39.025347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:39.025347+0000","last_clean_scrub_stamp":"2023-10-16T12:58:39.025347+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:22:36.722419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072318+0000","last_change":"2023-10-16T12:58:55.709450+0000","last_active":"2023-10-16T12:58:57.072318+0000","last_peered":"2023-10-16T12:58:57.072318+0000","last_clean":"2023-10-16T12:58:57.072318+0000","last_became_active":"2023-10-16T12:58:55.708457+0000","last_became_peered":"2023-10-16T12:58:55.708457+0000","last_unstale":"2023-10-16T12:58:57.072318+0000","last_undegraded":"2023-10-16T12:58:57.072318+0000","last_fullsized":"2023-10-16T12:58:57.072318+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:46:37.320993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684401+0000","last_change":"2023-10-16T12:58:51.440843+0000","last_active":"2023-10-16T12:58:55.684401+0000","last_peered":"2023-10-16T12:58:55.684401+0000","last_clean":"2023-10-16T12:58:55.684401+0000","last_became_active":"2023-10-16T12:58:51.440584+0000","last_became_peered":"2023-10-16T12:58:51.440584+0000","last_unstale":"2023-10-16T12:58:55.684401+0000","last_undegraded":"2023-10-16T12:58:55.684401+0000","last_fullsized":"2023-10-16T12:58:55.684401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:47.513811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.704824+0000","last_change":"2023-10-16T12:58:50.672662+0000","last_active":"2023-10-16T12:58:55.704824+0000","last_peered":"2023-10-16T12:58:55.704824+0000","last_clean":"2023-10-16T12:58:55.704824+0000","last_became_active":"2023-10-16T12:58:50.672268+0000","last_became_peered":"2023-10-16T12:58:50.672268+0000","last_unstale":"2023-10-16T12:58:55.704824+0000","last_undegraded":"2023-10-16T12:58:55.704824+0000","last_fullsized":"2023-10-16T12:58:55.704824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:22:34.308834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072561+0000","last_change":"2023-10-16T12:58:55.708627+0000","last_active":"2023-10-16T12:58:57.072561+0000","last_peered":"2023-10-16T12:58:57.072561+0000","last_clean":"2023-10-16T12:58:57.072561+0000","last_became_active":"2023-10-16T12:58:55.708171+0000","last_became_peered":"2023-10-16T12:58:55.708171+0000","last_unstale":"2023-10-16T12:58:57.072561+0000","last_undegraded":"2023-10-16T12:58:57.072561+0000","last_fullsized":"2023-10-16T12:58:57.072561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:42:30.929517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705826+0000","last_change":"2023-10-16T12:58:50.678911+0000","last_active":"2023-10-16T12:58:55.705826+0000","last_peered":"2023-10-16T12:58:55.705826+0000","last_clean":"2023-10-16T12:58:55.705826+0000","last_became_active":"2023-10-16T12:58:50.678642+0000","last_became_peered":"2023-10-16T12:58:50.678642+0000","last_unstale":"2023-10-16T12:58:55.705826+0000","last_undegraded":"2023-10-16T12:58:55.705826+0000","last_fullsized":"2023-10-16T12:58:55.705826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:46.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.680176+0000","last_change":"2023-10-16T12:58:51.439513+0000","last_active":"2023-10-16T12:58:55.680176+0000","last_peered":"2023-10-16T12:58:55.680176+0000","last_clean":"2023-10-16T12:58:55.680176+0000","last_became_active":"2023-10-16T12:58:51.439294+0000","last_became_peered":"2023-10-16T12:58:51.439294+0000","last_unstale":"2023-10-16T12:58:55.680176+0000","last_undegraded":"2023-10-16T12:58:55.680176+0000","last_fullsized":"2023-10-16T12:58:55.680176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:17.757203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.074246+0000","last_change":"2023-10-16T12:58:55.709315+0000","last_active":"2023-10-16T12:58:57.074246+0000","last_peered":"2023-10-16T12:58:57.074246+0000","last_clean":"2023-10-16T12:58:57.074246+0000","last_became_active":"2023-10-16T12:58:55.708910+0000","last_became_peered":"2023-10-16T12:58:55.708910+0000","last_unstale":"2023-10-16T12:58:57.074246+0000","last_undegraded":"2023-10-16T12:58:57.074246+0000","last_fullsized":"2023-10-16T12:58:57.074246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:05:40.393225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679472+0000","last_change":"2023-10-16T12:58:50.673963+0000","last_active":"2023-10-16T12:58:55.679472+0000","last_peered":"2023-10-16T12:58:55.679472+0000","last_clean":"2023-10-16T12:58:55.679472+0000","last_became_active":"2023-10-16T12:58:50.673711+0000","last_became_peered":"2023-10-16T12:58:50.673711+0000","last_unstale":"2023-10-16T12:58:55.679472+0000","last_undegraded":"2023-10-16T12:58:55.679472+0000","last_fullsized":"2023-10-16T12:58:55.679472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:20.511820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688867+0000","last_change":"2023-10-16T12:58:51.446153+0000","last_active":"2023-10-16T12:58:55.688867+0000","last_peered":"2023-10-16T12:58:55.688867+0000","last_clean":"2023-10-16T12:58:55.688867+0000","last_became_active":"2023-10-16T12:58:51.445929+0000","last_became_peered":"2023-10-16T12:58:51.445929+0000","last_unstale":"2023-10-16T12:58:55.688867+0000","last_undegraded":"2023-10-16T12:58:55.688867+0000","last_fullsized":"2023-10-16T12:58:55.688867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:42:07.880003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.425788+0000","last_change":"2023-10-16T12:58:55.708698+0000","last_active":"2023-10-16T12:58:56.425788+0000","last_peered":"2023-10-16T12:58:56.425788+0000","last_clean":"2023-10-16T12:58:56.425788+0000","last_became_active":"2023-10-16T12:58:55.708320+0000","last_became_peered":"2023-10-16T12:58:55.708320+0000","last_unstale":"2023-10-16T12:58:56.425788+0000","last_undegraded":"2023-10-16T12:58:56.425788+0000","last_fullsized":"2023-10-16T12:58:56.425788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:55.444997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686576+0000","last_change":"2023-10-16T12:58:50.673507+0000","last_active":"2023-10-16T12:58:55.686576+0000","last_peered":"2023-10-16T12:58:55.686576+0000","last_clean":"2023-10-16T12:58:55.686576+0000","last_became_active":"2023-10-16T12:58:50.672980+0000","last_became_peered":"2023-10-16T12:58:50.672980+0000","last_unstale":"2023-10-16T12:58:55.686576+0000","last_undegraded":"2023-10-16T12:58:55.686576+0000","last_fullsized":"2023-10-16T12:58:55.686576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:33.218756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.692578+0000","last_change":"2023-10-16T12:58:51.439054+0000","last_active":"2023-10-16T12:58:55.692578+0000","last_peered":"2023-10-16T12:58:55.692578+0000","last_clean":"2023-10-16T12:58:55.692578+0000","last_became_active":"2023-10-16T12:58:51.438776+0000","last_became_peered":"2023-10-16T12:58:51.438776+0000","last_unstale":"2023-10-16T12:58:55.692578+0000","last_undegraded":"2023-10-16T12:58:55.692578+0000","last_fullsized":"2023-10-16T12:58:55.692578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:17.757203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.425860+0000","last_change":"2023-10-16T12:58:55.694414+0000","last_active":"2023-10-16T12:58:56.425860+0000","last_peered":"2023-10-16T12:58:56.425860+0000","last_clean":"2023-10-16T12:58:56.425860+0000","last_became_active":"2023-10-16T12:58:55.694003+0000","last_became_peered":"2023-10-16T12:58:55.694003+0000","last_unstale":"2023-10-16T12:58:56.425860+0000","last_undegraded":"2023-10-16T12:58:56.425860+0000","last_fullsized":"2023-10-16T12:58:56.425860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:17:39.678343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.704716+0000","last_change":"2023-10-16T12:58:50.678331+0000","last_active":"2023-10-16T12:58:55.704716+0000","last_peered":"2023-10-16T12:58:55.704716+0000","last_clean":"2023-10-16T12:58:55.704716+0000","last_became_active":"2023-10-16T12:58:50.674513+0000","last_became_peered":"2023-10-16T12:58:50.674513+0000","last_unstale":"2023-10-16T12:58:55.704716+0000","last_undegraded":"2023-10-16T12:58:55.704716+0000","last_fullsized":"2023-10-16T12:58:55.704716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:33.218756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.682143+0000","last_change":"2023-10-16T12:58:51.438953+0000","last_active":"2023-10-16T12:58:55.682143+0000","last_peered":"2023-10-16T12:58:55.682143+0000","last_clean":"2023-10-16T12:58:55.682143+0000","last_became_active":"2023-10-16T12:58:51.438670+0000","last_became_peered":"2023-10-16T12:58:51.438670+0000","last_unstale":"2023-10-16T12:58:55.682143+0000","last_undegraded":"2023-10-16T12:58:55.682143+0000","last_fullsized":"2023-10-16T12:58:55.682143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:34.224481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.073430+0000","last_change":"2023-10-16T12:58:55.711548+0000","last_active":"2023-10-16T12:58:57.073430+0000","last_peered":"2023-10-16T12:58:57.073430+0000","last_clean":"2023-10-16T12:58:57.073430+0000","last_became_active":"2023-10-16T12:58:55.711144+0000","last_became_peered":"2023-10-16T12:58:55.711144+0000","last_unstale":"2023-10-16T12:58:57.073430+0000","last_undegraded":"2023-10-16T12:58:57.073430+0000","last_fullsized":"2023-10-16T12:58:57.073430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:42:30.929517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.677592+0000","last_change":"2023-10-16T12:58:50.674933+0000","last_active":"2023-10-16T12:58:55.677592+0000","last_peered":"2023-10-16T12:58:55.677592+0000","last_clean":"2023-10-16T12:58:55.677592+0000","last_became_active":"2023-10-16T12:58:50.674678+0000","last_became_peered":"2023-10-16T12:58:50.674678+0000","last_unstale":"2023-10-16T12:58:55.677592+0000","last_undegraded":"2023-10-16T12:58:55.677592+0000","last_fullsized":"2023-10-16T12:58:55.677592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:22:34.308834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688629+0000","last_change":"2023-10-16T12:58:51.438422+0000","last_active":"2023-10-16T12:58:55.688629+0000","last_peered":"2023-10-16T12:58:55.688629+0000","last_clean":"2023-10-16T12:58:55.688629+0000","last_became_active":"2023-10-16T12:58:51.437341+0000","last_became_peered":"2023-10-16T12:58:51.437341+0000","last_unstale":"2023-10-16T12:58:55.688629+0000","last_undegraded":"2023-10-16T12:58:55.688629+0000","last_fullsized":"2023-10-16T12:58:55.688629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:59.501942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426422+0000","last_change":"2023-10-16T12:58:55.702372+0000","last_active":"2023-10-16T12:58:56.426422+0000","last_peered":"2023-10-16T12:58:56.426422+0000","last_clean":"2023-10-16T12:58:56.426422+0000","last_became_active":"2023-10-16T12:58:55.701933+0000","last_became_peered":"2023-10-16T12:58:55.701933+0000","last_unstale":"2023-10-16T12:58:56.426422+0000","last_undegraded":"2023-10-16T12:58:56.426422+0000","last_fullsized":"2023-10-16T12:58:56.426422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:18:50.966086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.677714+0000","last_change":"2023-10-16T12:58:50.669022+0000","last_active":"2023-10-16T12:58:55.677714+0000","last_peered":"2023-10-16T12:58:55.677714+0000","last_clean":"2023-10-16T12:58:55.677714+0000","last_became_active":"2023-10-16T12:58:50.668730+0000","last_became_peered":"2023-10-16T12:58:50.668730+0000","last_unstale":"2023-10-16T12:58:55.677714+0000","last_undegraded":"2023-10-16T12:58:55.677714+0000","last_fullsized":"2023-10-16T12:58:55.677714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:10.863857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.683389+0000","last_change":"2023-10-16T12:58:51.442613+0000","last_active":"2023-10-16T12:58:55.683389+0000","last_peered":"2023-10-16T12:58:55.683389+0000","last_clean":"2023-10-16T12:58:55.683389+0000","last_became_active":"2023-10-16T12:58:51.442369+0000","last_became_peered":"2023-10-16T12:58:51.442369+0000","last_unstale":"2023-10-16T12:58:55.683389+0000","last_undegraded":"2023-10-16T12:58:55.683389+0000","last_fullsized":"2023-10-16T12:58:55.683389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:40:36.060468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426204+0000","last_change":"2023-10-16T12:58:55.698038+0000","last_active":"2023-10-16T12:58:56.426204+0000","last_peered":"2023-10-16T12:58:56.426204+0000","last_clean":"2023-10-16T12:58:56.426204+0000","last_became_active":"2023-10-16T12:58:55.697543+0000","last_became_peered":"2023-10-16T12:58:55.697543+0000","last_unstale":"2023-10-16T12:58:56.426204+0000","last_undegraded":"2023-10-16T12:58:56.426204+0000","last_fullsized":"2023-10-16T12:58:56.426204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:31:17.628395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705613+0000","last_change":"2023-10-16T12:58:50.682262+0000","last_active":"2023-10-16T12:58:55.705613+0000","last_peered":"2023-10-16T12:58:55.705613+0000","last_clean":"2023-10-16T12:58:55.705613+0000","last_became_active":"2023-10-16T12:58:50.681971+0000","last_became_peered":"2023-10-16T12:58:50.681971+0000","last_unstale":"2023-10-16T12:58:55.705613+0000","last_undegraded":"2023-10-16T12:58:55.705613+0000","last_fullsized":"2023-10-16T12:58:55.705613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:48:36.174987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.687168+0000","last_change":"2023-10-16T12:58:51.444120+0000","last_active":"2023-10-16T12:58:55.687168+0000","last_peered":"2023-10-16T12:58:55.687168+0000","last_clean":"2023-10-16T12:58:55.687168+0000","last_became_active":"2023-10-16T12:58:51.443932+0000","last_became_peered":"2023-10-16T12:58:51.443932+0000","last_unstale":"2023-10-16T12:58:55.687168+0000","last_undegraded":"2023-10-16T12:58:55.687168+0000","last_fullsized":"2023-10-16T12:58:55.687168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:59.501942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.425527+0000","last_change":"2023-10-16T12:58:55.705568+0000","last_active":"2023-10-16T12:58:56.425527+0000","last_peered":"2023-10-16T12:58:56.425527+0000","last_clean":"2023-10-16T12:58:56.425527+0000","last_became_active":"2023-10-16T12:58:55.705195+0000","last_became_peered":"2023-10-16T12:58:55.705195+0000","last_unstale":"2023-10-16T12:58:56.425527+0000","last_undegraded":"2023-10-16T12:58:56.425527+0000","last_fullsized":"2023-10-16T12:58:56.425527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:30:02.068649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.685246+0000","last_change":"2023-10-16T12:58:50.680178+0000","last_active":"2023-10-16T12:58:55.685246+0000","last_peered":"2023-10-16T12:58:55.685246+0000","last_clean":"2023-10-16T12:58:55.685246+0000","last_became_active":"2023-10-16T12:58:50.679945+0000","last_became_peered":"2023-10-16T12:58:50.679945+0000","last_unstale":"2023-10-16T12:58:55.685246+0000","last_undegraded":"2023-10-16T12:58:55.685246+0000","last_fullsized":"2023-10-16T12:58:55.685246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:10.863857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.706307+0000","last_change":"2023-10-16T12:58:51.449653+0000","last_active":"2023-10-16T12:58:55.706307+0000","last_peered":"2023-10-16T12:58:55.706307+0000","last_clean":"2023-10-16T12:58:55.706307+0000","last_became_active":"2023-10-16T12:58:51.449109+0000","last_became_peered":"2023-10-16T12:58:51.449109+0000","last_unstale":"2023-10-16T12:58:55.706307+0000","last_undegraded":"2023-10-16T12:58:55.706307+0000","last_fullsized":"2023-10-16T12:58:55.706307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:15.698887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072205+0000","last_change":"2023-10-16T12:58:55.702012+0000","last_active":"2023-10-16T12:58:57.072205+0000","last_peered":"2023-10-16T12:58:57.072205+0000","last_clean":"2023-10-16T12:58:57.072205+0000","last_became_active":"2023-10-16T12:58:55.701622+0000","last_became_peered":"2023-10-16T12:58:55.701622+0000","last_unstale":"2023-10-16T12:58:57.072205+0000","last_undegraded":"2023-10-16T12:58:57.072205+0000","last_fullsized":"2023-10-16T12:58:57.072205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:37.747199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679482+0000","last_change":"2023-10-16T12:58:50.669769+0000","last_active":"2023-10-16T12:58:55.679482+0000","last_peered":"2023-10-16T12:58:55.679482+0000","last_clean":"2023-10-16T12:58:55.679482+0000","last_became_active":"2023-10-16T12:58:50.669513+0000","last_became_peered":"2023-10-16T12:58:50.669513+0000","last_unstale":"2023-10-16T12:58:55.679482+0000","last_undegraded":"2023-10-16T12:58:55.679482+0000","last_fullsized":"2023-10-16T12:58:55.679482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:00:22.709075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679131+0000","last_change":"2023-10-16T12:58:51.440492+0000","last_active":"2023-10-16T12:58:55.679131+0000","last_peered":"2023-10-16T12:58:55.679131+0000","last_clean":"2023-10-16T12:58:55.679131+0000","last_became_active":"2023-10-16T12:58:51.440223+0000","last_became_peered":"2023-10-16T12:58:51.440223+0000","last_unstale":"2023-10-16T12:58:55.679131+0000","last_undegraded":"2023-10-16T12:58:55.679131+0000","last_fullsized":"2023-10-16T12:58:55.679131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:29:58.046253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072507+0000","last_change":"2023-10-16T12:58:55.709910+0000","last_active":"2023-10-16T12:58:57.072507+0000","last_peered":"2023-10-16T12:58:57.072507+0000","last_clean":"2023-10-16T12:58:57.072507+0000","last_became_active":"2023-10-16T12:58:55.709448+0000","last_became_peered":"2023-10-16T12:58:55.709448+0000","last_unstale":"2023-10-16T12:58:57.072507+0000","last_undegraded":"2023-10-16T12:58:57.072507+0000","last_fullsized":"2023-10-16T12:58:57.072507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:10:14.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686015+0000","last_change":"2023-10-16T12:58:50.677056+0000","last_active":"2023-10-16T12:58:55.686015+0000","last_peered":"2023-10-16T12:58:55.686015+0000","last_clean":"2023-10-16T12:58:55.686015+0000","last_became_active":"2023-10-16T12:58:50.676784+0000","last_became_peered":"2023-10-16T12:58:50.676784+0000","last_unstale":"2023-10-16T12:58:55.686015+0000","last_undegraded":"2023-10-16T12:58:55.686015+0000","last_fullsized":"2023-10-16T12:58:55.686015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:20.511820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705640+0000","last_change":"2023-10-16T12:58:51.451103+0000","last_active":"2023-10-16T12:58:55.705640+0000","last_peered":"2023-10-16T12:58:55.705640+0000","last_clean":"2023-10-16T12:58:55.705640+0000","last_became_active":"2023-10-16T12:58:51.449605+0000","last_became_peered":"2023-10-16T12:58:51.449605+0000","last_unstale":"2023-10-16T12:58:55.705640+0000","last_undegraded":"2023-10-16T12:58:55.705640+0000","last_fullsized":"2023-10-16T12:58:55.705640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:33.724803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686013+0000","last_change":"2023-10-16T12:58:51.439877+0000","last_active":"2023-10-16T12:58:55.686013+0000","last_peered":"2023-10-16T12:58:55.686013+0000","last_clean":"2023-10-16T12:58:55.686013+0000","last_became_active":"2023-10-16T12:58:51.439574+0000","last_became_peered":"2023-10-16T12:58:51.439574+0000","last_unstale":"2023-10-16T12:58:55.686013+0000","last_undegraded":"2023-10-16T12:58:55.686013+0000","last_fullsized":"2023-10-16T12:58:55.686013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:40:36.060468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684614+0000","last_change":"2023-10-16T12:58:51.444297+0000","last_active":"2023-10-16T12:58:55.684614+0000","last_peered":"2023-10-16T12:58:55.684614+0000","last_clean":"2023-10-16T12:58:55.684614+0000","last_became_active":"2023-10-16T12:58:51.444044+0000","last_became_peered":"2023-10-16T12:58:51.444044+0000","last_unstale":"2023-10-16T12:58:55.684614+0000","last_undegraded":"2023-10-16T12:58:55.684614+0000","last_fullsized":"2023-10-16T12:58:55.684614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:56.488214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.678833+0000","last_change":"2023-10-16T12:58:51.438825+0000","last_active":"2023-10-16T12:58:55.678833+0000","last_peered":"2023-10-16T12:58:55.678833+0000","last_clean":"2023-10-16T12:58:55.678833+0000","last_became_active":"2023-10-16T12:58:51.438444+0000","last_became_peered":"2023-10-16T12:58:51.438444+0000","last_unstale":"2023-10-16T12:58:55.678833+0000","last_undegraded":"2023-10-16T12:58:55.678833+0000","last_fullsized":"2023-10-16T12:58:55.678833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:41:33.353000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.692498+0000","last_change":"2023-10-16T12:58:51.442368+0000","last_active":"2023-10-16T12:58:55.692498+0000","last_peered":"2023-10-16T12:58:55.692498+0000","last_clean":"2023-10-16T12:58:55.692498+0000","last_became_active":"2023-10-16T12:58:51.442108+0000","last_became_peered":"2023-10-16T12:58:51.442108+0000","last_unstale":"2023-10-16T12:58:55.692498+0000","last_undegraded":"2023-10-16T12:58:55.692498+0000","last_fullsized":"2023-10-16T12:58:55.692498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:59.501942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.693864+0000","last_change":"2023-10-16T12:58:51.441274+0000","last_active":"2023-10-16T12:58:55.693864+0000","last_peered":"2023-10-16T12:58:55.693864+0000","last_clean":"2023-10-16T12:58:55.693864+0000","last_became_active":"2023-10-16T12:58:51.441004+0000","last_became_peered":"2023-10-16T12:58:51.441004+0000","last_unstale":"2023-10-16T12:58:55.693864+0000","last_undegraded":"2023-10-16T12:58:55.693864+0000","last_fullsized":"2023-10-16T12:58:55.693864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:28:04.262253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679247+0000","last_change":"2023-10-16T12:58:51.437880+0000","last_active":"2023-10-16T12:58:55.679247+0000","last_peered":"2023-10-16T12:58:55.679247+0000","last_clean":"2023-10-16T12:58:55.679247+0000","last_became_active":"2023-10-16T12:58:51.437590+0000","last_became_peered":"2023-10-16T12:58:51.437590+0000","last_unstale":"2023-10-16T12:58:55.679247+0000","last_undegraded":"2023-10-16T12:58:55.679247+0000","last_fullsized":"2023-10-16T12:58:55.679247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:28:04.262253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686716+0000","last_change":"2023-10-16T12:58:51.447018+0000","last_active":"2023-10-16T12:58:55.686716+0000","last_peered":"2023-10-16T12:58:55.686716+0000","last_clean":"2023-10-16T12:58:55.686716+0000","last_became_active":"2023-10-16T12:58:51.446732+0000","last_became_peered":"2023-10-16T12:58:51.446732+0000","last_unstale":"2023-10-16T12:58:55.686716+0000","last_undegraded":"2023-10-16T12:58:55.686716+0000","last_fullsized":"2023-10-16T12:58:55.686716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:51.422601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688954+0000","last_change":"2023-10-16T12:58:51.441277+0000","last_active":"2023-10-16T12:58:55.688954+0000","last_peered":"2023-10-16T12:58:55.688954+0000","last_clean":"2023-10-16T12:58:55.688954+0000","last_became_active":"2023-10-16T12:58:51.441023+0000","last_became_peered":"2023-10-16T12:58:51.441023+0000","last_unstale":"2023-10-16T12:58:55.688954+0000","last_undegraded":"2023-10-16T12:58:55.688954+0000","last_fullsized":"2023-10-16T12:58:55.688954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:17:35.655947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.680294+0000","last_change":"2023-10-16T12:58:51.443020+0000","last_active":"2023-10-16T12:58:55.680294+0000","last_peered":"2023-10-16T12:58:55.680294+0000","last_clean":"2023-10-16T12:58:55.680294+0000","last_became_active":"2023-10-16T12:58:51.442541+0000","last_became_peered":"2023-10-16T12:58:51.442541+0000","last_unstale":"2023-10-16T12:58:55.680294+0000","last_undegraded":"2023-10-16T12:58:55.680294+0000","last_fullsized":"2023-10-16T12:58:55.680294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:31:13.605999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688993+0000","last_change":"2023-10-16T12:58:51.441436+0000","last_active":"2023-10-16T12:58:55.688993+0000","last_peered":"2023-10-16T12:58:55.688993+0000","last_clean":"2023-10-16T12:58:55.688993+0000","last_became_active":"2023-10-16T12:58:51.441145+0000","last_became_peered":"2023-10-16T12:58:51.441145+0000","last_unstale":"2023-10-16T12:58:55.688993+0000","last_undegraded":"2023-10-16T12:58:55.688993+0000","last_fullsized":"2023-10-16T12:58:55.688993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:48.087275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.678940+0000","last_change":"2023-10-16T12:58:51.449786+0000","last_active":"2023-10-16T12:58:55.678940+0000","last_peered":"2023-10-16T12:58:55.678940+0000","last_clean":"2023-10-16T12:58:55.678940+0000","last_became_active":"2023-10-16T12:58:51.449513+0000","last_became_peered":"2023-10-16T12:58:51.449513+0000","last_unstale":"2023-10-16T12:58:55.678940+0000","last_undegraded":"2023-10-16T12:58:55.678940+0000","last_fullsized":"2023-10-16T12:58:55.678940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:42:07.880003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.692580+0000","last_change":"2023-10-16T12:58:51.446178+0000","last_active":"2023-10-16T12:58:55.692580+0000","last_peered":"2023-10-16T12:58:55.692580+0000","last_clean":"2023-10-16T12:58:55.692580+0000","last_became_active":"2023-10-16T12:58:51.445995+0000","last_became_peered":"2023-10-16T12:58:51.445995+0000","last_unstale":"2023-10-16T12:58:55.692580+0000","last_undegraded":"2023-10-16T12:58:55.692580+0000","last_fullsized":"2023-10-16T12:58:55.692580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:40:36.060468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686445+0000","last_change":"2023-10-16T12:58:51.444064+0000","last_active":"2023-10-16T12:58:55.686445+0000","last_peered":"2023-10-16T12:58:55.686445+0000","last_clean":"2023-10-16T12:58:55.686445+0000","last_became_active":"2023-10-16T12:58:51.443873+0000","last_became_peered":"2023-10-16T12:58:51.443873+0000","last_unstale":"2023-10-16T12:58:55.686445+0000","last_undegraded":"2023-10-16T12:58:55.686445+0000","last_fullsized":"2023-10-16T12:58:55.686445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:48:37.180712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T12:59:10.225 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-16T12:59:10.226 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-16T12:59:10.226 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-16T12:59:10.226 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-16T12:59:10.227 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-16T12:59:10.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.377+0000 7faca1483700 1 Processor -- start 2023-10-16T12:59:10.382 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.377+0000 7faca1483700 1 -- start start 2023-10-16T12:59:10.382 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.378+0000 7faca1483700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fac9c0cf980 0x7fac9c0b9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:10.382 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.378+0000 7faca1483700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac9c0b9540 con 0x7fac9c160b50 2023-10-16T12:59:10.382 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.378+0000 7faca1483700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac9c0cfdb0 con 0x7fac9c0b5700 2023-10-16T12:59:10.383 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.378+0000 7faca1483700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac9c0d0010 con 0x7fac9c0cf980 2023-10-16T12:59:10.383 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.378+0000 7fac9b7fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fac9c0cf980 0x7fac9c0b9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:10.383 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.378+0000 7fac9affd700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fac9c160b50 0x7fac9c0b4ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42210/0 (socket says 172.21.15.124:42210) 2023-10-16T12:59:10.383 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.378+0000 7fac9affd700 1 -- 172.21.15.124:0/3822994050 learned_addr learned my addr 172.21.15.124:0/3822994050 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:10.384 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.378+0000 7fac9b7fe700 1 -- 172.21.15.124:0/3822994050 >> v1:172.21.15.192:6789/0 conn(0x7fac9c0b5700 legacy=0x7fac9c0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:10.384 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.378+0000 7fac9b7fe700 1 -- 172.21.15.124:0/3822994050 >> v1:172.21.15.124:6789/0 conn(0x7fac9c160b50 legacy=0x7fac9c0b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:10.384 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.378+0000 7fac9b7fe700 1 -- 172.21.15.124:0/3822994050 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c0d02f0 con 0x7fac9c0cf980 2023-10-16T12:59:10.384 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.378+0000 7fac99ffb700 1 -- 172.21.15.124:0/3822994050 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1125152407 0 0) 0x7fac90001110 con 0x7fac9c160b50 2023-10-16T12:59:10.384 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.378+0000 7fac9b7fe700 1 --2- 172.21.15.124:0/3822994050 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fac9c0cf980 0x7fac9c0b9000 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fac94009d90 tx=0x7fac9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3fd2b607464a764 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:10.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.378+0000 7fac99ffb700 1 -- 172.21.15.124:0/3822994050 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9400e070 con 0x7fac9c0cf980 2023-10-16T12:59:10.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.378+0000 7fac99ffb700 1 -- 172.21.15.124:0/3822994050 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9400bb90 con 0x7fac9c0cf980 2023-10-16T12:59:10.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.378+0000 7fac99ffb700 1 -- 172.21.15.124:0/3822994050 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac94003a20 con 0x7fac9c0cf980 2023-10-16T12:59:10.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.379+0000 7faca1483700 1 -- 172.21.15.124:0/3822994050 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fac9c0cf980 msgr2=0x7fac9c0b9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:10.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.379+0000 7faca1483700 1 --2- 172.21.15.124:0/3822994050 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fac9c0cf980 0x7fac9c0b9000 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fac94009d90 tx=0x7fac9400b330 comp rx=0 tx=0).stop 2023-10-16T12:59:10.386 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.379+0000 7faca1483700 1 -- 172.21.15.124:0/3822994050 shutdown_connections 2023-10-16T12:59:10.386 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.379+0000 7faca1483700 1 --2- 172.21.15.124:0/3822994050 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fac9c0cf980 0x7fac9c0b9000 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.386 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.379+0000 7faca1483700 1 -- 172.21.15.124:0/3822994050 >> 172.21.15.124:0/3822994050 conn(0x7fac9c06bc70 msgr2=0x7fac9c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:10.386 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.379+0000 7faca1483700 1 -- 172.21.15.124:0/3822994050 shutdown_connections 2023-10-16T12:59:10.387 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.379+0000 7faca1483700 1 -- 172.21.15.124:0/3822994050 wait complete. 2023-10-16T12:59:10.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.380+0000 7faca1483700 1 Processor -- start 2023-10-16T12:59:10.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.380+0000 7faca1483700 1 -- start start 2023-10-16T12:59:10.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.381+0000 7faca1483700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fac9c0b5700 0x7fac9c14b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:10.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.381+0000 7faca1483700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac9c0cf980 0x7fac9c15a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:10.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.381+0000 7faca1483700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac9c160b50 0x7fac9c15ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:10.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.381+0000 7faca1483700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c1f2af0 con 0x7fac9c0b5700 2023-10-16T12:59:10.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.381+0000 7faca1483700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c158000 con 0x7fac9c160b50 2023-10-16T12:59:10.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.381+0000 7faca1483700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c0cd370 con 0x7fac9c0cf980 2023-10-16T12:59:10.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.381+0000 7fac9affd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fac9c0b5700 0x7fac9c14b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:10.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.381+0000 7fac9affd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fac9c0b5700 0x7fac9c14b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53548/0 (socket says 172.21.15.124:53548) 2023-10-16T12:59:10.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.381+0000 7fac9affd700 1 -- 172.21.15.124:0/1720608388 learned_addr learned my addr 172.21.15.124:0/1720608388 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:10.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.381+0000 7fac9affd700 1 -- 172.21.15.124:0/1720608388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac9c0cf980 msgr2=0x7fac9c15a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:10.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.381+0000 7fac9affd700 1 --2- 172.21.15.124:0/1720608388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac9c0cf980 0x7fac9c15a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.381+0000 7fac9affd700 1 -- 172.21.15.124:0/1720608388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac9c160b50 msgr2=0x7fac9c15ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:10.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.381+0000 7fac9affd700 1 --2- 172.21.15.124:0/1720608388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac9c160b50 0x7fac9c15ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.381+0000 7fac9affd700 1 -- 172.21.15.124:0/1720608388 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac94009a70 con 0x7fac9c0b5700 2023-10-16T12:59:10.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.381+0000 7fac9affd700 1 --2- 172.21.15.124:0/1720608388 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fac9c0b5700 0x7fac9c14b0a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fac9000c730 tx=0x7fac9000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:10.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.382+0000 7fac837fe700 1 -- 172.21.15.124:0/1720608388 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac90004c80 con 0x7fac9c0b5700 2023-10-16T12:59:10.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.382+0000 7fac837fe700 1 -- 172.21.15.124:0/1720608388 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac90004e00 con 0x7fac9c0b5700 2023-10-16T12:59:10.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.382+0000 7faca1483700 1 -- 172.21.15.124:0/1720608388 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac9c1582c0 con 0x7fac9c0b5700 2023-10-16T12:59:10.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.382+0000 7fac837fe700 1 -- 172.21.15.124:0/1720608388 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac90007310 con 0x7fac9c0b5700 2023-10-16T12:59:10.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.382+0000 7faca1483700 1 -- 172.21.15.124:0/1720608388 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac9c14b5e0 con 0x7fac9c0b5700 2023-10-16T12:59:10.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.383+0000 7faca1483700 1 -- 172.21.15.124:0/1720608388 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac9c04ebb0 con 0x7fac9c0b5700 2023-10-16T12:59:10.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.383+0000 7fac837fe700 1 -- 172.21.15.124:0/1720608388 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fac90007470 con 0x7fac9c0b5700 2023-10-16T12:59:10.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.383+0000 7fac837fe700 1 --2- 172.21.15.124:0/1720608388 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fac8806af00 0x7fac8806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:10.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.384+0000 7fac837fe700 1 -- 172.21.15.124:0/1720608388 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fac900894e0 con 0x7fac9c0b5700 2023-10-16T12:59:10.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.384+0000 7fac9a7fc700 1 --2- 172.21.15.124:0/1720608388 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fac8806af00 0x7fac8806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:10.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.384+0000 7fac9a7fc700 1 --2- 172.21.15.124:0/1720608388 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fac8806af00 0x7fac8806d3c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fac9c15b410 tx=0x7fac8c006c30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:10.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.388+0000 7fac837fe700 1 -- 172.21.15.124:0/1720608388 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fac900542a0 con 0x7fac9c0b5700 2023-10-16T12:59:10.634 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.631+0000 7faca1483700 1 -- 172.21.15.124:0/1720608388 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fac9c0b9540 con 0x7fac9c0b5700 2023-10-16T12:59:10.636 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.634+0000 7fac837fe700 1 -- 172.21.15.124:0/1720608388 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171036 (secure 0 0 0) 0x7fac9c0b9540 con 0x7fac9c0b5700 2023-10-16T12:59:10.639 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:10.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.637+0000 7faca1483700 1 -- 172.21.15.124:0/1720608388 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fac8806af00 msgr2=0x7fac8806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:10.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.637+0000 7faca1483700 1 --2- 172.21.15.124:0/1720608388 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fac8806af00 0x7fac8806d3c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fac9c15b410 tx=0x7fac8c006c30 comp rx=0 tx=0).stop 2023-10-16T12:59:10.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.637+0000 7faca1483700 1 -- 172.21.15.124:0/1720608388 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fac9c0b5700 msgr2=0x7fac9c14b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:10.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.637+0000 7faca1483700 1 --2- 172.21.15.124:0/1720608388 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fac9c0b5700 0x7fac9c14b0a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fac9000c730 tx=0x7fac9000caf0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.637+0000 7faca1483700 1 -- 172.21.15.124:0/1720608388 shutdown_connections 2023-10-16T12:59:10.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.637+0000 7faca1483700 1 --2- 172.21.15.124:0/1720608388 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fac8806af00 0x7fac8806d3c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.637+0000 7faca1483700 1 --2- 172.21.15.124:0/1720608388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac9c160b50 0x7fac9c15ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.637+0000 7faca1483700 1 --2- 172.21.15.124:0/1720608388 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fac9c0b5700 0x7fac9c14b0a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.637+0000 7faca1483700 1 --2- 172.21.15.124:0/1720608388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac9c0cf980 0x7fac9c15a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.637+0000 7faca1483700 1 -- 172.21.15.124:0/1720608388 >> 172.21.15.124:0/1720608388 conn(0x7fac9c06bc70 msgr2=0x7fac9c1610e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:10.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.637+0000 7faca1483700 1 -- 172.21.15.124:0/1720608388 shutdown_connections 2023-10-16T12:59:10.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.637+0000 7faca1483700 1 -- 172.21.15.124:0/1720608388 wait complete. 2023-10-16T12:59:10.651 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6832","nonce":2391611330},{"type":"v1","addr":"172.21.15.124:6833","nonce":2391611330}]},"active_addr":"172.21.15.124:6833/2391611330","active_change":"2023-10-16T12:58:32.608004+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4114,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.124:0","nonce":2798673161}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.124:0","nonce":2518921907}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.124:0","nonce":4009280147}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.124:0","nonce":730005749}]}]} 2023-10-16T12:59:10.656 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-16T12:59:10.656 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-16T12:59:10.657 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:59:10.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.775+0000 7f9cbcf2b700 1 Processor -- start 2023-10-16T12:59:10.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.775+0000 7f9cbcf2b700 1 -- start start 2023-10-16T12:59:10.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.776+0000 7f9cbcf2b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9cb815c510 0x7f9cb8071270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:10.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.776+0000 7f9cbcf2b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cb80717b0 0x7f9cb815cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:10.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.776+0000 7f9cbcf2b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb80cbfd0 con 0x7f9cb8158f10 2023-10-16T12:59:10.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.776+0000 7f9cbcf2b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb8071c40 con 0x7f9cb815c510 2023-10-16T12:59:10.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.776+0000 7f9cbcf2b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb80ca380 con 0x7f9cb80717b0 2023-10-16T12:59:10.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.776+0000 7f9cb5d9b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9cb815c510 0x7f9cb8071270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:10.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.776+0000 7f9cb6d9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cb80717b0 0x7f9cb815cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:10.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.776+0000 7f9cb6d9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cb80717b0 0x7f9cb815cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:39638/0 (socket says 172.21.15.124:39638) 2023-10-16T12:59:10.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.776+0000 7f9cb659c700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f9cb8158f10 0x7f9cb815f920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.124:54220/0 (socket says 172.21.15.124:54220) 2023-10-16T12:59:10.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.776+0000 7f9cb5d9b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9cb815c510 0x7f9cb8071270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:33724/0 (socket says 172.21.15.124:33724) 2023-10-16T12:59:10.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.776+0000 7f9cb6d9d700 1 -- 172.21.15.124:0/572809758 learned_addr learned my addr 172.21.15.124:0/572809758 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:10.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.777+0000 7f9cb5d9b700 1 -- 172.21.15.124:0/572809758 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cb80717b0 msgr2=0x7f9cb815cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:10.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.777+0000 7f9cb5d9b700 1 --2- 172.21.15.124:0/572809758 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cb80717b0 0x7f9cb815cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.777+0000 7f9cb5d9b700 1 -- 172.21.15.124:0/572809758 >> v1:172.21.15.192:6789/0 conn(0x7f9cb8158f10 legacy=0x7f9cb815f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:10.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.777+0000 7f9cb5d9b700 1 -- 172.21.15.124:0/572809758 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb80ca660 con 0x7f9cb815c510 2023-10-16T12:59:10.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.777+0000 7f9cb6d9d700 1 --2- 172.21.15.124:0/572809758 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cb80717b0 0x7f9cb815cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:59:10.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.777+0000 7f9cb5d9b700 1 --2- 172.21.15.124:0/572809758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cb815c510 0x7f9cb8071270 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009840 tx=0x7f9cac009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79688180927bf56c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:10.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.777+0000 7f9cb559a700 1 -- 172.21.15.124:0/572809758 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac011830 con 0x7f9cb815c510 2023-10-16T12:59:10.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.777+0000 7f9cb559a700 1 -- 172.21.15.124:0/572809758 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cac011990 con 0x7f9cb815c510 2023-10-16T12:59:10.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.777+0000 7f9cb559a700 1 -- 172.21.15.124:0/572809758 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac011d20 con 0x7f9cb815c510 2023-10-16T12:59:10.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.777+0000 7f9cbcf2b700 1 -- 172.21.15.124:0/572809758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cb815c510 msgr2=0x7f9cb8071270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:10.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.777+0000 7f9cbcf2b700 1 --2- 172.21.15.124:0/572809758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cb815c510 0x7f9cb8071270 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009840 tx=0x7f9cac009b50 comp rx=0 tx=0).stop 2023-10-16T12:59:10.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.777+0000 7f9cbcf2b700 1 -- 172.21.15.124:0/572809758 shutdown_connections 2023-10-16T12:59:10.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.777+0000 7f9cbcf2b700 1 --2- 172.21.15.124:0/572809758 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cb80717b0 0x7f9cb815cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.777+0000 7f9cbcf2b700 1 --2- 172.21.15.124:0/572809758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cb815c510 0x7f9cb8071270 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.777+0000 7f9cbcf2b700 1 -- 172.21.15.124:0/572809758 >> 172.21.15.124:0/572809758 conn(0x7f9cb80cfcd0 msgr2=0x7f9cb80d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:10.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.778+0000 7f9cbcf2b700 1 -- 172.21.15.124:0/572809758 shutdown_connections 2023-10-16T12:59:10.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.778+0000 7f9cbcf2b700 1 -- 172.21.15.124:0/572809758 wait complete. 2023-10-16T12:59:10.788 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.779+0000 7f9cbcf2b700 1 Processor -- start 2023-10-16T12:59:10.788 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.779+0000 7f9cbcf2b700 1 -- start start 2023-10-16T12:59:10.788 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.780+0000 7f9cbcf2b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cb80717b0 0x7f9cb80b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:10.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.780+0000 7f9cbcf2b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9cb8158f10 0x7f9cb81f0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:10.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.780+0000 7f9cbcf2b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cb815c510 0x7f9cb81f0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:10.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.780+0000 7f9cbcf2b700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb80b5220 con 0x7f9cb8158f10 2023-10-16T12:59:10.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.780+0000 7f9cbcf2b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb8155f30 con 0x7f9cb80717b0 2023-10-16T12:59:10.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.780+0000 7f9cbcf2b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb8156210 con 0x7f9cb815c510 2023-10-16T12:59:10.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.780+0000 7f9cb5d9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9cb8158f10 0x7f9cb81f0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:10.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.780+0000 7f9cb5d9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9cb8158f10 0x7f9cb81f0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53564/0 (socket says 172.21.15.124:53564) 2023-10-16T12:59:10.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.780+0000 7f9cb5d9b700 1 -- 172.21.15.124:0/2515937096 learned_addr learned my addr 172.21.15.124:0/2515937096 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:10.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.780+0000 7f9cb659c700 1 --2- 172.21.15.124:0/2515937096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cb80717b0 0x7f9cb80b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:10.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.780+0000 7f9cb6d9d700 1 --2- 172.21.15.124:0/2515937096 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cb815c510 0x7f9cb81f0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:10.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.780+0000 7f9cb5d9b700 1 -- 172.21.15.124:0/2515937096 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cb815c510 msgr2=0x7f9cb81f0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:10.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.780+0000 7f9cb5d9b700 1 --2- 172.21.15.124:0/2515937096 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cb815c510 0x7f9cb81f0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.780+0000 7f9cb5d9b700 1 -- 172.21.15.124:0/2515937096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cb80717b0 msgr2=0x7f9cb80b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:10.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.780+0000 7f9cb5d9b700 1 --2- 172.21.15.124:0/2515937096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cb80717b0 0x7f9cb80b07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.780+0000 7f9cb5d9b700 1 -- 172.21.15.124:0/2515937096 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb0009b30 con 0x7f9cb8158f10 2023-10-16T12:59:10.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.780+0000 7f9cb5d9b700 1 --2- 172.21.15.124:0/2515937096 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9cb8158f10 0x7f9cb81f0740 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009b90 tx=0x7f9cac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:10.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.780+0000 7f9ca6ffd700 1 -- 172.21.15.124:0/2515937096 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac004590 con 0x7f9cb8158f10 2023-10-16T12:59:10.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.780+0000 7f9ca6ffd700 1 -- 172.21.15.124:0/2515937096 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cac0036a0 con 0x7f9cb8158f10 2023-10-16T12:59:10.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.780+0000 7f9cbcf2b700 1 -- 172.21.15.124:0/2515937096 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cac0094a0 con 0x7f9cb8158f10 2023-10-16T12:59:10.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.780+0000 7f9ca6ffd700 1 -- 172.21.15.124:0/2515937096 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac003a30 con 0x7f9cb8158f10 2023-10-16T12:59:10.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.781+0000 7f9cbcf2b700 1 -- 172.21.15.124:0/2515937096 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb80b4ef0 con 0x7f9cb8158f10 2023-10-16T12:59:10.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.781+0000 7f9cbcf2b700 1 -- 172.21.15.124:0/2515937096 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb8156730 con 0x7f9cb8158f10 2023-10-16T12:59:10.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.782+0000 7f9ca6ffd700 1 -- 172.21.15.124:0/2515937096 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9cac003b90 con 0x7f9cb8158f10 2023-10-16T12:59:10.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.782+0000 7f9ca6ffd700 1 --2- 172.21.15.124:0/2515937096 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f9c9806af00 0x7f9c9806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:10.794 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.782+0000 7f9ca6ffd700 1 -- 172.21.15.124:0/2515937096 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9cac08abf0 con 0x7f9cb8158f10 2023-10-16T12:59:10.794 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.782+0000 7f9cb659c700 1 --2- 172.21.15.124:0/2515937096 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f9c9806af00 0x7f9c9806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:10.794 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.783+0000 7f9cb659c700 1 --2- 172.21.15.124:0/2515937096 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f9c9806af00 0x7f9c9806d3c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8000f60 tx=0x7f9ca8007f10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:10.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.788+0000 7f9ca6ffd700 1 -- 172.21.15.124:0/2515937096 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9cac055ae0 con 0x7f9cb8158f10 2023-10-16T12:59:10.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.977+0000 7f9cbcf2b700 1 -- 172.21.15.124:0/2515937096 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cb804ebb0 con 0x7f9cb8158f10 2023-10-16T12:59:10.981 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.978+0000 7f9ca6ffd700 1 -- 172.21.15.124:0/2515937096 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f9cac015020 con 0x7f9cb8158f10 2023-10-16T12:59:10.981 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:10.981 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":24,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:58:56.089767+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:59:10.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.981+0000 7f9cbcf2b700 1 -- 172.21.15.124:0/2515937096 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f9c9806af00 msgr2=0x7f9c9806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:10.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.981+0000 7f9cbcf2b700 1 --2- 172.21.15.124:0/2515937096 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f9c9806af00 0x7f9c9806d3c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8000f60 tx=0x7f9ca8007f10 comp rx=0 tx=0).stop 2023-10-16T12:59:10.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.981+0000 7f9cbcf2b700 1 -- 172.21.15.124:0/2515937096 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9cb8158f10 msgr2=0x7f9cb81f0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:10.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.981+0000 7f9cbcf2b700 1 --2- 172.21.15.124:0/2515937096 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9cb8158f10 0x7f9cb81f0740 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009b90 tx=0x7f9cac004750 comp rx=0 tx=0).stop 2023-10-16T12:59:10.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.981+0000 7f9cbcf2b700 1 -- 172.21.15.124:0/2515937096 shutdown_connections 2023-10-16T12:59:10.985 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.981+0000 7f9cbcf2b700 1 --2- 172.21.15.124:0/2515937096 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f9c9806af00 0x7f9c9806d3c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.985 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.981+0000 7f9cbcf2b700 1 --2- 172.21.15.124:0/2515937096 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cb815c510 0x7f9cb81f0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.985 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.981+0000 7f9cbcf2b700 1 --2- 172.21.15.124:0/2515937096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cb80717b0 0x7f9cb80b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.985 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.981+0000 7f9cbcf2b700 1 --2- 172.21.15.124:0/2515937096 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9cb8158f10 0x7f9cb81f0740 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:10.985 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.981+0000 7f9cbcf2b700 1 -- 172.21.15.124:0/2515937096 >> 172.21.15.124:0/2515937096 conn(0x7f9cb80cfcd0 msgr2=0x7f9cb8157fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:10.986 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.981+0000 7f9cbcf2b700 1 -- 172.21.15.124:0/2515937096 shutdown_connections 2023-10-16T12:59:10.986 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:10.981+0000 7f9cbcf2b700 1 -- 172.21.15.124:0/2515937096 wait complete. 2023-10-16T12:59:10.995 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-16T12:59:10.996 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:59:11.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.113+0000 7fe0f3bdb700 1 Processor -- start 2023-10-16T12:59:11.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.113+0000 7fe0f3bdb700 1 -- start start 2023-10-16T12:59:11.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.114+0000 7fe0f3bdb700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe0ec0cb400 0x7fe0ec15e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.114+0000 7fe0f3bdb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0ec15eb80 0x7fe0ec0aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.114+0000 7fe0f3bdb700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ec15e1b0 con 0x7fe0ec15a240 2023-10-16T12:59:11.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.114+0000 7fe0f3bdb700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ec15de60 con 0x7fe0ec0cb400 2023-10-16T12:59:11.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.114+0000 7fe0f3bdb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec0cb9c0 con 0x7fe0ec15eb80 2023-10-16T12:59:11.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.114+0000 7fe0f1176700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe0ec0cb400 0x7fe0ec15e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.114+0000 7fe0f2178700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0ec15eb80 0x7fe0ec0aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.120 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.114+0000 7fe0f1176700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe0ec0cb400 0x7fe0ec15e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:33740/0 (socket says 172.21.15.124:33740) 2023-10-16T12:59:11.120 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.114+0000 7fe0f2178700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0ec15eb80 0x7fe0ec0aefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:39650/0 (socket says 172.21.15.124:39650) 2023-10-16T12:59:11.120 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.114+0000 7fe0f1977700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe0ec15a240 0x7fe0ec0caa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.124:54234/0 (socket says 172.21.15.124:54234) 2023-10-16T12:59:11.120 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.114+0000 7fe0f1176700 1 -- 172.21.15.124:0/475809740 learned_addr learned my addr 172.21.15.124:0/475809740 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:11.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.115+0000 7fe0f2178700 1 -- 172.21.15.124:0/475809740 >> v2:172.21.15.192:3300/0 conn(0x7fe0ec0cb400 msgr2=0x7fe0ec15e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:11.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.115+0000 7fe0f2178700 1 --2- 172.21.15.124:0/475809740 >> v2:172.21.15.192:3300/0 conn(0x7fe0ec0cb400 0x7fe0ec15e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.115+0000 7fe0f2178700 1 -- 172.21.15.124:0/475809740 >> v1:172.21.15.192:6789/0 conn(0x7fe0ec15a240 legacy=0x7fe0ec0caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.115+0000 7fe0f2178700 1 -- 172.21.15.124:0/475809740 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ec0cbca0 con 0x7fe0ec15eb80 2023-10-16T12:59:11.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.115+0000 7fe0f1176700 1 --2- 172.21.15.124:0/475809740 >> v2:172.21.15.192:3300/0 conn(0x7fe0ec0cb400 0x7fe0ec15e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:59:11.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.115+0000 7fe0f2178700 1 --2- 172.21.15.124:0/475809740 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0ec15eb80 0x7fe0ec0aefb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009d90 tx=0x7fe0e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a795ea3c285b167 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.115+0000 7fe0f0975700 1 -- 172.21.15.124:0/475809740 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e400e070 con 0x7fe0ec15eb80 2023-10-16T12:59:11.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.115+0000 7fe0f0975700 1 -- 172.21.15.124:0/475809740 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e400bb20 con 0x7fe0ec15eb80 2023-10-16T12:59:11.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.115+0000 7fe0f0975700 1 -- 172.21.15.124:0/475809740 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4012430 con 0x7fe0ec15eb80 2023-10-16T12:59:11.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.116+0000 7fe0f3bdb700 1 -- 172.21.15.124:0/475809740 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0ec15eb80 msgr2=0x7fe0ec0aefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.123 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.116+0000 7fe0f3bdb700 1 --2- 172.21.15.124:0/475809740 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0ec15eb80 0x7fe0ec0aefb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009d90 tx=0x7fe0e400b330 comp rx=0 tx=0).stop 2023-10-16T12:59:11.123 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.116+0000 7fe0f3bdb700 1 -- 172.21.15.124:0/475809740 shutdown_connections 2023-10-16T12:59:11.123 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.116+0000 7fe0f3bdb700 1 --2- 172.21.15.124:0/475809740 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0ec15eb80 0x7fe0ec0aefb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.123 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.116+0000 7fe0f3bdb700 1 --2- 172.21.15.124:0/475809740 >> v2:172.21.15.192:3300/0 conn(0x7fe0ec0cb400 0x7fe0ec15e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.123 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.116+0000 7fe0f3bdb700 1 -- 172.21.15.124:0/475809740 >> 172.21.15.124:0/475809740 conn(0x7fe0ec0ccbd0 msgr2=0x7fe0ec0ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:11.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.116+0000 7fe0f3bdb700 1 -- 172.21.15.124:0/475809740 shutdown_connections 2023-10-16T12:59:11.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.116+0000 7fe0f3bdb700 1 -- 172.21.15.124:0/475809740 wait complete. 2023-10-16T12:59:11.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.117+0000 7fe0f3bdb700 1 Processor -- start 2023-10-16T12:59:11.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.117+0000 7fe0f3bdb700 1 -- start start 2023-10-16T12:59:11.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.118+0000 7fe0f3bdb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0ec0cb400 0x7fe0ec0b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.118+0000 7fe0f3bdb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0ec15a240 0x7fe0ec0b5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.118+0000 7fe0f3bdb700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe0ec15eb80 0x7fe0ec1f0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.118+0000 7fe0f3bdb700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec0b40f0 con 0x7fe0ec15eb80 2023-10-16T12:59:11.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.118+0000 7fe0f3bdb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec0b5a90 con 0x7fe0ec0cb400 2023-10-16T12:59:11.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.118+0000 7fe0f3bdb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec0b3470 con 0x7fe0ec15a240 2023-10-16T12:59:11.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.118+0000 7fe0f2178700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe0ec15eb80 0x7fe0ec1f0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.118+0000 7fe0f2178700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe0ec15eb80 0x7fe0ec1f0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53580/0 (socket says 172.21.15.124:53580) 2023-10-16T12:59:11.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.118+0000 7fe0f2178700 1 -- 172.21.15.124:0/1691419168 learned_addr learned my addr 172.21.15.124:0/1691419168 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:11.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.118+0000 7fe0f1176700 1 --2- 172.21.15.124:0/1691419168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0ec15a240 0x7fe0ec0b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.118+0000 7fe0f1977700 1 --2- 172.21.15.124:0/1691419168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0ec0cb400 0x7fe0ec0b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.118+0000 7fe0f2178700 1 -- 172.21.15.124:0/1691419168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0ec15a240 msgr2=0x7fe0ec0b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.118+0000 7fe0f2178700 1 --2- 172.21.15.124:0/1691419168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0ec15a240 0x7fe0ec0b5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.118+0000 7fe0f2178700 1 -- 172.21.15.124:0/1691419168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0ec0cb400 msgr2=0x7fe0ec0b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.118+0000 7fe0f2178700 1 --2- 172.21.15.124:0/1691419168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0ec0cb400 0x7fe0ec0b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.118+0000 7fe0f2178700 1 -- 172.21.15.124:0/1691419168 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e8009550 con 0x7fe0ec15eb80 2023-10-16T12:59:11.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.118+0000 7fe0f2178700 1 --2- 172.21.15.124:0/1691419168 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe0ec15eb80 0x7fe0ec1f0800 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4014040 tx=0x7fe0e4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.118+0000 7fe0e27fc700 1 -- 172.21.15.124:0/1691419168 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4012430 con 0x7fe0ec15eb80 2023-10-16T12:59:11.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.118+0000 7fe0e27fc700 1 -- 172.21.15.124:0/1691419168 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e4020070 con 0x7fe0ec15eb80 2023-10-16T12:59:11.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.118+0000 7fe0f3bdb700 1 -- 172.21.15.124:0/1691419168 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e4009a70 con 0x7fe0ec15eb80 2023-10-16T12:59:11.131 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.118+0000 7fe0e27fc700 1 -- 172.21.15.124:0/1691419168 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4004280 con 0x7fe0ec15eb80 2023-10-16T12:59:11.131 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.118+0000 7fe0f3bdb700 1 -- 172.21.15.124:0/1691419168 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ec0b3a30 con 0x7fe0ec15eb80 2023-10-16T12:59:11.131 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.120+0000 7fe0f3bdb700 1 -- 172.21.15.124:0/1691419168 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ec0cd910 con 0x7fe0ec15eb80 2023-10-16T12:59:11.131 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.120+0000 7fe0e27fc700 1 -- 172.21.15.124:0/1691419168 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe0e40043e0 con 0x7fe0ec15eb80 2023-10-16T12:59:11.131 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.120+0000 7fe0e27fc700 1 --2- 172.21.15.124:0/1691419168 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe0d006af00 0x7fe0d006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.132 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.120+0000 7fe0f1977700 1 --2- 172.21.15.124:0/1691419168 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe0d006af00 0x7fe0d006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.132 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.120+0000 7fe0e27fc700 1 -- 172.21.15.124:0/1691419168 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe0e4022070 con 0x7fe0ec15eb80 2023-10-16T12:59:11.132 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.121+0000 7fe0f1977700 1 --2- 172.21.15.124:0/1691419168 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe0d006af00 0x7fe0d006d3c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc000f60 tx=0x7fe0dc007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.132 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.126+0000 7fe0e27fc700 1 -- 172.21.15.124:0/1691419168 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe0e4056710 con 0x7fe0ec15eb80 2023-10-16T12:59:11.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.315+0000 7fe0f3bdb700 1 -- 172.21.15.124:0/1691419168 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0ec04ebb0 con 0x7fe0ec15eb80 2023-10-16T12:59:11.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.316+0000 7fe0e27fc700 1 -- 172.21.15.124:0/1691419168 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fe0e4059d30 con 0x7fe0ec15eb80 2023-10-16T12:59:11.319 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:11.319 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":24,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:58:56.089767+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:59:11.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.318+0000 7fe0f3bdb700 1 -- 172.21.15.124:0/1691419168 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe0d006af00 msgr2=0x7fe0d006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.318+0000 7fe0f3bdb700 1 --2- 172.21.15.124:0/1691419168 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe0d006af00 0x7fe0d006d3c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc000f60 tx=0x7fe0dc007d50 comp rx=0 tx=0).stop 2023-10-16T12:59:11.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.318+0000 7fe0f3bdb700 1 -- 172.21.15.124:0/1691419168 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe0ec15eb80 msgr2=0x7fe0ec1f0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.318+0000 7fe0f3bdb700 1 --2- 172.21.15.124:0/1691419168 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe0ec15eb80 0x7fe0ec1f0800 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4014040 tx=0x7fe0e4004ad0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.318+0000 7fe0f3bdb700 1 -- 172.21.15.124:0/1691419168 shutdown_connections 2023-10-16T12:59:11.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.318+0000 7fe0f3bdb700 1 --2- 172.21.15.124:0/1691419168 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe0d006af00 0x7fe0d006d3c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.318+0000 7fe0f3bdb700 1 --2- 172.21.15.124:0/1691419168 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe0ec15eb80 0x7fe0ec1f0800 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.318+0000 7fe0f3bdb700 1 --2- 172.21.15.124:0/1691419168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0ec0cb400 0x7fe0ec0b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.318+0000 7fe0f3bdb700 1 --2- 172.21.15.124:0/1691419168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0ec15a240 0x7fe0ec0b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.323 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.318+0000 7fe0f3bdb700 1 -- 172.21.15.124:0/1691419168 >> 172.21.15.124:0/1691419168 conn(0x7fe0ec0ccbd0 msgr2=0x7fe0ec0ae6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:11.323 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.318+0000 7fe0f3bdb700 1 -- 172.21.15.124:0/1691419168 shutdown_connections 2023-10-16T12:59:11.323 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.318+0000 7fe0f3bdb700 1 -- 172.21.15.124:0/1691419168 wait complete. 2023-10-16T12:59:11.333 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-16T12:59:11.334 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-16T12:59:11.334 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-16T12:59:11.335 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-16T12:59:11.335 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-16T12:59:11.336 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-16T12:59:11.336 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-16T12:59:11.337 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-16T12:59:11.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.542+0000 7f180701a700 1 Processor -- start 2023-10-16T12:59:11.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.542+0000 7f180701a700 1 -- start start 2023-10-16T12:59:11.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.544+0000 7f180701a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f180015e7f0 0x7f1800071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.544+0000 7f180701a700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18000cfeb0 con 0x7f180006a820 2023-10-16T12:59:11.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.544+0000 7f180701a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18000cfc30 con 0x7f18000cf7d0 2023-10-16T12:59:11.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.544+0000 7f180701a700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18000ce410 con 0x7f180015e7f0 2023-10-16T12:59:11.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.543+0000 7f4acb148700 1 Processor -- start 2023-10-16T12:59:11.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.543+0000 7f4acb148700 1 -- start start 2023-10-16T12:59:11.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.544+0000 7f4ceaadb700 1 Processor -- start 2023-10-16T12:59:11.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.545+0000 7f1804db6700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f180006a820 0x7f180006ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42252/0 (socket says 172.21.15.124:42252) 2023-10-16T12:59:11.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.545+0000 7f1804db6700 1 -- 172.21.15.124:0/828631992 learned_addr learned my addr 172.21.15.124:0/828631992 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:11.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.545+0000 7f17ff7fe700 1 -- 172.21.15.124:0/828631992 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1619883614 0 0) 0x7f18000cfeb0 con 0x7f180006a820 2023-10-16T12:59:11.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.545+0000 7f17ff7fe700 1 -- 172.21.15.124:0/828631992 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17f00035b0 con 0x7f180006a820 2023-10-16T12:59:11.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.546+0000 7f4ceaadb700 1 -- start start 2023-10-16T12:59:11.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.546+0000 7f17ff7fe700 1 -- 172.21.15.124:0/828631992 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2320141571 0 0) 0x7f17f00035b0 con 0x7f180006a820 2023-10-16T12:59:11.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.546+0000 7f17ff7fe700 1 -- 172.21.15.124:0/828631992 >> v2:172.21.15.124:3300/0 conn(0x7f180015e7f0 msgr2=0x7f1800071ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T12:59:11.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.546+0000 7f17ff7fe700 1 --2- 172.21.15.124:0/828631992 >> v2:172.21.15.124:3300/0 conn(0x7f180015e7f0 0x7f1800071ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.546+0000 7f17ff7fe700 1 -- 172.21.15.124:0/828631992 >> v1:172.21.15.192:6789/0 conn(0x7f18000cf7d0 legacy=0x7f18000ca7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T12:59:11.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.546+0000 7f17ff7fe700 1 -- 172.21.15.124:0/828631992 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18000af9d0 con 0x7f180006a820 2023-10-16T12:59:11.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.546+0000 7f17ff7fe700 1 -- 172.21.15.124:0/828631992 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f17ec001670 con 0x7f180006a820 2023-10-16T12:59:11.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.546+0000 7f17ff7fe700 1 -- 172.21.15.124:0/828631992 >> v1:172.21.15.124:6789/0 conn(0x7f180006a820 legacy=0x7f180006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.546+0000 7f17ff7fe700 1 --2- 172.21.15.124:0/828631992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17f0003a00 0x7f17f0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.546+0000 7f17ff7fe700 1 --2- 172.21.15.124:0/828631992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17f0004850 0x7f17f0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.546+0000 7f17ff7fe700 1 --2- 172.21.15.124:0/828631992 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f17f0005330 0x7f17f0014220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.546+0000 7f17ff7fe700 1 -- 172.21.15.124:0/828631992 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18000ce410 con 0x7f17f0005330 2023-10-16T12:59:11.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.546+0000 7f17ff7fe700 1 -- 172.21.15.124:0/828631992 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f0014a90 con 0x7f17f0003a00 2023-10-16T12:59:11.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.546+0000 7f17ff7fe700 1 -- 172.21.15.124:0/828631992 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f0014c50 con 0x7f17f0004850 2023-10-16T12:59:11.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.546+0000 7f1804db6700 1 --2- 172.21.15.124:0/828631992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17f0003a00 0x7f17f0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.547+0000 7f4ceaadb700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4ce4161a00 0x7f4ce40cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.547+0000 7f4ceaadb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ce40c9610 0x7f4ce40c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.547+0000 7f4ceaadb700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4ce40ccb90 0x7f4ce40cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.547+0000 7f4ceaadb700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce40cd540 con 0x7f4ce40ccb90 2023-10-16T12:59:11.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.547+0000 7f4ceaadb700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce40ca950 con 0x7f4ce4161a00 2023-10-16T12:59:11.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.547+0000 7f4ceaadb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce40ca0b0 con 0x7f4ce40c9610 2023-10-16T12:59:11.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.544+0000 7f4acb148700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4ac40cae00 0x7f4ac406daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.544+0000 7f4acb148700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ac406e030 0x7f4ac416eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.544+0000 7f4acb148700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac416f480 con 0x7f4ac416eff0 2023-10-16T12:59:11.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.544+0000 7f4acb148700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac40cd5a0 con 0x7f4ac40cae00 2023-10-16T12:59:11.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.544+0000 7f4acb148700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac406e4b0 con 0x7f4ac406e030 2023-10-16T12:59:11.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.545+0000 7f4ac96e5700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f4ac416eff0 0x7f4ac40c9610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42256/0 (socket says 172.21.15.124:42256) 2023-10-16T12:59:11.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.545+0000 7f4ac96e5700 1 -- 172.21.15.124:0/3789454521 learned_addr learned my addr 172.21.15.124:0/3789454521 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:11.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.545+0000 7f4ac3fff700 1 --2- 172.21.15.124:0/3789454521 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ac406e030 0x7f4ac416eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.545+0000 7f4ac37fe700 1 -- 172.21.15.124:0/3789454521 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011261621 0 0) 0x7f4ac416f480 con 0x7f4ac416eff0 2023-10-16T12:59:11.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.545+0000 7f4ac37fe700 1 -- 172.21.15.124:0/3789454521 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4aac0035b0 con 0x7f4ac416eff0 2023-10-16T12:59:11.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.546+0000 7f4ac3fff700 1 -- 172.21.15.124:0/3789454521 >> v2:172.21.15.192:3300/0 conn(0x7f4ac40cae00 msgr2=0x7f4ac406daf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T12:59:11.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.546+0000 7f4ac3fff700 1 --2- 172.21.15.124:0/3789454521 >> v2:172.21.15.192:3300/0 conn(0x7f4ac40cae00 0x7f4ac406daf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.546+0000 7f4ac3fff700 1 -- 172.21.15.124:0/3789454521 >> v1:172.21.15.124:6789/0 conn(0x7f4ac416eff0 legacy=0x7f4ac40c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.546+0000 7f4ac3fff700 1 -- 172.21.15.124:0/3789454521 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac40ca950 con 0x7f4ac406e030 2023-10-16T12:59:11.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.546+0000 7f4ac3fff700 1 --2- 172.21.15.124:0/3789454521 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ac406e030 0x7f4ac416eab0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8009840 tx=0x7f4ab8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f5923818cf32ed server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.546+0000 7f4ac37fe700 1 -- 172.21.15.124:0/3789454521 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8011830 con 0x7f4ac406e030 2023-10-16T12:59:11.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.546+0000 7f4ac37fe700 1 -- 172.21.15.124:0/3789454521 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab8011990 con 0x7f4ac406e030 2023-10-16T12:59:11.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.546+0000 7f4ac37fe700 1 -- 172.21.15.124:0/3789454521 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8011d20 con 0x7f4ac406e030 2023-10-16T12:59:11.559 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.547+0000 7f4ce8877700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4ce4161a00 0x7f4ce40cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.559 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.547+0000 7f4ce3fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ce40c9610 0x7f4ce40c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.559 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.547+0000 7f4ce8877700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4ce4161a00 0x7f4ce40cacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:33758/0 (socket says 172.21.15.124:33758) 2023-10-16T12:59:11.560 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.547+0000 7f4ce8877700 1 -- 172.21.15.124:0/2717772225 learned_addr learned my addr 172.21.15.124:0/2717772225 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:11.560 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.547+0000 7f4ce9078700 1 --2- 172.21.15.124:0/2717772225 >> v2:172.21.15.124:3300/0 conn(0x7f4ce40ccb90 0x7f4ce40cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.560 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.547+0000 7f4acb148700 1 -- 172.21.15.124:0/3789454521 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ac406e030 msgr2=0x7f4ac416eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.561 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.547+0000 7f4acb148700 1 --2- 172.21.15.124:0/3789454521 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ac406e030 0x7f4ac416eab0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8009840 tx=0x7f4ab8009b50 comp rx=0 tx=0).stop 2023-10-16T12:59:11.561 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.547+0000 7f4acb148700 1 -- 172.21.15.124:0/3789454521 shutdown_connections 2023-10-16T12:59:11.561 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.547+0000 7f4acb148700 1 --2- 172.21.15.124:0/3789454521 >> v2:172.21.15.192:3300/0 conn(0x7f4ac40cae00 0x7f4ac406daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.561 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.547+0000 7f4acb148700 1 --2- 172.21.15.124:0/3789454521 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ac406e030 0x7f4ac416eab0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.561 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.547+0000 7f4acb148700 1 -- 172.21.15.124:0/3789454521 >> 172.21.15.124:0/3789454521 conn(0x7f4ac40cbad0 msgr2=0x7f4ac40cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:11.562 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.547+0000 7f4ce8877700 1 -- 172.21.15.124:0/2717772225 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ce40c9610 msgr2=0x7f4ce40c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:11.562 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.547+0000 7f4ce8877700 1 --2- 172.21.15.124:0/2717772225 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ce40c9610 0x7f4ce40c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.562 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.547+0000 7f4ce8877700 1 -- 172.21.15.124:0/2717772225 >> v2:172.21.15.124:3300/0 conn(0x7f4ce40ccb90 msgr2=0x7f4ce40cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:11.563 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.547+0000 7f4ce8877700 1 --2- 172.21.15.124:0/2717772225 >> v2:172.21.15.124:3300/0 conn(0x7f4ce40ccb90 0x7f4ce40cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.563 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.547+0000 7f4ce8877700 1 -- 172.21.15.124:0/2717772225 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce40ca390 con 0x7f4ce4161a00 2023-10-16T12:59:11.563 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.548+0000 7f17fffff700 1 --2- 172.21.15.124:0/828631992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17f0004850 0x7f17f0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.564 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.548+0000 7fa4e1e79700 1 Processor -- start 2023-10-16T12:59:11.564 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.548+0000 7fa4e1e79700 1 -- start start 2023-10-16T12:59:11.564 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.548+0000 7f1804db6700 1 -- 172.21.15.124:0/828631992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17f0004850 msgr2=0x7f17f0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:11.565 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.548+0000 7f1804db6700 1 --2- 172.21.15.124:0/828631992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17f0004850 0x7f17f0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.565 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.548+0000 7f1804db6700 1 -- 172.21.15.124:0/828631992 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f17f0005330 msgr2=0x7f17f0014220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T12:59:11.565 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.548+0000 7f1804db6700 1 --2- 172.21.15.124:0/828631992 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f17f0005330 0x7f17f0014220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.565 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.548+0000 7f1804db6700 1 -- 172.21.15.124:0/828631992 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18000af9d0 con 0x7f17f0003a00 2023-10-16T12:59:11.566 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.548+0000 7f1804db6700 1 --2- 172.21.15.124:0/828631992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17f0003a00 0x7f17f0003e00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00c3c0 tx=0x7f17f0005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=414a5b4c6c379189 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.566 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.548+0000 7f17ff7fe700 1 -- 172.21.15.124:0/828631992 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec005960 con 0x7f17f0003a00 2023-10-16T12:59:11.566 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.548+0000 7f17ff7fe700 1 -- 172.21.15.124:0/828631992 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ec005ac0 con 0x7f17f0003a00 2023-10-16T12:59:11.566 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.548+0000 7f17ff7fe700 1 -- 172.21.15.124:0/828631992 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec005e70 con 0x7f17f0003a00 2023-10-16T12:59:11.567 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.548+0000 7f4ce8877700 1 --2- 172.21.15.124:0/2717772225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ce4161a00 0x7f4ce40cacf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ce40730e0 tx=0x7f4cd4009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b03dab8c809f3e15 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.567 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.549+0000 7f4ce37fe700 1 -- 172.21.15.124:0/2717772225 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4011830 con 0x7f4ce4161a00 2023-10-16T12:59:11.567 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.549+0000 7f4ce37fe700 1 -- 172.21.15.124:0/2717772225 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd4011990 con 0x7f4ce4161a00 2023-10-16T12:59:11.567 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.549+0000 7f4ce37fe700 1 -- 172.21.15.124:0/2717772225 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4011d20 con 0x7f4ce4161a00 2023-10-16T12:59:11.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.549+0000 7f180701a700 1 -- 172.21.15.124:0/828631992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17f0003a00 msgr2=0x7f17f0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.549+0000 7f180701a700 1 --2- 172.21.15.124:0/828631992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17f0003a00 0x7f17f0003e00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00c3c0 tx=0x7f17f0005880 comp rx=0 tx=0).stop 2023-10-16T12:59:11.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.549+0000 7f18055b7700 1 -- 172.21.15.124:0/828631992 reap_dead start 2023-10-16T12:59:11.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.550+0000 7f18055b7700 1 -- 172.21.15.124:0/828631992 reap_dead start 2023-10-16T12:59:11.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.550+0000 7f180701a700 1 -- 172.21.15.124:0/828631992 shutdown_connections 2023-10-16T12:59:11.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.550+0000 7f180701a700 1 -- 172.21.15.124:0/828631992 >> 172.21.15.124:0/828631992 conn(0x7f18000d0180 msgr2=0x7f18000d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:11.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.550+0000 7f4acb148700 1 -- 172.21.15.124:0/3789454521 shutdown_connections 2023-10-16T12:59:11.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.550+0000 7f180701a700 1 -- 172.21.15.124:0/828631992 shutdown_connections 2023-10-16T12:59:11.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.550+0000 7f180701a700 1 -- 172.21.15.124:0/828631992 wait complete. 2023-10-16T12:59:11.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.550+0000 7f4ceaadb700 1 -- 172.21.15.124:0/2717772225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ce4161a00 msgr2=0x7f4ce40cacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.571 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.550+0000 7f4ceaadb700 1 --2- 172.21.15.124:0/2717772225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ce4161a00 0x7f4ce40cacf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ce40730e0 tx=0x7f4cd4009bd0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.571 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.549+0000 7fa4e1e79700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa4dc15d9a0 0x7fa4dc0ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.571 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.549+0000 7fa4e1e79700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa4dc06daf0 0x7fa4dc06df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.572 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.549+0000 7fa4e1e79700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4dc06eba0 con 0x7fa4dc0ccd70 2023-10-16T12:59:11.572 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.549+0000 7fa4e1e79700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4dc15dd80 con 0x7fa4dc06daf0 2023-10-16T12:59:11.572 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.549+0000 7fa4e1e79700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4dc06e4b0 con 0x7fa4dc15d9a0 2023-10-16T12:59:11.572 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.549+0000 7fa4daffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa4dc06daf0 0x7fa4dc06df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.572 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.549+0000 7fa4daffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa4dc06daf0 0x7fa4dc06df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53600/0 (socket says 172.21.15.124:53600) 2023-10-16T12:59:11.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.549+0000 7fa4daffd700 1 -- 172.21.15.124:0/958666060 learned_addr learned my addr 172.21.15.124:0/958666060 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:11.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.549+0000 7fa4daffd700 1 -- 172.21.15.124:0/958666060 >> v2:172.21.15.192:3300/0 conn(0x7fa4dc15d9a0 msgr2=0x7fa4dc0ad1a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T12:59:11.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.549+0000 7fa4daffd700 1 --2- 172.21.15.124:0/958666060 >> v2:172.21.15.192:3300/0 conn(0x7fa4dc15d9a0 0x7fa4dc0ad1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.549+0000 7fa4daffd700 1 -- 172.21.15.124:0/958666060 >> v1:172.21.15.124:6789/0 conn(0x7fa4dc0ccd70 legacy=0x7fa4dc0cd200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T12:59:11.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.549+0000 7fa4daffd700 1 -- 172.21.15.124:0/958666060 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4dc06ee80 con 0x7fa4dc06daf0 2023-10-16T12:59:11.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.550+0000 7fa4daffd700 1 --2- 172.21.15.124:0/958666060 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4dc06daf0 0x7fa4dc06df70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc073100 tx=0x7fa4d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b2a7e6618f967d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.550+0000 7fa4da7fc700 1 -- 172.21.15.124:0/958666060 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d400e070 con 0x7fa4dc06daf0 2023-10-16T12:59:11.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.550+0000 7fa4da7fc700 1 -- 172.21.15.124:0/958666060 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d4003a20 con 0x7fa4dc06daf0 2023-10-16T12:59:11.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.550+0000 7fa4da7fc700 1 -- 172.21.15.124:0/958666060 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d4003dd0 con 0x7fa4dc06daf0 2023-10-16T12:59:11.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.551+0000 7fd35c83e700 1 Processor -- start 2023-10-16T12:59:11.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.551+0000 7fd35c83e700 1 -- start start 2023-10-16T12:59:11.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.551+0000 7f180701a700 1 Processor -- start 2023-10-16T12:59:11.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.551+0000 7f180701a700 1 -- start start 2023-10-16T12:59:11.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.551+0000 7f4ceaadb700 1 -- 172.21.15.124:0/2717772225 shutdown_connections 2023-10-16T12:59:11.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.551+0000 7f4ceaadb700 1 --2- 172.21.15.124:0/2717772225 >> v2:172.21.15.124:3300/0 conn(0x7f4ce40ccb90 0x7f4ce40cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.551+0000 7f4ceaadb700 1 --2- 172.21.15.124:0/2717772225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ce4161a00 0x7f4ce40cacf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.551+0000 7f4ceaadb700 1 --2- 172.21.15.124:0/2717772225 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ce40c9610 0x7f4ce40c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.551+0000 7f4ceaadb700 1 -- 172.21.15.124:0/2717772225 >> 172.21.15.124:0/2717772225 conn(0x7f4ce406c850 msgr2=0x7f4ce406cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:11.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.551+0000 7fa4e1e79700 1 -- 172.21.15.124:0/958666060 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4dc06daf0 msgr2=0x7fa4dc06df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.551+0000 7fa4e1e79700 1 --2- 172.21.15.124:0/958666060 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4dc06daf0 0x7fa4dc06df70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc073100 tx=0x7fa4d400b330 comp rx=0 tx=0).stop 2023-10-16T12:59:11.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.551+0000 7f4ceaadb700 1 -- 172.21.15.124:0/2717772225 shutdown_connections 2023-10-16T12:59:11.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.551+0000 7f4ceaadb700 1 -- 172.21.15.124:0/2717772225 wait complete. 2023-10-16T12:59:11.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.551+0000 7f4acb148700 1 -- 172.21.15.124:0/3789454521 wait complete. 2023-10-16T12:59:11.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.552+0000 7f4acb148700 1 Processor -- start 2023-10-16T12:59:11.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.552+0000 7f4acb148700 1 -- start start 2023-10-16T12:59:11.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.552+0000 7fd35c83e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3580c9dd0 0x7fd35815c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.552+0000 7fd35c83e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd35815f6c0 0x7fd3580cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.552+0000 7fd35c83e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd35806d6b0 con 0x7fd3580cba60 2023-10-16T12:59:11.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.552+0000 7fd35c83e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3580cc420 con 0x7fd35815f6c0 2023-10-16T12:59:11.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.552+0000 7fd35c83e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35815fea0 con 0x7fd3580c9dd0 2023-10-16T12:59:11.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.552+0000 7f180701a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1800152a60 0x7f180015c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7f180701a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1800153950 0x7f18000b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7f180701a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f180015cb90 0x7f18000b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7f180701a700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180015d030 con 0x7f180015cb90 2023-10-16T12:59:11.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7f180701a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18000c3d30 con 0x7f1800153950 2023-10-16T12:59:11.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7f180701a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18000c4010 con 0x7f1800152a60 2023-10-16T12:59:11.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7f18055b7700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f180015cb90 0x7f18000b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7f18055b7700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f180015cb90 0x7f18000b0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53606/0 (socket says 172.21.15.124:53606) 2023-10-16T12:59:11.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7f18055b7700 1 -- 172.21.15.124:0/1637757503 learned_addr learned my addr 172.21.15.124:0/1637757503 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:11.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7fd356d9d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd35815f6c0 0x7fd3580cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7fd356d9d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd35815f6c0 0x7fd3580cbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:33768/0 (socket says 172.21.15.124:33768) 2023-10-16T12:59:11.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7fd356d9d700 1 -- 172.21.15.124:0/4184939786 learned_addr learned my addr 172.21.15.124:0/4184939786 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:11.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7f1804db6700 1 --2- 172.21.15.124:0/1637757503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1800152a60 0x7f180015c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7f17fffff700 1 --2- 172.21.15.124:0/1637757503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1800153950 0x7f18000b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.554+0000 7fbe3e750700 1 Processor -- start 2023-10-16T12:59:11.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7fa4e1e79700 1 -- 172.21.15.124:0/958666060 shutdown_connections 2023-10-16T12:59:11.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7fa4e1e79700 1 --2- 172.21.15.124:0/958666060 >> v2:172.21.15.192:3300/0 conn(0x7fa4dc15d9a0 0x7fa4dc0ad1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7fa4e1e79700 1 --2- 172.21.15.124:0/958666060 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4dc06daf0 0x7fa4dc06df70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7fa4e1e79700 1 -- 172.21.15.124:0/958666060 >> 172.21.15.124:0/958666060 conn(0x7fa4dc0cbad0 msgr2=0x7fa4dc0cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:11.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.554+0000 7f4acb148700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4ac406e030 0x7f4ac4089550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.554+0000 7f4acb148700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac416eff0 0x7f4ac41643d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.554+0000 7f4acb148700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ac40afb10 0x7f4ac4164910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.554+0000 7f4acb148700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac41687e0 con 0x7f4ac406e030 2023-10-16T12:59:11.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.554+0000 7f4acb148700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac40b4470 con 0x7f4ac416eff0 2023-10-16T12:59:11.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.554+0000 7f4acb148700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac40b4750 con 0x7f4ac40afb10 2023-10-16T12:59:11.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.554+0000 7f4ac96e5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ac40afb10 0x7f4ac4164910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.554+0000 7f4ac96e5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ac40afb10 0x7f4ac4164910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:39690/0 (socket says 172.21.15.124:39690) 2023-10-16T12:59:11.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.554+0000 7f4ac96e5700 1 -- 172.21.15.124:0/3758092897 learned_addr learned my addr 172.21.15.124:0/3758092897 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:11.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.554+0000 7f4ac96e5700 1 -- 172.21.15.124:0/3758092897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac416eff0 msgr2=0x7f4ac41643d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T12:59:11.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.554+0000 7f4ac96e5700 1 --2- 172.21.15.124:0/3758092897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac416eff0 0x7f4ac41643d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.554+0000 7f4ac96e5700 1 -- 172.21.15.124:0/3758092897 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4ac406e030 msgr2=0x7f4ac4089550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.554+0000 7f4ac96e5700 1 --2- 172.21.15.124:0/3758092897 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4ac406e030 0x7f4ac4089550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.554+0000 7f4ac96e5700 1 -- 172.21.15.124:0/3758092897 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab80094a0 con 0x7f4ac40afb10 2023-10-16T12:59:11.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.554+0000 7f4ac96e5700 1 --2- 172.21.15.124:0/3758092897 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ac40afb10 0x7f4ac4164910 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4ab400c3c0 tx=0x7f4ab400c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7f18055b7700 1 -- 172.21.15.124:0/1637757503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1800152a60 msgr2=0x7f180015c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7f18055b7700 1 --2- 172.21.15.124:0/1637757503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1800152a60 0x7f180015c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7f18055b7700 1 -- 172.21.15.124:0/1637757503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1800153950 msgr2=0x7f18000b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7f18055b7700 1 --2- 172.21.15.124:0/1637757503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1800153950 0x7f18000b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7f18055b7700 1 -- 172.21.15.124:0/1637757503 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18000c42f0 con 0x7f180015cb90 2023-10-16T12:59:11.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7f18055b7700 1 --2- 172.21.15.124:0/1637757503 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f180015cb90 0x7f18000b0990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1800074a40 tx=0x7f17f800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.554+0000 7f17fd7fa700 1 -- 172.21.15.124:0/1637757503 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f800c870 con 0x7f180015cb90 2023-10-16T12:59:11.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.554+0000 7f17fd7fa700 1 -- 172.21.15.124:0/1637757503 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f800c9d0 con 0x7f180015cb90 2023-10-16T12:59:11.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.554+0000 7f17fd7fa700 1 -- 172.21.15.124:0/1637757503 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f800cd80 con 0x7f180015cb90 2023-10-16T12:59:11.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.554+0000 7f180701a700 1 -- 172.21.15.124:0/1637757503 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180015d310 con 0x7f180015cb90 2023-10-16T12:59:11.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.554+0000 7f180701a700 1 -- 172.21.15.124:0/1637757503 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1800153020 con 0x7f180015cb90 2023-10-16T12:59:11.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7f4ceaadb700 1 Processor -- start 2023-10-16T12:59:11.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7f4ceaadb700 1 -- start start 2023-10-16T12:59:11.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7f4ceaadb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ce40c9610 0x7f4ce415e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7f4ceaadb700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4ce40ccb90 0x7f4ce41fa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7f4ceaadb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ce4161a00 0x7f4ce4153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7f4ceaadb700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce4153fa0 con 0x7f4ce40ccb90 2023-10-16T12:59:11.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7f4ceaadb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce40c8bd0 con 0x7f4ce40c9610 2023-10-16T12:59:11.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7f4ceaadb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce41fb790 con 0x7f4ce4161a00 2023-10-16T12:59:11.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7f4ce8877700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ce40c9610 0x7f4ce415e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7f4ce8877700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ce40c9610 0x7f4ce415e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:33782/0 (socket says 172.21.15.124:33782) 2023-10-16T12:59:11.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7f4ce8877700 1 -- 172.21.15.124:0/2604095996 learned_addr learned my addr 172.21.15.124:0/2604095996 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:11.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7f4ce9078700 1 --2- 172.21.15.124:0/2604095996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ce4161a00 0x7f4ce4153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7fd356d9d700 1 -- 172.21.15.124:0/4184939786 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3580c9dd0 msgr2=0x7fd35815c620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T12:59:11.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7fd356d9d700 1 --2- 172.21.15.124:0/4184939786 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3580c9dd0 0x7fd35815c620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7fd356d9d700 1 -- 172.21.15.124:0/4184939786 >> v1:172.21.15.192:6789/0 conn(0x7fd3580cba60 legacy=0x7fd35815efb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T12:59:11.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7fd356d9d700 1 -- 172.21.15.124:0/4184939786 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35815fbc0 con 0x7fd35815f6c0 2023-10-16T12:59:11.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.553+0000 7fd356d9d700 1 --2- 172.21.15.124:0/4184939786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd35815f6c0 0x7fd3580cbee0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0098f0 tx=0x7fd34c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef27babb760db426 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.554+0000 7fd35559a700 1 -- 172.21.15.124:0/4184939786 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c004230 con 0x7fd35815f6c0 2023-10-16T12:59:11.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.554+0000 7fd35559a700 1 -- 172.21.15.124:0/4184939786 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c004390 con 0x7fd35815f6c0 2023-10-16T12:59:11.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.554+0000 7fd35559a700 1 -- 172.21.15.124:0/4184939786 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c0036a0 con 0x7fd35815f6c0 2023-10-16T12:59:11.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7fd35c83e700 1 -- 172.21.15.124:0/4184939786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd35815f6c0 msgr2=0x7fd3580cbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7fd35c83e700 1 --2- 172.21.15.124:0/4184939786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd35815f6c0 0x7fd3580cbee0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0098f0 tx=0x7fd34c009c00 comp rx=0 tx=0).stop 2023-10-16T12:59:11.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7fbe3e750700 1 -- start start 2023-10-16T12:59:11.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.556+0000 7fbe3e750700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbe380c2990 0x7fbe38166350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.556+0000 7fbe3e750700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe380cd930 0x7fbe38070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.556+0000 7fbe3e750700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe380aeae0 con 0x7fbe380cd550 2023-10-16T12:59:11.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.556+0000 7fbe3e750700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe38074ba0 con 0x7fbe380c2990 2023-10-16T12:59:11.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.556+0000 7fbe3e750700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe380aed30 con 0x7fbe380cd930 2023-10-16T12:59:11.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.557+0000 7fbe37fff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fbe380cd550 0x7fbe38165c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42290/0 (socket says 172.21.15.124:42290) 2023-10-16T12:59:11.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.557+0000 7fbe37fff700 1 -- 172.21.15.124:0/719255170 learned_addr learned my addr 172.21.15.124:0/719255170 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:11.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7fa4e1e79700 1 -- 172.21.15.124:0/958666060 shutdown_connections 2023-10-16T12:59:11.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7fa4e1e79700 1 -- 172.21.15.124:0/958666060 wait complete. 2023-10-16T12:59:11.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7f4ac17fa700 1 -- 172.21.15.124:0/3758092897 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4005d70 con 0x7f4ac40afb10 2023-10-16T12:59:11.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7f4ac17fa700 1 -- 172.21.15.124:0/3758092897 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab40070d0 con 0x7f4ac40afb10 2023-10-16T12:59:11.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7f4ac17fa700 1 -- 172.21.15.124:0/3758092897 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4007460 con 0x7f4ac40afb10 2023-10-16T12:59:11.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7f4ce8877700 1 -- 172.21.15.124:0/2604095996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ce4161a00 msgr2=0x7f4ce4153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7f4ce8877700 1 --2- 172.21.15.124:0/2604095996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ce4161a00 0x7f4ce4153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7f4ce8877700 1 -- 172.21.15.124:0/2604095996 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4ce40ccb90 msgr2=0x7f4ce41fa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7f4ce8877700 1 --2- 172.21.15.124:0/2604095996 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4ce40ccb90 0x7f4ce41fa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7f4ce8877700 1 -- 172.21.15.124:0/2604095996 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd4009550 con 0x7f4ce40c9610 2023-10-16T12:59:11.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7f4ce9078700 1 --2- 172.21.15.124:0/2604095996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ce4161a00 0x7f4ce4153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:11.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.556+0000 7f4ce8877700 1 --2- 172.21.15.124:0/2604095996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ce40c9610 0x7f4ce415e080 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009c10 tx=0x7f4cd4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.556+0000 7f4ce17fa700 1 -- 172.21.15.124:0/2604095996 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4004510 con 0x7f4ce40c9610 2023-10-16T12:59:11.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.556+0000 7f4ce17fa700 1 -- 172.21.15.124:0/2604095996 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd401e070 con 0x7f4ce40c9610 2023-10-16T12:59:11.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.556+0000 7f4ce17fa700 1 -- 172.21.15.124:0/2604095996 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd40038c0 con 0x7f4ce40c9610 2023-10-16T12:59:11.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.556+0000 7f4ceaadb700 1 -- 172.21.15.124:0/2604095996 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce41faef0 con 0x7f4ce40c9610 2023-10-16T12:59:11.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.557+0000 7f4ceaadb700 1 -- 172.21.15.124:0/2604095996 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce41fb4b0 con 0x7f4ce40c9610 2023-10-16T12:59:11.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7fd35c83e700 1 -- 172.21.15.124:0/4184939786 shutdown_connections 2023-10-16T12:59:11.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7fd35c83e700 1 --2- 172.21.15.124:0/4184939786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd35815f6c0 0x7fd3580cbee0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7fd35c83e700 1 --2- 172.21.15.124:0/4184939786 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3580c9dd0 0x7fd35815c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7fd35c83e700 1 -- 172.21.15.124:0/4184939786 >> 172.21.15.124:0/4184939786 conn(0x7fd35806c850 msgr2=0x7fd35806cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:11.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7fd35c83e700 1 -- 172.21.15.124:0/4184939786 shutdown_connections 2023-10-16T12:59:11.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7fd35c83e700 1 -- 172.21.15.124:0/4184939786 wait complete. 2023-10-16T12:59:11.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.557+0000 7fd35c83e700 1 Processor -- start 2023-10-16T12:59:11.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.557+0000 7fa4e1e79700 1 Processor -- start 2023-10-16T12:59:11.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.557+0000 7fa4e1e79700 1 -- start start 2023-10-16T12:59:11.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.558+0000 7f180701a700 1 -- 172.21.15.124:0/1637757503 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f17e0000fc0 con 0x7f180015cb90 2023-10-16T12:59:11.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.558+0000 7fbe377fe700 1 --2- 172.21.15.124:0/719255170 >> v2:172.21.15.192:3300/0 conn(0x7fbe380c2990 0x7fbe38166350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7f1df9e5f700 1 Processor -- start 2023-10-16T12:59:11.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.555+0000 7f1df9e5f700 1 -- start start 2023-10-16T12:59:11.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.556+0000 7f1df9e5f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1df40cd5a0 0x7f1df40c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.556+0000 7f1df9e5f700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f1df40cb230 0x7f1df40c5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.556+0000 7f1df9e5f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df40c4970 con 0x7f1df406daf0 2023-10-16T12:59:11.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.556+0000 7f1df9e5f700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df40c4040 con 0x7f1df40cb230 2023-10-16T12:59:11.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.558+0000 7f4ceaadb700 1 -- 172.21.15.124:0/2604095996 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4ce40c4370 con 0x7f4ce40c9610 2023-10-16T12:59:11.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.556+0000 7f1df9e5f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df40c4320 con 0x7f1df40cd5a0 2023-10-16T12:59:11.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.558+0000 7fbe3cced700 1 --2- 172.21.15.124:0/719255170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe380cd930 0x7fbe38070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.557+0000 7fd35c83e700 1 -- start start 2023-10-16T12:59:11.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.558+0000 7fbe377fe700 1 -- 172.21.15.124:0/719255170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe380cd930 msgr2=0x7fbe38070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:11.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.558+0000 7fbe377fe700 1 --2- 172.21.15.124:0/719255170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe380cd930 0x7fbe38070ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.558+0000 7fbe377fe700 1 -- 172.21.15.124:0/719255170 >> v1:172.21.15.124:6789/0 conn(0x7fbe380cd550 legacy=0x7fbe38165c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.558+0000 7fbe377fe700 1 -- 172.21.15.124:0/719255170 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe380cae40 con 0x7fbe380c2990 2023-10-16T12:59:11.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.558+0000 7fbe377fe700 1 --2- 172.21.15.124:0/719255170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe380c2990 0x7fbe38166350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe28009840 tx=0x7fbe28009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=217a08f79fdde3ae server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.558+0000 7f1df2ffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1df40cd5a0 0x7f1df40c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.558+0000 7fd35c83e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3580c9dd0 0x7fd3580c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.558+0000 7fd35c83e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3580cba60 0x7fd3580b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.558+0000 7fd35c83e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd35815f6c0 0x7fd358202f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.558+0000 7fd35c83e700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580af6c0 con 0x7fd35815f6c0 2023-10-16T12:59:11.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.558+0000 7fd35c83e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580c8a90 con 0x7fd3580cba60 2023-10-16T12:59:11.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.558+0000 7fd35c83e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd358154570 con 0x7fd3580c9dd0 2023-10-16T12:59:11.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7f1df37fe700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f1df406daf0 0x7f1df406ded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.124:54290/0 (socket says 172.21.15.124:54290) 2023-10-16T12:59:11.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7f1df37fe700 1 -- 172.21.15.124:0/2800307636 learned_addr learned my addr 172.21.15.124:0/2800307636 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:11.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.558+0000 7f4acb148700 1 -- 172.21.15.124:0/3758092897 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac40b4a30 con 0x7f4ac40afb10 2023-10-16T12:59:11.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.558+0000 7f4acb148700 1 -- 172.21.15.124:0/3758092897 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac40b4ff0 con 0x7f4ac40afb10 2023-10-16T12:59:11.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7fbe36ffd700 1 -- 172.21.15.124:0/719255170 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28011830 con 0x7fbe380c2990 2023-10-16T12:59:11.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7fbe36ffd700 1 -- 172.21.15.124:0/719255170 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe28011990 con 0x7fbe380c2990 2023-10-16T12:59:11.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7fa4e1e79700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4dc06daf0 0x7fa4dc0aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7fa4e1e79700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4dc0ccd70 0x7fa4dc0c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7fa4e1e79700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa4dc15d9a0 0x7fa4dc153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7fa4e1e79700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc0c8290 con 0x7fa4dc0ccd70 2023-10-16T12:59:11.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7fa4e1e79700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc0af1f0 con 0x7fa4dc06daf0 2023-10-16T12:59:11.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7fa4e1e79700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc0af4d0 con 0x7fa4dc15d9a0 2023-10-16T12:59:11.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7fd355d9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3580cba60 0x7fd3580b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7fd35659c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3580c9dd0 0x7fd3580c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7fd35659c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3580c9dd0 0x7fd3580c7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:39714/0 (socket says 172.21.15.124:39714) 2023-10-16T12:59:11.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7fd35659c700 1 -- 172.21.15.124:0/983462000 learned_addr learned my addr 172.21.15.124:0/983462000 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:11.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7fd356d9d700 1 --2- 172.21.15.124:0/983462000 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd35815f6c0 0x7fd358202f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7fbe36ffd700 1 -- 172.21.15.124:0/719255170 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28011d20 con 0x7fbe380c2990 2023-10-16T12:59:11.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7f4acb148700 1 -- 172.21.15.124:0/3758092897 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4ac406ea60 con 0x7f4ac40afb10 2023-10-16T12:59:11.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7f17fd7fa700 1 -- 172.21.15.124:0/1637757503 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f17f8012070 con 0x7f180015cb90 2023-10-16T12:59:11.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7fd356d9d700 1 -- 172.21.15.124:0/983462000 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3580c9dd0 msgr2=0x7fd3580c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7fd356d9d700 1 --2- 172.21.15.124:0/983462000 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3580c9dd0 0x7fd3580c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7fd356d9d700 1 -- 172.21.15.124:0/983462000 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3580cba60 msgr2=0x7fd3580b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7fd356d9d700 1 --2- 172.21.15.124:0/983462000 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3580cba60 0x7fd3580b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7fd356d9d700 1 -- 172.21.15.124:0/983462000 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c009550 con 0x7fd35815f6c0 2023-10-16T12:59:11.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7fbe3e750700 1 -- 172.21.15.124:0/719255170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe380c2990 msgr2=0x7fbe38166350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7fbe3e750700 1 --2- 172.21.15.124:0/719255170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe380c2990 0x7fbe38166350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe28009840 tx=0x7fbe28009b50 comp rx=0 tx=0).stop 2023-10-16T12:59:11.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7fa4daffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4dc0ccd70 0x7fa4dc0c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7fa4daffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4dc0ccd70 0x7fa4dc0c7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53642/0 (socket says 172.21.15.124:53642) 2023-10-16T12:59:11.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7fa4daffd700 1 -- 172.21.15.124:0/1213904966 learned_addr learned my addr 172.21.15.124:0/1213904966 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:11.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7fa4daffd700 1 -- 172.21.15.124:0/1213904966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa4dc15d9a0 msgr2=0x7fa4dc153790 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T12:59:11.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7fa4daffd700 1 --2- 172.21.15.124:0/1213904966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa4dc15d9a0 0x7fa4dc153790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7fa4daffd700 1 -- 172.21.15.124:0/1213904966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4dc06daf0 msgr2=0x7fa4dc0aeb10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T12:59:11.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7fa4daffd700 1 --2- 172.21.15.124:0/1213904966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4dc06daf0 0x7fa4dc0aeb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.559+0000 7fa4daffd700 1 -- 172.21.15.124:0/1213904966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d4009b30 con 0x7fa4dc0ccd70 2023-10-16T12:59:11.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7fa4daffd700 1 --2- 172.21.15.124:0/1213904966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4dc0ccd70 0x7fa4dc0c7d50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4000f80 tx=0x7fa4d4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f17fd7fa700 1 --2- 172.21.15.124:0/1637757503 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f17e406af00 0x7f17e406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f17fd7fa700 1 -- 172.21.15.124:0/1637757503 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f17f8089b70 con 0x7f180015cb90 2023-10-16T12:59:11.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f1804db6700 1 --2- 172.21.15.124:0/1637757503 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f17e406af00 0x7f17e406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f17fd7fa700 1 --2- 172.21.15.124:0/1637757503 >> [v2:172.21.15.124:6824/115265899,v1:172.21.15.124:6825/115265899] conn(0x7f17e40744c0 0x7f17e4076900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f17fd7fa700 1 -- 172.21.15.124:0/1637757503 --> [v2:172.21.15.124:6824/115265899,v1:172.21.15.124:6825/115265899] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f17e4076fd0 con 0x7f17e40744c0 2023-10-16T12:59:11.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f17fd7fa700 1 -- 172.21.15.124:0/1637757503 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17f8089fc0 con 0x7f180015cb90 2023-10-16T12:59:11.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f1df27fc700 1 -- 172.21.15.124:0/2800307636 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925855530 0 0) 0x7f1df40c4970 con 0x7f1df406daf0 2023-10-16T12:59:11.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f1df27fc700 1 -- 172.21.15.124:0/2800307636 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ddc0035b0 con 0x7f1df406daf0 2023-10-16T12:59:11.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f1df27fc700 1 -- 172.21.15.124:0/2800307636 <== mon.1 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 976528046 0 0) 0x7f1ddc0035b0 con 0x7f1df406daf0 2023-10-16T12:59:11.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f1df3fff700 1 --2- 172.21.15.124:0/2800307636 >> v2:172.21.15.124:3300/0 conn(0x7f1df40cb230 0x7f1df40c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f1df27fc700 1 -- 172.21.15.124:0/2800307636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1df40cd5a0 msgr2=0x7f1df40c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:11.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f1df27fc700 1 --2- 172.21.15.124:0/2800307636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1df40cd5a0 0x7f1df40c4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f1df27fc700 1 -- 172.21.15.124:0/2800307636 >> v2:172.21.15.124:3300/0 conn(0x7f1df40cb230 msgr2=0x7f1df40c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:11.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f1df27fc700 1 --2- 172.21.15.124:0/2800307636 >> v2:172.21.15.124:3300/0 conn(0x7f1df40cb230 0x7f1df40c5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f1df27fc700 1 -- 172.21.15.124:0/2800307636 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df40c4600 con 0x7f1df406daf0 2023-10-16T12:59:11.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f1df27fc700 1 -- 172.21.15.124:0/2800307636 <== mon.1 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f1dec0019f0 con 0x7f1df406daf0 2023-10-16T12:59:11.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f1df27fc700 1 -- 172.21.15.124:0/2800307636 >> v1:172.21.15.192:6789/0 conn(0x7f1df406daf0 legacy=0x7f1df406ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f1df27fc700 1 --2- 172.21.15.124:0/2800307636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ddc003a30 0x7f1ddc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f1df27fc700 1 --2- 172.21.15.124:0/2800307636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ddc004420 0x7f1ddc0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f1df27fc700 1 --2- 172.21.15.124:0/2800307636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1ddc005140 0x7f1ddc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f1df27fc700 1 -- 172.21.15.124:0/2800307636 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df40c4040 con 0x7f1ddc005140 2023-10-16T12:59:11.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f1df27fc700 1 -- 172.21.15.124:0/2800307636 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df40c4320 con 0x7f1ddc003a30 2023-10-16T12:59:11.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f1df27fc700 1 -- 172.21.15.124:0/2800307636 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc00c0e0 con 0x7f1ddc004420 2023-10-16T12:59:11.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f17fffff700 1 --2- 172.21.15.124:0/1637757503 >> [v2:172.21.15.124:6824/115265899,v1:172.21.15.124:6825/115265899] conn(0x7f17e40744c0 0x7f17e4076900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.561+0000 7f1804db6700 1 --2- 172.21.15.124:0/1637757503 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f17e406af00 0x7f17e406d3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0048d0 tx=0x7f17ec00a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7f1df3fff700 1 --2- 172.21.15.124:0/2800307636 >> v2:172.21.15.124:3300/0 conn(0x7f1df40cb230 0x7f1df40c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:11.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.561+0000 7f1df2ffd700 1 --2- 172.21.15.124:0/2800307636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ddc004420 0x7f1ddc0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.561+0000 7f1df3fff700 1 --2- 172.21.15.124:0/2800307636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1ddc005140 0x7f1ddc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.561+0000 7f17fffff700 1 --2- 172.21.15.124:0/1637757503 >> [v2:172.21.15.124:6824/115265899,v1:172.21.15.124:6825/115265899] conn(0x7f17e40744c0 0x7f17e4076900 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7fd35659c700 1 --2- 172.21.15.124:0/983462000 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3580c9dd0 0x7fd3580c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:59:11.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.560+0000 7fd356d9d700 1 --2- 172.21.15.124:0/983462000 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd35815f6c0 0x7fd358202f10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd34c015000 tx=0x7fd34c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.561+0000 7f4ce17fa700 1 -- 172.21.15.124:0/2604095996 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4cd4003a20 con 0x7f4ce40c9610 2023-10-16T12:59:11.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.561+0000 7fbe3e750700 1 -- 172.21.15.124:0/719255170 shutdown_connections 2023-10-16T12:59:11.632 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.561+0000 7fbe3e750700 1 --2- 172.21.15.124:0/719255170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe380cd930 0x7fbe38070ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.632 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.561+0000 7fbe3e750700 1 --2- 172.21.15.124:0/719255170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe380c2990 0x7fbe38166350 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.632 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.561+0000 7fbe3e750700 1 -- 172.21.15.124:0/719255170 >> 172.21.15.124:0/719255170 conn(0x7fbe380b1100 msgr2=0x7fbe380b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:11.632 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.561+0000 7fa4c3fff700 1 -- 172.21.15.124:0/1213904966 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d40042c0 con 0x7fa4dc0ccd70 2023-10-16T12:59:11.633 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.561+0000 7fa4e1e79700 1 -- 172.21.15.124:0/1213904966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4dc0af7b0 con 0x7fa4dc0ccd70 2023-10-16T12:59:11.633 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.561+0000 7fa4e1e79700 1 -- 172.21.15.124:0/1213904966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4dc0afd70 con 0x7fa4dc0ccd70 2023-10-16T12:59:11.633 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.561+0000 7f1df37fe700 1 --2- 172.21.15.124:0/2800307636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ddc003a30 0x7f1ddc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.634 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7f4ce17fa700 1 --2- 172.21.15.124:0/2604095996 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f4cd006af50 0x7f4cd006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.634 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.561+0000 7f4ac17fa700 1 -- 172.21.15.124:0/3758092897 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4ab40075c0 con 0x7f4ac40afb10 2023-10-16T12:59:11.634 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.561+0000 7f4ac17fa700 1 --2- 172.21.15.124:0/3758092897 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f4aa806af20 0x7f4aa806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7f4ac17fa700 1 -- 172.21.15.124:0/3758092897 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4ab4089410 con 0x7f4ac40afb10 2023-10-16T12:59:11.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7f4ac8ee4700 1 --2- 172.21.15.124:0/3758092897 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f4aa806af20 0x7f4aa806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7f4ac17fa700 1 --2- 172.21.15.124:0/3758092897 >> [v2:172.21.15.124:6816/2753229488,v1:172.21.15.124:6817/2753229488] conn(0x7f4aa8074560 0x7f4aa80769a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7f4ac17fa700 1 -- 172.21.15.124:0/3758092897 --> [v2:172.21.15.124:6816/2753229488,v1:172.21.15.124:6817/2753229488] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4aa8077070 con 0x7f4aa8074560 2023-10-16T12:59:11.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7f4ac17fa700 1 -- 172.21.15.124:0/3758092897 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ab40898b0 con 0x7f4ac40afb10 2023-10-16T12:59:11.636 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7fbe3e750700 1 -- 172.21.15.124:0/719255170 shutdown_connections 2023-10-16T12:59:11.636 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7f4ce17fa700 1 -- 172.21.15.124:0/2604095996 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4cd408ac70 con 0x7f4ce40c9610 2023-10-16T12:59:11.637 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7f4ce17fa700 1 --2- 172.21.15.124:0/2604095996 >> [v2:172.21.15.192:6816/651957595,v1:172.21.15.192:6818/651957595] conn(0x7f4cd0074590 0x7f4cd00769d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.637 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7f4ce17fa700 1 -- 172.21.15.124:0/2604095996 --> [v2:172.21.15.192:6816/651957595,v1:172.21.15.192:6818/651957595] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4cd00770a0 con 0x7f4cd0074590 2023-10-16T12:59:11.637 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7f4ce17fa700 1 -- 172.21.15.124:0/2604095996 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4cd408b110 con 0x7f4ce40c9610 2023-10-16T12:59:11.637 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7f4ce3fff700 1 --2- 172.21.15.124:0/2604095996 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f4cd006af50 0x7f4cd006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.638 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7fa4e1e79700 1 -- 172.21.15.124:0/1213904966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa4dc0c98f0 con 0x7fa4dc0ccd70 2023-10-16T12:59:11.638 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7f4ac3fff700 1 --2- 172.21.15.124:0/3758092897 >> [v2:172.21.15.124:6816/2753229488,v1:172.21.15.124:6817/2753229488] conn(0x7f4aa8074560 0x7f4aa80769a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.639 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7f4ac8ee4700 1 --2- 172.21.15.124:0/3758092897 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f4aa806af20 0x7f4aa806d3e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4067640 tx=0x7f4abc009230 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.639 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.563+0000 7f4ac3fff700 1 --2- 172.21.15.124:0/3758092897 >> [v2:172.21.15.124:6816/2753229488,v1:172.21.15.124:6817/2753229488] conn(0x7f4aa8074560 0x7f4aa80769a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7f17fd7fa700 1 -- 172.21.15.124:0/1637757503 <== osd.3 v2:172.21.15.124:6824/115265899 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f17e4076fd0 con 0x7f17e40744c0 2023-10-16T12:59:11.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7f1df2ffd700 1 -- 172.21.15.124:0/2800307636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ddc003a30 msgr2=0x7f1ddc003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:11.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7f1df2ffd700 1 --2- 172.21.15.124:0/2800307636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ddc003a30 0x7f1ddc003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7f1df2ffd700 1 -- 172.21.15.124:0/2800307636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1ddc005140 msgr2=0x7f1ddc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:11.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7f1df2ffd700 1 --2- 172.21.15.124:0/2800307636 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1ddc005140 0x7f1ddc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7f1df2ffd700 1 -- 172.21.15.124:0/2800307636 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df40c4600 con 0x7f1ddc004420 2023-10-16T12:59:11.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7f1df2ffd700 1 --2- 172.21.15.124:0/2800307636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ddc004420 0x7f1ddc0048f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1df406d8b0 tx=0x7f1ddc005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40d0d60c19e74c8d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.563+0000 7f1df27fc700 1 -- 172.21.15.124:0/2800307636 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de400e4d0 con 0x7f1ddc004420 2023-10-16T12:59:11.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7f4ce9078700 1 --2- 172.21.15.124:0/2604095996 >> [v2:172.21.15.192:6816/651957595,v1:172.21.15.192:6818/651957595] conn(0x7f4cd0074590 0x7f4cd00769d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7fd346ffd700 1 -- 172.21.15.124:0/983462000 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c003e90 con 0x7fd35815f6c0 2023-10-16T12:59:11.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7fd346ffd700 1 -- 172.21.15.124:0/983462000 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c00b660 con 0x7fd35815f6c0 2023-10-16T12:59:11.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7fd346ffd700 1 -- 172.21.15.124:0/983462000 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c00b9f0 con 0x7fd35815f6c0 2023-10-16T12:59:11.643 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.563+0000 7f4ce3fff700 1 --2- 172.21.15.124:0/2604095996 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f4cd006af50 0x7f4cd006d410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4ce415e5c0 tx=0x7f4cdc00d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.643 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.563+0000 7f4ce9078700 1 --2- 172.21.15.124:0/2604095996 >> [v2:172.21.15.192:6816/651957595,v1:172.21.15.192:6818/651957595] conn(0x7f4cd0074590 0x7f4cd00769d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.563+0000 7f1df27fc700 1 -- 172.21.15.124:0/2800307636 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de400e630 con 0x7f1ddc004420 2023-10-16T12:59:11.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.563+0000 7f1df27fc700 1 -- 172.21.15.124:0/2800307636 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de400e9c0 con 0x7f1ddc004420 2023-10-16T12:59:11.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.562+0000 7fbe3e750700 1 -- 172.21.15.124:0/719255170 wait complete. 2023-10-16T12:59:11.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.564+0000 7f1df9e5f700 1 -- 172.21.15.124:0/2800307636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ddc004420 msgr2=0x7f1ddc0048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.564+0000 7f1df9e5f700 1 --2- 172.21.15.124:0/2800307636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ddc004420 0x7f1ddc0048f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1df406d8b0 tx=0x7f1ddc005880 comp rx=0 tx=0).stop 2023-10-16T12:59:11.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.564+0000 7f1df3fff700 1 -- 172.21.15.124:0/2800307636 reap_dead start 2023-10-16T12:59:11.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.564+0000 7f4ac17fa700 1 -- 172.21.15.124:0/3758092897 <== osd.2 v2:172.21.15.124:6816/2753229488 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f4aa8077070 con 0x7f4aa8074560 2023-10-16T12:59:11.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.564+0000 7fbe3e750700 1 Processor -- start 2023-10-16T12:59:11.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.564+0000 7fa4c3fff700 1 -- 172.21.15.124:0/1213904966 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d4004420 con 0x7fa4dc0ccd70 2023-10-16T12:59:11.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.564+0000 7fa4c3fff700 1 -- 172.21.15.124:0/1213904966 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d4004790 con 0x7fa4dc0ccd70 2023-10-16T12:59:11.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.564+0000 7f4ce17fa700 1 -- 172.21.15.124:0/2604095996 <== osd.5 v2:172.21.15.192:6816/651957595 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f4cd00770a0 con 0x7f4cd0074590 2023-10-16T12:59:11.648 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.566+0000 7fa4c3fff700 1 -- 172.21.15.124:0/1213904966 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa4d4019070 con 0x7fa4dc0ccd70 2023-10-16T12:59:11.649 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.566+0000 7fa4c3fff700 1 --2- 172.21.15.124:0/1213904966 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa4c806af00 0x7fa4c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.649 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.566+0000 7fa4c3fff700 1 -- 172.21.15.124:0/1213904966 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa4d408a970 con 0x7fa4dc0ccd70 2023-10-16T12:59:11.649 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.566+0000 7fa4db7fe700 1 --2- 172.21.15.124:0/1213904966 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa4c806af00 0x7fa4c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.649 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.566+0000 7fa4c3fff700 1 --2- 172.21.15.124:0/1213904966 >> [v2:172.21.15.124:6808/1996055598,v1:172.21.15.124:6809/1996055598] conn(0x7fa4c8074440 0x7fa4c8076880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.649 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.566+0000 7fa4c3fff700 1 -- 172.21.15.124:0/1213904966 --> [v2:172.21.15.124:6808/1996055598,v1:172.21.15.124:6809/1996055598] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa4c8076f50 con 0x7fa4c8074440 2023-10-16T12:59:11.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.566+0000 7fa4dbfff700 1 --2- 172.21.15.124:0/1213904966 >> [v2:172.21.15.124:6808/1996055598,v1:172.21.15.124:6809/1996055598] conn(0x7fa4c8074440 0x7fa4c8076880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.567+0000 7fa4db7fe700 1 --2- 172.21.15.124:0/1213904966 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa4c806af00 0x7fa4c806d3c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc006fd0 tx=0x7fa4cc006bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.567+0000 7fa4dbfff700 1 --2- 172.21.15.124:0/1213904966 >> [v2:172.21.15.124:6808/1996055598,v1:172.21.15.124:6809/1996055598] conn(0x7fa4c8074440 0x7fa4c8076880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.651 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.566+0000 7fbe3e750700 1 -- start start 2023-10-16T12:59:11.651 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.567+0000 7fbe3e750700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbe380c2990 0x7fbe3814a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.651 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.567+0000 7fbe3e750700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe380cd550 0x7fbe3815dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.651 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.567+0000 7fbe3e750700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe380cd930 0x7fbe3815e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.651 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.567+0000 7fbe3e750700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe38159600 con 0x7fbe380c2990 2023-10-16T12:59:11.652 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.567+0000 7fbe3e750700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe381502a0 con 0x7fbe380cd550 2023-10-16T12:59:11.652 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.567+0000 7fbe3e750700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe38159320 con 0x7fbe380cd930 2023-10-16T12:59:11.652 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.567+0000 7fbe37fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbe380c2990 0x7fbe3814a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.652 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.567+0000 7fbe37fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbe380c2990 0x7fbe3814a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53668/0 (socket says 172.21.15.124:53668) 2023-10-16T12:59:11.652 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.567+0000 7fbe37fff700 1 -- 172.21.15.124:0/1910871522 learned_addr learned my addr 172.21.15.124:0/1910871522 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:11.653 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.568+0000 7fbe377fe700 1 --2- 172.21.15.124:0/1910871522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe380cd550 0x7fbe3815dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.653 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.568+0000 7fbe3cced700 1 --2- 172.21.15.124:0/1910871522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe380cd930 0x7fbe3815e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.653 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.568+0000 7fa4c3fff700 1 -- 172.21.15.124:0/1213904966 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4d4055740 con 0x7fa4dc0ccd70 2023-10-16T12:59:11.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.568+0000 7fbe37fff700 1 -- 172.21.15.124:0/1910871522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe380cd930 msgr2=0x7fbe3815e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.568+0000 7fbe37fff700 1 --2- 172.21.15.124:0/1910871522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe380cd930 0x7fbe3815e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.568+0000 7fbe37fff700 1 -- 172.21.15.124:0/1910871522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe380cd550 msgr2=0x7fbe3815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.568+0000 7fbe37fff700 1 --2- 172.21.15.124:0/1910871522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe380cd550 0x7fbe3815dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.568+0000 7fbe37fff700 1 -- 172.21.15.124:0/1910871522 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe280094a0 con 0x7fbe380c2990 2023-10-16T12:59:11.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.568+0000 7fa4c3fff700 1 -- 172.21.15.124:0/1213904966 <== osd.1 v2:172.21.15.124:6808/1996055598 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fa4c8076f50 con 0x7fa4c8074440 2023-10-16T12:59:11.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.568+0000 7fbe37fff700 1 --2- 172.21.15.124:0/1910871522 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbe380c2990 0x7fbe3814a2d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbe3000cba0 tx=0x7fbe3000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.569+0000 7fbe34ff9700 1 -- 172.21.15.124:0/1910871522 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3000aaa0 con 0x7fbe380c2990 2023-10-16T12:59:11.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.569+0000 7fbe34ff9700 1 -- 172.21.15.124:0/1910871522 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3000ac00 con 0x7fbe380c2990 2023-10-16T12:59:11.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.569+0000 7fbe34ff9700 1 -- 172.21.15.124:0/1910871522 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30012400 con 0x7fbe380c2990 2023-10-16T12:59:11.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.569+0000 7fbe3e750700 1 -- 172.21.15.124:0/1910871522 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe381504b0 con 0x7fbe380c2990 2023-10-16T12:59:11.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.569+0000 7fbe3e750700 1 -- 172.21.15.124:0/1910871522 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe38150a70 con 0x7fbe380c2990 2023-10-16T12:59:11.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.571+0000 7fbe34ff9700 1 -- 172.21.15.124:0/1910871522 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbe3001b3b0 con 0x7fbe380c2990 2023-10-16T12:59:11.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.571+0000 7fbe34ff9700 1 --2- 172.21.15.124:0/1910871522 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbe2406af50 0x7fbe2406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.571+0000 7fbe34ff9700 1 -- 172.21.15.124:0/1910871522 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbe30089370 con 0x7fbe380c2990 2023-10-16T12:59:11.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.572+0000 7fbe377fe700 1 --2- 172.21.15.124:0/1910871522 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbe2406af50 0x7fbe2406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.573+0000 7fbe377fe700 1 --2- 172.21.15.124:0/1910871522 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbe2406af50 0x7fbe2406d410 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbe28000c00 tx=0x7fbe2801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.568+0000 7fd35c83e700 1 -- 172.21.15.124:0/983462000 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3580c81f0 con 0x7fd35815f6c0 2023-10-16T12:59:11.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.568+0000 7fd35c83e700 1 -- 172.21.15.124:0/983462000 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3580c87b0 con 0x7fd35815f6c0 2023-10-16T12:59:11.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.571+0000 7fd346ffd700 1 -- 172.21.15.124:0/983462000 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd34c021070 con 0x7fd35815f6c0 2023-10-16T12:59:11.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.572+0000 7fd346ffd700 1 --2- 172.21.15.124:0/983462000 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd33806af50 0x7fd33806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.572+0000 7fd346ffd700 1 -- 172.21.15.124:0/983462000 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd34c08acd0 con 0x7fd35815f6c0 2023-10-16T12:59:11.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.574+0000 7fd35c83e700 1 --2- 172.21.15.124:0/983462000 >> [v2:172.21.15.192:6800/213455189,v1:172.21.15.192:6801/213455189] conn(0x7fd3580712b0 0x7fd358203450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.574+0000 7fd35c83e700 1 -- 172.21.15.124:0/983462000 --> [v2:172.21.15.192:6800/213455189,v1:172.21.15.192:6801/213455189] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd35815bb40 con 0x7fd3580712b0 2023-10-16T12:59:11.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.574+0000 7fd355d9b700 1 --2- 172.21.15.124:0/983462000 >> [v2:172.21.15.192:6800/213455189,v1:172.21.15.192:6801/213455189] conn(0x7fd3580712b0 0x7fd358203450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.574+0000 7fd355d9b700 1 --2- 172.21.15.124:0/983462000 >> [v2:172.21.15.192:6800/213455189,v1:172.21.15.192:6801/213455189] conn(0x7fd3580712b0 0x7fd358203450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.575+0000 7fd346ffd700 1 -- 172.21.15.124:0/983462000 <== osd.7 v2:172.21.15.192:6800/213455189 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fd3480099a0 con 0x7fd3580712b0 2023-10-16T12:59:11.661 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.576+0000 7fb428c2a700 1 Processor -- start 2023-10-16T12:59:11.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.576+0000 7fb428c2a700 1 -- start start 2023-10-16T12:59:11.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.577+0000 7fb428c2a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb42415daa0 0x7fb4240af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.577+0000 7fb428c2a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb4240af560 0x7fb424071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.577+0000 7fb428c2a700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb42415ed10 con 0x7fb424071d90 2023-10-16T12:59:11.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.577+0000 7fb428c2a700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4240721a0 con 0x7fb4240af560 2023-10-16T12:59:11.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.577+0000 7fb428c2a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb42415de80 con 0x7fb42415daa0 2023-10-16T12:59:11.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.577+0000 7fb42259c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb42415daa0 0x7fb4240af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.577+0000 7fb42259c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb42415daa0 0x7fb4240af020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:33844/0 (socket says 172.21.15.124:33844) 2023-10-16T12:59:11.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.577+0000 7fb42259c700 1 -- 172.21.15.124:0/2027558457 learned_addr learned my addr 172.21.15.124:0/2027558457 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:11.664 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.577+0000 7fb42259c700 1 -- 172.21.15.124:0/2027558457 >> v2:172.21.15.124:3300/0 conn(0x7fb4240af560 msgr2=0x7fb424071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:11.664 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.577+0000 7fb42259c700 1 --2- 172.21.15.124:0/2027558457 >> v2:172.21.15.124:3300/0 conn(0x7fb4240af560 0x7fb424071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.664 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.577+0000 7fb42259c700 1 -- 172.21.15.124:0/2027558457 >> v1:172.21.15.124:6789/0 conn(0x7fb424071d90 legacy=0x7fb4240ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:11.664 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.577+0000 7fb42259c700 1 -- 172.21.15.124:0/2027558457 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42415e100 con 0x7fb42415daa0 2023-10-16T12:59:11.664 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.577+0000 7fb42259c700 1 --2- 172.21.15.124:0/2027558457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb42415daa0 0x7fb4240af020 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb424072fb0 tx=0x7fb418009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b8872e7683f63f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.665 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.577+0000 7fb42159a700 1 -- 172.21.15.124:0/2027558457 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb418004230 con 0x7fb42415daa0 2023-10-16T12:59:11.665 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.577+0000 7fb42159a700 1 -- 172.21.15.124:0/2027558457 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb418004390 con 0x7fb42415daa0 2023-10-16T12:59:11.665 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.577+0000 7fb42159a700 1 -- 172.21.15.124:0/2027558457 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4180036a0 con 0x7fb42415daa0 2023-10-16T12:59:11.665 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.578+0000 7fb428c2a700 1 -- 172.21.15.124:0/2027558457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb42415daa0 msgr2=0x7fb4240af020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.665 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.578+0000 7fb428c2a700 1 --2- 172.21.15.124:0/2027558457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb42415daa0 0x7fb4240af020 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb424072fb0 tx=0x7fb418009bd0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.666 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.579+0000 7fbe3e750700 1 --2- 172.21.15.124:0/1910871522 >> [v2:172.21.15.124:6800/930055859,v1:172.21.15.124:6801/930055859] conn(0x7fbe38150f90 0x7fbe381586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.666 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.579+0000 7fbe3e750700 1 -- 172.21.15.124:0/1910871522 --> [v2:172.21.15.124:6800/930055859,v1:172.21.15.124:6801/930055859] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe380cb120 con 0x7fbe38150f90 2023-10-16T12:59:11.666 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.580+0000 7fbe3cced700 1 --2- 172.21.15.124:0/1910871522 >> [v2:172.21.15.124:6800/930055859,v1:172.21.15.124:6801/930055859] conn(0x7fbe38150f90 0x7fbe381586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.667 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.580+0000 7fd35659c700 1 --2- 172.21.15.124:0/983462000 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd33806af50 0x7fd33806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.667 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.580+0000 7fd35659c700 1 --2- 172.21.15.124:0/983462000 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd33806af50 0x7fd33806d410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd35000c550 tx=0x7fd35000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.668 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.580+0000 7fbe3cced700 1 --2- 172.21.15.124:0/1910871522 >> [v2:172.21.15.124:6800/930055859,v1:172.21.15.124:6801/930055859] conn(0x7fbe38150f90 0x7fbe381586a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.668 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.581+0000 7fbe34ff9700 1 -- 172.21.15.124:0/1910871522 <== osd.0 v2:172.21.15.124:6800/930055859 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fbe2c009a10 con 0x7fbe38150f90 2023-10-16T12:59:11.668 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.586+0000 7f4acb148700 1 -- 172.21.15.124:0/3758092897 --> [v2:172.21.15.124:6816/2753229488,v1:172.21.15.124:6817/2753229488] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4ac40cd1d0 con 0x7f4aa8074560 2023-10-16T12:59:11.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.585+0000 7f1df9e5f700 1 -- 172.21.15.124:0/2800307636 shutdown_connections 2023-10-16T12:59:11.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.585+0000 7f1df9e5f700 1 -- 172.21.15.124:0/2800307636 >> 172.21.15.124:0/2800307636 conn(0x7f1df40cbad0 msgr2=0x7f1df40cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:11.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.586+0000 7f1df9e5f700 1 -- 172.21.15.124:0/2800307636 shutdown_connections 2023-10-16T12:59:11.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.586+0000 7f4ac17fa700 1 -- 172.21.15.124:0/3758092897 <== osd.2 v2:172.21.15.124:6816/2753229488 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4ab8011630 con 0x7f4aa8074560 2023-10-16T12:59:11.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.586+0000 7f4acb148700 1 -- 172.21.15.124:0/3758092897 >> [v2:172.21.15.124:6816/2753229488,v1:172.21.15.124:6817/2753229488] conn(0x7f4aa8074560 msgr2=0x7f4aa80769a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.586+0000 7f4acb148700 1 --2- 172.21.15.124:0/3758092897 >> [v2:172.21.15.124:6816/2753229488,v1:172.21.15.124:6817/2753229488] conn(0x7f4aa8074560 0x7f4aa80769a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.588+0000 7fb428c2a700 1 -- 172.21.15.124:0/2027558457 shutdown_connections 2023-10-16T12:59:11.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.588+0000 7fb428c2a700 1 --2- 172.21.15.124:0/2027558457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb42415daa0 0x7fb4240af020 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.588+0000 7fb428c2a700 1 --2- 172.21.15.124:0/2027558457 >> v2:172.21.15.124:3300/0 conn(0x7fb4240af560 0x7fb424071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.588+0000 7fb428c2a700 1 -- 172.21.15.124:0/2027558457 >> 172.21.15.124:0/2027558457 conn(0x7fb4240d0180 msgr2=0x7fb4240d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:11.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.588+0000 7f4acb148700 1 -- 172.21.15.124:0/3758092897 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f4aa806af20 msgr2=0x7f4aa806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.588+0000 7f4acb148700 1 --2- 172.21.15.124:0/3758092897 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f4aa806af20 0x7f4aa806d3e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4067640 tx=0x7f4abc009230 comp rx=0 tx=0).stop 2023-10-16T12:59:11.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.588+0000 7f4acb148700 1 -- 172.21.15.124:0/3758092897 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ac40afb10 msgr2=0x7f4ac4164910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.588+0000 7f4acb148700 1 --2- 172.21.15.124:0/3758092897 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ac40afb10 0x7f4ac4164910 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4ab400c3c0 tx=0x7f4ab400c780 comp rx=0 tx=0).stop 2023-10-16T12:59:11.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.589+0000 7f1df9e5f700 1 -- 172.21.15.124:0/2800307636 wait complete. 2023-10-16T12:59:11.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.589+0000 7f4ac96e5700 1 -- 172.21.15.124:0/3758092897 reap_dead start 2023-10-16T12:59:11.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.589+0000 7f4acb148700 1 -- 172.21.15.124:0/3758092897 shutdown_connections 2023-10-16T12:59:11.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.589+0000 7f4acb148700 1 -- 172.21.15.124:0/3758092897 >> 172.21.15.124:0/3758092897 conn(0x7f4ac40cbad0 msgr2=0x7f4ac40b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:11.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.590+0000 7fb428c2a700 1 -- 172.21.15.124:0/2027558457 shutdown_connections 2023-10-16T12:59:11.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.590+0000 7f1df9e5f700 1 Processor -- start 2023-10-16T12:59:11.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.591+0000 7f1df9e5f700 1 -- start start 2023-10-16T12:59:11.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.592+0000 7f1df9e5f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ddc004420 0x7f1df40c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.592+0000 7f1df9e5f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1df40caaf0 0x7f1df40b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.592+0000 7f1df9e5f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1df4149ad0 0x7f1df4149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.592+0000 7f1df9e5f700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df414a4c0 con 0x7f1df40caaf0 2023-10-16T12:59:11.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.592+0000 7f1df9e5f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df40ca020 con 0x7f1ddc004420 2023-10-16T12:59:11.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.592+0000 7f1df9e5f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df40c9780 con 0x7f1df4149ad0 2023-10-16T12:59:11.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.590+0000 7fb428c2a700 1 -- 172.21.15.124:0/2027558457 wait complete. 2023-10-16T12:59:11.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.592+0000 7fb428c2a700 1 Processor -- start 2023-10-16T12:59:11.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.592+0000 7f1df2ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1df40caaf0 0x7f1df40b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.592+0000 7f1df2ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1df40caaf0 0x7f1df40b4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53690/0 (socket says 172.21.15.124:53690) 2023-10-16T12:59:11.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.592+0000 7f1df2ffd700 1 -- 172.21.15.124:0/2696712422 learned_addr learned my addr 172.21.15.124:0/2696712422 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:11.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.592+0000 7f1df2ffd700 1 -- 172.21.15.124:0/2696712422 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1df4149ad0 msgr2=0x7f1df4149f80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T12:59:11.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.592+0000 7f1df2ffd700 1 --2- 172.21.15.124:0/2696712422 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1df4149ad0 0x7f1df4149f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.592+0000 7f1df2ffd700 1 -- 172.21.15.124:0/2696712422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ddc004420 msgr2=0x7f1df40c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.592+0000 7f1df2ffd700 1 --2- 172.21.15.124:0/2696712422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ddc004420 0x7f1df40c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.592+0000 7f1df2ffd700 1 -- 172.21.15.124:0/2696712422 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df40c9a60 con 0x7f1df40caaf0 2023-10-16T12:59:11.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.592+0000 7f1df2ffd700 1 --2- 172.21.15.124:0/2696712422 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1df40caaf0 0x7f1df40b4390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00c270 tx=0x7f1de40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.593+0000 7f1ddbfff700 1 -- 172.21.15.124:0/2696712422 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de4021070 con 0x7f1df40caaf0 2023-10-16T12:59:11.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.593+0000 7f1ddbfff700 1 -- 172.21.15.124:0/2696712422 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de400fc40 con 0x7f1df40caaf0 2023-10-16T12:59:11.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.593+0000 7f1ddbfff700 1 -- 172.21.15.124:0/2696712422 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de4006e60 con 0x7f1df40caaf0 2023-10-16T12:59:11.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.593+0000 7f1df9e5f700 1 -- 172.21.15.124:0/2696712422 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df40c9d40 con 0x7f1df40caaf0 2023-10-16T12:59:11.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.593+0000 7f1df9e5f700 1 -- 172.21.15.124:0/2696712422 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df40caf70 con 0x7f1df40caaf0 2023-10-16T12:59:11.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.592+0000 7fb428c2a700 1 -- start start 2023-10-16T12:59:11.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.593+0000 7fb428c2a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb424071d90 0x7fb424156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.593+0000 7fb428c2a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb4240af560 0x7fb4240c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.593+0000 7fb428c2a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb42415daa0 0x7fb4240c2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.593+0000 7fb428c2a700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4240c6b30 con 0x7fb4240af560 2023-10-16T12:59:11.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.593+0000 7fb428c2a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb424156e70 con 0x7fb42415daa0 2023-10-16T12:59:11.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.593+0000 7fb428c2a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4240c6850 con 0x7fb424071d90 2023-10-16T12:59:11.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.594+0000 7fb42259c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb424071d90 0x7fb424156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.594+0000 7fb42259c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb424071d90 0x7fb424156930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:39774/0 (socket says 172.21.15.124:39774) 2023-10-16T12:59:11.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.594+0000 7fb42259c700 1 -- 172.21.15.124:0/1893032968 learned_addr learned my addr 172.21.15.124:0/1893032968 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:11.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.594+0000 7fb42259c700 1 -- 172.21.15.124:0/1893032968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb42415daa0 msgr2=0x7fb4240c2c20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T12:59:11.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.594+0000 7fb42259c700 1 --2- 172.21.15.124:0/1893032968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb42415daa0 0x7fb4240c2c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.594+0000 7fb42259c700 1 -- 172.21.15.124:0/1893032968 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb4240af560 msgr2=0x7fb4240c5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.594+0000 7fb421d9b700 1 --2- 172.21.15.124:0/1893032968 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb4240af560 0x7fb4240c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.594+0000 7fb42259c700 1 --2- 172.21.15.124:0/1893032968 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb4240af560 0x7fb4240c5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.594+0000 7fb42259c700 1 -- 172.21.15.124:0/1893032968 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb418009550 con 0x7fb424071d90 2023-10-16T12:59:11.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.594+0000 7fb421d9b700 1 --2- 172.21.15.124:0/1893032968 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb4240af560 0x7fb4240c5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:11.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.595+0000 7f1ddbfff700 1 -- 172.21.15.124:0/2696712422 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1de4025070 con 0x7f1df40caaf0 2023-10-16T12:59:11.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.595+0000 7fb42259c700 1 --2- 172.21.15.124:0/1893032968 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb424071d90 0x7fb424156930 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb418009130 tx=0x7fb418004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.595+0000 7f1df9e5f700 1 -- 172.21.15.124:0/2696712422 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1dd4000fc0 con 0x7f1df40caaf0 2023-10-16T12:59:11.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.596+0000 7f1ddbfff700 1 --2- 172.21.15.124:0/2696712422 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1de006af50 0x7f1de006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.596+0000 7f4acb148700 1 -- 172.21.15.124:0/3758092897 shutdown_connections 2023-10-16T12:59:11.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.596+0000 7f1ddbfff700 1 -- 172.21.15.124:0/2696712422 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1de408a8e0 con 0x7f1df40caaf0 2023-10-16T12:59:11.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.596+0000 7f1df37fe700 1 --2- 172.21.15.124:0/2696712422 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1de006af50 0x7f1de006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.596+0000 7f4acb148700 1 -- 172.21.15.124:0/3758092897 wait complete. 2023-10-16T12:59:11.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.596+0000 7f1ddbfff700 1 --2- 172.21.15.124:0/2696712422 >> [v2:172.21.15.192:6808/4065801592,v1:172.21.15.192:6809/4065801592] conn(0x7f1de0074590 0x7f1de00769d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.596+0000 7f1ddbfff700 1 -- 172.21.15.124:0/2696712422 --> [v2:172.21.15.192:6808/4065801592,v1:172.21.15.192:6809/4065801592] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1de00770a0 con 0x7f1de0074590 2023-10-16T12:59:11.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.596+0000 7f1ddbfff700 1 -- 172.21.15.124:0/2696712422 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1de408f2c0 con 0x7f1df40caaf0 2023-10-16T12:59:11.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.596+0000 7f1df37fe700 1 --2- 172.21.15.124:0/2696712422 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1de006af50 0x7f1de006d410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1dec001330 tx=0x7f1dec000f40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.596+0000 7f180701a700 1 -- 172.21.15.124:0/1637757503 --> [v2:172.21.15.124:6824/115265899,v1:172.21.15.124:6825/115265899] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f17e0002d40 con 0x7f17e40744c0 2023-10-16T12:59:11.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.597+0000 7f17fd7fa700 1 -- 172.21.15.124:0/1637757503 <== osd.3 v2:172.21.15.124:6824/115265899 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f17e0002d40 con 0x7f17e40744c0 2023-10-16T12:59:11.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.596+0000 7f4ceaadb700 1 -- 172.21.15.124:0/2604095996 --> [v2:172.21.15.192:6816/651957595,v1:172.21.15.192:6818/651957595] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4ce40ca670 con 0x7f4cd0074590 2023-10-16T12:59:11.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.598+0000 7f180701a700 1 -- 172.21.15.124:0/1637757503 >> [v2:172.21.15.124:6824/115265899,v1:172.21.15.124:6825/115265899] conn(0x7f17e40744c0 msgr2=0x7f17e4076900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.598+0000 7f180701a700 1 --2- 172.21.15.124:0/1637757503 >> [v2:172.21.15.124:6824/115265899,v1:172.21.15.124:6825/115265899] conn(0x7f17e40744c0 0x7f17e4076900 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.598+0000 7f180701a700 1 -- 172.21.15.124:0/1637757503 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f17e406af00 msgr2=0x7f17e406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.598+0000 7f180701a700 1 --2- 172.21.15.124:0/1637757503 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f17e406af00 0x7f17e406d3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0048d0 tx=0x7f17ec00a000 comp rx=0 tx=0).stop 2023-10-16T12:59:11.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.598+0000 7f180701a700 1 -- 172.21.15.124:0/1637757503 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f180015cb90 msgr2=0x7f18000b0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.598+0000 7f180701a700 1 --2- 172.21.15.124:0/1637757503 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f180015cb90 0x7f18000b0990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1800074a40 tx=0x7f17f800be50 comp rx=0 tx=0).stop 2023-10-16T12:59:11.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.598+0000 7f18055b7700 1 -- 172.21.15.124:0/1637757503 reap_dead start 2023-10-16T12:59:11.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.598+0000 7fb412ffd700 1 -- 172.21.15.124:0/1893032968 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb418003dc0 con 0x7fb424071d90 2023-10-16T12:59:11.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.598+0000 7f180701a700 1 -- 172.21.15.124:0/1637757503 shutdown_connections 2023-10-16T12:59:11.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.598+0000 7f180701a700 1 -- 172.21.15.124:0/1637757503 >> 172.21.15.124:0/1637757503 conn(0x7f18000d0180 msgr2=0x7f180006ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:11.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.598+0000 7f1df3fff700 1 --2- 172.21.15.124:0/2696712422 >> [v2:172.21.15.192:6808/4065801592,v1:172.21.15.192:6809/4065801592] conn(0x7f1de0074590 0x7f1de00769d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.598+0000 7f180701a700 1 -- 172.21.15.124:0/1637757503 shutdown_connections 2023-10-16T12:59:11.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.598+0000 7fb412ffd700 1 -- 172.21.15.124:0/1893032968 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41801f070 con 0x7fb424071d90 2023-10-16T12:59:11.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.598+0000 7fb412ffd700 1 -- 172.21.15.124:0/1893032968 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb418011850 con 0x7fb424071d90 2023-10-16T12:59:11.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.598+0000 7f180701a700 1 -- 172.21.15.124:0/1637757503 wait complete. 2023-10-16T12:59:11.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.598+0000 7fb428c2a700 1 -- 172.21.15.124:0/1893032968 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42406a9c0 con 0x7fb424071d90 2023-10-16T12:59:11.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.599+0000 7fb428c2a700 1 -- 172.21.15.124:0/1893032968 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb42406af80 con 0x7fb424071d90 2023-10-16T12:59:11.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.599+0000 7f1df3fff700 1 --2- 172.21.15.124:0/2696712422 >> [v2:172.21.15.192:6808/4065801592,v1:172.21.15.192:6809/4065801592] conn(0x7f1de0074590 0x7f1de00769d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.599+0000 7fb428c2a700 1 -- 172.21.15.124:0/1893032968 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb42415e6c0 con 0x7fb424071d90 2023-10-16T12:59:11.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.600+0000 7fa4e1e79700 1 -- 172.21.15.124:0/1213904966 --> [v2:172.21.15.124:6808/1996055598,v1:172.21.15.124:6809/1996055598] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa4dc0c9610 con 0x7fa4c8074440 2023-10-16T12:59:11.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.601+0000 7fa4c3fff700 1 -- 172.21.15.124:0/1213904966 <== osd.1 v2:172.21.15.124:6808/1996055598 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa4d0009280 con 0x7fa4c8074440 2023-10-16T12:59:11.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.601+0000 7fb412ffd700 1 -- 172.21.15.124:0/1893032968 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb418044d50 con 0x7fb424071d90 2023-10-16T12:59:11.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.601+0000 7f1ddbfff700 1 -- 172.21.15.124:0/2696712422 <== osd.4 v2:172.21.15.192:6808/4065801592 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f1de00770a0 con 0x7f1de0074590 2023-10-16T12:59:11.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.601+0000 7fb412ffd700 1 --2- 172.21.15.124:0/1893032968 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb40c06b0b0 0x7fb40c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.601+0000 7fb412ffd700 1 -- 172.21.15.124:0/1893032968 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb41808b400 con 0x7fb424071d90 2023-10-16T12:59:11.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.601+0000 7fb412ffd700 1 --2- 172.21.15.124:0/1893032968 >> [v2:172.21.15.192:6817/853874996,v1:172.21.15.192:6819/853874996] conn(0x7fb40c0746f0 0x7fb40c076b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.601+0000 7fb412ffd700 1 -- 172.21.15.124:0/1893032968 --> [v2:172.21.15.192:6817/853874996,v1:172.21.15.192:6819/853874996] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb40c077200 con 0x7fb40c0746f0 2023-10-16T12:59:11.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.601+0000 7fb412ffd700 1 -- 172.21.15.124:0/1893032968 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb41808b8a0 con 0x7fb424071d90 2023-10-16T12:59:11.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.603+0000 7f4ce17fa700 1 -- 172.21.15.124:0/2604095996 <== osd.5 v2:172.21.15.192:6816/651957595 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4cd8009760 con 0x7f4cd0074590 2023-10-16T12:59:11.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.604+0000 7fbe3e750700 1 -- 172.21.15.124:0/1910871522 --> [v2:172.21.15.124:6800/930055859,v1:172.21.15.124:6801/930055859] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbe380cab60 con 0x7fbe38150f90 2023-10-16T12:59:11.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.604+0000 7fa4e1e79700 1 -- 172.21.15.124:0/1213904966 >> [v2:172.21.15.124:6808/1996055598,v1:172.21.15.124:6809/1996055598] conn(0x7fa4c8074440 msgr2=0x7fa4c8076880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.604+0000 7fa4e1e79700 1 --2- 172.21.15.124:0/1213904966 >> [v2:172.21.15.124:6808/1996055598,v1:172.21.15.124:6809/1996055598] conn(0x7fa4c8074440 0x7fa4c8076880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.605+0000 7fa4e1e79700 1 -- 172.21.15.124:0/1213904966 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa4c806af00 msgr2=0x7fa4c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.605+0000 7fa4e1e79700 1 --2- 172.21.15.124:0/1213904966 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa4c806af00 0x7fa4c806d3c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc006fd0 tx=0x7fa4cc006bc0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.605+0000 7fa4e1e79700 1 -- 172.21.15.124:0/1213904966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4dc0ccd70 msgr2=0x7fa4dc0c7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.605+0000 7fa4e1e79700 1 --2- 172.21.15.124:0/1213904966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4dc0ccd70 0x7fa4dc0c7d50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4000f80 tx=0x7fa4d4004ad0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.605+0000 7fa4dbfff700 1 -- 172.21.15.124:0/1213904966 reap_dead start 2023-10-16T12:59:11.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.605+0000 7fa4e1e79700 1 -- 172.21.15.124:0/1213904966 shutdown_connections 2023-10-16T12:59:11.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.605+0000 7fa4e1e79700 1 -- 172.21.15.124:0/1213904966 >> 172.21.15.124:0/1213904966 conn(0x7fa4dc0cbad0 msgr2=0x7fa4dc0cb240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:11.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.605+0000 7fbe34ff9700 1 -- 172.21.15.124:0/1910871522 <== osd.0 v2:172.21.15.124:6800/930055859 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbe2c009b80 con 0x7fbe38150f90 2023-10-16T12:59:11.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.606+0000 7fbe3e750700 1 -- 172.21.15.124:0/1910871522 >> [v2:172.21.15.124:6800/930055859,v1:172.21.15.124:6801/930055859] conn(0x7fbe38150f90 msgr2=0x7fbe381586a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.606+0000 7fbe3e750700 1 --2- 172.21.15.124:0/1910871522 >> [v2:172.21.15.124:6800/930055859,v1:172.21.15.124:6801/930055859] conn(0x7fbe38150f90 0x7fbe381586a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.606+0000 7fa4e1e79700 1 -- 172.21.15.124:0/1213904966 shutdown_connections 2023-10-16T12:59:11.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.606+0000 7fbe3e750700 1 -- 172.21.15.124:0/1910871522 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbe2406af50 msgr2=0x7fbe2406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.606+0000 7fbe3e750700 1 --2- 172.21.15.124:0/1910871522 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbe2406af50 0x7fbe2406d410 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbe28000c00 tx=0x7fbe2801c040 comp rx=0 tx=0).stop 2023-10-16T12:59:11.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.606+0000 7fbe3e750700 1 -- 172.21.15.124:0/1910871522 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbe380c2990 msgr2=0x7fbe3814a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.606+0000 7fbe3e750700 1 --2- 172.21.15.124:0/1910871522 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbe380c2990 0x7fbe3814a2d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbe3000cba0 tx=0x7fbe3000ceb0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.606+0000 7fbe3cced700 1 -- 172.21.15.124:0/1910871522 reap_dead start 2023-10-16T12:59:11.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.606+0000 7fa4e1e79700 1 -- 172.21.15.124:0/1213904966 wait complete. 2023-10-16T12:59:11.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.606+0000 7fb421d9b700 1 --2- 172.21.15.124:0/1893032968 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb40c06b0b0 0x7fb40c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.606+0000 7fb421d9b700 1 --2- 172.21.15.124:0/1893032968 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb40c06b0b0 0x7fb40c06d570 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb4240adfb0 tx=0x7fb4140073e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.609+0000 7fd35c83e700 1 -- 172.21.15.124:0/983462000 --> [v2:172.21.15.192:6800/213455189,v1:172.21.15.192:6801/213455189] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd35815c100 con 0x7fd3580712b0 2023-10-16T12:59:11.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.610+0000 7fd346ffd700 1 -- 172.21.15.124:0/983462000 <== osd.7 v2:172.21.15.192:6800/213455189 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd348009160 con 0x7fd3580712b0 2023-10-16T12:59:11.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.610+0000 7fd35c83e700 1 -- 172.21.15.124:0/983462000 >> [v2:172.21.15.192:6800/213455189,v1:172.21.15.192:6801/213455189] conn(0x7fd3580712b0 msgr2=0x7fd358203450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.610+0000 7fd35c83e700 1 --2- 172.21.15.124:0/983462000 >> [v2:172.21.15.192:6800/213455189,v1:172.21.15.192:6801/213455189] conn(0x7fd3580712b0 0x7fd358203450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.610+0000 7fd35c83e700 1 -- 172.21.15.124:0/983462000 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd33806af50 msgr2=0x7fd33806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.610+0000 7fd35c83e700 1 --2- 172.21.15.124:0/983462000 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd33806af50 0x7fd33806d410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd35000c550 tx=0x7fd35000b040 comp rx=0 tx=0).stop 2023-10-16T12:59:11.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.610+0000 7fd35c83e700 1 -- 172.21.15.124:0/983462000 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd35815f6c0 msgr2=0x7fd358202f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.610+0000 7fd35c83e700 1 --2- 172.21.15.124:0/983462000 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd35815f6c0 0x7fd358202f10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd34c015000 tx=0x7fd34c004750 comp rx=0 tx=0).stop 2023-10-16T12:59:11.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.610+0000 7fd356d9d700 1 -- 172.21.15.124:0/983462000 reap_dead start 2023-10-16T12:59:11.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.611+0000 7fd35c83e700 1 -- 172.21.15.124:0/983462000 shutdown_connections 2023-10-16T12:59:11.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.611+0000 7fd35c83e700 1 -- 172.21.15.124:0/983462000 >> 172.21.15.124:0/983462000 conn(0x7fd35806c850 msgr2=0x7fd358070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:11.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.611+0000 7fd35c83e700 1 -- 172.21.15.124:0/983462000 shutdown_connections 2023-10-16T12:59:11.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.611+0000 7fd35c83e700 1 -- 172.21.15.124:0/983462000 wait complete. 2023-10-16T12:59:11.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.612+0000 7fb422d9d700 1 --2- 172.21.15.124:0/1893032968 >> [v2:172.21.15.192:6817/853874996,v1:172.21.15.192:6819/853874996] conn(0x7fb40c0746f0 0x7fb40c076b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.714 INFO:teuthology.orchestra.run.smithi124.stdout:55834574859 2023-10-16T12:59:11.714 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-16T12:59:11.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.612+0000 7fbe3e750700 1 -- 172.21.15.124:0/1910871522 shutdown_connections 2023-10-16T12:59:11.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.612+0000 7fbe3e750700 1 -- 172.21.15.124:0/1910871522 >> 172.21.15.124:0/1910871522 conn(0x7fbe380b1100 msgr2=0x7fbe380b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:11.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.615+0000 7f4ceaadb700 1 -- 172.21.15.124:0/2604095996 >> [v2:172.21.15.192:6816/651957595,v1:172.21.15.192:6818/651957595] conn(0x7f4cd0074590 msgr2=0x7f4cd00769d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.615+0000 7f4ceaadb700 1 --2- 172.21.15.124:0/2604095996 >> [v2:172.21.15.192:6816/651957595,v1:172.21.15.192:6818/651957595] conn(0x7f4cd0074590 0x7f4cd00769d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.615+0000 7fb422d9d700 1 --2- 172.21.15.124:0/1893032968 >> [v2:172.21.15.192:6817/853874996,v1:172.21.15.192:6819/853874996] conn(0x7fb40c0746f0 0x7fb40c076b30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.615+0000 7f4ceaadb700 1 -- 172.21.15.124:0/2604095996 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f4cd006af50 msgr2=0x7f4cd006d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.615+0000 7f4ceaadb700 1 --2- 172.21.15.124:0/2604095996 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f4cd006af50 0x7f4cd006d410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4ce415e5c0 tx=0x7f4cdc00d040 comp rx=0 tx=0).stop 2023-10-16T12:59:11.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.615+0000 7f4ceaadb700 1 -- 172.21.15.124:0/2604095996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ce40c9610 msgr2=0x7f4ce415e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.615+0000 7f4ceaadb700 1 --2- 172.21.15.124:0/2604095996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ce40c9610 0x7f4ce415e080 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009c10 tx=0x7f4cd4004750 comp rx=0 tx=0).stop 2023-10-16T12:59:11.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.615+0000 7f4ce9078700 1 -- 172.21.15.124:0/2604095996 reap_dead start 2023-10-16T12:59:11.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.615+0000 7f4ceaadb700 1 -- 172.21.15.124:0/2604095996 shutdown_connections 2023-10-16T12:59:11.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.615+0000 7f4ceaadb700 1 -- 172.21.15.124:0/2604095996 >> 172.21.15.124:0/2604095996 conn(0x7f4ce406c850 msgr2=0x7f4ce40cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:11.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.616+0000 7f4ceaadb700 1 -- 172.21.15.124:0/2604095996 shutdown_connections 2023-10-16T12:59:11.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.616+0000 7fbe3e750700 1 -- 172.21.15.124:0/1910871522 shutdown_connections 2023-10-16T12:59:11.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.616+0000 7f4ceaadb700 1 -- 172.21.15.124:0/2604095996 wait complete. 2023-10-16T12:59:11.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.616+0000 7fbe3e750700 1 -- 172.21.15.124:0/1910871522 wait complete. 2023-10-16T12:59:11.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.616+0000 7fb412ffd700 1 -- 172.21.15.124:0/1893032968 <== osd.6 v2:172.21.15.192:6817/853874996 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fb40c077200 con 0x7fb40c0746f0 2023-10-16T12:59:11.721 INFO:teuthology.orchestra.run.smithi124.stdout:55834574858 2023-10-16T12:59:11.721 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-16T12:59:11.722 INFO:teuthology.orchestra.run.smithi124.stdout:55834574859 2023-10-16T12:59:11.723 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-16T12:59:11.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.625+0000 7f1df9e5f700 1 -- 172.21.15.124:0/2696712422 --> [v2:172.21.15.192:6808/4065801592,v1:172.21.15.192:6809/4065801592] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1dd4002d40 con 0x7f1de0074590 2023-10-16T12:59:11.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.626+0000 7f1ddbfff700 1 -- 172.21.15.124:0/2696712422 <== osd.4 v2:172.21.15.192:6808/4065801592 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1dd4002d40 con 0x7f1de0074590 2023-10-16T12:59:11.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.626+0000 7f1df9e5f700 1 -- 172.21.15.124:0/2696712422 >> [v2:172.21.15.192:6808/4065801592,v1:172.21.15.192:6809/4065801592] conn(0x7f1de0074590 msgr2=0x7f1de00769d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.626+0000 7f1df9e5f700 1 --2- 172.21.15.124:0/2696712422 >> [v2:172.21.15.192:6808/4065801592,v1:172.21.15.192:6809/4065801592] conn(0x7f1de0074590 0x7f1de00769d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.626+0000 7f1df9e5f700 1 -- 172.21.15.124:0/2696712422 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1de006af50 msgr2=0x7f1de006d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.626+0000 7f1df9e5f700 1 --2- 172.21.15.124:0/2696712422 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1de006af50 0x7f1de006d410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1dec001330 tx=0x7f1dec000f40 comp rx=0 tx=0).stop 2023-10-16T12:59:11.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.626+0000 7f1df9e5f700 1 -- 172.21.15.124:0/2696712422 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1df40caaf0 msgr2=0x7f1df40b4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.626+0000 7f1df9e5f700 1 --2- 172.21.15.124:0/2696712422 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1df40caaf0 0x7f1df40b4390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00c270 tx=0x7f1de40047c0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.626+0000 7f1df3fff700 1 -- 172.21.15.124:0/2696712422 reap_dead start 2023-10-16T12:59:11.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.628+0000 7f1df9e5f700 1 -- 172.21.15.124:0/2696712422 shutdown_connections 2023-10-16T12:59:11.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.628+0000 7f1df9e5f700 1 -- 172.21.15.124:0/2696712422 >> 172.21.15.124:0/2696712422 conn(0x7f1df40cbad0 msgr2=0x7f1df4070a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:11.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.628+0000 7f1df9e5f700 1 -- 172.21.15.124:0/2696712422 shutdown_connections 2023-10-16T12:59:11.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.628+0000 7f1df9e5f700 1 -- 172.21.15.124:0/2696712422 wait complete. 2023-10-16T12:59:11.727 INFO:teuthology.orchestra.run.smithi124.stdout:55834574857 2023-10-16T12:59:11.728 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-16T12:59:11.730 INFO:teuthology.orchestra.run.smithi124.stdout:55834574858 2023-10-16T12:59:11.731 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-16T12:59:11.732 INFO:teuthology.orchestra.run.smithi124.stdout:55834574858 2023-10-16T12:59:11.732 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-16T12:59:11.734 INFO:teuthology.orchestra.run.smithi124.stdout:55834574858 2023-10-16T12:59:11.734 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-16T12:59:11.735 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.641+0000 7fb428c2a700 1 -- 172.21.15.124:0/1893032968 --> [v2:172.21.15.192:6817/853874996,v1:172.21.15.192:6819/853874996] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb42415e3e0 con 0x7fb40c0746f0 2023-10-16T12:59:11.736 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.641+0000 7fb412ffd700 1 -- 172.21.15.124:0/1893032968 <== osd.6 v2:172.21.15.192:6817/853874996 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb41c009250 con 0x7fb40c0746f0 2023-10-16T12:59:11.738 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.642+0000 7fb428c2a700 1 -- 172.21.15.124:0/1893032968 >> [v2:172.21.15.192:6817/853874996,v1:172.21.15.192:6819/853874996] conn(0x7fb40c0746f0 msgr2=0x7fb40c076b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.739 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.642+0000 7fb428c2a700 1 --2- 172.21.15.124:0/1893032968 >> [v2:172.21.15.192:6817/853874996,v1:172.21.15.192:6819/853874996] conn(0x7fb40c0746f0 0x7fb40c076b30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.739 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.642+0000 7fb428c2a700 1 -- 172.21.15.124:0/1893032968 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb40c06b0b0 msgr2=0x7fb40c06d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.740 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.642+0000 7fb428c2a700 1 --2- 172.21.15.124:0/1893032968 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb40c06b0b0 0x7fb40c06d570 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb4240adfb0 tx=0x7fb4140073e0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.740 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.642+0000 7fb428c2a700 1 -- 172.21.15.124:0/1893032968 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb424071d90 msgr2=0x7fb424156930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.741 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.642+0000 7fb428c2a700 1 --2- 172.21.15.124:0/1893032968 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb424071d90 0x7fb424156930 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb418009130 tx=0x7fb418004750 comp rx=0 tx=0).stop 2023-10-16T12:59:11.741 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.642+0000 7fb422d9d700 1 -- 172.21.15.124:0/1893032968 reap_dead start 2023-10-16T12:59:11.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.642+0000 7fb428c2a700 1 -- 172.21.15.124:0/1893032968 shutdown_connections 2023-10-16T12:59:11.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.642+0000 7fb428c2a700 1 -- 172.21.15.124:0/1893032968 >> 172.21.15.124:0/1893032968 conn(0x7fb4240d0180 msgr2=0x7fb4240cb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:11.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.642+0000 7fb428c2a700 1 -- 172.21.15.124:0/1893032968 shutdown_connections 2023-10-16T12:59:11.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.642+0000 7fb428c2a700 1 -- 172.21.15.124:0/1893032968 wait complete. 2023-10-16T12:59:11.742 INFO:teuthology.orchestra.run.smithi124.stdout:55834574858 2023-10-16T12:59:11.743 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-16T12:59:11.968 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.966+0000 7f6f632f2700 1 Processor -- start 2023-10-16T12:59:11.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.966+0000 7f6f632f2700 1 -- start start 2023-10-16T12:59:11.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.967+0000 7f6f632f2700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f6f5c0cd4b0 0x7f6f5c166140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.967+0000 7f6f632f2700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5c0cda90 con 0x7f6f5c06bf80 2023-10-16T12:59:11.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.967+0000 7f6f632f2700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5c0cdd70 con 0x7f6f5c071210 2023-10-16T12:59:11.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.967+0000 7f6f632f2700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5c165660 con 0x7f6f5c0cd4b0 2023-10-16T12:59:11.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.967+0000 7f6f6188f700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f6f5c0cd4b0 0x7f6f5c166140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.967+0000 7f6f6188f700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f6f5c0cd4b0 0x7f6f5c166140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53710/0 (socket says 172.21.15.124:53710) 2023-10-16T12:59:11.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.967+0000 7f6f6188f700 1 -- 172.21.15.124:0/432274155 learned_addr learned my addr 172.21.15.124:0/432274155 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:11.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.968+0000 7fb10da14700 1 Processor -- start 2023-10-16T12:59:11.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.968+0000 7f6f6188f700 1 -- 172.21.15.124:0/432274155 >> v1:172.21.15.192:6789/0 conn(0x7f6f5c071210 legacy=0x7f6f5c0715f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:11.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.968+0000 7f6f6188f700 1 -- 172.21.15.124:0/432274155 >> v1:172.21.15.124:6789/0 conn(0x7f6f5c06bf80 legacy=0x7f6f5c161ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.968+0000 7f6f53fff700 1 -- 172.21.15.124:0/432274155 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905262969 0 0) 0x7f6f5c0cda90 con 0x7f6f5c06bf80 2023-10-16T12:59:11.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.968+0000 7f6f6188f700 1 -- 172.21.15.124:0/432274155 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c165940 con 0x7f6f5c0cd4b0 2023-10-16T12:59:11.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.968+0000 7f6f6188f700 1 --2- 172.21.15.124:0/432274155 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f5c0cd4b0 0x7f6f5c166140 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009e50 tx=0x7f6f5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a491b4c3a1a10102 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.968+0000 7fb10da14700 1 -- start start 2023-10-16T12:59:11.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.969+0000 7f6f53fff700 1 -- 172.21.15.124:0/432274155 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5400e070 con 0x7f6f5c0cd4b0 2023-10-16T12:59:11.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.969+0000 7f6f53fff700 1 -- 172.21.15.124:0/432274155 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f54003a20 con 0x7f6f5c0cd4b0 2023-10-16T12:59:11.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.969+0000 7f6f53fff700 1 -- 172.21.15.124:0/432274155 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f54003dd0 con 0x7f6f5c0cd4b0 2023-10-16T12:59:11.976 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.969+0000 7f2dcddef700 1 Processor -- start 2023-10-16T12:59:11.976 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.969+0000 7f2dcddef700 1 -- start start 2023-10-16T12:59:11.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.970+0000 7f6f632f2700 1 -- 172.21.15.124:0/432274155 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f5c0cd4b0 msgr2=0x7f6f5c166140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.970+0000 7f6f632f2700 1 --2- 172.21.15.124:0/432274155 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f5c0cd4b0 0x7f6f5c166140 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009e50 tx=0x7f6f5400b330 comp rx=0 tx=0).stop 2023-10-16T12:59:11.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.970+0000 7f6f632f2700 1 -- 172.21.15.124:0/432274155 shutdown_connections 2023-10-16T12:59:11.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.970+0000 7f6f632f2700 1 --2- 172.21.15.124:0/432274155 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f5c0cd4b0 0x7f6f5c166140 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.970+0000 7f6f632f2700 1 -- 172.21.15.124:0/432274155 >> 172.21.15.124:0/432274155 conn(0x7f6f5c0cfcd0 msgr2=0x7f6f5c0d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:11.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.970+0000 7f6f632f2700 1 -- 172.21.15.124:0/432274155 shutdown_connections 2023-10-16T12:59:11.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.970+0000 7f2dcddef700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2dc8159510 0x7f2dc80cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.970+0000 7f6f632f2700 1 -- 172.21.15.124:0/432274155 wait complete. 2023-10-16T12:59:11.980 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.970+0000 7f2dcddef700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc80c98f0 con 0x7f2dc80cd920 2023-10-16T12:59:11.980 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.970+0000 7f2dcddef700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc815e200 con 0x7f2dc81598f0 2023-10-16T12:59:11.980 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.970+0000 7f2dcddef700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc815d960 con 0x7f2dc8159510 2023-10-16T12:59:11.981 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.970+0000 7f1a19d2e700 1 Processor -- start 2023-10-16T12:59:11.981 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.970+0000 7fb10da14700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb10815d890 0x7fb1080ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.970+0000 7fb10da14700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb10806bef0 0x7fb1080b6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.970+0000 7fb10da14700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1080ceab0 con 0x7fb1080ce610 2023-10-16T12:59:11.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.970+0000 7fb10da14700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1080ced90 con 0x7fb10815d890 2023-10-16T12:59:11.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.970+0000 7fb10da14700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1080cf070 con 0x7fb10806bef0 2023-10-16T12:59:11.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.970+0000 7f1a19d2e700 1 -- start start 2023-10-16T12:59:11.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.970+0000 7f2dc6ffd700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2dc81598f0 0x7f2dc80cd210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.124:54380/0 (socket says 172.21.15.124:54380) 2023-10-16T12:59:11.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.970+0000 7f2dc77fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2dc8159510 0x7f2dc80cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.970+0000 7f2dc6ffd700 1 -- 172.21.15.124:0/1306137734 learned_addr learned my addr 172.21.15.124:0/1306137734 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:11.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.971+0000 7fb1077fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb10806bef0 0x7fb1080b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.971+0000 7fb1077fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb10806bef0 0x7fb1080b6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:39798/0 (socket says 172.21.15.124:39798) 2023-10-16T12:59:11.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.971+0000 7fb1077fe700 1 -- 172.21.15.124:0/3703907160 learned_addr learned my addr 172.21.15.124:0/3703907160 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:11.985 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7fb106ffd700 1 --2- 172.21.15.124:0/3703907160 >> v2:172.21.15.192:3300/0 conn(0x7fb10815d890 0x7fb1080ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.985 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7f6f632f2700 1 Processor -- start 2023-10-16T12:59:11.985 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7f6f632f2700 1 -- start start 2023-10-16T12:59:11.986 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.971+0000 7f2dc77fe700 1 -- 172.21.15.124:0/1306137734 >> v1:172.21.15.192:6789/0 conn(0x7f2dc81598f0 legacy=0x7f2dc80cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.986 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.971+0000 7f2dc77fe700 1 -- 172.21.15.124:0/1306137734 >> v1:172.21.15.124:6789/0 conn(0x7f2dc80cd920 legacy=0x7f2dc80ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.986 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.971+0000 7f2dc77fe700 1 -- 172.21.15.124:0/1306137734 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc815dc40 con 0x7f2dc8159510 2023-10-16T12:59:11.986 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.971+0000 7f2dc77fe700 1 --2- 172.21.15.124:0/1306137734 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2dc8159510 0x7f2dc80cc470 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2db8009840 tx=0x7f2db8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2de511f57ca0ace server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.987 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.971+0000 7f2dc67fc700 1 -- 172.21.15.124:0/1306137734 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db8004230 con 0x7f2dc8159510 2023-10-16T12:59:11.987 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.971+0000 7f2dc67fc700 1 -- 172.21.15.124:0/1306137734 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db8004390 con 0x7f2dc8159510 2023-10-16T12:59:11.987 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.971+0000 7f2dc67fc700 1 -- 172.21.15.124:0/1306137734 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db80036a0 con 0x7f2dc8159510 2023-10-16T12:59:11.987 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7f1a19d2e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a1406bc90 0x7f1a140b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.988 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7f1a19d2e700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a140ce7e0 con 0x7f1a1406b7e0 2023-10-16T12:59:11.988 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7f1a19d2e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a140ceab0 con 0x7f1a1415d890 2023-10-16T12:59:11.988 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7f1a19d2e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a140ced90 con 0x7f1a1406bc90 2023-10-16T12:59:11.988 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7f1a12ffd700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f1a1406b7e0 0x7f1a140b6620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42396/0 (socket says 172.21.15.124:42396) 2023-10-16T12:59:11.988 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7f1a12ffd700 1 -- 172.21.15.124:0/3713244953 learned_addr learned my addr 172.21.15.124:0/3713244953 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:11.989 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7f1a127fc700 1 -- 172.21.15.124:0/3713244953 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495143472 0 0) 0x7f1a140ce7e0 con 0x7f1a1406b7e0 2023-10-16T12:59:11.989 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7f1a127fc700 1 -- 172.21.15.124:0/3713244953 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19fc0035b0 con 0x7f1a1406b7e0 2023-10-16T12:59:11.989 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7f1a13fff700 1 --2- 172.21.15.124:0/3713244953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a1406bc90 0x7f1a140b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.989 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7f1a127fc700 1 -- 172.21.15.124:0/3713244953 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4149887331 0 0) 0x7f19fc0035b0 con 0x7f1a1406b7e0 2023-10-16T12:59:11.989 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7f1a127fc700 1 -- 172.21.15.124:0/3713244953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a1406bc90 msgr2=0x7f1a140b6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:11.989 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7f1a127fc700 1 --2- 172.21.15.124:0/3713244953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a1406bc90 0x7f1a140b6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.990 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7f1a127fc700 1 -- 172.21.15.124:0/3713244953 >> v1:172.21.15.192:6789/0 conn(0x7f1a1415d890 legacy=0x7f1a140ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:11.990 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7fb105ffb700 1 -- 172.21.15.124:0/3703907160 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2531374301 0 0) 0x7fb1080ceab0 con 0x7fb1080ce610 2023-10-16T12:59:11.990 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7fb105ffb700 1 -- 172.21.15.124:0/3703907160 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0f00035b0 con 0x7fb1080ce610 2023-10-16T12:59:11.991 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7f1a127fc700 1 -- 172.21.15.124:0/3713244953 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a140cf070 con 0x7f1a1406b7e0 2023-10-16T12:59:11.991 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7f1a127fc700 1 -- 172.21.15.124:0/3713244953 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f1a04001670 con 0x7f1a1406b7e0 2023-10-16T12:59:11.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7f1a127fc700 1 -- 172.21.15.124:0/3713244953 >> v1:172.21.15.124:6789/0 conn(0x7f1a1406b7e0 legacy=0x7f1a140b6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7f1a127fc700 1 --2- 172.21.15.124:0/3713244953 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f19fc003a30 0x7f19fc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7f1a127fc700 1 --2- 172.21.15.124:0/3713244953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19fc004850 0x7f19fc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7f1a127fc700 1 --2- 172.21.15.124:0/3713244953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19fc005260 0x7f19fc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7f1a127fc700 1 -- 172.21.15.124:0/3713244953 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a140ced90 con 0x7f19fc003a30 2023-10-16T12:59:11.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7f1a127fc700 1 -- 172.21.15.124:0/3713244953 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc00c170 con 0x7f19fc005260 2023-10-16T12:59:11.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7f1a127fc700 1 -- 172.21.15.124:0/3713244953 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc00c330 con 0x7f19fc004850 2023-10-16T12:59:11.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7fb1077fe700 1 -- 172.21.15.124:0/3703907160 >> v2:172.21.15.192:3300/0 conn(0x7fb10815d890 msgr2=0x7fb1080ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:11.993 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7fb1077fe700 1 --2- 172.21.15.124:0/3703907160 >> v2:172.21.15.192:3300/0 conn(0x7fb10815d890 0x7fb1080ce0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:11.994 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7fb1077fe700 1 -- 172.21.15.124:0/3703907160 >> v1:172.21.15.192:6789/0 conn(0x7fb1080ce610 legacy=0x7fb10806b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.994 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.972+0000 7fb1077fe700 1 -- 172.21.15.124:0/3703907160 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1080cf350 con 0x7fb10806bef0 2023-10-16T12:59:11.994 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.973+0000 7f1a12ffd700 1 --2- 172.21.15.124:0/3713244953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19fc004850 0x7f19fc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.973+0000 7fb1077fe700 1 --2- 172.21.15.124:0/3703907160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb10806bef0 0x7fb1080b6620 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb100009e50 tx=0x7fb10000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fd97de2804bba7b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:11.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.973+0000 7f1a137fe700 1 --2- 172.21.15.124:0/3713244953 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f19fc003a30 0x7f19fc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.973+0000 7fb105ffb700 1 -- 172.21.15.124:0/3703907160 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10000e070 con 0x7fb10806bef0 2023-10-16T12:59:11.996 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.973+0000 7fb105ffb700 1 -- 172.21.15.124:0/3703907160 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10000b910 con 0x7fb10806bef0 2023-10-16T12:59:11.996 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.973+0000 7fb105ffb700 1 -- 172.21.15.124:0/3703907160 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10000bcc0 con 0x7fb10806bef0 2023-10-16T12:59:11.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.973+0000 7f6f632f2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f5c06bf80 0x7f6f5c160470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.973+0000 7f6f632f2700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f5c071210 0x7f6f5c0c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.973+0000 7f6f632f2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f5c0cd4b0 0x7f6f5c0c3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:11.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.973+0000 7f6f632f2700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c160290 con 0x7f6f5c071210 2023-10-16T12:59:11.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.973+0000 7f6f632f2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0c4620 con 0x7f6f5c0cd4b0 2023-10-16T12:59:11.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.973+0000 7f6f632f2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0c3a10 con 0x7f6f5c06bf80 2023-10-16T12:59:11.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.973+0000 7f6f6088d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f5c071210 0x7f6f5c0c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.973+0000 7f6f6088d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f5c071210 0x7f6f5c0c4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53740/0 (socket says 172.21.15.124:53740) 2023-10-16T12:59:11.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.973+0000 7f6f6088d700 1 -- 172.21.15.124:0/3407812223 learned_addr learned my addr 172.21.15.124:0/3407812223 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:11.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.973+0000 7f6f6108e700 1 --2- 172.21.15.124:0/3407812223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f5c06bf80 0x7f6f5c160470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.974+0000 7f6f6188f700 1 --2- 172.21.15.124:0/3407812223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f5c0cd4b0 0x7f6f5c0c3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:11.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.974+0000 7f6f6088d700 1 -- 172.21.15.124:0/3407812223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f5c06bf80 msgr2=0x7f6f5c160470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:11.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.974+0000 7f6f6088d700 1 --2- 172.21.15.124:0/3407812223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f5c06bf80 0x7f6f5c160470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.974+0000 7f6f6088d700 1 -- 172.21.15.124:0/3407812223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f5c0cd4b0 msgr2=0x7f6f5c0c3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.974+0000 7f6f6088d700 1 --2- 172.21.15.124:0/3407812223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f5c0cd4b0 0x7f6f5c0c3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.974+0000 7f6f6088d700 1 -- 172.21.15.124:0/3407812223 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f54009b30 con 0x7f6f5c071210 2023-10-16T12:59:12.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.974+0000 7f6f6108e700 1 --2- 172.21.15.124:0/3407812223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f5c06bf80 0x7f6f5c160470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:59:12.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.974+0000 7fb10da14700 1 -- 172.21.15.124:0/3703907160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb10806bef0 msgr2=0x7fb1080b6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.001 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.974+0000 7fb10da14700 1 --2- 172.21.15.124:0/3703907160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb10806bef0 0x7fb1080b6620 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb100009e50 tx=0x7fb10000b330 comp rx=0 tx=0).stop 2023-10-16T12:59:12.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.973+0000 7f1a137fe700 1 -- 172.21.15.124:0/3713244953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19fc004850 msgr2=0x7f19fc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:12.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.973+0000 7f1a137fe700 1 --2- 172.21.15.124:0/3713244953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19fc004850 0x7f19fc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.973+0000 7f1a137fe700 1 -- 172.21.15.124:0/3713244953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19fc005260 msgr2=0x7f19fc00ba10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T12:59:12.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.973+0000 7f1a137fe700 1 --2- 172.21.15.124:0/3713244953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19fc005260 0x7f19fc00ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.973+0000 7f1a137fe700 1 -- 172.21.15.124:0/3713244953 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a140cf070 con 0x7f19fc003a30 2023-10-16T12:59:12.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.974+0000 7f1a137fe700 1 --2- 172.21.15.124:0/3713244953 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f19fc003a30 0x7f19fc003e30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1a08003ed0 tx=0x7f19fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431f1b67d2052ddd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:12.004 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.974+0000 7f6f6088d700 1 --2- 172.21.15.124:0/3407812223 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f5c071210 0x7f6f5c0c4ab0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c001eb0 tx=0x7f6f4c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:12.004 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.974+0000 7f6f51ffb700 1 -- 172.21.15.124:0/3407812223 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c0054e0 con 0x7f6f5c071210 2023-10-16T12:59:12.004 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.974+0000 7f6f51ffb700 1 -- 172.21.15.124:0/3407812223 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4c003680 con 0x7f6f5c071210 2023-10-16T12:59:12.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.974+0000 7f1a127fc700 1 -- 172.21.15.124:0/3713244953 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08016070 con 0x7f19fc003a30 2023-10-16T12:59:12.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.974+0000 7f6f51ffb700 1 -- 172.21.15.124:0/3407812223 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c0039f0 con 0x7f6f5c071210 2023-10-16T12:59:12.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.974+0000 7f1a127fc700 1 -- 172.21.15.124:0/3713244953 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a08006860 con 0x7f19fc003a30 2023-10-16T12:59:12.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.974+0000 7f1a127fc700 1 -- 172.21.15.124:0/3713244953 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08006c10 con 0x7f19fc003a30 2023-10-16T12:59:12.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.974+0000 7f6f632f2700 1 -- 172.21.15.124:0/3407812223 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5c0c3cf0 con 0x7f6f5c071210 2023-10-16T12:59:12.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.975+0000 7f6f632f2700 1 -- 172.21.15.124:0/3407812223 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5c0c42b0 con 0x7f6f5c071210 2023-10-16T12:59:12.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.975+0000 7f2dcddef700 1 -- 172.21.15.124:0/1306137734 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2dc8159510 msgr2=0x7f2dc80cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.975+0000 7f2dcddef700 1 --2- 172.21.15.124:0/1306137734 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2dc8159510 0x7f2dc80cc470 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2db8009840 tx=0x7f2db8009b50 comp rx=0 tx=0).stop 2023-10-16T12:59:12.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.975+0000 7f1a19d2e700 1 -- 172.21.15.124:0/3713244953 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f19fc003a30 msgr2=0x7f19fc003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.975+0000 7f1a19d2e700 1 --2- 172.21.15.124:0/3713244953 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f19fc003a30 0x7f19fc003e30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1a08003ed0 tx=0x7f19fc005880 comp rx=0 tx=0).stop 2023-10-16T12:59:12.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.975+0000 7f1a13fff700 1 -- 172.21.15.124:0/3713244953 reap_dead start 2023-10-16T12:59:12.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.976+0000 7f2dcddef700 1 -- 172.21.15.124:0/1306137734 shutdown_connections 2023-10-16T12:59:12.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.976+0000 7f2dcddef700 1 --2- 172.21.15.124:0/1306137734 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2dc8159510 0x7f2dc80cc470 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.976+0000 7f2dcddef700 1 -- 172.21.15.124:0/1306137734 >> 172.21.15.124:0/1306137734 conn(0x7f2dc806c850 msgr2=0x7f2dc806cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:12.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.976+0000 7f2dcddef700 1 -- 172.21.15.124:0/1306137734 shutdown_connections 2023-10-16T12:59:12.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.976+0000 7f6f632f2700 1 -- 172.21.15.124:0/3407812223 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3c0052f0 con 0x7f6f5c071210 2023-10-16T12:59:12.011 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.976+0000 7f1a19d2e700 1 -- 172.21.15.124:0/3713244953 shutdown_connections 2023-10-16T12:59:12.012 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.976+0000 7f1a19d2e700 1 -- 172.21.15.124:0/3713244953 >> 172.21.15.124:0/3713244953 conn(0x7f1a14072340 msgr2=0x7f1a14072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:12.012 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.976+0000 7f1a19d2e700 1 -- 172.21.15.124:0/3713244953 shutdown_connections 2023-10-16T12:59:12.012 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.976+0000 7f1a19d2e700 1 -- 172.21.15.124:0/3713244953 wait complete. 2023-10-16T12:59:12.012 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.978+0000 7f1a19d2e700 1 Processor -- start 2023-10-16T12:59:12.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.977+0000 7f6f51ffb700 1 -- 172.21.15.124:0/3407812223 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6f4c003b50 con 0x7f6f5c071210 2023-10-16T12:59:12.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.978+0000 7f6f51ffb700 1 --2- 172.21.15.124:0/3407812223 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6f4006af00 0x7f6f4006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.978+0000 7f6f51ffb700 1 -- 172.21.15.124:0/3407812223 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6f4c0890c0 con 0x7f6f5c071210 2023-10-16T12:59:12.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.978+0000 7f1a19d2e700 1 -- start start 2023-10-16T12:59:12.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.978+0000 7f6f6108e700 1 --2- 172.21.15.124:0/3407812223 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6f4006af00 0x7f6f4006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.979+0000 7f6f6108e700 1 --2- 172.21.15.124:0/3407812223 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6f4006af00 0x7f6f4006d3c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6f58007fd0 tx=0x7f6f58009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:12.015 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.977+0000 7f2dcddef700 1 -- 172.21.15.124:0/1306137734 wait complete. 2023-10-16T12:59:12.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.979+0000 7f2dcddef700 1 Processor -- start 2023-10-16T12:59:12.016 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.979+0000 7f2dcddef700 1 -- start start 2023-10-16T12:59:12.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.979+0000 7f1a19d2e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19fc003a30 0x7f1a140c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.979+0000 7f1a19d2e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1a1415a4f0 0x7f1a140ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.979+0000 7f1a19d2e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a140cc170 0x7f1a140cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.979+0000 7f1a19d2e700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a140c96f0 con 0x7f1a1415a4f0 2023-10-16T12:59:12.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.979+0000 7f1a19d2e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1415dc70 con 0x7f19fc003a30 2023-10-16T12:59:12.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.979+0000 7f1a19d2e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1415a980 con 0x7f1a140cc170 2023-10-16T12:59:12.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.980+0000 7f1a12ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1a1415a4f0 0x7f1a140ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.980+0000 7f1a137fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19fc003a30 0x7f1a140c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.980+0000 7f1a137fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19fc003a30 0x7f1a140c91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:33912/0 (socket says 172.21.15.124:33912) 2023-10-16T12:59:12.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.980+0000 7f1a12ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1a1415a4f0 0x7f1a140ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53748/0 (socket says 172.21.15.124:53748) 2023-10-16T12:59:12.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.980+0000 7f1a137fe700 1 -- 172.21.15.124:0/119836970 learned_addr learned my addr 172.21.15.124:0/119836970 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:12.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.979+0000 7fe9ef70e700 1 Processor -- start 2023-10-16T12:59:12.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.979+0000 7fe9ef70e700 1 -- start start 2023-10-16T12:59:12.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.980+0000 7f1a137fe700 1 -- 172.21.15.124:0/119836970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a140cc170 msgr2=0x7f1a140cd030 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T12:59:12.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.980+0000 7f1a137fe700 1 --2- 172.21.15.124:0/119836970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a140cc170 0x7f1a140cd030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.980+0000 7f1a137fe700 1 -- 172.21.15.124:0/119836970 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1a1415a4f0 msgr2=0x7f1a140ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.980+0000 7f1a137fe700 1 --2- 172.21.15.124:0/119836970 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1a1415a4f0 0x7f1a140ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.980+0000 7f1a137fe700 1 -- 172.21.15.124:0/119836970 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1415ac60 con 0x7f19fc003a30 2023-10-16T12:59:12.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.980+0000 7f1a12ffd700 1 --2- 172.21.15.124:0/119836970 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1a1415a4f0 0x7f1a140ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:59:12.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.980+0000 7f1a137fe700 1 --2- 172.21.15.124:0/119836970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19fc003a30 0x7f1a140c91b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1a080044c0 tx=0x7f1a08003780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:12.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7f2dcddef700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2dc80cd920 0x7f2dc814cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7f2dcddef700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2dc8159510 0x7f2dc814e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.023 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7f2dcddef700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2dc814edc0 0x7f2dc814fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.023 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7f2dcddef700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc80c8b80 con 0x7f2dc80cd920 2023-10-16T12:59:12.023 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7f2dcddef700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc80c8000 con 0x7f2dc814edc0 2023-10-16T12:59:12.023 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7f2dcddef700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc80c82e0 con 0x7f2dc8159510 2023-10-16T12:59:12.023 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7f2dc77fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2dc80cd920 0x7f2dc814cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.024 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7f2dc77fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2dc80cd920 0x7f2dc814cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53752/0 (socket says 172.21.15.124:53752) 2023-10-16T12:59:12.024 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7f2dc77fe700 1 -- 172.21.15.124:0/1614233597 learned_addr learned my addr 172.21.15.124:0/1614233597 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:12.024 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7f2dc6ffd700 1 --2- 172.21.15.124:0/1614233597 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2dc8159510 0x7f2dc814e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.024 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7fe6fbaef700 1 Processor -- start 2023-10-16T12:59:12.025 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7f2dc77fe700 1 -- 172.21.15.124:0/1614233597 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2dc8159510 msgr2=0x7f2dc814e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.025 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7f2dc77fe700 1 --2- 172.21.15.124:0/1614233597 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2dc8159510 0x7f2dc814e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.025 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7f2dc77fe700 1 -- 172.21.15.124:0/1614233597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2dc814edc0 msgr2=0x7f2dc814fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.025 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7f2dc77fe700 1 --2- 172.21.15.124:0/1614233597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2dc814edc0 0x7f2dc814fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7f2dc77fe700 1 -- 172.21.15.124:0/1614233597 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db80094a0 con 0x7f2dc80cd920 2023-10-16T12:59:12.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7fb10da14700 1 -- 172.21.15.124:0/3703907160 shutdown_connections 2023-10-16T12:59:12.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7fb10da14700 1 --2- 172.21.15.124:0/3703907160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb10806bef0 0x7fb1080b6620 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7fb10da14700 1 --2- 172.21.15.124:0/3703907160 >> v2:172.21.15.192:3300/0 conn(0x7fb10815d890 0x7fb1080ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7fb10da14700 1 -- 172.21.15.124:0/3703907160 >> 172.21.15.124:0/3703907160 conn(0x7fb108072340 msgr2=0x7fb108072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:12.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7fe9ef70e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9e806daf0 0x7fe9e806ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7fe9ef70e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe9e80cd5a0 0x7fe9e80c9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7fe9ef70e700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e80c4970 con 0x7fe9e80cb230 2023-10-16T12:59:12.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7fe9ef70e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e806e410 con 0x7fe9e80cd5a0 2023-10-16T12:59:12.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7fe9ef70e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e80c4040 con 0x7fe9e806daf0 2023-10-16T12:59:12.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7fe9edcab700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fe9e80cb230 0x7fe9e80c9b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42428/0 (socket says 172.21.15.124:42428) 2023-10-16T12:59:12.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7fe9edcab700 1 -- 172.21.15.124:0/683070762 learned_addr learned my addr 172.21.15.124:0/683070762 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:12.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7fe9ed4aa700 1 --2- 172.21.15.124:0/683070762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9e806daf0 0x7fe9e806ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.029 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.982+0000 7f2dc77fe700 1 --2- 172.21.15.124:0/1614233597 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2dc80cd920 0x7f2dc814cc10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2dc806b760 tx=0x7f2db8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:12.029 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.982+0000 7fe6fbaef700 1 -- start start 2023-10-16T12:59:12.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.982+0000 7fe9ed4aa700 1 -- 172.21.15.124:0/683070762 >> v2:172.21.15.192:3300/0 conn(0x7fe9e80cd5a0 msgr2=0x7fe9e80c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:12.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.982+0000 7fe9ed4aa700 1 --2- 172.21.15.124:0/683070762 >> v2:172.21.15.192:3300/0 conn(0x7fe9e80cd5a0 0x7fe9e80c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.982+0000 7fe9ed4aa700 1 -- 172.21.15.124:0/683070762 >> v1:172.21.15.124:6789/0 conn(0x7fe9e80cb230 legacy=0x7fe9e80c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.982+0000 7fe9ed4aa700 1 -- 172.21.15.124:0/683070762 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e80c4320 con 0x7fe9e806daf0 2023-10-16T12:59:12.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.982+0000 7fe9ed4aa700 1 --2- 172.21.15.124:0/683070762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9e806daf0 0x7fe9e806ded0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009840 tx=0x7fe9e4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=778425932b6f19fa server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:12.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.982+0000 7fe9dffff700 1 -- 172.21.15.124:0/683070762 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4011830 con 0x7fe9e806daf0 2023-10-16T12:59:12.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.982+0000 7fe9dffff700 1 -- 172.21.15.124:0/683070762 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e4011990 con 0x7fe9e806daf0 2023-10-16T12:59:12.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.982+0000 7fe9dffff700 1 -- 172.21.15.124:0/683070762 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4011d20 con 0x7fe9e806daf0 2023-10-16T12:59:12.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7f19fbfff700 1 -- 172.21.15.124:0/119836970 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08016040 con 0x7f19fc003a30 2023-10-16T12:59:12.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7f19fbfff700 1 -- 172.21.15.124:0/119836970 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a08025460 con 0x7f19fc003a30 2023-10-16T12:59:12.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7f19fbfff700 1 -- 172.21.15.124:0/119836970 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a080257f0 con 0x7f19fc003a30 2023-10-16T12:59:12.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7f1a19d2e700 1 -- 172.21.15.124:0/119836970 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a1415af40 con 0x7f19fc003a30 2023-10-16T12:59:12.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.981+0000 7f1a19d2e700 1 -- 172.21.15.124:0/119836970 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a140ca8e0 con 0x7f19fc003a30 2023-10-16T12:59:12.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.983+0000 7fe6fbaef700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe6f40ae710 0x7fe6f406d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.983+0000 7fe6fbaef700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe6f406df30 0x7fe6f406e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.983+0000 7fe6fbaef700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f40cf260 con 0x7fe6f4159cb0 2023-10-16T12:59:12.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.983+0000 7fe6fbaef700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f40aebb0 con 0x7fe6f406df30 2023-10-16T12:59:12.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.983+0000 7fe6fbaef700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f40af140 con 0x7fe6f40ae710 2023-10-16T12:59:12.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.983+0000 7fe6fa08c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe6f406df30 0x7fe6f406e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.983+0000 7fe6fa08c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe6f406df30 0x7fe6f406e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53766/0 (socket says 172.21.15.124:53766) 2023-10-16T12:59:12.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.983+0000 7fe6fa08c700 1 -- 172.21.15.124:0/4182924716 learned_addr learned my addr 172.21.15.124:0/4182924716 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:12.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.982+0000 7f61f959f700 1 Processor -- start 2023-10-16T12:59:12.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.982+0000 7f61f959f700 1 -- start start 2023-10-16T12:59:12.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.983+0000 7f61f959f700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f61f40cf5c0 0x7f61f40cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.983+0000 7f61f959f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61f415b450 0x7f61f406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.983+0000 7f61f959f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f40cf9a0 con 0x7f61f406daf0 2023-10-16T12:59:12.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.983+0000 7f61f959f700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f40cba50 con 0x7f61f40cf5c0 2023-10-16T12:59:12.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.983+0000 7f61f959f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f406df00 con 0x7f61f415b450 2023-10-16T12:59:12.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.983+0000 7f61f2ffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f61f40cf5c0 0x7f61f40cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.984+0000 7f61f2ffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f61f40cf5c0 0x7f61f40cb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53770/0 (socket says 172.21.15.124:53770) 2023-10-16T12:59:12.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.984+0000 7f61f2ffd700 1 -- 172.21.15.124:0/1861907420 learned_addr learned my addr 172.21.15.124:0/1861907420 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:12.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.983+0000 7fe9ef70e700 1 -- 172.21.15.124:0/683070762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9e806daf0 msgr2=0x7fe9e806ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.983+0000 7fe9ef70e700 1 --2- 172.21.15.124:0/683070762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9e806daf0 0x7fe9e806ded0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009840 tx=0x7fe9e4009b50 comp rx=0 tx=0).stop 2023-10-16T12:59:12.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.984+0000 7fe9ef70e700 1 -- 172.21.15.124:0/683070762 shutdown_connections 2023-10-16T12:59:12.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.984+0000 7fe9ef70e700 1 --2- 172.21.15.124:0/683070762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9e806daf0 0x7fe9e806ded0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.984+0000 7fe9ef70e700 1 --2- 172.21.15.124:0/683070762 >> v2:172.21.15.192:3300/0 conn(0x7fe9e80cd5a0 0x7fe9e80c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.984+0000 7fe9ef70e700 1 -- 172.21.15.124:0/683070762 >> 172.21.15.124:0/683070762 conn(0x7fe9e80cbad0 msgr2=0x7fe9e80cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:12.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.984+0000 7f19fbfff700 1 -- 172.21.15.124:0/119836970 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1a0801c420 con 0x7f19fc003a30 2023-10-16T12:59:12.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.984+0000 7fe6f988b700 1 --2- 172.21.15.124:0/4182924716 >> v2:172.21.15.192:3300/0 conn(0x7fe6f40ae710 0x7fe6f406d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.984+0000 7fe6fa08c700 1 -- 172.21.15.124:0/4182924716 >> v2:172.21.15.192:3300/0 conn(0x7fe6f40ae710 msgr2=0x7fe6f406d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:12.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.984+0000 7fe6fa08c700 1 --2- 172.21.15.124:0/4182924716 >> v2:172.21.15.192:3300/0 conn(0x7fe6f40ae710 0x7fe6f406d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.984+0000 7fe6fa08c700 1 -- 172.21.15.124:0/4182924716 >> v1:172.21.15.124:6789/0 conn(0x7fe6f4159cb0 legacy=0x7fe6f40665a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.984+0000 7fe6fa08c700 1 -- 172.21.15.124:0/4182924716 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f40cf540 con 0x7fe6f406df30 2023-10-16T12:59:12.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.984+0000 7fe9ef70e700 1 -- 172.21.15.124:0/683070762 shutdown_connections 2023-10-16T12:59:12.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.984+0000 7fe6fa08c700 1 --2- 172.21.15.124:0/4182924716 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe6f406df30 0x7fe6f406e3a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40cd850 tx=0x7fe6f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258aaff95223f2c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:12.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.984+0000 7fe9ef70e700 1 -- 172.21.15.124:0/683070762 wait complete. 2023-10-16T12:59:12.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.984+0000 7f19fbfff700 1 --2- 172.21.15.124:0/119836970 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1a0006af50 0x7f1a0006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.984+0000 7f19fbfff700 1 -- 172.21.15.124:0/119836970 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1a0808a7c0 con 0x7f19fc003a30 2023-10-16T12:59:12.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.984+0000 7f61f27fc700 1 --2- 172.21.15.124:0/1861907420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61f415b450 0x7f61f406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.984+0000 7f61f2ffd700 1 -- 172.21.15.124:0/1861907420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61f415b450 msgr2=0x7f61f406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:12.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.984+0000 7f61f2ffd700 1 --2- 172.21.15.124:0/1861907420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61f415b450 0x7f61f406d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.984+0000 7f61f2ffd700 1 -- 172.21.15.124:0/1861907420 >> v1:172.21.15.192:6789/0 conn(0x7f61f406daf0 legacy=0x7f61f4150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.984+0000 7f61f2ffd700 1 -- 172.21.15.124:0/1861907420 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f40cbc60 con 0x7f61f40cf5c0 2023-10-16T12:59:12.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.984+0000 7f61f1ffb700 1 -- 172.21.15.124:0/1861907420 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508497967 0 0) 0x7f61f40cf9a0 con 0x7f61f406daf0 2023-10-16T12:59:12.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.984+0000 7f61f2ffd700 1 --2- 172.21.15.124:0/1861907420 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f61f40cf5c0 0x7f61f40cb510 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f61e400bb90 tx=0x7f61e400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92df5062bab30cd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:12.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.985+0000 7f1a12ffd700 1 --2- 172.21.15.124:0/119836970 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1a0006af50 0x7f1a0006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.985+0000 7f2daffff700 1 -- 172.21.15.124:0/1614233597 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db8010590 con 0x7f2dc80cd920 2023-10-16T12:59:12.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.985+0000 7f2dcddef700 1 -- 172.21.15.124:0/1614233597 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc80c85c0 con 0x7f2dc80cd920 2023-10-16T12:59:12.046 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.985+0000 7f2dcddef700 1 -- 172.21.15.124:0/1614233597 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc814d150 con 0x7f2dc80cd920 2023-10-16T12:59:12.046 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.985+0000 7fe6f8889700 1 -- 172.21.15.124:0/4182924716 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f000b870 con 0x7fe6f406df30 2023-10-16T12:59:12.047 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.985+0000 7fe6f8889700 1 -- 172.21.15.124:0/4182924716 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f000b9d0 con 0x7fe6f406df30 2023-10-16T12:59:12.047 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.985+0000 7fe6f8889700 1 -- 172.21.15.124:0/4182924716 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f000bd60 con 0x7fe6f406df30 2023-10-16T12:59:12.047 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.985+0000 7f6f51ffb700 1 -- 172.21.15.124:0/3407812223 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6f4c053f10 con 0x7f6f5c071210 2023-10-16T12:59:12.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.986+0000 7fb10da14700 1 -- 172.21.15.124:0/3703907160 shutdown_connections 2023-10-16T12:59:12.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.986+0000 7f2daffff700 1 -- 172.21.15.124:0/1614233597 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db80106f0 con 0x7f2dc80cd920 2023-10-16T12:59:12.049 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.986+0000 7f2daffff700 1 -- 172.21.15.124:0/1614233597 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db8010a60 con 0x7f2dc80cd920 2023-10-16T12:59:12.049 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.985+0000 7f1a12ffd700 1 --2- 172.21.15.124:0/119836970 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1a0006af50 0x7f1a0006d410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1a040017a0 tx=0x7f1a04007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:12.050 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.986+0000 7f61f1ffb700 1 -- 172.21.15.124:0/1861907420 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e400dd50 con 0x7f61f40cf5c0 2023-10-16T12:59:12.050 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.986+0000 7f61f1ffb700 1 -- 172.21.15.124:0/1861907420 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e4010470 con 0x7f61f40cf5c0 2023-10-16T12:59:12.050 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.986+0000 7f61f1ffb700 1 -- 172.21.15.124:0/1861907420 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e4010800 con 0x7f61f40cf5c0 2023-10-16T12:59:12.051 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.987+0000 7f61f959f700 1 -- 172.21.15.124:0/1861907420 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f61f40cf5c0 msgr2=0x7f61f40cb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.051 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.987+0000 7f61f959f700 1 --2- 172.21.15.124:0/1861907420 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f61f40cf5c0 0x7f61f40cb510 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f61e400bb90 tx=0x7f61e400bea0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.051 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.986+0000 7fb10da14700 1 -- 172.21.15.124:0/3703907160 wait complete. 2023-10-16T12:59:12.052 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.988+0000 7fb10da14700 1 Processor -- start 2023-10-16T12:59:12.052 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.988+0000 7fb10da14700 1 -- start start 2023-10-16T12:59:12.052 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.987+0000 7f61f959f700 1 -- 172.21.15.124:0/1861907420 shutdown_connections 2023-10-16T12:59:12.053 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.987+0000 7f61f959f700 1 --2- 172.21.15.124:0/1861907420 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f61f40cf5c0 0x7f61f40cb510 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.053 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.987+0000 7f61f959f700 1 --2- 172.21.15.124:0/1861907420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61f415b450 0x7f61f406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.053 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.987+0000 7f61f959f700 1 -- 172.21.15.124:0/1861907420 >> 172.21.15.124:0/1861907420 conn(0x7f61f40ccbe0 msgr2=0x7f61f40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:12.054 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.987+0000 7fe6fbaef700 1 -- 172.21.15.124:0/4182924716 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe6f406df30 msgr2=0x7fe6f406e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.054 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.987+0000 7fe6fbaef700 1 --2- 172.21.15.124:0/4182924716 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe6f406df30 0x7fe6f406e3a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40cd850 tx=0x7fe6f0009bd0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.986+0000 7fe9ef70e700 1 Processor -- start 2023-10-16T12:59:12.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.986+0000 7fe9ef70e700 1 -- start start 2023-10-16T12:59:12.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.987+0000 7fe9ef70e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9e806daf0 0x7fe9e81e7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.987+0000 7fe9ef70e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9e80cb230 0x7fe9e81eb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.055 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.987+0000 7fe9ef70e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9e80cd5a0 0x7fe9e81e9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.056 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.987+0000 7fe9ef70e700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e81ffbb0 con 0x7fe9e806daf0 2023-10-16T12:59:12.056 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.987+0000 7fe9ef70e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e81e6e90 con 0x7fe9e80cb230 2023-10-16T12:59:12.056 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.987+0000 7fe9ef70e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e815eb00 con 0x7fe9e80cd5a0 2023-10-16T12:59:12.056 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.987+0000 7fe9ed4aa700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9e806daf0 0x7fe9e81e7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.056 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.987+0000 7fe9ed4aa700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9e806daf0 0x7fe9e81e7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53778/0 (socket says 172.21.15.124:53778) 2023-10-16T12:59:12.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.987+0000 7fe9ed4aa700 1 -- 172.21.15.124:0/955647997 learned_addr learned my addr 172.21.15.124:0/955647997 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:12.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.987+0000 7fe9ecca9700 1 --2- 172.21.15.124:0/955647997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9e80cb230 0x7fe9e81eb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.987+0000 7fe9ed4aa700 1 -- 172.21.15.124:0/955647997 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9e80cd5a0 msgr2=0x7fe9e81e9160 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T12:59:12.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.987+0000 7fe9ed4aa700 1 --2- 172.21.15.124:0/955647997 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9e80cd5a0 0x7fe9e81e9160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.987+0000 7fe9ed4aa700 1 -- 172.21.15.124:0/955647997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9e80cb230 msgr2=0x7fe9e81eb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.987+0000 7fe9ed4aa700 1 --2- 172.21.15.124:0/955647997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9e80cb230 0x7fe9e81eb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.987+0000 7fe9ed4aa700 1 -- 172.21.15.124:0/955647997 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e40094a0 con 0x7fe9e806daf0 2023-10-16T12:59:12.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.987+0000 7fe9ecca9700 1 --2- 172.21.15.124:0/955647997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9e80cb230 0x7fe9e81eb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:12.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.988+0000 7fe9ed4aa700 1 --2- 172.21.15.124:0/955647997 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9e806daf0 0x7fe9e81e7ea0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4000c00 tx=0x7fe9e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:12.059 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.989+0000 7fb10da14700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb10806bef0 0x7fb108200050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.059 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.989+0000 7fb10da14700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1080ce610 0x7fb10815fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.059 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.989+0000 7fb10da14700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb10815d890 0x7fb1081fede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.059 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.989+0000 7fb10da14700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1081600d0 con 0x7fb10815d890 2023-10-16T12:59:12.060 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.989+0000 7fb10da14700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1080cb860 con 0x7fb1080ce610 2023-10-16T12:59:12.060 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.989+0000 7fb10da14700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb108160b80 con 0x7fb10806bef0 2023-10-16T12:59:12.060 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.989+0000 7f1a19d2e700 1 -- 172.21.15.124:0/119836970 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f40052f0 con 0x7f19fc003a30 2023-10-16T12:59:12.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.989+0000 7fb106ffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb10806bef0 0x7fb108200050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.989+0000 7fb106ffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb10806bef0 0x7fb108200050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:39862/0 (socket says 172.21.15.124:39862) 2023-10-16T12:59:12.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.989+0000 7fb106ffd700 1 -- 172.21.15.124:0/1504595653 learned_addr learned my addr 172.21.15.124:0/1504595653 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:12.061 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.989+0000 7fe9ddffb700 1 -- 172.21.15.124:0/955647997 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e40038a0 con 0x7fe9e806daf0 2023-10-16T12:59:12.062 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.989+0000 7fe9ddffb700 1 -- 172.21.15.124:0/955647997 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e401e070 con 0x7fe9e806daf0 2023-10-16T12:59:12.062 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.989+0000 7fe9ef70e700 1 -- 172.21.15.124:0/955647997 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e81e70e0 con 0x7fe9e806daf0 2023-10-16T12:59:12.062 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.989+0000 7fb1067fc700 1 --2- 172.21.15.124:0/1504595653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1080ce610 0x7fb10815fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.989+0000 7fb106ffd700 1 -- 172.21.15.124:0/1504595653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1080ce610 msgr2=0x7fb10815fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.989+0000 7fb106ffd700 1 --2- 172.21.15.124:0/1504595653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1080ce610 0x7fb10815fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.989+0000 7fb106ffd700 1 -- 172.21.15.124:0/1504595653 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb10815d890 msgr2=0x7fb1081fede0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T12:59:12.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.989+0000 7fb106ffd700 1 --2- 172.21.15.124:0/1504595653 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb10815d890 0x7fb1081fede0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.989+0000 7fb106ffd700 1 -- 172.21.15.124:0/1504595653 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb100009b30 con 0x7fb10806bef0 2023-10-16T12:59:12.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.990+0000 7f2daffff700 1 -- 172.21.15.124:0/1614233597 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2db8010bc0 con 0x7f2dc80cd920 2023-10-16T12:59:12.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.989+0000 7fe9ef70e700 1 -- 172.21.15.124:0/955647997 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e81e76a0 con 0x7fe9e806daf0 2023-10-16T12:59:12.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.990+0000 7fb106ffd700 1 --2- 172.21.15.124:0/1504595653 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb10806bef0 0x7fb108200050 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00c7f0 tx=0x7fb0fc00cb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:12.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.990+0000 7fb0effff700 1 -- 172.21.15.124:0/1504595653 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc011800 con 0x7fb10806bef0 2023-10-16T12:59:12.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.990+0000 7fb0effff700 1 -- 172.21.15.124:0/1504595653 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0fc011960 con 0x7fb10806bef0 2023-10-16T12:59:12.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.990+0000 7fb10da14700 1 -- 172.21.15.124:0/1504595653 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1080cfcd0 con 0x7fb10806bef0 2023-10-16T12:59:12.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.990+0000 7fb0effff700 1 -- 172.21.15.124:0/1504595653 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc011cd0 con 0x7fb10806bef0 2023-10-16T12:59:12.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.990+0000 7fb10da14700 1 -- 172.21.15.124:0/1504595653 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1081605c0 con 0x7fb10806bef0 2023-10-16T12:59:12.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.991+0000 7fe9ef70e700 1 -- 172.21.15.124:0/955647997 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e804ebb0 con 0x7fe9e806daf0 2023-10-16T12:59:12.067 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.991+0000 7fb10da14700 1 -- 172.21.15.124:0/1504595653 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e80052f0 con 0x7fb10806bef0 2023-10-16T12:59:12.067 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.992+0000 7fb0effff700 1 -- 172.21.15.124:0/1504595653 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb0fc010350 con 0x7fb10806bef0 2023-10-16T12:59:12.067 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.991+0000 7f2dcddef700 1 -- 172.21.15.124:0/1614233597 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da80052f0 con 0x7f2dc80cd920 2023-10-16T12:59:12.068 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.992+0000 7fe6fbaef700 1 -- 172.21.15.124:0/4182924716 shutdown_connections 2023-10-16T12:59:12.068 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.992+0000 7fe6fbaef700 1 --2- 172.21.15.124:0/4182924716 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe6f406df30 0x7fe6f406e3a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.068 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.992+0000 7fe6fbaef700 1 --2- 172.21.15.124:0/4182924716 >> v2:172.21.15.192:3300/0 conn(0x7fe6f40ae710 0x7fe6f406d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.069 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.992+0000 7fe6fbaef700 1 -- 172.21.15.124:0/4182924716 >> 172.21.15.124:0/4182924716 conn(0x7fe6f40b1620 msgr2=0x7fe6f40b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:12.069 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.991+0000 7fe9ddffb700 1 -- 172.21.15.124:0/955647997 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4003c40 con 0x7fe9e806daf0 2023-10-16T12:59:12.070 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.992+0000 7fb0effff700 1 --2- 172.21.15.124:0/1504595653 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb0f406af00 0x7fb0f406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.070 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.992+0000 7f8fdb6af700 1 Processor -- start 2023-10-16T12:59:12.070 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.992+0000 7fe9ddffb700 1 -- 172.21.15.124:0/955647997 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe9e402d450 con 0x7fe9e806daf0 2023-10-16T12:59:12.071 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.992+0000 7fb0effff700 1 -- 172.21.15.124:0/1504595653 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb0fc0893e0 con 0x7fb10806bef0 2023-10-16T12:59:12.071 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.992+0000 7fb1067fc700 1 --2- 172.21.15.124:0/1504595653 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb0f406af00 0x7fb0f406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.993+0000 7fe9ddffb700 1 --2- 172.21.15.124:0/955647997 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe9cc06af50 0x7fe9cc06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.993+0000 7fe9ddffb700 1 -- 172.21.15.124:0/955647997 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe9e408ae00 con 0x7fe9e806daf0 2023-10-16T12:59:12.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.993+0000 7fb1067fc700 1 --2- 172.21.15.124:0/1504595653 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb0f406af00 0x7fb0f406d3c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80011e0 tx=0x7fb0f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:12.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.993+0000 7f2daffff700 1 --2- 172.21.15.124:0/1614233597 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f2db406af00 0x7f2db406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.993+0000 7fe9ecca9700 1 --2- 172.21.15.124:0/955647997 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe9cc06af50 0x7fe9cc06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.993+0000 7f2daffff700 1 -- 172.21.15.124:0/1614233597 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2db808b2d0 con 0x7f2dc80cd920 2023-10-16T12:59:12.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.993+0000 7fe6fbaef700 1 -- 172.21.15.124:0/4182924716 shutdown_connections 2023-10-16T12:59:12.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.993+0000 7fe9ecca9700 1 --2- 172.21.15.124:0/955647997 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe9cc06af50 0x7fe9cc06d410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe9e815ba00 tx=0x7fe9d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:12.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.994+0000 7f2dc6ffd700 1 --2- 172.21.15.124:0/1614233597 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f2db406af00 0x7f2db406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.994+0000 7f2dc6ffd700 1 --2- 172.21.15.124:0/1614233597 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f2db406af00 0x7f2db406d3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc000f60 tx=0x7f2dbc007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:12.076 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.994+0000 7f61f959f700 1 -- 172.21.15.124:0/1861907420 shutdown_connections 2023-10-16T12:59:12.076 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.994+0000 7fe6fbaef700 1 -- 172.21.15.124:0/4182924716 wait complete. 2023-10-16T12:59:12.077 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.994+0000 7f61f959f700 1 -- 172.21.15.124:0/1861907420 wait complete. 2023-10-16T12:59:12.077 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.996+0000 7f61f959f700 1 Processor -- start 2023-10-16T12:59:12.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.996+0000 7fe6fbaef700 1 Processor -- start 2023-10-16T12:59:12.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.996+0000 7fe6fbaef700 1 -- start start 2023-10-16T12:59:12.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.996+0000 7f61f959f700 1 -- start start 2023-10-16T12:59:12.080 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.997+0000 7f61f959f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61f406daf0 0x7f61f41eb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.080 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.997+0000 7f61f959f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f61f40cf5c0 0x7f61f41549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.080 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.997+0000 7f61f959f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61f415b450 0x7f61f40c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.080 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.997+0000 7f61f959f700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f40c9d50 con 0x7f61f40cf5c0 2023-10-16T12:59:12.080 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.997+0000 7f61f959f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f4154f30 con 0x7f61f415b450 2023-10-16T12:59:12.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.997+0000 7f61f959f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f40c9fa0 con 0x7f61f406daf0 2023-10-16T12:59:12.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.997+0000 7f61f2ffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61f406daf0 0x7f61f41eb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.997+0000 7f61f2ffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61f406daf0 0x7f61f41eb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:39878/0 (socket says 172.21.15.124:39878) 2023-10-16T12:59:12.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.997+0000 7f61f2ffd700 1 -- 172.21.15.124:0/3119845175 learned_addr learned my addr 172.21.15.124:0/3119845175 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:12.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.997+0000 7f61f37fe700 1 --2- 172.21.15.124:0/3119845175 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61f415b450 0x7f61f40c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.997+0000 7f61f2ffd700 1 -- 172.21.15.124:0/3119845175 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61f415b450 msgr2=0x7f61f40c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.997+0000 7f61f2ffd700 1 --2- 172.21.15.124:0/3119845175 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61f415b450 0x7f61f40c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.997+0000 7f61f2ffd700 1 -- 172.21.15.124:0/3119845175 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f61f40cf5c0 msgr2=0x7f61f41549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.997+0000 7f61f2ffd700 1 --2- 172.21.15.124:0/3119845175 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f61f40cf5c0 0x7f61f41549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.997+0000 7f61f2ffd700 1 -- 172.21.15.124:0/3119845175 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e400b7f0 con 0x7f61f406daf0 2023-10-16T12:59:12.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.997+0000 7f61f2ffd700 1 --2- 172.21.15.124:0/3119845175 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61f406daf0 0x7f61f41eb0a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f61e400bee0 tx=0x7f61e4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:12.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.997+0000 7fe6fbaef700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe6f406df30 0x7fe6f4144c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.997+0000 7fe6fbaef700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6f40ae710 0x7fe6f414b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.997+0000 7fe6fbaef700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6f4159cb0 0x7fe6f414b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.997+0000 7fe6fbaef700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f414e270 con 0x7fe6f406df30 2023-10-16T12:59:12.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.997+0000 7fe6fbaef700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f41451c0 con 0x7fe6f4159cb0 2023-10-16T12:59:12.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.997+0000 7fe6fbaef700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f41488c0 con 0x7fe6f40ae710 2023-10-16T12:59:12.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.993+0000 7f8fdb6af700 1 -- start start 2023-10-16T12:59:12.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.994+0000 7f8fdb6af700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8fd4161a00 0x7f8fd40cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.994+0000 7f8fdb6af700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8fd40c9610 0x7f8fd40c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.088 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.998+0000 7fe6f908a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6f40ae710 0x7fe6f414b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.088 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.994+0000 7f8fdb6af700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd40ca950 con 0x7f8fd40ccb90 2023-10-16T12:59:12.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.994+0000 7f8fdb6af700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd40ca0b0 con 0x7f8fd40c9610 2023-10-16T12:59:12.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.994+0000 7f8fdb6af700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd40ca390 con 0x7f8fd4161a00 2023-10-16T12:59:12.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.994+0000 7f8fd9c4c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f8fd40ccb90 0x7f8fd40ccfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42466/0 (socket says 172.21.15.124:42466) 2023-10-16T12:59:12.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.994+0000 7f8fd9c4c700 1 -- 172.21.15.124:0/2309461043 learned_addr learned my addr 172.21.15.124:0/2309461043 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:12.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.994+0000 7f8fd944b700 1 --2- 172.21.15.124:0/2309461043 >> v2:172.21.15.192:3300/0 conn(0x7f8fd4161a00 0x7f8fd40cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.998+0000 7fe6f908a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6f40ae710 0x7fe6f414b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:39884/0 (socket says 172.21.15.124:39884) 2023-10-16T12:59:12.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.998+0000 7fe6f908a700 1 -- 172.21.15.124:0/3663403709 learned_addr learned my addr 172.21.15.124:0/3663403709 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:12.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.994+0000 7f8fd944b700 1 -- 172.21.15.124:0/2309461043 >> v2:172.21.15.124:3300/0 conn(0x7f8fd40c9610 msgr2=0x7f8fd40c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:12.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.994+0000 7f8fd944b700 1 --2- 172.21.15.124:0/2309461043 >> v2:172.21.15.124:3300/0 conn(0x7f8fd40c9610 0x7f8fd40c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.994+0000 7f8fd944b700 1 -- 172.21.15.124:0/2309461043 >> v1:172.21.15.124:6789/0 conn(0x7f8fd40ccb90 legacy=0x7f8fd40ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.994+0000 7f8fd944b700 1 -- 172.21.15.124:0/2309461043 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd40ca670 con 0x7f8fd4161a00 2023-10-16T12:59:12.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.995+0000 7f8fd944b700 1 --2- 172.21.15.124:0/2309461043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fd4161a00 0x7f8fd40cacf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40730e0 tx=0x7f8fd0009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36ff6a049915ae83 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:12.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.995+0000 7f8fcbfff700 1 -- 172.21.15.124:0/2309461043 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0011830 con 0x7f8fd4161a00 2023-10-16T12:59:12.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.995+0000 7f8fcbfff700 1 -- 172.21.15.124:0/2309461043 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd0011990 con 0x7f8fd4161a00 2023-10-16T12:59:12.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.995+0000 7f8fcbfff700 1 -- 172.21.15.124:0/2309461043 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0011d20 con 0x7f8fd4161a00 2023-10-16T12:59:12.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.996+0000 7f8fdb6af700 1 -- 172.21.15.124:0/2309461043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fd4161a00 msgr2=0x7f8fd40cacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.996+0000 7f8fdb6af700 1 --2- 172.21.15.124:0/2309461043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fd4161a00 0x7f8fd40cacf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40730e0 tx=0x7f8fd0009b20 comp rx=0 tx=0).stop 2023-10-16T12:59:12.094 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.996+0000 7f8fdb6af700 1 -- 172.21.15.124:0/2309461043 shutdown_connections 2023-10-16T12:59:12.094 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.996+0000 7f8fdb6af700 1 --2- 172.21.15.124:0/2309461043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fd4161a00 0x7f8fd40cacf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.094 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.996+0000 7f8fdb6af700 1 --2- 172.21.15.124:0/2309461043 >> v2:172.21.15.124:3300/0 conn(0x7f8fd40c9610 0x7f8fd40c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.095 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.996+0000 7f8fdb6af700 1 -- 172.21.15.124:0/2309461043 >> 172.21.15.124:0/2309461043 conn(0x7f8fd406c850 msgr2=0x7f8fd406cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:12.095 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.996+0000 7f8fdb6af700 1 -- 172.21.15.124:0/2309461043 shutdown_connections 2023-10-16T12:59:12.095 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.996+0000 7f8fdb6af700 1 -- 172.21.15.124:0/2309461043 wait complete. 2023-10-16T12:59:12.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.998+0000 7f61db7fe700 1 -- 172.21.15.124:0/3119845175 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e4003b70 con 0x7f61f406daf0 2023-10-16T12:59:12.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.997+0000 7f8fdb6af700 1 Processor -- start 2023-10-16T12:59:12.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.997+0000 7f8fdb6af700 1 -- start start 2023-10-16T12:59:12.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.998+0000 7f61f959f700 1 -- 172.21.15.124:0/3119845175 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f40ca280 con 0x7f61f406daf0 2023-10-16T12:59:12.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.998+0000 7f61f959f700 1 -- 172.21.15.124:0/3119845175 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f40c8040 con 0x7f61f406daf0 2023-10-16T12:59:12.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.998+0000 7fe6f908a700 1 -- 172.21.15.124:0/3663403709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6f4159cb0 msgr2=0x7fe6f414b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.998+0000 7fe6f908a700 1 --2- 172.21.15.124:0/3663403709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6f4159cb0 0x7fe6f414b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.998+0000 7fe6f908a700 1 -- 172.21.15.124:0/3663403709 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe6f406df30 msgr2=0x7fe6f4144c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.998+0000 7fe6f908a700 1 --2- 172.21.15.124:0/3663403709 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe6f406df30 0x7fe6f4144c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.998+0000 7fe6f908a700 1 -- 172.21.15.124:0/3663403709 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f0009550 con 0x7fe6f40ae710 2023-10-16T12:59:12.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.998+0000 7fe6f908a700 1 --2- 172.21.15.124:0/3663403709 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6f40ae710 0x7fe6f414b440 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec001ed0 tx=0x7fe6ec00a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:12.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.998+0000 7fe6ea7fc700 1 -- 172.21.15.124:0/3663403709 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec00ade0 con 0x7fe6f40ae710 2023-10-16T12:59:12.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.998+0000 7fe6ea7fc700 1 -- 172.21.15.124:0/3663403709 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ec0020d0 con 0x7fe6f40ae710 2023-10-16T12:59:12.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.998+0000 7fe6ea7fc700 1 -- 172.21.15.124:0/3663403709 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec003c20 con 0x7fe6f40ae710 2023-10-16T12:59:12.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.998+0000 7fe6fbaef700 1 -- 172.21.15.124:0/3663403709 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f414d6e0 con 0x7fe6f40ae710 2023-10-16T12:59:12.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.998+0000 7f8fdb6af700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fd40c9610 0x7f8fd4164b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.998+0000 7f8fdb6af700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8fd40ccb90 0x7f8fd413e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.101 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.998+0000 7f8fdb6af700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8fd4161a00 0x7f8fd415ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.101 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.998+0000 7f8fdb6af700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd40af6a0 con 0x7f8fd4161a00 2023-10-16T12:59:12.101 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.998+0000 7f8fdb6af700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd40aed90 con 0x7f8fd40c9610 2023-10-16T12:59:12.101 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.998+0000 7f8fdb6af700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd40b3240 con 0x7f8fd40ccb90 2023-10-16T12:59:12.101 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.999+0000 7f8fd944b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fd40c9610 0x7f8fd4164b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.999+0000 7f8fd944b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fd40c9610 0x7f8fd4164b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:33980/0 (socket says 172.21.15.124:33980) 2023-10-16T12:59:12.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.999+0000 7f8fd944b700 1 -- 172.21.15.124:0/2584829933 learned_addr learned my addr 172.21.15.124:0/2584829933 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:12.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.999+0000 7f8fd8c4a700 1 --2- 172.21.15.124:0/2584829933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8fd40ccb90 0x7f8fd413e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.999+0000 7f19fbfff700 1 -- 172.21.15.124:0/119836970 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a080557a0 con 0x7f19fc003a30 2023-10-16T12:59:12.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.999+0000 7f61f959f700 1 -- 172.21.15.124:0/3119845175 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f404ebb0 con 0x7f61f406daf0 2023-10-16T12:59:12.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.999+0000 7f8fd944b700 1 -- 172.21.15.124:0/2584829933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8fd40ccb90 msgr2=0x7f8fd413e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.999+0000 7f8fd944b700 1 --2- 172.21.15.124:0/2584829933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8fd40ccb90 0x7f8fd413e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.999+0000 7f8fd944b700 1 -- 172.21.15.124:0/2584829933 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8fd4161a00 msgr2=0x7f8fd415ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.999+0000 7f8fd944b700 1 --2- 172.21.15.124:0/2584829933 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8fd4161a00 0x7f8fd415ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.999+0000 7f8fd944b700 1 -- 172.21.15.124:0/2584829933 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd00094a0 con 0x7f8fd40c9610 2023-10-16T12:59:12.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.999+0000 7fb0effff700 1 -- 172.21.15.124:0/1504595653 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb0fc0541b0 con 0x7fb10806bef0 2023-10-16T12:59:12.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.999+0000 7f8fd944b700 1 --2- 172.21.15.124:0/2584829933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fd40c9610 0x7f8fd4164b40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0000c00 tx=0x7f8fd0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:12.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.998+0000 7fe6fbaef700 1 -- 172.21.15.124:0/3663403709 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f414dca0 con 0x7fe6f40ae710 2023-10-16T12:59:12.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.999+0000 7f61db7fe700 1 -- 172.21.15.124:0/3119845175 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e4003cd0 con 0x7f61f406daf0 2023-10-16T12:59:12.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.999+0000 7f61db7fe700 1 -- 172.21.15.124:0/3119845175 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e4006d00 con 0x7f61f406daf0 2023-10-16T12:59:12.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:11.999+0000 7f8fc9ffb700 1 -- 172.21.15.124:0/2584829933 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd00038a0 con 0x7f8fd40c9610 2023-10-16T12:59:12.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.000+0000 7f8fc9ffb700 1 -- 172.21.15.124:0/2584829933 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd001f070 con 0x7f8fd40c9610 2023-10-16T12:59:12.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.000+0000 7f8fc9ffb700 1 -- 172.21.15.124:0/2584829933 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0003c40 con 0x7f8fd40c9610 2023-10-16T12:59:12.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.000+0000 7f8fdb6af700 1 -- 172.21.15.124:0/2584829933 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd40af050 con 0x7f8fd40c9610 2023-10-16T12:59:12.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.000+0000 7f8fdb6af700 1 -- 172.21.15.124:0/2584829933 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd40b3520 con 0x7f8fd40c9610 2023-10-16T12:59:12.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.000+0000 7fe6ea7fc700 1 -- 172.21.15.124:0/3663403709 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe6ec012420 con 0x7fe6f40ae710 2023-10-16T12:59:12.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.000+0000 7fe9ddffb700 1 -- 172.21.15.124:0/955647997 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe9e4055d30 con 0x7fe9e806daf0 2023-10-16T12:59:12.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.000+0000 7fe6ea7fc700 1 --2- 172.21.15.124:0/3663403709 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe6d806af00 0x7fe6d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.001+0000 7fe6ea7fc700 1 -- 172.21.15.124:0/3663403709 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe6ec089a50 con 0x7fe6f40ae710 2023-10-16T12:59:12.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.001+0000 7f8fdb6af700 1 -- 172.21.15.124:0/2584829933 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd404f400 con 0x7f8fd40c9610 2023-10-16T12:59:12.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.001+0000 7f61db7fe700 1 -- 172.21.15.124:0/3119845175 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f61e402d480 con 0x7f61f406daf0 2023-10-16T12:59:12.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.002+0000 7f8fc9ffb700 1 -- 172.21.15.124:0/2584829933 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8fd001a430 con 0x7f8fd40c9610 2023-10-16T12:59:12.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.002+0000 7f61db7fe700 1 --2- 172.21.15.124:0/3119845175 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f61e006af00 0x7f61e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.002+0000 7f8fc9ffb700 1 --2- 172.21.15.124:0/2584829933 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f8fb806af00 0x7f8fb806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:12.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.002+0000 7f8fc9ffb700 1 -- 172.21.15.124:0/2584829933 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8fd0021070 con 0x7f8fd40c9610 2023-10-16T12:59:12.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.002+0000 7f61db7fe700 1 -- 172.21.15.124:0/3119845175 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f61e408b450 con 0x7f61f406daf0 2023-10-16T12:59:12.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.003+0000 7fe6fbaef700 1 -- 172.21.15.124:0/3663403709 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6dc0052f0 con 0x7fe6f40ae710 2023-10-16T12:59:12.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.003+0000 7f61f27fc700 1 --2- 172.21.15.124:0/3119845175 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f61e006af00 0x7f61e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.003+0000 7f61f27fc700 1 --2- 172.21.15.124:0/3119845175 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f61e006af00 0x7f61e006d3c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f61e8006f10 tx=0x7f61e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:12.113 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.005+0000 7f61db7fe700 1 -- 172.21.15.124:0/3119845175 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f61e40562a0 con 0x7f61f406daf0 2023-10-16T12:59:12.113 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.007+0000 7f8fc9ffb700 1 -- 172.21.15.124:0/2584829933 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8fd0056140 con 0x7f8fd40c9610 2023-10-16T12:59:12.113 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.009+0000 7f2daffff700 1 -- 172.21.15.124:0/1614233597 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2db80564f0 con 0x7f2dc80cd920 2023-10-16T12:59:12.114 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.011+0000 7f8fd8c4a700 1 --2- 172.21.15.124:0/2584829933 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f8fb806af00 0x7f8fb806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.114 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.015+0000 7fe6f988b700 1 --2- 172.21.15.124:0/3663403709 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe6d806af00 0x7fe6d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:12.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.015+0000 7f8fd8c4a700 1 --2- 172.21.15.124:0/2584829933 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f8fb806af00 0x7f8fb806d3c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4165080 tx=0x7f8fc4009110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:12.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.026+0000 7fe6f988b700 1 --2- 172.21.15.124:0/3663403709 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe6d806af00 0x7fe6d806d3c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40ae6a0 tx=0x7fe6e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:12.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.035+0000 7fe6ea7fc700 1 -- 172.21.15.124:0/3663403709 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe6ec0548a0 con 0x7fe6f40ae710 2023-10-16T12:59:12.384 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.382+0000 7f6f632f2700 1 -- 172.21.15.124:0/3407812223 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6f3c005870 con 0x7f6f5c071210 2023-10-16T12:59:12.384 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.383+0000 7f6f51ffb700 1 -- 172.21.15.124:0/3407812223 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6f4c017090 con 0x7f6f5c071210 2023-10-16T12:59:12.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.383+0000 7f61f959f700 1 -- 172.21.15.124:0/3119845175 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f61f40ced50 con 0x7f61f406daf0 2023-10-16T12:59:12.385 INFO:teuthology.orchestra.run.smithi124.stdout:55834574857 2023-10-16T12:59:12.387 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.386+0000 7f61db7fe700 1 -- 172.21.15.124:0/3119845175 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f61e40598c0 con 0x7f61f406daf0 2023-10-16T12:59:12.388 INFO:teuthology.orchestra.run.smithi124.stdout:55834574857 2023-10-16T12:59:12.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.387+0000 7f6f632f2700 1 -- 172.21.15.124:0/3407812223 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6f4006af00 msgr2=0x7f6f4006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.387+0000 7f6f632f2700 1 --2- 172.21.15.124:0/3407812223 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6f4006af00 0x7f6f4006d3c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6f58007fd0 tx=0x7f6f58009040 comp rx=0 tx=0).stop 2023-10-16T12:59:12.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.387+0000 7f6f632f2700 1 -- 172.21.15.124:0/3407812223 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f5c071210 msgr2=0x7f6f5c0c4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.387+0000 7f6f632f2700 1 --2- 172.21.15.124:0/3407812223 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f5c071210 0x7f6f5c0c4ab0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c001eb0 tx=0x7f6f4c00c800 comp rx=0 tx=0).stop 2023-10-16T12:59:12.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.388+0000 7f6f632f2700 1 -- 172.21.15.124:0/3407812223 shutdown_connections 2023-10-16T12:59:12.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.388+0000 7f6f632f2700 1 --2- 172.21.15.124:0/3407812223 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6f4006af00 0x7f6f4006d3c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.388+0000 7f6f632f2700 1 --2- 172.21.15.124:0/3407812223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f5c0cd4b0 0x7f6f5c0c3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.388+0000 7f6f632f2700 1 --2- 172.21.15.124:0/3407812223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f5c06bf80 0x7f6f5c160470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.388+0000 7f6f632f2700 1 --2- 172.21.15.124:0/3407812223 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f5c071210 0x7f6f5c0c4ab0 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c001eb0 tx=0x7f6f4c00c800 comp rx=0 tx=0).stop 2023-10-16T12:59:12.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.388+0000 7f6f632f2700 1 -- 172.21.15.124:0/3407812223 >> 172.21.15.124:0/3407812223 conn(0x7f6f5c0cfcd0 msgr2=0x7f6f5c161ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:12.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.389+0000 7f61f959f700 1 -- 172.21.15.124:0/3119845175 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f61e006af00 msgr2=0x7f61e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.389+0000 7f61f959f700 1 --2- 172.21.15.124:0/3119845175 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f61e006af00 0x7f61e006d3c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f61e8006f10 tx=0x7f61e8008040 comp rx=0 tx=0).stop 2023-10-16T12:59:12.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.389+0000 7f61f959f700 1 -- 172.21.15.124:0/3119845175 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61f406daf0 msgr2=0x7f61f41eb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.389+0000 7f61f959f700 1 --2- 172.21.15.124:0/3119845175 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61f406daf0 0x7f61f41eb0a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f61e400bee0 tx=0x7f61e4004750 comp rx=0 tx=0).stop 2023-10-16T12:59:12.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.390+0000 7f61f959f700 1 -- 172.21.15.124:0/3119845175 shutdown_connections 2023-10-16T12:59:12.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.390+0000 7f61f959f700 1 --2- 172.21.15.124:0/3119845175 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f61e006af00 0x7f61e006d3c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.390+0000 7f61f959f700 1 --2- 172.21.15.124:0/3119845175 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61f415b450 0x7f61f40c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.390+0000 7f61f959f700 1 --2- 172.21.15.124:0/3119845175 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61f406daf0 0x7f61f41eb0a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.390+0000 7f61f959f700 1 --2- 172.21.15.124:0/3119845175 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f61f40cf5c0 0x7f61f41549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.390+0000 7f61f959f700 1 -- 172.21.15.124:0/3119845175 >> 172.21.15.124:0/3119845175 conn(0x7f61f40ccbe0 msgr2=0x7f61f40ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:12.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.390+0000 7f61f959f700 1 -- 172.21.15.124:0/3119845175 shutdown_connections 2023-10-16T12:59:12.393 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.390+0000 7f61f959f700 1 -- 172.21.15.124:0/3119845175 wait complete. 2023-10-16T12:59:12.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.390+0000 7f6f632f2700 1 -- 172.21.15.124:0/3407812223 shutdown_connections 2023-10-16T12:59:12.394 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.390+0000 7f6f632f2700 1 -- 172.21.15.124:0/3407812223 wait complete. 2023-10-16T12:59:12.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.405+0000 7f2dcddef700 1 -- 172.21.15.124:0/1614233597 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2da80055a0 con 0x7f2dc80cd920 2023-10-16T12:59:12.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.405+0000 7fb10da14700 1 -- 172.21.15.124:0/1504595653 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb0e8005870 con 0x7fb10806bef0 2023-10-16T12:59:12.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.406+0000 7f2daffff700 1 -- 172.21.15.124:0/1614233597 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2db8059740 con 0x7f2dc80cd920 2023-10-16T12:59:12.408 INFO:teuthology.orchestra.run.smithi124.stdout:55834574858 2023-10-16T12:59:12.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.407+0000 7f1a19d2e700 1 -- 172.21.15.124:0/119836970 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f19f4005870 con 0x7f19fc003a30 2023-10-16T12:59:12.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.407+0000 7fb0effff700 1 -- 172.21.15.124:0/1504595653 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb0fc0577d0 con 0x7fb10806bef0 2023-10-16T12:59:12.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.408+0000 7f19fbfff700 1 -- 172.21.15.124:0/119836970 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a08020090 con 0x7f19fc003a30 2023-10-16T12:59:12.410 INFO:teuthology.orchestra.run.smithi124.stdout:55834574856 2023-10-16T12:59:12.410 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.408+0000 7f8fdb6af700 1 -- 172.21.15.124:0/2584829933 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8fd40cdc00 con 0x7f8fd40c9610 2023-10-16T12:59:12.411 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.408+0000 7f8fc9ffb700 1 -- 172.21.15.124:0/2584829933 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8fd0059760 con 0x7f8fd40c9610 2023-10-16T12:59:12.412 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2023-10-16T12:59:12.412 INFO:teuthology.orchestra.run.smithi124.stdout:55834574857 2023-10-16T12:59:12.412 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.410+0000 7f2dcddef700 1 -- 172.21.15.124:0/1614233597 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f2db406af00 msgr2=0x7f2db406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.413 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.410+0000 7f2dcddef700 1 --2- 172.21.15.124:0/1614233597 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f2db406af00 0x7f2db406d3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc000f60 tx=0x7f2dbc007d30 comp rx=0 tx=0).stop 2023-10-16T12:59:12.413 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.410+0000 7f2dcddef700 1 -- 172.21.15.124:0/1614233597 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2dc80cd920 msgr2=0x7f2dc814cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.413 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.410+0000 7f2dcddef700 1 --2- 172.21.15.124:0/1614233597 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2dc80cd920 0x7f2dc814cc10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2dc806b760 tx=0x7f2db8004750 comp rx=0 tx=0).stop 2023-10-16T12:59:12.413 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.410+0000 7f2dcddef700 1 -- 172.21.15.124:0/1614233597 shutdown_connections 2023-10-16T12:59:12.414 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.410+0000 7f2dcddef700 1 --2- 172.21.15.124:0/1614233597 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f2db406af00 0x7f2db406d3c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.414 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.410+0000 7f2dcddef700 1 --2- 172.21.15.124:0/1614233597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2dc814edc0 0x7f2dc814fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.414 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.410+0000 7f2dcddef700 1 --2- 172.21.15.124:0/1614233597 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2dc80cd920 0x7f2dc814cc10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.414 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.410+0000 7f2dcddef700 1 --2- 172.21.15.124:0/1614233597 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2dc8159510 0x7f2dc814e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.414 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.410+0000 7f2dcddef700 1 -- 172.21.15.124:0/1614233597 >> 172.21.15.124:0/1614233597 conn(0x7f2dc806c850 msgr2=0x7f2dc80705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:12.414 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.410+0000 7f2dcddef700 1 -- 172.21.15.124:0/1614233597 shutdown_connections 2023-10-16T12:59:12.415 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.410+0000 7f2dcddef700 1 -- 172.21.15.124:0/1614233597 wait complete. 2023-10-16T12:59:12.415 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.411+0000 7f8fdb6af700 1 -- 172.21.15.124:0/2584829933 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f8fb806af00 msgr2=0x7f8fb806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.415 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.411+0000 7f8fdb6af700 1 --2- 172.21.15.124:0/2584829933 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f8fb806af00 0x7f8fb806d3c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4165080 tx=0x7f8fc4009110 comp rx=0 tx=0).stop 2023-10-16T12:59:12.416 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.411+0000 7f8fdb6af700 1 -- 172.21.15.124:0/2584829933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fd40c9610 msgr2=0x7f8fd4164b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.416 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.411+0000 7f8fdb6af700 1 --2- 172.21.15.124:0/2584829933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fd40c9610 0x7f8fd4164b40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0000c00 tx=0x7f8fd0004750 comp rx=0 tx=0).stop 2023-10-16T12:59:12.416 INFO:teuthology.orchestra.run.smithi124.stdout:55834574858 2023-10-16T12:59:12.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.411+0000 7f1a19d2e700 1 -- 172.21.15.124:0/119836970 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1a0006af50 msgr2=0x7f1a0006d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.411+0000 7f1a19d2e700 1 --2- 172.21.15.124:0/119836970 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1a0006af50 0x7f1a0006d410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1a040017a0 tx=0x7f1a04007040 comp rx=0 tx=0).stop 2023-10-16T12:59:12.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.411+0000 7f1a19d2e700 1 -- 172.21.15.124:0/119836970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19fc003a30 msgr2=0x7f1a140c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.418 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.411+0000 7f1a19d2e700 1 --2- 172.21.15.124:0/119836970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19fc003a30 0x7f1a140c91b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1a080044c0 tx=0x7f1a08003780 comp rx=0 tx=0).stop 2023-10-16T12:59:12.418 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.412+0000 7f1a19d2e700 1 -- 172.21.15.124:0/119836970 shutdown_connections 2023-10-16T12:59:12.418 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.412+0000 7f1a19d2e700 1 --2- 172.21.15.124:0/119836970 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1a0006af50 0x7f1a0006d410 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.418 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.412+0000 7f1a19d2e700 1 --2- 172.21.15.124:0/119836970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a140cc170 0x7f1a140cd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.418 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.412+0000 7f1a19d2e700 1 --2- 172.21.15.124:0/119836970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19fc003a30 0x7f1a140c91b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.412+0000 7f1a19d2e700 1 --2- 172.21.15.124:0/119836970 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1a1415a4f0 0x7f1a140ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.412+0000 7f1a19d2e700 1 -- 172.21.15.124:0/119836970 >> 172.21.15.124:0/119836970 conn(0x7f1a14072340 msgr2=0x7f1a14158170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:12.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.412+0000 7f1a19d2e700 1 -- 172.21.15.124:0/119836970 shutdown_connections 2023-10-16T12:59:12.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.412+0000 7f1a19d2e700 1 -- 172.21.15.124:0/119836970 wait complete. 2023-10-16T12:59:12.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.412+0000 7f8fdb6af700 1 -- 172.21.15.124:0/2584829933 shutdown_connections 2023-10-16T12:59:12.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.412+0000 7f8fdb6af700 1 --2- 172.21.15.124:0/2584829933 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f8fb806af00 0x7f8fb806d3c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.412+0000 7f8fdb6af700 1 --2- 172.21.15.124:0/2584829933 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8fd4161a00 0x7f8fd415ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.412+0000 7f8fdb6af700 1 --2- 172.21.15.124:0/2584829933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fd40c9610 0x7f8fd4164b40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.412+0000 7f8fdb6af700 1 --2- 172.21.15.124:0/2584829933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8fd40ccb90 0x7f8fd413e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.421 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.412+0000 7f8fdb6af700 1 -- 172.21.15.124:0/2584829933 >> 172.21.15.124:0/2584829933 conn(0x7f8fd406c850 msgr2=0x7f8fd40705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:12.421 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.412+0000 7fe9ef70e700 1 -- 172.21.15.124:0/955647997 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe9e80cda80 con 0x7fe9e806daf0 2023-10-16T12:59:12.421 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.412+0000 7f8fdb6af700 1 -- 172.21.15.124:0/2584829933 shutdown_connections 2023-10-16T12:59:12.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.412+0000 7f8fdb6af700 1 -- 172.21.15.124:0/2584829933 wait complete. 2023-10-16T12:59:12.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.413+0000 7fe9ddffb700 1 -- 172.21.15.124:0/955647997 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe9e4020020 con 0x7fe9e806daf0 2023-10-16T12:59:12.422 INFO:teuthology.orchestra.run.smithi124.stdout:55834574857 2023-10-16T12:59:12.423 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.415+0000 7fe9ef70e700 1 -- 172.21.15.124:0/955647997 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe9cc06af50 msgr2=0x7fe9cc06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.423 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.415+0000 7fe9ef70e700 1 --2- 172.21.15.124:0/955647997 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe9cc06af50 0x7fe9cc06d410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe9e815ba00 tx=0x7fe9d8008040 comp rx=0 tx=0).stop 2023-10-16T12:59:12.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.415+0000 7fe9ef70e700 1 -- 172.21.15.124:0/955647997 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9e806daf0 msgr2=0x7fe9e81e7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.416+0000 7fe9ef70e700 1 --2- 172.21.15.124:0/955647997 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9e806daf0 0x7fe9e81e7ea0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4000c00 tx=0x7fe9e4004750 comp rx=0 tx=0).stop 2023-10-16T12:59:12.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.417+0000 7fe9ef70e700 1 -- 172.21.15.124:0/955647997 shutdown_connections 2023-10-16T12:59:12.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.417+0000 7fe9ef70e700 1 --2- 172.21.15.124:0/955647997 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe9cc06af50 0x7fe9cc06d410 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.424 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.417+0000 7fe9ef70e700 1 --2- 172.21.15.124:0/955647997 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9e80cd5a0 0x7fe9e81e9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.417+0000 7fe9ef70e700 1 --2- 172.21.15.124:0/955647997 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe9e806daf0 0x7fe9e81e7ea0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.417+0000 7fe9ef70e700 1 --2- 172.21.15.124:0/955647997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9e80cb230 0x7fe9e81eb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.417+0000 7fe9ef70e700 1 -- 172.21.15.124:0/955647997 >> 172.21.15.124:0/955647997 conn(0x7fe9e80cbad0 msgr2=0x7fe9e80b47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:12.425 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.417+0000 7fb10da14700 1 -- 172.21.15.124:0/1504595653 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb0f406af00 msgr2=0x7fb0f406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.426 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.417+0000 7fb10da14700 1 --2- 172.21.15.124:0/1504595653 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb0f406af00 0x7fb0f406d3c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80011e0 tx=0x7fb0f8009040 comp rx=0 tx=0).stop 2023-10-16T12:59:12.426 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.417+0000 7fb10da14700 1 -- 172.21.15.124:0/1504595653 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb10806bef0 msgr2=0x7fb108200050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.426 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.417+0000 7fb10da14700 1 --2- 172.21.15.124:0/1504595653 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb10806bef0 0x7fb108200050 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00c7f0 tx=0x7fb0fc00cb00 comp rx=0 tx=0).stop 2023-10-16T12:59:12.426 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.418+0000 7fb10da14700 1 -- 172.21.15.124:0/1504595653 shutdown_connections 2023-10-16T12:59:12.426 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.418+0000 7fb10da14700 1 --2- 172.21.15.124:0/1504595653 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb0f406af00 0x7fb0f406d3c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.418+0000 7fb10da14700 1 --2- 172.21.15.124:0/1504595653 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb10815d890 0x7fb1081fede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.418+0000 7fb10da14700 1 --2- 172.21.15.124:0/1504595653 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb10806bef0 0x7fb108200050 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.418+0000 7fb10da14700 1 --2- 172.21.15.124:0/1504595653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1080ce610 0x7fb10815fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.418+0000 7fb10da14700 1 -- 172.21.15.124:0/1504595653 >> 172.21.15.124:0/1504595653 conn(0x7fb108072340 msgr2=0x7fb1080b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:12.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.418+0000 7fe9ef70e700 1 -- 172.21.15.124:0/955647997 shutdown_connections 2023-10-16T12:59:12.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.418+0000 7fe9ef70e700 1 -- 172.21.15.124:0/955647997 wait complete. 2023-10-16T12:59:12.429 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2023-10-16T12:59:12.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.418+0000 7fb10da14700 1 -- 172.21.15.124:0/1504595653 shutdown_connections 2023-10-16T12:59:12.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.418+0000 7fb10da14700 1 -- 172.21.15.124:0/1504595653 wait complete. 2023-10-16T12:59:12.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.1 2023-10-16T12:59:12.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2023-10-16T12:59:12.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2023-10-16T12:59:12.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2023-10-16T12:59:12.439 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.438+0000 7fe6fbaef700 1 -- 172.21.15.124:0/3663403709 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe6dc005870 con 0x7fe6f40ae710 2023-10-16T12:59:12.440 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.438+0000 7fe6ea7fc700 1 -- 172.21.15.124:0/3663403709 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe6ec057ec0 con 0x7fe6f40ae710 2023-10-16T12:59:12.440 INFO:teuthology.orchestra.run.smithi124.stdout:55834574857 2023-10-16T12:59:12.443 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.441+0000 7fe6fbaef700 1 -- 172.21.15.124:0/3663403709 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe6d806af00 msgr2=0x7fe6d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.443 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.441+0000 7fe6fbaef700 1 --2- 172.21.15.124:0/3663403709 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe6d806af00 0x7fe6d806d3c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40ae6a0 tx=0x7fe6e4008040 comp rx=0 tx=0).stop 2023-10-16T12:59:12.443 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.441+0000 7fe6fbaef700 1 -- 172.21.15.124:0/3663403709 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6f40ae710 msgr2=0x7fe6f414b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:12.443 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.441+0000 7fe6fbaef700 1 --2- 172.21.15.124:0/3663403709 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6f40ae710 0x7fe6f414b440 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec001ed0 tx=0x7fe6ec00a340 comp rx=0 tx=0).stop 2023-10-16T12:59:12.444 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.441+0000 7fe6fbaef700 1 -- 172.21.15.124:0/3663403709 shutdown_connections 2023-10-16T12:59:12.444 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.441+0000 7fe6fbaef700 1 --2- 172.21.15.124:0/3663403709 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe6d806af00 0x7fe6d806d3c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.444 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.441+0000 7fe6fbaef700 1 --2- 172.21.15.124:0/3663403709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6f4159cb0 0x7fe6f414b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.444 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.441+0000 7fe6fbaef700 1 --2- 172.21.15.124:0/3663403709 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe6f406df30 0x7fe6f4144c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.444 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.441+0000 7fe6fbaef700 1 --2- 172.21.15.124:0/3663403709 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6f40ae710 0x7fe6f414b440 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:12.445 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.441+0000 7fe6fbaef700 1 -- 172.21.15.124:0/3663403709 >> 172.21.15.124:0/3663403709 conn(0x7fe6f40b1620 msgr2=0x7fe6f40b09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:12.445 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.441+0000 7fe6fbaef700 1 -- 172.21.15.124:0/3663403709 shutdown_connections 2023-10-16T12:59:12.445 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:12.441+0000 7fe6fbaef700 1 -- 172.21.15.124:0/3663403709 wait complete. 2023-10-16T12:59:12.446 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.2 2023-10-16T12:59:12.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2023-10-16T12:59:13.412 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-16T12:59:13.430 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-16T12:59:13.433 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-16T12:59:13.437 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-16T12:59:13.439 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-16T12:59:13.439 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-16T12:59:13.447 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-16T12:59:13.457 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-16T12:59:13.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.613+0000 7f9811b93700 1 Processor -- start 2023-10-16T12:59:13.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.613+0000 7f9811b93700 1 -- start start 2023-10-16T12:59:13.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.615+0000 7f9811b93700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f980c0cd5a0 0x7f980c0c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.615+0000 7f9811b93700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f980c0cb230 0x7f980c0c5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.615+0000 7f9811b93700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980c0c4970 con 0x7f980c06daf0 2023-10-16T12:59:13.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.615+0000 7f9811b93700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c0c4040 con 0x7f980c0cb230 2023-10-16T12:59:13.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.615+0000 7f9811b93700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c0c4320 con 0x7f980c0cd5a0 2023-10-16T12:59:13.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.615+0000 7f980bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f980c0cb230 0x7f980c0c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.615+0000 7f980bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f980c0cb230 0x7f980c0c5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:33992/0 (socket says 172.21.15.124:33992) 2023-10-16T12:59:13.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.615+0000 7f980bfff700 1 -- 172.21.15.124:0/706050095 learned_addr learned my addr 172.21.15.124:0/706050095 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:13.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.616+0000 7f980affd700 1 --2- 172.21.15.124:0/706050095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f980c0cd5a0 0x7f980c0c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.616+0000 7f980bfff700 1 -- 172.21.15.124:0/706050095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f980c0cd5a0 msgr2=0x7f980c0c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:13.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.616+0000 7f980bfff700 1 --2- 172.21.15.124:0/706050095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f980c0cd5a0 0x7f980c0c4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.616+0000 7f980bfff700 1 -- 172.21.15.124:0/706050095 >> v1:172.21.15.124:6789/0 conn(0x7f980c06daf0 legacy=0x7f980c06ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.616+0000 7f980bfff700 1 -- 172.21.15.124:0/706050095 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c0c4600 con 0x7f980c0cb230 2023-10-16T12:59:13.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.616+0000 7f980bfff700 1 --2- 172.21.15.124:0/706050095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f980c0cb230 0x7f980c0c5340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f97fc009920 tx=0x7f97fc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d970bd010b5194d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:13.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.623+0000 7f980a7fc700 1 -- 172.21.15.124:0/706050095 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc011830 con 0x7f980c0cb230 2023-10-16T12:59:13.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.623+0000 7f980a7fc700 1 -- 172.21.15.124:0/706050095 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc011990 con 0x7f980c0cb230 2023-10-16T12:59:13.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.623+0000 7f980a7fc700 1 -- 172.21.15.124:0/706050095 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc011d20 con 0x7f980c0cb230 2023-10-16T12:59:13.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.624+0000 7f9811b93700 1 -- 172.21.15.124:0/706050095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f980c0cb230 msgr2=0x7f980c0c5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.624+0000 7f9811b93700 1 --2- 172.21.15.124:0/706050095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f980c0cb230 0x7f980c0c5340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f97fc009920 tx=0x7f97fc009c30 comp rx=0 tx=0).stop 2023-10-16T12:59:13.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.625+0000 7f9811b93700 1 -- 172.21.15.124:0/706050095 shutdown_connections 2023-10-16T12:59:13.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.625+0000 7f9811b93700 1 --2- 172.21.15.124:0/706050095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f980c0cb230 0x7f980c0c5340 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.625+0000 7f9811b93700 1 --2- 172.21.15.124:0/706050095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f980c0cd5a0 0x7f980c0c4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.625+0000 7f9811b93700 1 -- 172.21.15.124:0/706050095 >> 172.21.15.124:0/706050095 conn(0x7f980c0cbad0 msgr2=0x7f980c0cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:13.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.625+0000 7f9811b93700 1 -- 172.21.15.124:0/706050095 shutdown_connections 2023-10-16T12:59:13.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.625+0000 7f9811b93700 1 -- 172.21.15.124:0/706050095 wait complete. 2023-10-16T12:59:13.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.627+0000 7f9811b93700 1 Processor -- start 2023-10-16T12:59:13.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.628+0000 7f9811b93700 1 -- start start 2023-10-16T12:59:13.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.629+0000 7f9811b93700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f980c06daf0 0x7f980c148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.629+0000 7f9811b93700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f980c0cb230 0x7f980c147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.629+0000 7f9811b93700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f980c0cd5a0 0x7f980c153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.629+0000 7f9811b93700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c147940 con 0x7f980c0cb230 2023-10-16T12:59:13.632 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.629+0000 7f9811b93700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c1533f0 con 0x7f980c0cd5a0 2023-10-16T12:59:13.632 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.629+0000 7f9811b93700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c13e940 con 0x7f980c06daf0 2023-10-16T12:59:13.632 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.630+0000 7f980bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f980c0cd5a0 0x7f980c153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.633 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.630+0000 7f980b7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f980c06daf0 0x7f980c148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.633 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.630+0000 7f980b7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f980c06daf0 0x7f980c148d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:39908/0 (socket says 172.21.15.124:39908) 2023-10-16T12:59:13.633 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.630+0000 7f980b7fe700 1 -- 172.21.15.124:0/2018278821 learned_addr learned my addr 172.21.15.124:0/2018278821 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:13.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.630+0000 7f980affd700 1 --2- 172.21.15.124:0/2018278821 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f980c0cb230 0x7f980c147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.631+0000 7f980affd700 1 -- 172.21.15.124:0/2018278821 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f980c06daf0 msgr2=0x7f980c148d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.641 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.631+0000 7f980affd700 1 --2- 172.21.15.124:0/2018278821 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f980c06daf0 0x7f980c148d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.631+0000 7f980affd700 1 -- 172.21.15.124:0/2018278821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f980c0cd5a0 msgr2=0x7f980c153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.631+0000 7f980affd700 1 --2- 172.21.15.124:0/2018278821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f980c0cd5a0 0x7f980c153a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.631+0000 7f980affd700 1 -- 172.21.15.124:0/2018278821 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97fc009550 con 0x7f980c0cb230 2023-10-16T12:59:13.642 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.631+0000 7f980affd700 1 --2- 172.21.15.124:0/2018278821 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f980c0cb230 0x7f980c147dd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f980000e8a0 tx=0x7f980000ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:13.643 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.632+0000 7f97f3fff700 1 -- 172.21.15.124:0/2018278821 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800013680 con 0x7f980c0cb230 2023-10-16T12:59:13.643 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.632+0000 7f97f3fff700 1 -- 172.21.15.124:0/2018278821 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98000137e0 con 0x7f980c0cb230 2023-10-16T12:59:13.643 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.632+0000 7f97f3fff700 1 -- 172.21.15.124:0/2018278821 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800013b90 con 0x7f980c0cb230 2023-10-16T12:59:13.643 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.632+0000 7f9811b93700 1 -- 172.21.15.124:0/2018278821 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f980c149410 con 0x7f980c0cb230 2023-10-16T12:59:13.643 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.632+0000 7f9811b93700 1 -- 172.21.15.124:0/2018278821 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980c1499d0 con 0x7f980c0cb230 2023-10-16T12:59:13.643 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.637+0000 7f97f3fff700 1 -- 172.21.15.124:0/2018278821 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9800013cf0 con 0x7f980c0cb230 2023-10-16T12:59:13.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.638+0000 7f97f3fff700 1 --2- 172.21.15.124:0/2018278821 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f97f806afd0 0x7f97f806d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.638+0000 7f97f3fff700 1 -- 172.21.15.124:0/2018278821 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f98000898b0 con 0x7f980c0cb230 2023-10-16T12:59:13.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.640+0000 7f9811b93700 1 -- 172.21.15.124:0/2018278821 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ec0052f0 con 0x7f980c0cb230 2023-10-16T12:59:13.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.640+0000 7f980b7fe700 1 --2- 172.21.15.124:0/2018278821 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f97f806afd0 0x7f97f806d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.641+0000 7f980b7fe700 1 --2- 172.21.15.124:0/2018278821 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f97f806afd0 0x7f97f806d490 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f980c1547a0 tx=0x7f9804009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:13.653 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.649+0000 7f97f3fff700 1 -- 172.21.15.124:0/2018278821 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9800054650 con 0x7f980c0cb230 2023-10-16T12:59:13.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.671+0000 7f02f51c9700 1 Processor -- start 2023-10-16T12:59:13.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.671+0000 7f02f51c9700 1 -- start start 2023-10-16T12:59:13.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.672+0000 7f02f51c9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02f0071bb0 0x7f02f00c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.672+0000 7f02f51c9700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f00c54e0 con 0x7f02f0144de0 2023-10-16T12:59:13.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.672+0000 7f02f51c9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f00c57c0 con 0x7f02f006daf0 2023-10-16T12:59:13.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.672+0000 7f02f51c9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f00c5aa0 con 0x7f02f0071bb0 2023-10-16T12:59:13.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.673+0000 7f02ef59e700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f02f0144de0 0x7f02f00c4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42508/0 (socket says 172.21.15.124:42508) 2023-10-16T12:59:13.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.673+0000 7f02ef59e700 1 -- 172.21.15.124:0/3197457864 learned_addr learned my addr 172.21.15.124:0/3197457864 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:13.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.673+0000 7f02edd9b700 1 -- 172.21.15.124:0/3197457864 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369485936 0 0) 0x7f02f00c57c0 con 0x7f02f006daf0 2023-10-16T12:59:13.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.673+0000 7f02edd9b700 1 -- 172.21.15.124:0/3197457864 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02d80035b0 con 0x7f02f006daf0 2023-10-16T12:59:13.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.674+0000 7f02edd9b700 1 -- 172.21.15.124:0/3197457864 <== mon.1 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3890567409 0 0) 0x7f02d80035b0 con 0x7f02f006daf0 2023-10-16T12:59:13.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.674+0000 7f02edd9b700 1 -- 172.21.15.124:0/3197457864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02f0071bb0 msgr2=0x7f02f00c3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:13.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.674+0000 7f02edd9b700 1 --2- 172.21.15.124:0/3197457864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02f0071bb0 0x7f02f00c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.674+0000 7f02edd9b700 1 -- 172.21.15.124:0/3197457864 >> v1:172.21.15.124:6789/0 conn(0x7f02f0144de0 legacy=0x7f02f00c4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:13.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.674+0000 7f02edd9b700 1 -- 172.21.15.124:0/3197457864 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f00c5d80 con 0x7f02f006daf0 2023-10-16T12:59:13.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.674+0000 7f02edd9b700 1 -- 172.21.15.124:0/3197457864 <== mon.1 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f02e0001670 con 0x7f02f006daf0 2023-10-16T12:59:13.678 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.674+0000 7f02edd9b700 1 -- 172.21.15.124:0/3197457864 >> v1:172.21.15.192:6789/0 conn(0x7f02f006daf0 legacy=0x7f02f006ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.674+0000 7f02edd9b700 1 --2- 172.21.15.124:0/3197457864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02d8003a00 0x7f02d8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.674+0000 7f02edd9b700 1 --2- 172.21.15.124:0/3197457864 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02d8004850 0x7f02d8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.674+0000 7f02edd9b700 1 --2- 172.21.15.124:0/3197457864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02d8005280 0x7f02d800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.674+0000 7f02edd9b700 1 -- 172.21.15.124:0/3197457864 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f00c5aa0 con 0x7f02d8004850 2023-10-16T12:59:13.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.674+0000 7f02edd9b700 1 -- 172.21.15.124:0/3197457864 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d800c140 con 0x7f02d8003a00 2023-10-16T12:59:13.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.674+0000 7f02edd9b700 1 -- 172.21.15.124:0/3197457864 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d800c300 con 0x7f02d8005280 2023-10-16T12:59:13.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.674+0000 7f02eed9d700 1 --2- 172.21.15.124:0/3197457864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02d8003a00 0x7f02d8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.674+0000 7f02ef59e700 1 --2- 172.21.15.124:0/3197457864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02d8005280 0x7f02d800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.675+0000 7f02eed9d700 1 -- 172.21.15.124:0/3197457864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02d8005280 msgr2=0x7f02d800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:13.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.675+0000 7f02eed9d700 1 --2- 172.21.15.124:0/3197457864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02d8005280 0x7f02d800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.675+0000 7f02eed9d700 1 -- 172.21.15.124:0/3197457864 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02d8004850 msgr2=0x7f02d8004cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T12:59:13.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.675+0000 7f02eed9d700 1 --2- 172.21.15.124:0/3197457864 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02d8004850 0x7f02d8004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.675+0000 7f02eed9d700 1 -- 172.21.15.124:0/3197457864 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d80035b0 con 0x7f02d8003a00 2023-10-16T12:59:13.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.675+0000 7f02ef59e700 1 --2- 172.21.15.124:0/3197457864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02d8005280 0x7f02d800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:59:13.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.675+0000 7f02eed9d700 1 --2- 172.21.15.124:0/3197457864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02d8003a00 0x7f02d8003e00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f02e000c190 tx=0x7f02d8005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac20db9891e14155 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:13.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.675+0000 7f02edd9b700 1 -- 172.21.15.124:0/3197457864 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e000cc70 con 0x7f02d8003a00 2023-10-16T12:59:13.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.675+0000 7f02edd9b700 1 -- 172.21.15.124:0/3197457864 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e000cdd0 con 0x7f02d8003a00 2023-10-16T12:59:13.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.675+0000 7f02edd9b700 1 -- 172.21.15.124:0/3197457864 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0006aa0 con 0x7f02d8003a00 2023-10-16T12:59:13.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.676+0000 7f02f51c9700 1 -- 172.21.15.124:0/3197457864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02d8003a00 msgr2=0x7f02d8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.676+0000 7f02f51c9700 1 --2- 172.21.15.124:0/3197457864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02d8003a00 0x7f02d8003e00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f02e000c190 tx=0x7f02d8005880 comp rx=0 tx=0).stop 2023-10-16T12:59:13.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.676+0000 7f02ef59e700 1 -- 172.21.15.124:0/3197457864 reap_dead start 2023-10-16T12:59:13.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.676+0000 7f02f51c9700 1 -- 172.21.15.124:0/3197457864 shutdown_connections 2023-10-16T12:59:13.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.676+0000 7f02f51c9700 1 -- 172.21.15.124:0/3197457864 >> 172.21.15.124:0/3197457864 conn(0x7f02f00cbad0 msgr2=0x7f02f00cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:13.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.677+0000 7f799e1f0700 1 Processor -- start 2023-10-16T12:59:13.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.677+0000 7f799e1f0700 1 -- start start 2023-10-16T12:59:13.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.678+0000 7f799e1f0700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f799806dd60 0x7f799816e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.678+0000 7f799e1f0700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f799806e140 0x7f79980c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.678+0000 7f799e1f0700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79980cd7b0 con 0x7f79980cae00 2023-10-16T12:59:13.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.678+0000 7f799e1f0700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79980cd5a0 con 0x7f799806e140 2023-10-16T12:59:13.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.678+0000 7f799e1f0700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79980ca950 con 0x7f799806dd60 2023-10-16T12:59:13.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.678+0000 7f7997fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f799806e140 0x7f79980c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.679+0000 7f7997fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f799806e140 0x7f79980c4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53852/0 (socket says 172.21.15.124:53852) 2023-10-16T12:59:13.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.679+0000 7f7997fff700 1 -- 172.21.15.124:0/1179404666 learned_addr learned my addr 172.21.15.124:0/1179404666 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:13.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.679+0000 7f79977fe700 1 --2- 172.21.15.124:0/1179404666 >> v2:172.21.15.192:3300/0 conn(0x7f799806dd60 0x7f799816e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.679+0000 7f54d284f700 1 Processor -- start 2023-10-16T12:59:13.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.679+0000 7f02f51c9700 1 -- 172.21.15.124:0/3197457864 shutdown_connections 2023-10-16T12:59:13.687 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.679+0000 7f54d284f700 1 -- start start 2023-10-16T12:59:13.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.679+0000 7f02f51c9700 1 -- 172.21.15.124:0/3197457864 wait complete. 2023-10-16T12:59:13.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.680+0000 7f54d284f700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f54cc1599f0 0x7f54cc06daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.688 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.680+0000 7f54d284f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f54cc0cc5f0 0x7f54cc06e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.680+0000 7f54d284f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54cc0c9a30 con 0x7f54cc0cb210 2023-10-16T12:59:13.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.680+0000 7f54d284f700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54cc0c9cd0 con 0x7f54cc1599f0 2023-10-16T12:59:13.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.680+0000 7f54d284f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54cc0c9fb0 con 0x7f54cc0cc5f0 2023-10-16T12:59:13.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.681+0000 7f3d8c04d700 1 Processor -- start 2023-10-16T12:59:13.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.681+0000 7f54cb7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f54cc0cc5f0 0x7f54cc06e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.681+0000 7f54d0dec700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f54cc0cb210 0x7f54cc0705e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.124:54520/0 (socket says 172.21.15.124:54520) 2023-10-16T12:59:13.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.681+0000 7f54d0dec700 1 -- 172.21.15.124:0/2433758482 learned_addr learned my addr 172.21.15.124:0/2433758482 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:13.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.681+0000 7f02f51c9700 1 Processor -- start 2023-10-16T12:59:13.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.681+0000 7f24cb0a8700 1 Processor -- start 2023-10-16T12:59:13.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.681+0000 7f24cb0a8700 1 -- start start 2023-10-16T12:59:13.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.679+0000 7f7997fff700 1 -- 172.21.15.124:0/1179404666 >> v2:172.21.15.192:3300/0 conn(0x7f799806dd60 msgr2=0x7f799816e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:13.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.679+0000 7f7997fff700 1 --2- 172.21.15.124:0/1179404666 >> v2:172.21.15.192:3300/0 conn(0x7f799806dd60 0x7f799816e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.679+0000 7f7997fff700 1 -- 172.21.15.124:0/1179404666 >> v1:172.21.15.124:6789/0 conn(0x7f79980cae00 legacy=0x7f799816eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.679+0000 7f7997fff700 1 -- 172.21.15.124:0/1179404666 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79980ca620 con 0x7f799806e140 2023-10-16T12:59:13.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.680+0000 7f7997fff700 1 --2- 172.21.15.124:0/1179404666 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f799806e140 0x7f79980c4c90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f799806b6c0 tx=0x7f7990008190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c51694b786bc9ad server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:13.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.680+0000 7f79967fc700 1 -- 172.21.15.124:0/1179404666 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990008c50 con 0x7f799806e140 2023-10-16T12:59:13.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.680+0000 7f79967fc700 1 -- 172.21.15.124:0/1179404666 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7990008db0 con 0x7f799806e140 2023-10-16T12:59:13.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.680+0000 7f79967fc700 1 -- 172.21.15.124:0/1179404666 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990003c20 con 0x7f799806e140 2023-10-16T12:59:13.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.681+0000 7f799e1f0700 1 -- 172.21.15.124:0/1179404666 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f799806e140 msgr2=0x7f79980c4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.681+0000 7f799e1f0700 1 --2- 172.21.15.124:0/1179404666 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f799806e140 0x7f79980c4c90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f799806b6c0 tx=0x7f7990008190 comp rx=0 tx=0).stop 2023-10-16T12:59:13.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.681+0000 7f799e1f0700 1 -- 172.21.15.124:0/1179404666 shutdown_connections 2023-10-16T12:59:13.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.681+0000 7f799e1f0700 1 --2- 172.21.15.124:0/1179404666 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f799806e140 0x7f79980c4c90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.681+0000 7f799e1f0700 1 --2- 172.21.15.124:0/1179404666 >> v2:172.21.15.192:3300/0 conn(0x7f799806dd60 0x7f799816e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.681+0000 7f799e1f0700 1 -- 172.21.15.124:0/1179404666 >> 172.21.15.124:0/1179404666 conn(0x7f79980cbad0 msgr2=0x7f79980cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:13.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.681+0000 7f54caffd700 1 -- 172.21.15.124:0/2433758482 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162219188 0 0) 0x7f54cc0c9a30 con 0x7f54cc0cb210 2023-10-16T12:59:13.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.681+0000 7f54caffd700 1 -- 172.21.15.124:0/2433758482 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54b40035b0 con 0x7f54cc0cb210 2023-10-16T12:59:13.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.680+0000 7f885fdb2700 1 Processor -- start 2023-10-16T12:59:13.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.680+0000 7f885fdb2700 1 -- start start 2023-10-16T12:59:13.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f885fdb2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f88580cd5a0 0x7f88580c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f885fdb2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88580cb230 0x7f88580c5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f885fdb2700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88580c4970 con 0x7f885806daf0 2023-10-16T12:59:13.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f885fdb2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88580c4040 con 0x7f88580cd5a0 2023-10-16T12:59:13.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f885fdb2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88580c4320 con 0x7f88580cb230 2023-10-16T12:59:13.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f885d34d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f88580cd5a0 0x7f88580c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f885d34d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f88580cd5a0 0x7f88580c4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:34026/0 (socket says 172.21.15.124:34026) 2023-10-16T12:59:13.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f885d34d700 1 -- 172.21.15.124:0/2766459147 learned_addr learned my addr 172.21.15.124:0/2766459147 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:13.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f885e34f700 1 --2- 172.21.15.124:0/2766459147 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88580cb230 0x7f88580c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f885d34d700 1 -- 172.21.15.124:0/2766459147 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88580cb230 msgr2=0x7f88580c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:13.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f885d34d700 1 --2- 172.21.15.124:0/2766459147 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88580cb230 0x7f88580c5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f885d34d700 1 -- 172.21.15.124:0/2766459147 >> v1:172.21.15.192:6789/0 conn(0x7f885806daf0 legacy=0x7f885806ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:13.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f885d34d700 1 -- 172.21.15.124:0/2766459147 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88580c4600 con 0x7f88580cd5a0 2023-10-16T12:59:13.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.681+0000 7f3d8c04d700 1 -- start start 2023-10-16T12:59:13.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.681+0000 7f02f51c9700 1 -- start start 2023-10-16T12:59:13.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f02f51c9700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02f01ffa50 0x7f02f00c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f02f51c9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02f00c7ac0 0x7f02f00c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f02f51c9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02f00c4830 0x7f02f01368b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f02f51c9700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f01332d0 con 0x7f02f01ffa50 2023-10-16T12:59:13.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f02f51c9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f01330d0 con 0x7f02f00c7ac0 2023-10-16T12:59:13.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f02f51c9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f00c4cb0 con 0x7f02f00c4830 2023-10-16T12:59:13.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f799e1f0700 1 -- 172.21.15.124:0/1179404666 shutdown_connections 2023-10-16T12:59:13.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f24cb0a8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c406cf10 0x7f24c406d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f24cb0a8700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c40ca420 con 0x7f24c40cae90 2023-10-16T12:59:13.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f24cb0a8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c406d9b0 con 0x7f24c40712e0 2023-10-16T12:59:13.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f24cb0a8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c40ca690 con 0x7f24c406cf10 2023-10-16T12:59:13.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f24c3fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c406cf10 0x7f24c406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f24c3fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c406cf10 0x7f24c406d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:39948/0 (socket says 172.21.15.124:39948) 2023-10-16T12:59:13.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f24c3fff700 1 -- 172.21.15.124:0/2720349956 learned_addr learned my addr 172.21.15.124:0/2720349956 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:13.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f54cbfff700 1 --2- 172.21.15.124:0/2433758482 >> v2:172.21.15.124:3300/0 conn(0x7f54cc1599f0 0x7f54cc06daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f54caffd700 1 -- 172.21.15.124:0/2433758482 <== mon.1 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1032082831 0 0) 0x7f54b40035b0 con 0x7f54cc0cb210 2023-10-16T12:59:13.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f54caffd700 1 -- 172.21.15.124:0/2433758482 >> v2:172.21.15.192:3300/0 conn(0x7f54cc0cc5f0 msgr2=0x7f54cc06e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:13.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f54caffd700 1 --2- 172.21.15.124:0/2433758482 >> v2:172.21.15.192:3300/0 conn(0x7f54cc0cc5f0 0x7f54cc06e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f54caffd700 1 -- 172.21.15.124:0/2433758482 >> v2:172.21.15.124:3300/0 conn(0x7f54cc1599f0 msgr2=0x7f54cc06daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:13.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f54caffd700 1 --2- 172.21.15.124:0/2433758482 >> v2:172.21.15.124:3300/0 conn(0x7f54cc1599f0 0x7f54cc06daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f54caffd700 1 -- 172.21.15.124:0/2433758482 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54cc0ca290 con 0x7f54cc0cb210 2023-10-16T12:59:13.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f54caffd700 1 -- 172.21.15.124:0/2433758482 <== mon.1 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f54c0001670 con 0x7f54cc0cb210 2023-10-16T12:59:13.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f54caffd700 1 -- 172.21.15.124:0/2433758482 >> v1:172.21.15.192:6789/0 conn(0x7f54cc0cb210 legacy=0x7f54cc0705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f54caffd700 1 --2- 172.21.15.124:0/2433758482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54b4003a00 0x7f54b4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f54caffd700 1 --2- 172.21.15.124:0/2433758482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54b4004850 0x7f54b4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f54caffd700 1 --2- 172.21.15.124:0/2433758482 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54b4005210 0x7f54b400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f54caffd700 1 -- 172.21.15.124:0/2433758482 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc0c9cd0 con 0x7f54b4005210 2023-10-16T12:59:13.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f54caffd700 1 -- 172.21.15.124:0/2433758482 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc0c9fb0 con 0x7f54b4003a00 2023-10-16T12:59:13.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f54caffd700 1 -- 172.21.15.124:0/2433758482 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b400c050 con 0x7f54b4004850 2023-10-16T12:59:13.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f54cbfff700 1 --2- 172.21.15.124:0/2433758482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54b4003a00 0x7f54b4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f885d34d700 1 --2- 172.21.15.124:0/2766459147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88580cd5a0 0x7f88580c4e00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f88480098f0 tx=0x7f8848009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66cc65934f11472e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:13.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f3d8c04d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3d840cb210 0x7f3d84165a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f3d8c04d700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d840716f0 con 0x7f3d840cc5f0 2023-10-16T12:59:13.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f3d8c04d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d840c9a30 con 0x7f3d8406e200 2023-10-16T12:59:13.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f3d8c04d700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d840c9cd0 con 0x7f3d840cb210 2023-10-16T12:59:13.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f24c37fe700 1 -- 172.21.15.124:0/2720349956 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347362944 0 0) 0x7f24c406d9b0 con 0x7f24c40712e0 2023-10-16T12:59:13.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f24c37fe700 1 -- 172.21.15.124:0/2720349956 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24b00035b0 con 0x7f24c40712e0 2023-10-16T12:59:13.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f24c3fff700 1 -- 172.21.15.124:0/2720349956 >> v1:172.21.15.192:6789/0 conn(0x7f24c40712e0 legacy=0x7f24c40716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f24c3fff700 1 -- 172.21.15.124:0/2720349956 >> v1:172.21.15.124:6789/0 conn(0x7f24c40cae90 legacy=0x7f24c40cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:13.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f24c3fff700 1 -- 172.21.15.124:0/2720349956 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c40ca970 con 0x7f24c406cf10 2023-10-16T12:59:13.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f54cbfff700 1 -- 172.21.15.124:0/2433758482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54b4004850 msgr2=0x7f54b4004cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T12:59:13.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f54cbfff700 1 --2- 172.21.15.124:0/2433758482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54b4004850 0x7f54b4004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f54cbfff700 1 -- 172.21.15.124:0/2433758482 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54b4005210 msgr2=0x7f54b400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:13.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f54cbfff700 1 --2- 172.21.15.124:0/2433758482 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54b4005210 0x7f54b400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f54cbfff700 1 -- 172.21.15.124:0/2433758482 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54cc0ca290 con 0x7f54b4003a00 2023-10-16T12:59:13.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f885cb4c700 1 -- 172.21.15.124:0/2766459147 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848004230 con 0x7f88580cd5a0 2023-10-16T12:59:13.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f885cb4c700 1 -- 172.21.15.124:0/2766459147 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8848004390 con 0x7f88580cd5a0 2023-10-16T12:59:13.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f885cb4c700 1 -- 172.21.15.124:0/2766459147 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88480036a0 con 0x7f88580cd5a0 2023-10-16T12:59:13.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f3d8a5ea700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3d840cb210 0x7f3d84165a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f3d8a5ea700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3d840cb210 0x7f3d84165a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53882/0 (socket says 172.21.15.124:53882) 2023-10-16T12:59:13.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f3d8a5ea700 1 -- 172.21.15.124:0/1672927977 learned_addr learned my addr 172.21.15.124:0/1672927977 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:13.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.684+0000 7f3d8a5ea700 1 -- 172.21.15.124:0/1672927977 >> v1:172.21.15.192:6789/0 conn(0x7f3d8406e200 legacy=0x7f3d84162350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T12:59:13.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.684+0000 7f3d8a5ea700 1 -- 172.21.15.124:0/1672927977 >> v1:172.21.15.124:6789/0 conn(0x7f3d840cc5f0 legacy=0x7f3d8406daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:13.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.684+0000 7f3d8a5ea700 1 -- 172.21.15.124:0/1672927977 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d840c9fb0 con 0x7f3d840cb210 2023-10-16T12:59:13.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.684+0000 7f02ee59c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02f00c7ac0 0x7f02f00c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.682+0000 7f799e1f0700 1 -- 172.21.15.124:0/1179404666 wait complete. 2023-10-16T12:59:13.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.684+0000 7f799e1f0700 1 Processor -- start 2023-10-16T12:59:13.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f24c3fff700 1 --2- 172.21.15.124:0/2720349956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c406cf10 0x7f24c406d390 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f24b400bbc0 tx=0x7f24b400bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49b87390b275ab7c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:13.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.684+0000 7f24c37fe700 1 -- 172.21.15.124:0/2720349956 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b400dcf0 con 0x7f24c406cf10 2023-10-16T12:59:13.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.684+0000 7f24c37fe700 1 -- 172.21.15.124:0/2720349956 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b400de50 con 0x7f24c406cf10 2023-10-16T12:59:13.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.684+0000 7f24c37fe700 1 -- 172.21.15.124:0/2720349956 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b4004250 con 0x7f24c406cf10 2023-10-16T12:59:13.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.683+0000 7f54d0dec700 1 -- 172.21.15.124:0/2433758482 reap_dead start 2023-10-16T12:59:13.715 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.684+0000 7f54cbfff700 1 --2- 172.21.15.124:0/2433758482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54b4003a00 0x7f54b4003e20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009fc0 tx=0x7f54b4005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d05cb4a02b3d7c77 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:13.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.684+0000 7f02ef59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02f00c4830 0x7f02f01368b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.684+0000 7f885fdb2700 1 -- 172.21.15.124:0/2766459147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88580cd5a0 msgr2=0x7f88580c4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.684+0000 7f885fdb2700 1 --2- 172.21.15.124:0/2766459147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88580cd5a0 0x7f88580c4e00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f88480098f0 tx=0x7f8848009c00 comp rx=0 tx=0).stop 2023-10-16T12:59:13.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.684+0000 7f3d8a5ea700 1 --2- 172.21.15.124:0/1672927977 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d840cb210 0x7f3d84165a80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3d740098f0 tx=0x7f3d74009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d5c61eea329a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:13.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.684+0000 7f02ef59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02f00c4830 0x7f02f01368b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:39966/0 (socket says 172.21.15.124:39966) 2023-10-16T12:59:13.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.684+0000 7f02ef59e700 1 -- 172.21.15.124:0/571116340 learned_addr learned my addr 172.21.15.124:0/571116340 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:13.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.684+0000 7f885fdb2700 1 -- 172.21.15.124:0/2766459147 shutdown_connections 2023-10-16T12:59:13.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.684+0000 7f885fdb2700 1 --2- 172.21.15.124:0/2766459147 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88580cb230 0x7f88580c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.684+0000 7f885fdb2700 1 --2- 172.21.15.124:0/2766459147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88580cd5a0 0x7f88580c4e00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.684+0000 7f885fdb2700 1 -- 172.21.15.124:0/2766459147 >> 172.21.15.124:0/2766459147 conn(0x7f88580cbad0 msgr2=0x7f88580cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:13.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.685+0000 7f885fdb2700 1 -- 172.21.15.124:0/2766459147 shutdown_connections 2023-10-16T12:59:13.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.685+0000 7f885fdb2700 1 -- 172.21.15.124:0/2766459147 wait complete. 2023-10-16T12:59:13.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.685+0000 7f3d88de7700 1 -- 172.21.15.124:0/1672927977 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74004230 con 0x7f3d840cb210 2023-10-16T12:59:13.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.685+0000 7f3d88de7700 1 -- 172.21.15.124:0/1672927977 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d74004390 con 0x7f3d840cb210 2023-10-16T12:59:13.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.685+0000 7f3d88de7700 1 -- 172.21.15.124:0/1672927977 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d740036a0 con 0x7f3d840cb210 2023-10-16T12:59:13.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f3d8c04d700 1 -- 172.21.15.124:0/1672927977 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d840cb210 msgr2=0x7f3d84165a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f3d8c04d700 1 --2- 172.21.15.124:0/1672927977 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d840cb210 0x7f3d84165a80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3d740098f0 tx=0x7f3d74009c00 comp rx=0 tx=0).stop 2023-10-16T12:59:13.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f3d8c04d700 1 -- 172.21.15.124:0/1672927977 shutdown_connections 2023-10-16T12:59:13.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f3d8c04d700 1 --2- 172.21.15.124:0/1672927977 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d840cb210 0x7f3d84165a80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f3d8c04d700 1 -- 172.21.15.124:0/1672927977 >> 172.21.15.124:0/1672927977 conn(0x7f3d840cbad0 msgr2=0x7f3d840cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:13.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.685+0000 7f24cb0a8700 1 -- 172.21.15.124:0/2720349956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c406cf10 msgr2=0x7f24c406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.685+0000 7f24cb0a8700 1 --2- 172.21.15.124:0/2720349956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c406cf10 0x7f24c406d390 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f24b400bbc0 tx=0x7f24b400bed0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.685+0000 7f24cb0a8700 1 -- 172.21.15.124:0/2720349956 shutdown_connections 2023-10-16T12:59:13.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.685+0000 7f24cb0a8700 1 --2- 172.21.15.124:0/2720349956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c406cf10 0x7f24c406d390 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f24b400bbc0 tx=0x7f24b400bed0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.685+0000 7f24cb0a8700 1 -- 172.21.15.124:0/2720349956 >> 172.21.15.124:0/2720349956 conn(0x7f24c40cfcd0 msgr2=0x7f24c40d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:13.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f24cb0a8700 1 -- 172.21.15.124:0/2720349956 shutdown_connections 2023-10-16T12:59:13.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.684+0000 7f54caffd700 1 -- 172.21.15.124:0/2433758482 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c400eb70 con 0x7f54b4003a00 2023-10-16T12:59:13.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.684+0000 7f54caffd700 1 -- 172.21.15.124:0/2433758482 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c400f040 con 0x7f54b4003a00 2023-10-16T12:59:13.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.685+0000 7f54caffd700 1 -- 172.21.15.124:0/2433758482 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c400eed0 con 0x7f54b4003a00 2023-10-16T12:59:13.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.685+0000 7f54d284f700 1 -- 172.21.15.124:0/2433758482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54b4003a00 msgr2=0x7f54b4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.685+0000 7f54d284f700 1 --2- 172.21.15.124:0/2433758482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54b4003a00 0x7f54b4003e20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009fc0 tx=0x7f54b4005880 comp rx=0 tx=0).stop 2023-10-16T12:59:13.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.685+0000 7f02eed9d700 1 --2- 172.21.15.124:0/571116340 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02f01ffa50 0x7f02f00c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.685+0000 7f02eed9d700 1 -- 172.21.15.124:0/571116340 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02f00c4830 msgr2=0x7f02f01368b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.685+0000 7f02eed9d700 1 --2- 172.21.15.124:0/571116340 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02f00c4830 0x7f02f01368b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.685+0000 7f02eed9d700 1 -- 172.21.15.124:0/571116340 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02f00c7ac0 msgr2=0x7f02f00c42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.685+0000 7f02eed9d700 1 --2- 172.21.15.124:0/571116340 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02f00c7ac0 0x7f02f00c42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.685+0000 7f02eed9d700 1 -- 172.21.15.124:0/571116340 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f00c65d0 con 0x7f02f01ffa50 2023-10-16T12:59:13.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.685+0000 7f02eed9d700 1 --2- 172.21.15.124:0/571116340 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02f01ffa50 0x7f02f00c6090 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f02e0015000 tx=0x7f02e0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:13.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f02d77fe700 1 -- 172.21.15.124:0/571116340 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0001c70 con 0x7f02f01ffa50 2023-10-16T12:59:13.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f02d77fe700 1 -- 172.21.15.124:0/571116340 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e0006c70 con 0x7f02f01ffa50 2023-10-16T12:59:13.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f02d77fe700 1 -- 172.21.15.124:0/571116340 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0007050 con 0x7f02f01ffa50 2023-10-16T12:59:13.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f02f51c9700 1 -- 172.21.15.124:0/571116340 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f00c6800 con 0x7f02f01ffa50 2023-10-16T12:59:13.729 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.685+0000 7f799e1f0700 1 -- start start 2023-10-16T12:59:13.729 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f799e1f0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f799806e140 0x7f79980c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.729 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f799e1f0700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f79980cae00 0x7f7998200250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.729 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f799e1f0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79980c8760 0x7f79981fec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.730 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f799e1f0700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7998200790 con 0x7f79980cae00 2023-10-16T12:59:13.730 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f799e1f0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79980c7980 con 0x7f79980c8760 2023-10-16T12:59:13.730 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f799e1f0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79980c68e0 con 0x7f799806e140 2023-10-16T12:59:13.730 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f7996ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f79980cae00 0x7f7998200250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.730 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f7996ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f79980cae00 0x7f7998200250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53892/0 (socket says 172.21.15.124:53892) 2023-10-16T12:59:13.731 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f7996ffd700 1 -- 172.21.15.124:0/825577729 learned_addr learned my addr 172.21.15.124:0/825577729 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:13.731 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f3d8c04d700 1 -- 172.21.15.124:0/1672927977 shutdown_connections 2023-10-16T12:59:13.731 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f7996ffd700 1 -- 172.21.15.124:0/825577729 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f799806e140 msgr2=0x7f79980c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.732 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f7996ffd700 1 --2- 172.21.15.124:0/825577729 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f799806e140 0x7f79980c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.732 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f7996ffd700 1 -- 172.21.15.124:0/825577729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79980c8760 msgr2=0x7f79981fec30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T12:59:13.732 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f7996ffd700 1 --2- 172.21.15.124:0/825577729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79980c8760 0x7f79981fec30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.732 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f7996ffd700 1 -- 172.21.15.124:0/825577729 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7990007b10 con 0x7f79980cae00 2023-10-16T12:59:13.733 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.687+0000 7f24cb0a8700 1 -- 172.21.15.124:0/2720349956 wait complete. 2023-10-16T12:59:13.733 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.687+0000 7f7996ffd700 1 --2- 172.21.15.124:0/825577729 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f79980cae00 0x7f7998200250 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f798c00c550 tx=0x7f798c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:13.733 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.687+0000 7f885fdb2700 1 Processor -- start 2023-10-16T12:59:13.734 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.687+0000 7f885fdb2700 1 -- start start 2023-10-16T12:59:13.734 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f3d8c04d700 1 -- 172.21.15.124:0/1672927977 wait complete. 2023-10-16T12:59:13.735 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.688+0000 7f3d8c04d700 1 Processor -- start 2023-10-16T12:59:13.735 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.688+0000 7f885fdb2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f885806daf0 0x7f885813ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.735 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.688+0000 7f885fdb2700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88580cb230 0x7f8858152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.735 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.688+0000 7f885fdb2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88580cd5a0 0x7f8858152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.736 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.688+0000 7f885fdb2700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88581385c0 con 0x7f88580cb230 2023-10-16T12:59:13.736 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.688+0000 7f885fdb2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8858138810 con 0x7f88580cd5a0 2023-10-16T12:59:13.736 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.688+0000 7f885fdb2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8858138af0 con 0x7f885806daf0 2023-10-16T12:59:13.736 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.688+0000 7f3d8c04d700 1 -- start start 2023-10-16T12:59:13.737 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.689+0000 7f3d8c04d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d8406e200 0x7f3d8414aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.737 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.689+0000 7f3d8c04d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d840cb210 0x7f3d8416b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.737 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.689+0000 7f3d8c04d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d840cc5f0 0x7f3d840c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.737 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.689+0000 7f3d8c04d700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8416bf60 con 0x7f3d840cb210 2023-10-16T12:59:13.737 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.689+0000 7f3d8c04d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8416c240 con 0x7f3d840cc5f0 2023-10-16T12:59:13.738 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.689+0000 7f3d8c04d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8416c520 con 0x7f3d8406e200 2023-10-16T12:59:13.738 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.686+0000 7f02f51c9700 1 -- 172.21.15.124:0/571116340 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f00c6dc0 con 0x7f02f01ffa50 2023-10-16T12:59:13.739 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.688+0000 7f797ffff700 1 -- 172.21.15.124:0/825577729 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c0054e0 con 0x7f79980cae00 2023-10-16T12:59:13.739 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.688+0000 7f797ffff700 1 -- 172.21.15.124:0/825577729 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798c003680 con 0x7f79980cae00 2023-10-16T12:59:13.739 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.688+0000 7f797ffff700 1 -- 172.21.15.124:0/825577729 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c003a30 con 0x7f79980cae00 2023-10-16T12:59:13.739 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.688+0000 7f799e1f0700 1 -- 172.21.15.124:0/825577729 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79980c6bc0 con 0x7f79980cae00 2023-10-16T12:59:13.739 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.688+0000 7f799e1f0700 1 -- 172.21.15.124:0/825577729 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79980c7180 con 0x7f79980cae00 2023-10-16T12:59:13.740 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.688+0000 7f24cb0a8700 1 Processor -- start 2023-10-16T12:59:13.740 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.688+0000 7f54d284f700 1 -- 172.21.15.124:0/2433758482 shutdown_connections 2023-10-16T12:59:13.740 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.688+0000 7f54d284f700 1 --2- 172.21.15.124:0/2433758482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54b4003a00 0x7f54b4003e20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.741 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.688+0000 7f54d284f700 1 -- 172.21.15.124:0/2433758482 >> 172.21.15.124:0/2433758482 conn(0x7f54cc0cbad0 msgr2=0x7f54cc0cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:13.741 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.688+0000 7f54d284f700 1 -- 172.21.15.124:0/2433758482 shutdown_connections 2023-10-16T12:59:13.741 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.689+0000 7f885db4e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f885806daf0 0x7f885813ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.689+0000 7f885db4e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f885806daf0 0x7f885813ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:39974/0 (socket says 172.21.15.124:39974) 2023-10-16T12:59:13.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.689+0000 7f885db4e700 1 -- 172.21.15.124:0/1758992132 learned_addr learned my addr 172.21.15.124:0/1758992132 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:13.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.690+0000 7f885e34f700 1 --2- 172.21.15.124:0/1758992132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88580cd5a0 0x7f8858152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.689+0000 7f3d89de9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d8406e200 0x7f3d8414aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.690+0000 7f3d89de9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d8406e200 0x7f3d8414aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:39976/0 (socket says 172.21.15.124:39976) 2023-10-16T12:59:13.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.690+0000 7f3d89de9700 1 -- 172.21.15.124:0/751992896 learned_addr learned my addr 172.21.15.124:0/751992896 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:13.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.690+0000 7f885e34f700 1 -- 172.21.15.124:0/1758992132 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f885806daf0 msgr2=0x7f885813ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.690+0000 7f885e34f700 1 --2- 172.21.15.124:0/1758992132 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f885806daf0 0x7f885813ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.690+0000 7f885e34f700 1 -- 172.21.15.124:0/1758992132 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88580cb230 msgr2=0x7f8858152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.690+0000 7f885e34f700 1 --2- 172.21.15.124:0/1758992132 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88580cb230 0x7f8858152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.690+0000 7f885e34f700 1 -- 172.21.15.124:0/1758992132 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8848009550 con 0x7f88580cd5a0 2023-10-16T12:59:13.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.690+0000 7f799e1f0700 1 -- 172.21.15.124:0/825577729 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79780052f0 con 0x7f79980cae00 2023-10-16T12:59:13.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.689+0000 7f24cb0a8700 1 -- start start 2023-10-16T12:59:13.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.690+0000 7f24cb0a8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24c40712e0 0x7f24c4153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.690+0000 7f24cb0a8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c40cae90 0x7f24c40c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.690+0000 7f24cb0a8700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f24c40b1660 0x7f24c40b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.690+0000 7f24cb0a8700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c40c4230 con 0x7f24c40b1660 2023-10-16T12:59:13.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.690+0000 7f24cb0a8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c40b2030 con 0x7f24c40712e0 2023-10-16T12:59:13.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.690+0000 7f24cb0a8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c40c35b0 con 0x7f24c40cae90 2023-10-16T12:59:13.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.690+0000 7f885e34f700 1 --2- 172.21.15.124:0/1758992132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88580cd5a0 0x7f8858152fe0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8850007cc0 tx=0x7f885000e0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:13.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.688+0000 7f54d284f700 1 -- 172.21.15.124:0/2433758482 wait complete. 2023-10-16T12:59:13.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.690+0000 7f54d284f700 1 Processor -- start 2023-10-16T12:59:13.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.690+0000 7f3d8a5ea700 1 --2- 172.21.15.124:0/751992896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d840cc5f0 0x7f3d840c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.691+0000 7f3d8a5ea700 1 -- 172.21.15.124:0/751992896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d8406e200 msgr2=0x7f3d8414aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.691+0000 7f3d8a5ea700 1 --2- 172.21.15.124:0/751992896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d8406e200 0x7f3d8414aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.691+0000 7f3d8a5ea700 1 -- 172.21.15.124:0/751992896 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d840cb210 msgr2=0x7f3d8416b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.691+0000 7f3d8a5ea700 1 --2- 172.21.15.124:0/751992896 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d840cb210 0x7f3d8416b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.749 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.691+0000 7f3d8a5ea700 1 -- 172.21.15.124:0/751992896 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d74009550 con 0x7f3d840cc5f0 2023-10-16T12:59:13.749 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.691+0000 7f02f51c9700 1 -- 172.21.15.124:0/571116340 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d00052f0 con 0x7f02f01ffa50 2023-10-16T12:59:13.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.690+0000 7f24c9645700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f24c40b1660 0x7f24c40b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.690+0000 7f24c9645700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f24c40b1660 0x7f24c40b1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53908/0 (socket says 172.21.15.124:53908) 2023-10-16T12:59:13.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.690+0000 7f24c9645700 1 -- 172.21.15.124:0/972794060 learned_addr learned my addr 172.21.15.124:0/972794060 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:13.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.691+0000 7f24c8e44700 1 --2- 172.21.15.124:0/972794060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24c40712e0 0x7f24c4153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.691+0000 7f24c8e44700 1 -- 172.21.15.124:0/972794060 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c40cae90 msgr2=0x7f24c40c9170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T12:59:13.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.691+0000 7f24c8e44700 1 --2- 172.21.15.124:0/972794060 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c40cae90 0x7f24c40c9170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.691+0000 7f24c8e44700 1 -- 172.21.15.124:0/972794060 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f24c40b1660 msgr2=0x7f24c40b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.691+0000 7f24c8e44700 1 --2- 172.21.15.124:0/972794060 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f24c40b1660 0x7f24c40b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.691+0000 7f24c8e44700 1 -- 172.21.15.124:0/972794060 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b400b7f0 con 0x7f24c40712e0 2023-10-16T12:59:13.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.691+0000 7f24c8e44700 1 --2- 172.21.15.124:0/972794060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24c40712e0 0x7f24c4153d30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00cbe0 tx=0x7f24bc00cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:13.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.691+0000 7f884e7fc700 1 -- 172.21.15.124:0/1758992132 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850018070 con 0x7f88580cd5a0 2023-10-16T12:59:13.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.691+0000 7f884e7fc700 1 -- 172.21.15.124:0/1758992132 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8850003a20 con 0x7f88580cd5a0 2023-10-16T12:59:13.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.691+0000 7f884e7fc700 1 -- 172.21.15.124:0/1758992132 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850003db0 con 0x7f88580cd5a0 2023-10-16T12:59:13.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.691+0000 7f3d8a5ea700 1 --2- 172.21.15.124:0/751992896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d840cc5f0 0x7f3d840c3f10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3d74015000 tx=0x7f3d74004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:13.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.692+0000 7f885fdb2700 1 -- 172.21.15.124:0/1758992132 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8858138dd0 con 0x7f88580cd5a0 2023-10-16T12:59:13.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.692+0000 7f885fdb2700 1 -- 172.21.15.124:0/1758992132 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885813b190 con 0x7f88580cd5a0 2023-10-16T12:59:13.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.692+0000 7f24c17fa700 1 -- 172.21.15.124:0/972794060 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc003c00 con 0x7f24c40712e0 2023-10-16T12:59:13.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.692+0000 7f24c17fa700 1 -- 172.21.15.124:0/972794060 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24bc003d60 con 0x7f24c40712e0 2023-10-16T12:59:13.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.692+0000 7f24c17fa700 1 -- 172.21.15.124:0/972794060 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc00ab90 con 0x7f24c40712e0 2023-10-16T12:59:13.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.691+0000 7f54d284f700 1 -- start start 2023-10-16T12:59:13.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.692+0000 7f54d284f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54b4003a00 0x7f54cc148190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.692+0000 7f54d284f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc0c8ff0 0x7f54cc16a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.692+0000 7f54d284f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54cc147a70 0x7f54cc0c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.692+0000 7f54d284f700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc148a30 con 0x7f54b4003a00 2023-10-16T12:59:13.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.692+0000 7f54d284f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc0c8230 con 0x7f54cc0c8ff0 2023-10-16T12:59:13.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.692+0000 7f54d284f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc0c8510 con 0x7f54cc147a70 2023-10-16T12:59:13.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.692+0000 7f54cb7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc0c8ff0 0x7f54cc16a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.692+0000 7f54cb7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc0c8ff0 0x7f54cc16a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:34082/0 (socket says 172.21.15.124:34082) 2023-10-16T12:59:13.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.692+0000 7f54cb7fe700 1 -- 172.21.15.124:0/2916348216 learned_addr learned my addr 172.21.15.124:0/2916348216 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:13.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.692+0000 7f54d0dec700 1 --2- 172.21.15.124:0/2916348216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54cc147a70 0x7f54cc0c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.692+0000 7f797ffff700 1 -- 172.21.15.124:0/825577729 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f798c003b90 con 0x7f79980cae00 2023-10-16T12:59:13.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.692+0000 7f27df5bd700 1 Processor -- start 2023-10-16T12:59:13.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.692+0000 7f27df5bd700 1 -- start start 2023-10-16T12:59:13.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.693+0000 7f54cb7fe700 1 -- 172.21.15.124:0/2916348216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54cc147a70 msgr2=0x7f54cc0c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.693+0000 7f54cb7fe700 1 --2- 172.21.15.124:0/2916348216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54cc147a70 0x7f54cc0c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.693+0000 7f54cb7fe700 1 -- 172.21.15.124:0/2916348216 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54b4003a00 msgr2=0x7f54cc148190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.693+0000 7f54cb7fe700 1 --2- 172.21.15.124:0/2916348216 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54b4003a00 0x7f54cc148190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.693+0000 7f54cb7fe700 1 -- 172.21.15.124:0/2916348216 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54cc0c87f0 con 0x7f54cc0c8ff0 2023-10-16T12:59:13.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.693+0000 7f3d7a7fc700 1 -- 172.21.15.124:0/751992896 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74011630 con 0x7f3d840cc5f0 2023-10-16T12:59:13.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.693+0000 7f3d7a7fc700 1 -- 172.21.15.124:0/751992896 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d74011790 con 0x7f3d840cc5f0 2023-10-16T12:59:13.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.693+0000 7f3d7a7fc700 1 -- 172.21.15.124:0/751992896 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74011b20 con 0x7f3d840cc5f0 2023-10-16T12:59:13.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.693+0000 7f797ffff700 1 --2- 172.21.15.124:0/825577729 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f798406afd0 0x7f798406d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.693+0000 7f797ffff700 1 -- 172.21.15.124:0/825577729 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f798c089220 con 0x7f79980cae00 2023-10-16T12:59:13.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.693+0000 7f79977fe700 1 --2- 172.21.15.124:0/825577729 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f798406afd0 0x7f798406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.692+0000 7f24cb0a8700 1 -- 172.21.15.124:0/972794060 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c40c3890 con 0x7f24c40712e0 2023-10-16T12:59:13.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.692+0000 7f24cb0a8700 1 -- 172.21.15.124:0/972794060 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c40c3e50 con 0x7f24c40712e0 2023-10-16T12:59:13.762 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.693+0000 7f54cb7fe700 1 --2- 172.21.15.124:0/2916348216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc0c8ff0 0x7f54cc16a1f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00e960 tx=0x7f54bc00ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:13.762 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.694+0000 7f27df5bd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f27d80c5b00 0x7f27d80705e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.763 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.694+0000 7f27df5bd700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d806ea60 con 0x7f27d80cae00 2023-10-16T12:59:13.763 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.694+0000 7f27df5bd700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d80cab80 con 0x7f27d806e200 2023-10-16T12:59:13.763 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.694+0000 7f27df5bd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d80ca620 con 0x7f27d80c5b00 2023-10-16T12:59:13.763 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.694+0000 7f27ddb5a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f27d80c5b00 0x7f27d80705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.763 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.694+0000 7f27ddb5a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f27d80c5b00 0x7f27d80705e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:34088/0 (socket says 172.21.15.124:34088) 2023-10-16T12:59:13.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.694+0000 7f54c8ff9700 1 -- 172.21.15.124:0/2916348216 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc0096d0 con 0x7f54cc0c8ff0 2023-10-16T12:59:13.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.694+0000 7f54c8ff9700 1 -- 172.21.15.124:0/2916348216 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54bc00eeb0 con 0x7f54cc0c8ff0 2023-10-16T12:59:13.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.694+0000 7f27ddb5a700 1 -- 172.21.15.124:0/809485309 learned_addr learned my addr 172.21.15.124:0/809485309 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:13.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.694+0000 7f54d284f700 1 -- 172.21.15.124:0/2916348216 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54cc0c8ad0 con 0x7f54cc0c8ff0 2023-10-16T12:59:13.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.694+0000 7f54d284f700 1 -- 172.21.15.124:0/2916348216 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54cc0c7f00 con 0x7f54cc0c8ff0 2023-10-16T12:59:13.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.694+0000 7f54c8ff9700 1 -- 172.21.15.124:0/2916348216 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc00ca50 con 0x7f54cc0c8ff0 2023-10-16T12:59:13.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.694+0000 7f27ddb5a700 1 -- 172.21.15.124:0/809485309 >> v1:172.21.15.192:6789/0 conn(0x7f27d806e200 legacy=0x7f27d80c53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:13.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.694+0000 7f27ddb5a700 1 -- 172.21.15.124:0/809485309 >> v1:172.21.15.124:6789/0 conn(0x7f27d80cae00 legacy=0x7f27d806daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.694+0000 7f27ddb5a700 1 -- 172.21.15.124:0/809485309 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d806ecb0 con 0x7f27d80c5b00 2023-10-16T12:59:13.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.694+0000 7f3d8c04d700 1 -- 172.21.15.124:0/751992896 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d840b2f30 con 0x7f3d840cc5f0 2023-10-16T12:59:13.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.694+0000 7f3d8c04d700 1 -- 172.21.15.124:0/751992896 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d840af3b0 con 0x7f3d840cc5f0 2023-10-16T12:59:13.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.695+0000 7f27ddb5a700 1 --2- 172.21.15.124:0/809485309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27d80c5b00 0x7f27d80705e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f27d000d150 tx=0x7f27d000d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d914ceede5eb09f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:13.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.695+0000 7f27cffff700 1 -- 172.21.15.124:0/809485309 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0010070 con 0x7f27d80c5b00 2023-10-16T12:59:13.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.695+0000 7f27cffff700 1 -- 172.21.15.124:0/809485309 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d000db70 con 0x7f27d80c5b00 2023-10-16T12:59:13.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.695+0000 7f27cffff700 1 -- 172.21.15.124:0/809485309 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0003a20 con 0x7f27d80c5b00 2023-10-16T12:59:13.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.696+0000 7f79977fe700 1 --2- 172.21.15.124:0/825577729 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f798406afd0 0x7f798406d490 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7998067640 tx=0x7f7988008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:13.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.696+0000 7f24cb0a8700 1 -- 172.21.15.124:0/972794060 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a80052f0 con 0x7f24c40712e0 2023-10-16T12:59:13.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.695+0000 7f885fdb2700 1 -- 172.21.15.124:0/1758992132 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88581392f0 con 0x7f88580cd5a0 2023-10-16T12:59:13.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.696+0000 7f24c17fa700 1 -- 172.21.15.124:0/972794060 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f24bc00acf0 con 0x7f24c40712e0 2023-10-16T12:59:13.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.696+0000 7f24c17fa700 1 --2- 172.21.15.124:0/972794060 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f24a406afd0 0x7f24a406d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.696+0000 7f24c17fa700 1 -- 172.21.15.124:0/972794060 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f24bc089a00 con 0x7f24c40712e0 2023-10-16T12:59:13.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.696+0000 7f884e7fc700 1 -- 172.21.15.124:0/1758992132 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f885000e9f0 con 0x7f88580cd5a0 2023-10-16T12:59:13.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.696+0000 7f884e7fc700 1 --2- 172.21.15.124:0/1758992132 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f883c06afd0 0x7f883c06d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.696+0000 7f884e7fc700 1 -- 172.21.15.124:0/1758992132 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8850089850 con 0x7f88580cd5a0 2023-10-16T12:59:13.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.696+0000 7f27df5bd700 1 -- 172.21.15.124:0/809485309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27d80c5b00 msgr2=0x7f27d80705e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:13.772 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.696+0000 7f27df5bd700 1 --2- 172.21.15.124:0/809485309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27d80c5b00 0x7f27d80705e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f27d000d150 tx=0x7f27d000d460 comp rx=0 tx=0).stop 2023-10-16T12:59:13.772 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.696+0000 7f24c3fff700 1 --2- 172.21.15.124:0/972794060 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f24a406afd0 0x7f24a406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.696+0000 7f54c8ff9700 1 -- 172.21.15.124:0/2916348216 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f54bc00cc90 con 0x7f54cc0c8ff0 2023-10-16T12:59:13.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.697+0000 7f54c8ff9700 1 --2- 172.21.15.124:0/2916348216 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f54b806af00 0x7f54b806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.697+0000 7f54c8ff9700 1 -- 172.21.15.124:0/2916348216 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f54bc089910 con 0x7f54cc0c8ff0 2023-10-16T12:59:13.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.697+0000 7f24c3fff700 1 --2- 172.21.15.124:0/972794060 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f24a406afd0 0x7f24a406d490 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f24c40cf370 tx=0x7f24b4013000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:13.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.697+0000 7f27df5bd700 1 -- 172.21.15.124:0/809485309 shutdown_connections 2023-10-16T12:59:13.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.697+0000 7f27df5bd700 1 --2- 172.21.15.124:0/809485309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27d80c5b00 0x7f27d80705e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.697+0000 7f27df5bd700 1 -- 172.21.15.124:0/809485309 >> 172.21.15.124:0/809485309 conn(0x7f27d80cbad0 msgr2=0x7f27d80cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:13.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.697+0000 7f27df5bd700 1 -- 172.21.15.124:0/809485309 shutdown_connections 2023-10-16T12:59:13.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.697+0000 7f27df5bd700 1 -- 172.21.15.124:0/809485309 wait complete. 2023-10-16T12:59:13.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.697+0000 7f54cbfff700 1 --2- 172.21.15.124:0/2916348216 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f54b806af00 0x7f54b806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.698+0000 7f54d284f700 1 -- 172.21.15.124:0/2916348216 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54ac0052f0 con 0x7f54cc0c8ff0 2023-10-16T12:59:13.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.698+0000 7f885db4e700 1 --2- 172.21.15.124:0/1758992132 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f883c06afd0 0x7f883c06d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.698+0000 7f54cbfff700 1 --2- 172.21.15.124:0/2916348216 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f54b806af00 0x7f54b806d3c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f54c4000f80 tx=0x7f54c4011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:13.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.698+0000 7f3d8c04d700 1 -- 172.21.15.124:0/751992896 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d6c0052f0 con 0x7f3d840cc5f0 2023-10-16T12:59:13.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.698+0000 7f3d7a7fc700 1 -- 172.21.15.124:0/751992896 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3d74022070 con 0x7f3d840cc5f0 2023-10-16T12:59:13.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.698+0000 7f885db4e700 1 --2- 172.21.15.124:0/1758992132 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f883c06afd0 0x7f883c06d490 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8854009a30 tx=0x7f8854009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:13.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.698+0000 7f27df5bd700 1 Processor -- start 2023-10-16T12:59:13.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.698+0000 7f3d7a7fc700 1 --2- 172.21.15.124:0/751992896 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f3d6806afd0 0x7f3d6806d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.779 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.699+0000 7f27df5bd700 1 -- start start 2023-10-16T12:59:13.779 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.699+0000 7f3d89de9700 1 --2- 172.21.15.124:0/751992896 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f3d6806afd0 0x7f3d6806d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.779 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.699+0000 7f3d7a7fc700 1 -- 172.21.15.124:0/751992896 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3d7408b4d0 con 0x7f3d840cc5f0 2023-10-16T12:59:13.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.699+0000 7f797ffff700 1 -- 172.21.15.124:0/825577729 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f798c053fc0 con 0x7f79980cae00 2023-10-16T12:59:13.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.699+0000 7f3d89de9700 1 --2- 172.21.15.124:0/751992896 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f3d6806afd0 0x7f3d6806d490 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3d80009930 tx=0x7f3d80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:13.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.699+0000 7f27df5bd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f27d806e200 0x7f27d815f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.699+0000 7f27df5bd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27d80c5b00 0x7f27d81617f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.700+0000 7f27df5bd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27d80cae00 0x7f27d8164fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.700+0000 7f27df5bd700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d815fdf0 con 0x7f27d806e200 2023-10-16T12:59:13.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.700+0000 7f27df5bd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d8163f10 con 0x7f27d80c5b00 2023-10-16T12:59:13.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.700+0000 7f27df5bd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d81641f0 con 0x7f27d80cae00 2023-10-16T12:59:13.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.700+0000 7f27ddb5a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27d80cae00 0x7f27d8164fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.700+0000 7f27ddb5a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27d80cae00 0x7f27d8164fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:40014/0 (socket says 172.21.15.124:40014) 2023-10-16T12:59:13.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.700+0000 7f27ddb5a700 1 -- 172.21.15.124:0/2545754032 learned_addr learned my addr 172.21.15.124:0/2545754032 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:13.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.700+0000 7f02d77fe700 1 -- 172.21.15.124:0/571116340 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f02e00071b0 con 0x7f02f01ffa50 2023-10-16T12:59:13.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.701+0000 7f02d77fe700 1 --2- 172.21.15.124:0/571116340 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f02dc06af50 0x7f02dc06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.701+0000 7f02d77fe700 1 -- 172.21.15.124:0/571116340 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f02e008b700 con 0x7f02f01ffa50 2023-10-16T12:59:13.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.700+0000 7f27ddb5a700 1 -- 172.21.15.124:0/2545754032 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27d80c5b00 msgr2=0x7f27d81617f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T12:59:13.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.700+0000 7f27ddb5a700 1 --2- 172.21.15.124:0/2545754032 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27d80c5b00 0x7f27d81617f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.700+0000 7f27ddb5a700 1 -- 172.21.15.124:0/2545754032 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f27d806e200 msgr2=0x7f27d815f8b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T12:59:13.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.700+0000 7f27ddb5a700 1 --2- 172.21.15.124:0/2545754032 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f27d806e200 0x7f27d815f8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:13.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.700+0000 7f27ddb5a700 1 -- 172.21.15.124:0/2545754032 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d000bd40 con 0x7f27d80cae00 2023-10-16T12:59:13.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.700+0000 7f27ddb5a700 1 --2- 172.21.15.124:0/2545754032 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27d80cae00 0x7f27d8164fb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f27d0004000 tx=0x7f27d0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:13.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.701+0000 7f27cdffb700 1 -- 172.21.15.124:0/2545754032 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0004440 con 0x7f27d80cae00 2023-10-16T12:59:13.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.701+0000 7f27df5bd700 1 -- 172.21.15.124:0/2545754032 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d81644d0 con 0x7f27d80cae00 2023-10-16T12:59:13.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.701+0000 7f27cdffb700 1 -- 172.21.15.124:0/2545754032 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d00045a0 con 0x7f27d80cae00 2023-10-16T12:59:13.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.701+0000 7f27cdffb700 1 -- 172.21.15.124:0/2545754032 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0004910 con 0x7f27d80cae00 2023-10-16T12:59:13.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.701+0000 7f27df5bd700 1 -- 172.21.15.124:0/2545754032 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d8164a90 con 0x7f27d80cae00 2023-10-16T12:59:13.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.701+0000 7f884e7fc700 1 -- 172.21.15.124:0/1758992132 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f88581392f0 con 0x7f88580cd5a0 2023-10-16T12:59:13.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.702+0000 7f02ee59c700 1 --2- 172.21.15.124:0/571116340 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f02dc06af50 0x7f02dc06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.702+0000 7f02ee59c700 1 --2- 172.21.15.124:0/571116340 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f02dc06af50 0x7f02dc06d410 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f02f00c9190 tx=0x7f02e8007290 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:13.788 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.703+0000 7f27cdffb700 1 -- 172.21.15.124:0/2545754032 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f27d001d040 con 0x7f27d80cae00 2023-10-16T12:59:13.788 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.704+0000 7f27cdffb700 1 --2- 172.21.15.124:0/2545754032 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f27c406b080 0x7f27c406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:13.788 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.704+0000 7f27cdffb700 1 -- 172.21.15.124:0/2545754032 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f27d008aca0 con 0x7f27d80cae00 2023-10-16T12:59:13.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.704+0000 7f27c37fe700 1 -- 172.21.15.124:0/2545754032 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b80052f0 con 0x7f27d80cae00 2023-10-16T12:59:13.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.704+0000 7f27dd359700 1 --2- 172.21.15.124:0/2545754032 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f27c406b080 0x7f27c406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:13.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.705+0000 7f27dd359700 1 --2- 172.21.15.124:0/2545754032 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f27c406b080 0x7f27c406d540 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f27d4000f60 tx=0x7f27d4007a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:13.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.706+0000 7f02d77fe700 1 -- 172.21.15.124:0/571116340 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f02e0056750 con 0x7f02f01ffa50 2023-10-16T12:59:13.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.706+0000 7f24c17fa700 1 -- 172.21.15.124:0/972794060 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f24bc054710 con 0x7f24c40712e0 2023-10-16T12:59:13.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.710+0000 7f27cdffb700 1 -- 172.21.15.124:0/2545754032 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f27d0055c10 con 0x7f27d80cae00 2023-10-16T12:59:13.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.711+0000 7f54c8ff9700 1 -- 172.21.15.124:0/2916348216 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f54bc054640 con 0x7f54cc0c8ff0 2023-10-16T12:59:13.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:13.720+0000 7f3d7a7fc700 1 -- 172.21.15.124:0/751992896 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3d74056300 con 0x7f3d840cc5f0 2023-10-16T12:59:14.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.041+0000 7f9811b93700 1 -- 172.21.15.124:0/2018278821 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f97ec0055a0 con 0x7f980c0cb230 2023-10-16T12:59:14.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.042+0000 7f97f3fff700 1 -- 172.21.15.124:0/2018278821 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9800021030 con 0x7f980c0cb230 2023-10-16T12:59:14.046 INFO:teuthology.orchestra.run.smithi124.stdout:55834574858 2023-10-16T12:59:14.046 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.045+0000 7f9811b93700 1 -- 172.21.15.124:0/2018278821 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f97f806afd0 msgr2=0x7f97f806d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.047 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.045+0000 7f9811b93700 1 --2- 172.21.15.124:0/2018278821 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f97f806afd0 0x7f97f806d490 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f980c1547a0 tx=0x7f9804009040 comp rx=0 tx=0).stop 2023-10-16T12:59:14.047 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.045+0000 7f9811b93700 1 -- 172.21.15.124:0/2018278821 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f980c0cb230 msgr2=0x7f980c147dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.047 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.045+0000 7f9811b93700 1 --2- 172.21.15.124:0/2018278821 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f980c0cb230 0x7f980c147dd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f980000e8a0 tx=0x7f980000ebb0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.046+0000 7f9811b93700 1 -- 172.21.15.124:0/2018278821 shutdown_connections 2023-10-16T12:59:14.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.046+0000 7f9811b93700 1 --2- 172.21.15.124:0/2018278821 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f97f806afd0 0x7f97f806d490 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.046+0000 7f9811b93700 1 --2- 172.21.15.124:0/2018278821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f980c0cd5a0 0x7f980c153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.046+0000 7f9811b93700 1 --2- 172.21.15.124:0/2018278821 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f980c06daf0 0x7f980c148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.049 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.046+0000 7f9811b93700 1 --2- 172.21.15.124:0/2018278821 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f980c0cb230 0x7f980c147dd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.049 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.046+0000 7f9811b93700 1 -- 172.21.15.124:0/2018278821 >> 172.21.15.124:0/2018278821 conn(0x7f980c0cbad0 msgr2=0x7f980c0b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:14.049 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.046+0000 7f9811b93700 1 -- 172.21.15.124:0/2018278821 shutdown_connections 2023-10-16T12:59:14.049 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.046+0000 7f9811b93700 1 -- 172.21.15.124:0/2018278821 wait complete. 2023-10-16T12:59:14.066 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2023-10-16T12:59:14.066 DEBUG:teuthology.parallel:result is None 2023-10-16T12:59:14.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.085+0000 7f799e1f0700 1 -- 172.21.15.124:0/825577729 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7978005870 con 0x7f79980cae00 2023-10-16T12:59:14.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.086+0000 7f797ffff700 1 -- 172.21.15.124:0/825577729 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f798c0575e0 con 0x7f79980cae00 2023-10-16T12:59:14.087 INFO:teuthology.orchestra.run.smithi124.stdout:55834574858 2023-10-16T12:59:14.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.090+0000 7f799e1f0700 1 -- 172.21.15.124:0/825577729 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f798406afd0 msgr2=0x7f798406d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.090+0000 7f799e1f0700 1 --2- 172.21.15.124:0/825577729 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f798406afd0 0x7f798406d490 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7998067640 tx=0x7f7988008040 comp rx=0 tx=0).stop 2023-10-16T12:59:14.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.090+0000 7f799e1f0700 1 -- 172.21.15.124:0/825577729 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f79980cae00 msgr2=0x7f7998200250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.090+0000 7f799e1f0700 1 --2- 172.21.15.124:0/825577729 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f79980cae00 0x7f7998200250 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f798c00c550 tx=0x7f798c00c910 comp rx=0 tx=0).stop 2023-10-16T12:59:14.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.091+0000 7f799e1f0700 1 -- 172.21.15.124:0/825577729 shutdown_connections 2023-10-16T12:59:14.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.091+0000 7f799e1f0700 1 --2- 172.21.15.124:0/825577729 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f798406afd0 0x7f798406d490 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.091+0000 7f799e1f0700 1 --2- 172.21.15.124:0/825577729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79980c8760 0x7f79981fec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.091+0000 7f799e1f0700 1 --2- 172.21.15.124:0/825577729 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f799806e140 0x7f79980c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.094 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.091+0000 7f799e1f0700 1 --2- 172.21.15.124:0/825577729 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f79980cae00 0x7f7998200250 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.094 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.091+0000 7f799e1f0700 1 -- 172.21.15.124:0/825577729 >> 172.21.15.124:0/825577729 conn(0x7f79980cbad0 msgr2=0x7f79980affa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:14.094 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.091+0000 7f54d284f700 1 -- 172.21.15.124:0/2916348216 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f54ac0055a0 con 0x7f54cc0c8ff0 2023-10-16T12:59:14.095 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.092+0000 7f54c8ff9700 1 -- 172.21.15.124:0/2916348216 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f54bc021090 con 0x7f54cc0c8ff0 2023-10-16T12:59:14.095 INFO:teuthology.orchestra.run.smithi124.stdout:55834574858 2023-10-16T12:59:14.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.094+0000 7f54d284f700 1 -- 172.21.15.124:0/2916348216 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f54b806af00 msgr2=0x7f54b806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.094+0000 7f54d284f700 1 --2- 172.21.15.124:0/2916348216 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f54b806af00 0x7f54b806d3c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f54c4000f80 tx=0x7f54c4011000 comp rx=0 tx=0).stop 2023-10-16T12:59:14.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.094+0000 7f54d284f700 1 -- 172.21.15.124:0/2916348216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc0c8ff0 msgr2=0x7f54cc16a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.094+0000 7f54d284f700 1 --2- 172.21.15.124:0/2916348216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc0c8ff0 0x7f54cc16a1f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00e960 tx=0x7f54bc00ec70 comp rx=0 tx=0).stop 2023-10-16T12:59:14.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.094+0000 7f54d284f700 1 -- 172.21.15.124:0/2916348216 shutdown_connections 2023-10-16T12:59:14.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.094+0000 7f54d284f700 1 --2- 172.21.15.124:0/2916348216 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f54b806af00 0x7f54b806d3c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.094+0000 7f54d284f700 1 --2- 172.21.15.124:0/2916348216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54cc147a70 0x7f54cc0c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.094+0000 7f54d284f700 1 --2- 172.21.15.124:0/2916348216 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54b4003a00 0x7f54cc148190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.094+0000 7f54d284f700 1 --2- 172.21.15.124:0/2916348216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc0c8ff0 0x7f54cc16a1f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.094+0000 7f54d284f700 1 -- 172.21.15.124:0/2916348216 >> 172.21.15.124:0/2916348216 conn(0x7f54cc0cbad0 msgr2=0x7f54cc0aec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:14.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.094+0000 7f54d284f700 1 -- 172.21.15.124:0/2916348216 shutdown_connections 2023-10-16T12:59:14.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.094+0000 7f54d284f700 1 -- 172.21.15.124:0/2916348216 wait complete. 2023-10-16T12:59:14.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.097+0000 7f799e1f0700 1 -- 172.21.15.124:0/825577729 shutdown_connections 2023-10-16T12:59:14.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.097+0000 7f799e1f0700 1 -- 172.21.15.124:0/825577729 wait complete. 2023-10-16T12:59:14.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.102+0000 7f885fdb2700 1 -- 172.21.15.124:0/1758992132 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f88581392f0 con 0x7f88580cd5a0 2023-10-16T12:59:14.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.102+0000 7f884e7fc700 1 -- 172.21.15.124:0/1758992132 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f88581392f0 con 0x7f88580cd5a0 2023-10-16T12:59:14.104 INFO:teuthology.orchestra.run.smithi124.stdout:55834574858 2023-10-16T12:59:14.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.106+0000 7f27c37fe700 1 -- 172.21.15.124:0/2545754032 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f27b8005870 con 0x7f27d80cae00 2023-10-16T12:59:14.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.106+0000 7f885fdb2700 1 -- 172.21.15.124:0/1758992132 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f883c06afd0 msgr2=0x7f883c06d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.106+0000 7f885fdb2700 1 --2- 172.21.15.124:0/1758992132 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f883c06afd0 0x7f883c06d490 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8854009a30 tx=0x7f8854009190 comp rx=0 tx=0).stop 2023-10-16T12:59:14.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.106+0000 7f885fdb2700 1 -- 172.21.15.124:0/1758992132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88580cd5a0 msgr2=0x7f8858152fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.106+0000 7f885fdb2700 1 --2- 172.21.15.124:0/1758992132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88580cd5a0 0x7f8858152fe0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8850007cc0 tx=0x7f885000e0e0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.106+0000 7f885fdb2700 1 -- 172.21.15.124:0/1758992132 shutdown_connections 2023-10-16T12:59:14.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.106+0000 7f885fdb2700 1 --2- 172.21.15.124:0/1758992132 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f883c06afd0 0x7f883c06d490 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.106+0000 7f885fdb2700 1 --2- 172.21.15.124:0/1758992132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88580cd5a0 0x7f8858152fe0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.106+0000 7f885fdb2700 1 --2- 172.21.15.124:0/1758992132 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f885806daf0 0x7f885813ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.106+0000 7f885fdb2700 1 --2- 172.21.15.124:0/1758992132 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f88580cb230 0x7f8858152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.106+0000 7f885fdb2700 1 -- 172.21.15.124:0/1758992132 >> 172.21.15.124:0/1758992132 conn(0x7f88580cbad0 msgr2=0x7f88580b28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:14.110 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.106+0000 7f27cdffb700 1 -- 172.21.15.124:0/2545754032 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f27d001b030 con 0x7f27d80cae00 2023-10-16T12:59:14.110 INFO:teuthology.orchestra.run.smithi124.stdout:55834574857 2023-10-16T12:59:14.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.108+0000 7f02f51c9700 1 -- 172.21.15.124:0/571116340 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f02d0005870 con 0x7f02f01ffa50 2023-10-16T12:59:14.111 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.109+0000 7f02d77fe700 1 -- 172.21.15.124:0/571116340 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f02e0059d70 con 0x7f02f01ffa50 2023-10-16T12:59:14.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.109+0000 7f885fdb2700 1 -- 172.21.15.124:0/1758992132 shutdown_connections 2023-10-16T12:59:14.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.109+0000 7f24cb0a8700 1 -- 172.21.15.124:0/972794060 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f24a80055a0 con 0x7f24c40712e0 2023-10-16T12:59:14.112 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.109+0000 7f885fdb2700 1 -- 172.21.15.124:0/1758992132 wait complete. 2023-10-16T12:59:14.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2023-10-16T12:59:14.115 INFO:teuthology.orchestra.run.smithi124.stdout:55834574858 2023-10-16T12:59:14.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.111+0000 7f24c17fa700 1 -- 172.21.15.124:0/972794060 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f24bc057d30 con 0x7f24c40712e0 2023-10-16T12:59:14.116 DEBUG:teuthology.parallel:result is None 2023-10-16T12:59:14.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.111+0000 7f27c37fe700 1 -- 172.21.15.124:0/2545754032 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f27c406b080 msgr2=0x7f27c406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.111+0000 7f27c37fe700 1 --2- 172.21.15.124:0/2545754032 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f27c406b080 0x7f27c406d540 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f27d4000f60 tx=0x7f27d4007a40 comp rx=0 tx=0).stop 2023-10-16T12:59:14.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.111+0000 7f27c37fe700 1 -- 172.21.15.124:0/2545754032 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27d80cae00 msgr2=0x7f27d8164fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.111+0000 7f27c37fe700 1 --2- 172.21.15.124:0/2545754032 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27d80cae00 0x7f27d8164fb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f27d0004000 tx=0x7f27d0004ad0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.111+0000 7f27c37fe700 1 -- 172.21.15.124:0/2545754032 shutdown_connections 2023-10-16T12:59:14.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.111+0000 7f27c37fe700 1 --2- 172.21.15.124:0/2545754032 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f27c406b080 0x7f27c406d540 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.111+0000 7f27c37fe700 1 --2- 172.21.15.124:0/2545754032 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27d80cae00 0x7f27d8164fb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.111+0000 7f27c37fe700 1 --2- 172.21.15.124:0/2545754032 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f27d806e200 0x7f27d815f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.111+0000 7f27c37fe700 1 --2- 172.21.15.124:0/2545754032 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27d80c5b00 0x7f27d81617f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.111+0000 7f27c37fe700 1 -- 172.21.15.124:0/2545754032 >> 172.21.15.124:0/2545754032 conn(0x7f27d80cbad0 msgr2=0x7f27d80cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:14.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.111+0000 7f27c37fe700 1 -- 172.21.15.124:0/2545754032 shutdown_connections 2023-10-16T12:59:14.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.111+0000 7f27c37fe700 1 -- 172.21.15.124:0/2545754032 wait complete. 2023-10-16T12:59:14.120 INFO:teuthology.orchestra.run.smithi124.stdout:55834574859 2023-10-16T12:59:14.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.113+0000 7f02f51c9700 1 -- 172.21.15.124:0/571116340 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f02dc06af50 msgr2=0x7f02dc06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.113+0000 7f02f51c9700 1 --2- 172.21.15.124:0/571116340 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f02dc06af50 0x7f02dc06d410 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f02f00c9190 tx=0x7f02e8007290 comp rx=0 tx=0).stop 2023-10-16T12:59:14.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.113+0000 7f02f51c9700 1 -- 172.21.15.124:0/571116340 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02f01ffa50 msgr2=0x7f02f00c6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.113+0000 7f02f51c9700 1 --2- 172.21.15.124:0/571116340 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02f01ffa50 0x7f02f00c6090 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f02e0015000 tx=0x7f02e0001a00 comp rx=0 tx=0).stop 2023-10-16T12:59:14.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.113+0000 7f02f51c9700 1 -- 172.21.15.124:0/571116340 shutdown_connections 2023-10-16T12:59:14.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.113+0000 7f02f51c9700 1 --2- 172.21.15.124:0/571116340 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f02dc06af50 0x7f02dc06d410 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.113+0000 7f02f51c9700 1 --2- 172.21.15.124:0/571116340 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02f00c4830 0x7f02f01368b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.113+0000 7f02f51c9700 1 --2- 172.21.15.124:0/571116340 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02f01ffa50 0x7f02f00c6090 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.113+0000 7f02f51c9700 1 --2- 172.21.15.124:0/571116340 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02f00c7ac0 0x7f02f00c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.123 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.113+0000 7f02f51c9700 1 -- 172.21.15.124:0/571116340 >> 172.21.15.124:0/571116340 conn(0x7f02f00cbad0 msgr2=0x7f02f00b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:14.123 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.113+0000 7f02f51c9700 1 -- 172.21.15.124:0/571116340 shutdown_connections 2023-10-16T12:59:14.123 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.113+0000 7f02f51c9700 1 -- 172.21.15.124:0/571116340 wait complete. 2023-10-16T12:59:14.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.114+0000 7f24cb0a8700 1 -- 172.21.15.124:0/972794060 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f24a406afd0 msgr2=0x7f24a406d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.115+0000 7f24cb0a8700 1 --2- 172.21.15.124:0/972794060 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f24a406afd0 0x7f24a406d490 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f24c40cf370 tx=0x7f24b4013000 comp rx=0 tx=0).stop 2023-10-16T12:59:14.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.115+0000 7f24cb0a8700 1 -- 172.21.15.124:0/972794060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24c40712e0 msgr2=0x7f24c4153d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.115+0000 7f24cb0a8700 1 --2- 172.21.15.124:0/972794060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24c40712e0 0x7f24c4153d30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00cbe0 tx=0x7f24bc00cef0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.115+0000 7f24cb0a8700 1 -- 172.21.15.124:0/972794060 shutdown_connections 2023-10-16T12:59:14.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.115+0000 7f24cb0a8700 1 --2- 172.21.15.124:0/972794060 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f24a406afd0 0x7f24a406d490 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.115+0000 7f24cb0a8700 1 --2- 172.21.15.124:0/972794060 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f24c40b1660 0x7f24c40b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.115+0000 7f24cb0a8700 1 --2- 172.21.15.124:0/972794060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24c40712e0 0x7f24c4153d30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.115+0000 7f24cb0a8700 1 --2- 172.21.15.124:0/972794060 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c40cae90 0x7f24c40c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.115+0000 7f24cb0a8700 1 -- 172.21.15.124:0/972794060 >> 172.21.15.124:0/972794060 conn(0x7f24c40cfcd0 msgr2=0x7f24c40d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:14.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.115+0000 7f24cb0a8700 1 -- 172.21.15.124:0/972794060 shutdown_connections 2023-10-16T12:59:14.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.115+0000 7f24cb0a8700 1 -- 172.21.15.124:0/972794060 wait complete. 2023-10-16T12:59:14.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.119+0000 7f3d8c04d700 1 -- 172.21.15.124:0/751992896 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3d6c0055a0 con 0x7f3d840cc5f0 2023-10-16T12:59:14.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.119+0000 7f3d7a7fc700 1 -- 172.21.15.124:0/751992896 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3d74059920 con 0x7f3d840cc5f0 2023-10-16T12:59:14.127 INFO:teuthology.orchestra.run.smithi124.stdout:55834574859 2023-10-16T12:59:14.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2023-10-16T12:59:14.128 DEBUG:teuthology.parallel:result is None 2023-10-16T12:59:14.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.122+0000 7f3d8c04d700 1 -- 172.21.15.124:0/751992896 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f3d6806afd0 msgr2=0x7f3d6806d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.122+0000 7f3d8c04d700 1 --2- 172.21.15.124:0/751992896 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f3d6806afd0 0x7f3d6806d490 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3d80009930 tx=0x7f3d80008040 comp rx=0 tx=0).stop 2023-10-16T12:59:14.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.122+0000 7f3d8c04d700 1 -- 172.21.15.124:0/751992896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d840cc5f0 msgr2=0x7f3d840c3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.122+0000 7f3d8c04d700 1 --2- 172.21.15.124:0/751992896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d840cc5f0 0x7f3d840c3f10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3d74015000 tx=0x7f3d74004750 comp rx=0 tx=0).stop 2023-10-16T12:59:14.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.123+0000 7f3d8c04d700 1 -- 172.21.15.124:0/751992896 shutdown_connections 2023-10-16T12:59:14.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.123+0000 7f3d8c04d700 1 --2- 172.21.15.124:0/751992896 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f3d6806afd0 0x7f3d6806d490 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.123+0000 7f3d8c04d700 1 --2- 172.21.15.124:0/751992896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d840cc5f0 0x7f3d840c3f10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.131 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.123+0000 7f3d8c04d700 1 --2- 172.21.15.124:0/751992896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d8406e200 0x7f3d8414aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.131 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.123+0000 7f3d8c04d700 1 --2- 172.21.15.124:0/751992896 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d840cb210 0x7f3d8416b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.131 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.123+0000 7f3d8c04d700 1 -- 172.21.15.124:0/751992896 >> 172.21.15.124:0/751992896 conn(0x7f3d840cbad0 msgr2=0x7f3d8414bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:14.131 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.123+0000 7f3d8c04d700 1 -- 172.21.15.124:0/751992896 shutdown_connections 2023-10-16T12:59:14.131 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.123+0000 7f3d8c04d700 1 -- 172.21.15.124:0/751992896 wait complete. 2023-10-16T12:59:14.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2023-10-16T12:59:14.135 DEBUG:teuthology.parallel:result is None 2023-10-16T12:59:14.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2023-10-16T12:59:14.137 DEBUG:teuthology.parallel:result is None 2023-10-16T12:59:14.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2023-10-16T12:59:14.138 DEBUG:teuthology.parallel:result is None 2023-10-16T12:59:14.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2023-10-16T12:59:14.141 DEBUG:teuthology.parallel:result is None 2023-10-16T12:59:14.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2023-10-16T12:59:14.142 DEBUG:teuthology.parallel:result is None 2023-10-16T12:59:14.143 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-16T12:59:14.143 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T12:59:14.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.298+0000 7f42c0c20700 1 Processor -- start 2023-10-16T12:59:14.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.298+0000 7f42c0c20700 1 -- start start 2023-10-16T12:59:14.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.299+0000 7f42c0c20700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f42bc152470 0x7f42bc0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:14.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.299+0000 7f42c0c20700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f42bc0cb8d0 0x7f42bc0b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:14.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.299+0000 7f42c0c20700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42bc070d70 con 0x7f42bc0b3240 2023-10-16T12:59:14.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.299+0000 7f42c0c20700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42bc0b36d0 con 0x7f42bc0cb8d0 2023-10-16T12:59:14.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.299+0000 7f42c0c20700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42bc071200 con 0x7f42bc152470 2023-10-16T12:59:14.304 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.299+0000 7f42b9d9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f42bc0cb8d0 0x7f42bc0b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:14.304 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.299+0000 7f42b9d9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f42bc0cb8d0 0x7f42bc0b2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53942/0 (socket says 172.21.15.124:53942) 2023-10-16T12:59:14.304 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.299+0000 7f42b9d9b700 1 -- 172.21.15.124:0/3550599563 learned_addr learned my addr 172.21.15.124:0/3550599563 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:14.304 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.299+0000 7f42ba59c700 1 --2- 172.21.15.124:0/3550599563 >> v2:172.21.15.192:3300/0 conn(0x7f42bc152470 0x7f42bc0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:14.304 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.299+0000 7f42b9d9b700 1 -- 172.21.15.124:0/3550599563 >> v2:172.21.15.192:3300/0 conn(0x7f42bc152470 msgr2=0x7f42bc0cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:14.305 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.300+0000 7f42b9d9b700 1 --2- 172.21.15.124:0/3550599563 >> v2:172.21.15.192:3300/0 conn(0x7f42bc152470 0x7f42bc0cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.305 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.300+0000 7f42b9d9b700 1 -- 172.21.15.124:0/3550599563 >> v1:172.21.15.192:6789/0 conn(0x7f42bc0b3240 legacy=0x7f42bc0b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.305 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.300+0000 7f42b9d9b700 1 -- 172.21.15.124:0/3550599563 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42bc0cbd80 con 0x7f42bc0cb8d0 2023-10-16T12:59:14.305 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.300+0000 7f42b9d9b700 1 --2- 172.21.15.124:0/3550599563 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42bc0cb8d0 0x7f42bc0b2d00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f42bc071460 tx=0x7f42ac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=616d2060811e6993 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:14.305 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.300+0000 7f42b959a700 1 -- 172.21.15.124:0/3550599563 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac00b870 con 0x7f42bc0cb8d0 2023-10-16T12:59:14.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.300+0000 7f42b959a700 1 -- 172.21.15.124:0/3550599563 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ac00b9d0 con 0x7f42bc0cb8d0 2023-10-16T12:59:14.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.300+0000 7f42b959a700 1 -- 172.21.15.124:0/3550599563 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac00bd60 con 0x7f42bc0cb8d0 2023-10-16T12:59:14.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.300+0000 7f42c0c20700 1 -- 172.21.15.124:0/3550599563 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42bc0cb8d0 msgr2=0x7f42bc0b2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.300+0000 7f42c0c20700 1 --2- 172.21.15.124:0/3550599563 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42bc0cb8d0 0x7f42bc0b2d00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f42bc071460 tx=0x7f42ac009bd0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.300+0000 7f42c0c20700 1 -- 172.21.15.124:0/3550599563 shutdown_connections 2023-10-16T12:59:14.307 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.300+0000 7f42c0c20700 1 --2- 172.21.15.124:0/3550599563 >> v2:172.21.15.192:3300/0 conn(0x7f42bc152470 0x7f42bc0cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.307 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.300+0000 7f42c0c20700 1 --2- 172.21.15.124:0/3550599563 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42bc0cb8d0 0x7f42bc0b2d00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.307 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.300+0000 7f42c0c20700 1 -- 172.21.15.124:0/3550599563 >> 172.21.15.124:0/3550599563 conn(0x7f42bc0cdd00 msgr2=0x7f42bc0ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:14.307 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.300+0000 7f42c0c20700 1 -- 172.21.15.124:0/3550599563 shutdown_connections 2023-10-16T12:59:14.307 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.301+0000 7f42c0c20700 1 -- 172.21.15.124:0/3550599563 wait complete. 2023-10-16T12:59:14.310 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.302+0000 7f42c0c20700 1 Processor -- start 2023-10-16T12:59:14.310 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.302+0000 7f42c0c20700 1 -- start start 2023-10-16T12:59:14.310 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.303+0000 7f42c0c20700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42bc0b3240 0x7f42bc1f3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:14.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.303+0000 7f42c0c20700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42bc0cb8d0 0x7f42bc154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:14.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.303+0000 7f42c0c20700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42bc152470 0x7f42bc1f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:14.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.303+0000 7f42c0c20700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc14efa0 con 0x7f42bc0cb8d0 2023-10-16T12:59:14.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.303+0000 7f42c0c20700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc0cafb0 con 0x7f42bc152470 2023-10-16T12:59:14.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.303+0000 7f42c0c20700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc1f20e0 con 0x7f42bc0b3240 2023-10-16T12:59:14.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.303+0000 7f42b9d9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42bc0cb8d0 0x7f42bc154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:14.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.303+0000 7f42b9d9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42bc0cb8d0 0x7f42bc154b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53948/0 (socket says 172.21.15.124:53948) 2023-10-16T12:59:14.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.303+0000 7f42b9d9b700 1 -- 172.21.15.124:0/1115281054 learned_addr learned my addr 172.21.15.124:0/1115281054 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:14.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.303+0000 7f42ba59c700 1 --2- 172.21.15.124:0/1115281054 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42bc0b3240 0x7f42bc1f3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:14.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.303+0000 7f42bad9d700 1 --2- 172.21.15.124:0/1115281054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42bc152470 0x7f42bc1f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:14.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.303+0000 7f42b9d9b700 1 -- 172.21.15.124:0/1115281054 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42bc0b3240 msgr2=0x7f42bc1f3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.303+0000 7f42b9d9b700 1 --2- 172.21.15.124:0/1115281054 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42bc0b3240 0x7f42bc1f3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.303+0000 7f42b9d9b700 1 -- 172.21.15.124:0/1115281054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42bc152470 msgr2=0x7f42bc1f1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.303+0000 7f42b9d9b700 1 --2- 172.21.15.124:0/1115281054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42bc152470 0x7f42bc1f1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.303+0000 7f42b9d9b700 1 -- 172.21.15.124:0/1115281054 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ac009550 con 0x7f42bc0cb8d0 2023-10-16T12:59:14.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.303+0000 7f42b9d9b700 1 --2- 172.21.15.124:0/1115281054 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42bc0cb8d0 0x7f42bc154b60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f42bc0b3a80 tx=0x7f42ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:14.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.303+0000 7f42b2ffd700 1 -- 172.21.15.124:0/1115281054 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac004540 con 0x7f42bc0cb8d0 2023-10-16T12:59:14.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.303+0000 7f42b2ffd700 1 -- 172.21.15.124:0/1115281054 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ac0036a0 con 0x7f42bc0cb8d0 2023-10-16T12:59:14.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.303+0000 7f42c0c20700 1 -- 172.21.15.124:0/1115281054 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42bc1551f0 con 0x7f42bc0cb8d0 2023-10-16T12:59:14.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.303+0000 7f42b2ffd700 1 -- 172.21.15.124:0/1115281054 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac003a10 con 0x7f42bc0cb8d0 2023-10-16T12:59:14.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.303+0000 7f42c0c20700 1 -- 172.21.15.124:0/1115281054 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42bc152b30 con 0x7f42bc0cb8d0 2023-10-16T12:59:14.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.304+0000 7f42c0c20700 1 -- 172.21.15.124:0/1115281054 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42bc04ebb0 con 0x7f42bc0cb8d0 2023-10-16T12:59:14.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.305+0000 7f42b2ffd700 1 -- 172.21.15.124:0/1115281054 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f42ac021070 con 0x7f42bc0cb8d0 2023-10-16T12:59:14.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.305+0000 7f42b2ffd700 1 --2- 172.21.15.124:0/1115281054 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f429c06af00 0x7f429c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:14.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.305+0000 7f42b2ffd700 1 -- 172.21.15.124:0/1115281054 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f42ac08af90 con 0x7f42bc0cb8d0 2023-10-16T12:59:14.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.305+0000 7f42ba59c700 1 --2- 172.21.15.124:0/1115281054 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f429c06af00 0x7f429c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:14.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.305+0000 7f42ba59c700 1 --2- 172.21.15.124:0/1115281054 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f429c06af00 0x7f429c06d3c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f42a4009930 tx=0x7f42a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:14.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.309+0000 7f42b2ffd700 1 -- 172.21.15.124:0/1115281054 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f42ac0bdca0 con 0x7f42bc0cb8d0 2023-10-16T12:59:14.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.496+0000 7f42c0c20700 1 -- 172.21.15.124:0/1115281054 --> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f42bc070720 con 0x7f429c06af00 2023-10-16T12:59:14.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.505+0000 7f42b2ffd700 1 -- 172.21.15.124:0/1115281054 <== mgr.4104 v2:172.21.15.124:6832/2391611330 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345194 (secure 0 0 0) 0x7f42a4009e00 con 0x7f429c06af00 2023-10-16T12:59:14.510 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:14.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.509+0000 7f42c0c20700 1 -- 172.21.15.124:0/1115281054 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f429c06af00 msgr2=0x7f429c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.509+0000 7f42c0c20700 1 --2- 172.21.15.124:0/1115281054 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f429c06af00 0x7f429c06d3c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f42a4009930 tx=0x7f42a4008040 comp rx=0 tx=0).stop 2023-10-16T12:59:14.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.509+0000 7f42c0c20700 1 -- 172.21.15.124:0/1115281054 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42bc0cb8d0 msgr2=0x7f42bc154b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.509+0000 7f42c0c20700 1 --2- 172.21.15.124:0/1115281054 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42bc0cb8d0 0x7f42bc154b60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f42bc0b3a80 tx=0x7f42ac004750 comp rx=0 tx=0).stop 2023-10-16T12:59:14.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.509+0000 7f42c0c20700 1 -- 172.21.15.124:0/1115281054 shutdown_connections 2023-10-16T12:59:14.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.509+0000 7f42c0c20700 1 --2- 172.21.15.124:0/1115281054 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f429c06af00 0x7f429c06d3c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.509+0000 7f42c0c20700 1 --2- 172.21.15.124:0/1115281054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42bc152470 0x7f42bc1f1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.509+0000 7f42c0c20700 1 --2- 172.21.15.124:0/1115281054 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42bc0b3240 0x7f42bc1f3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.509+0000 7f42c0c20700 1 --2- 172.21.15.124:0/1115281054 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42bc0cb8d0 0x7f42bc154b60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.509+0000 7f42c0c20700 1 -- 172.21.15.124:0/1115281054 >> 172.21.15.124:0/1115281054 conn(0x7f42bc0cdd00 msgr2=0x7f42bc159580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:14.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.509+0000 7f42c0c20700 1 -- 172.21.15.124:0/1115281054 shutdown_connections 2023-10-16T12:59:14.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.509+0000 7f42c0c20700 1 -- 172.21.15.124:0/1115281054 wait complete. 2023-10-16T12:59:14.516 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-16T12:59:14.522 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-10-16T12:59:12.625047+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219380,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755340,"statfs":{"total":773094113280,"available":772869468160,"internally_reserved":0,"allocated":3284992,"data_stored":1988256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003189"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705875+0000","last_change":"2023-10-16T12:58:51.447948+0000","last_active":"2023-10-16T12:58:55.705875+0000","last_peered":"2023-10-16T12:58:55.705875+0000","last_clean":"2023-10-16T12:58:55.705875+0000","last_became_active":"2023-10-16T12:58:51.447661+0000","last_became_peered":"2023-10-16T12:58:51.447661+0000","last_unstale":"2023-10-16T12:58:55.705875+0000","last_undegraded":"2023-10-16T12:58:55.705875+0000","last_fullsized":"2023-10-16T12:58:55.705875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:29:07.394120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679949+0000","last_change":"2023-10-16T12:58:51.439340+0000","last_active":"2023-10-16T12:58:55.679949+0000","last_peered":"2023-10-16T12:58:55.679949+0000","last_clean":"2023-10-16T12:58:55.679949+0000","last_became_active":"2023-10-16T12:58:51.439064+0000","last_became_peered":"2023-10-16T12:58:51.439064+0000","last_unstale":"2023-10-16T12:58:55.679949+0000","last_undegraded":"2023-10-16T12:58:55.679949+0000","last_fullsized":"2023-10-16T12:58:55.679949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:51.422601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.689332+0000","last_change":"2023-10-16T12:58:51.441634+0000","last_active":"2023-10-16T12:58:55.689332+0000","last_peered":"2023-10-16T12:58:55.689332+0000","last_clean":"2023-10-16T12:58:55.689332+0000","last_became_active":"2023-10-16T12:58:51.441380+0000","last_became_peered":"2023-10-16T12:58:51.441380+0000","last_unstale":"2023-10-16T12:58:55.689332+0000","last_undegraded":"2023-10-16T12:58:55.689332+0000","last_fullsized":"2023-10-16T12:58:55.689332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:28:04.262253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679334+0000","last_change":"2023-10-16T12:58:51.442103+0000","last_active":"2023-10-16T12:58:55.679334+0000","last_peered":"2023-10-16T12:58:55.679334+0000","last_clean":"2023-10-16T12:58:55.679334+0000","last_became_active":"2023-10-16T12:58:51.438544+0000","last_became_peered":"2023-10-16T12:58:51.438544+0000","last_unstale":"2023-10-16T12:58:55.679334+0000","last_undegraded":"2023-10-16T12:58:55.679334+0000","last_fullsized":"2023-10-16T12:58:55.679334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:29:07.394120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705435+0000","last_change":"2023-10-16T12:58:51.447862+0000","last_active":"2023-10-16T12:58:55.705435+0000","last_peered":"2023-10-16T12:58:55.705435+0000","last_clean":"2023-10-16T12:58:55.705435+0000","last_became_active":"2023-10-16T12:58:51.447596+0000","last_became_peered":"2023-10-16T12:58:51.447596+0000","last_unstale":"2023-10-16T12:58:55.705435+0000","last_undegraded":"2023-10-16T12:58:55.705435+0000","last_fullsized":"2023-10-16T12:58:55.705435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:42:07.880003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679036+0000","last_change":"2023-10-16T12:58:51.439890+0000","last_active":"2023-10-16T12:58:55.679036+0000","last_peered":"2023-10-16T12:58:55.679036+0000","last_clean":"2023-10-16T12:58:55.679036+0000","last_became_active":"2023-10-16T12:58:51.439624+0000","last_became_peered":"2023-10-16T12:58:51.439624+0000","last_unstale":"2023-10-16T12:58:55.679036+0000","last_undegraded":"2023-10-16T12:58:55.679036+0000","last_fullsized":"2023-10-16T12:58:55.679036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:17:35.655947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705720+0000","last_change":"2023-10-16T12:58:51.446245+0000","last_active":"2023-10-16T12:58:55.705720+0000","last_peered":"2023-10-16T12:58:55.705720+0000","last_clean":"2023-10-16T12:58:55.705720+0000","last_became_active":"2023-10-16T12:58:51.445888+0000","last_became_peered":"2023-10-16T12:58:51.445888+0000","last_unstale":"2023-10-16T12:58:55.705720+0000","last_undegraded":"2023-10-16T12:58:55.705720+0000","last_fullsized":"2023-10-16T12:58:55.705720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:51.422601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688745+0000","last_change":"2023-10-16T12:58:51.444473+0000","last_active":"2023-10-16T12:58:55.688745+0000","last_peered":"2023-10-16T12:58:55.688745+0000","last_clean":"2023-10-16T12:58:55.688745+0000","last_became_active":"2023-10-16T12:58:51.444135+0000","last_became_peered":"2023-10-16T12:58:51.444135+0000","last_unstale":"2023-10-16T12:58:55.688745+0000","last_undegraded":"2023-10-16T12:58:55.688745+0000","last_fullsized":"2023-10-16T12:58:55.688745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:35.585161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705821+0000","last_change":"2023-10-16T12:58:51.450649+0000","last_active":"2023-10-16T12:58:55.705821+0000","last_peered":"2023-10-16T12:58:55.705821+0000","last_clean":"2023-10-16T12:58:55.705821+0000","last_became_active":"2023-10-16T12:58:51.450086+0000","last_became_peered":"2023-10-16T12:58:51.450086+0000","last_unstale":"2023-10-16T12:58:55.705821+0000","last_undegraded":"2023-10-16T12:58:55.705821+0000","last_fullsized":"2023-10-16T12:58:55.705821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:46:33.298597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686340+0000","last_change":"2023-10-16T12:58:51.443152+0000","last_active":"2023-10-16T12:58:55.686340+0000","last_peered":"2023-10-16T12:58:55.686340+0000","last_clean":"2023-10-16T12:58:55.686340+0000","last_became_active":"2023-10-16T12:58:51.442907+0000","last_became_peered":"2023-10-16T12:58:51.442907+0000","last_unstale":"2023-10-16T12:58:55.686340+0000","last_undegraded":"2023-10-16T12:58:55.686340+0000","last_fullsized":"2023-10-16T12:58:55.686340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:17:35.655947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686659+0000","last_change":"2023-10-16T12:58:51.445780+0000","last_active":"2023-10-16T12:58:55.686659+0000","last_peered":"2023-10-16T12:58:55.686659+0000","last_clean":"2023-10-16T12:58:55.686659+0000","last_became_active":"2023-10-16T12:58:51.445488+0000","last_became_peered":"2023-10-16T12:58:51.445488+0000","last_unstale":"2023-10-16T12:58:55.686659+0000","last_undegraded":"2023-10-16T12:58:55.686659+0000","last_fullsized":"2023-10-16T12:58:55.686659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:17.757203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.681164+0000","last_change":"2023-10-16T12:58:51.443335+0000","last_active":"2023-10-16T12:58:55.681164+0000","last_peered":"2023-10-16T12:58:55.681164+0000","last_clean":"2023-10-16T12:58:55.681164+0000","last_became_active":"2023-10-16T12:58:51.443022+0000","last_became_peered":"2023-10-16T12:58:51.443022+0000","last_unstale":"2023-10-16T12:58:55.681164+0000","last_undegraded":"2023-10-16T12:58:55.681164+0000","last_fullsized":"2023-10-16T12:58:55.681164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:21.517544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.683113+0000","last_change":"2023-10-16T12:58:51.442753+0000","last_active":"2023-10-16T12:58:55.683113+0000","last_peered":"2023-10-16T12:58:55.683113+0000","last_clean":"2023-10-16T12:58:55.683113+0000","last_became_active":"2023-10-16T12:58:51.442501+0000","last_became_peered":"2023-10-16T12:58:51.442501+0000","last_unstale":"2023-10-16T12:58:55.683113+0000","last_undegraded":"2023-10-16T12:58:55.683113+0000","last_fullsized":"2023-10-16T12:58:55.683113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:17.757203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.690094+0000","last_change":"2023-10-16T12:58:51.439019+0000","last_active":"2023-10-16T12:58:55.690094+0000","last_peered":"2023-10-16T12:58:55.690094+0000","last_clean":"2023-10-16T12:58:55.690094+0000","last_became_active":"2023-10-16T12:58:51.438742+0000","last_became_peered":"2023-10-16T12:58:51.438742+0000","last_unstale":"2023-10-16T12:58:55.690094+0000","last_undegraded":"2023-10-16T12:58:55.690094+0000","last_fullsized":"2023-10-16T12:58:55.690094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:35.585161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.678142+0000","last_change":"2023-10-16T12:58:51.431552+0000","last_active":"2023-10-16T12:58:55.678142+0000","last_peered":"2023-10-16T12:58:55.678142+0000","last_clean":"2023-10-16T12:58:55.678142+0000","last_became_active":"2023-10-16T12:58:51.431302+0000","last_became_peered":"2023-10-16T12:58:51.431302+0000","last_unstale":"2023-10-16T12:58:55.678142+0000","last_undegraded":"2023-10-16T12:58:55.678142+0000","last_fullsized":"2023-10-16T12:58:55.678142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:40:36.060468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.680089+0000","last_change":"2023-10-16T12:58:51.442937+0000","last_active":"2023-10-16T12:58:55.680089+0000","last_peered":"2023-10-16T12:58:55.680089+0000","last_clean":"2023-10-16T12:58:55.680089+0000","last_became_active":"2023-10-16T12:58:51.442503+0000","last_became_peered":"2023-10-16T12:58:51.442503+0000","last_unstale":"2023-10-16T12:58:55.680089+0000","last_undegraded":"2023-10-16T12:58:55.680089+0000","last_fullsized":"2023-10-16T12:58:55.680089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:51.422601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.678499+0000","last_change":"2023-10-16T12:58:51.447014+0000","last_active":"2023-10-16T12:58:55.678499+0000","last_peered":"2023-10-16T12:58:55.678499+0000","last_clean":"2023-10-16T12:58:55.678499+0000","last_became_active":"2023-10-16T12:58:51.446752+0000","last_became_peered":"2023-10-16T12:58:51.446752+0000","last_unstale":"2023-10-16T12:58:55.678499+0000","last_undegraded":"2023-10-16T12:58:55.678499+0000","last_fullsized":"2023-10-16T12:58:55.678499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:42:26.907121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686121+0000","last_change":"2023-10-16T12:58:51.442299+0000","last_active":"2023-10-16T12:58:55.686121+0000","last_peered":"2023-10-16T12:58:55.686121+0000","last_clean":"2023-10-16T12:58:55.686121+0000","last_became_active":"2023-10-16T12:58:51.442028+0000","last_became_peered":"2023-10-16T12:58:51.442028+0000","last_unstale":"2023-10-16T12:58:55.686121+0000","last_undegraded":"2023-10-16T12:58:55.686121+0000","last_fullsized":"2023-10-16T12:58:55.686121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:26:09.658750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.706083+0000","last_change":"2023-10-16T12:58:51.446159+0000","last_active":"2023-10-16T12:58:55.706083+0000","last_peered":"2023-10-16T12:58:55.706083+0000","last_clean":"2023-10-16T12:58:55.706083+0000","last_became_active":"2023-10-16T12:58:51.445862+0000","last_became_peered":"2023-10-16T12:58:51.445862+0000","last_unstale":"2023-10-16T12:58:55.706083+0000","last_undegraded":"2023-10-16T12:58:55.706083+0000","last_fullsized":"2023-10-16T12:58:55.706083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:41:33.353000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.074473+0000","last_change":"2023-10-16T12:58:55.710385+0000","last_active":"2023-10-16T12:58:57.074473+0000","last_peered":"2023-10-16T12:58:57.074473+0000","last_clean":"2023-10-16T12:58:57.074473+0000","last_became_active":"2023-10-16T12:58:55.709936+0000","last_became_peered":"2023-10-16T12:58:55.709936+0000","last_unstale":"2023-10-16T12:58:57.074473+0000","last_undegraded":"2023-10-16T12:58:57.074473+0000","last_fullsized":"2023-10-16T12:58:57.074473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:10:14.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684401+0000","last_change":"2023-10-16T12:58:50.682380+0000","last_active":"2023-10-16T12:58:55.684401+0000","last_peered":"2023-10-16T12:58:55.684401+0000","last_clean":"2023-10-16T12:58:55.684401+0000","last_became_active":"2023-10-16T12:58:50.682119+0000","last_became_peered":"2023-10-16T12:58:50.682119+0000","last_unstale":"2023-10-16T12:58:55.684401+0000","last_undegraded":"2023-10-16T12:58:55.684401+0000","last_fullsized":"2023-10-16T12:58:55.684401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:43:43.356254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688115+0000","last_change":"2023-10-16T12:58:51.442218+0000","last_active":"2023-10-16T12:58:55.688115+0000","last_peered":"2023-10-16T12:58:55.688115+0000","last_clean":"2023-10-16T12:58:55.688115+0000","last_became_active":"2023-10-16T12:58:51.441929+0000","last_became_peered":"2023-10-16T12:58:51.441929+0000","last_unstale":"2023-10-16T12:58:55.688115+0000","last_undegraded":"2023-10-16T12:58:55.688115+0000","last_fullsized":"2023-10-16T12:58:55.688115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:31:13.605999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.425885+0000","last_change":"2023-10-16T12:58:55.694446+0000","last_active":"2023-10-16T12:58:56.425885+0000","last_peered":"2023-10-16T12:58:56.425885+0000","last_clean":"2023-10-16T12:58:56.425885+0000","last_became_active":"2023-10-16T12:58:55.694006+0000","last_became_peered":"2023-10-16T12:58:55.694006+0000","last_unstale":"2023-10-16T12:58:56.425885+0000","last_undegraded":"2023-10-16T12:58:56.425885+0000","last_fullsized":"2023-10-16T12:58:56.425885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:42:11.902399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688217+0000","last_change":"2023-10-16T12:58:50.672891+0000","last_active":"2023-10-16T12:58:55.688217+0000","last_peered":"2023-10-16T12:58:55.688217+0000","last_clean":"2023-10-16T12:58:55.688217+0000","last_became_active":"2023-10-16T12:58:50.672632+0000","last_became_peered":"2023-10-16T12:58:50.672632+0000","last_unstale":"2023-10-16T12:58:55.688217+0000","last_undegraded":"2023-10-16T12:58:55.688217+0000","last_fullsized":"2023-10-16T12:58:55.688217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:00:22.709075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684236+0000","last_change":"2023-10-16T12:58:51.444115+0000","last_active":"2023-10-16T12:58:55.684236+0000","last_peered":"2023-10-16T12:58:55.684236+0000","last_clean":"2023-10-16T12:58:55.684236+0000","last_became_active":"2023-10-16T12:58:51.443884+0000","last_became_peered":"2023-10-16T12:58:51.443884+0000","last_unstale":"2023-10-16T12:58:55.684236+0000","last_undegraded":"2023-10-16T12:58:55.684236+0000","last_fullsized":"2023-10-16T12:58:55.684236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:32.084288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426516+0000","last_change":"2023-10-16T12:58:55.697719+0000","last_active":"2023-10-16T12:58:56.426516+0000","last_peered":"2023-10-16T12:58:56.426516+0000","last_clean":"2023-10-16T12:58:56.426516+0000","last_became_active":"2023-10-16T12:58:55.697330+0000","last_became_peered":"2023-10-16T12:58:55.697330+0000","last_unstale":"2023-10-16T12:58:56.426516+0000","last_undegraded":"2023-10-16T12:58:56.426516+0000","last_fullsized":"2023-10-16T12:58:56.426516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:30:02.068649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705908+0000","last_change":"2023-10-16T12:58:50.678753+0000","last_active":"2023-10-16T12:58:55.705908+0000","last_peered":"2023-10-16T12:58:55.705908+0000","last_clean":"2023-10-16T12:58:55.705908+0000","last_became_active":"2023-10-16T12:58:50.674216+0000","last_became_peered":"2023-10-16T12:58:50.674216+0000","last_unstale":"2023-10-16T12:58:55.705908+0000","last_undegraded":"2023-10-16T12:58:55.705908+0000","last_fullsized":"2023-10-16T12:58:55.705908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:34.579436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679582+0000","last_change":"2023-10-16T12:58:51.442758+0000","last_active":"2023-10-16T12:58:55.679582+0000","last_peered":"2023-10-16T12:58:55.679582+0000","last_clean":"2023-10-16T12:58:55.679582+0000","last_became_active":"2023-10-16T12:58:51.442485+0000","last_became_peered":"2023-10-16T12:58:51.442485+0000","last_unstale":"2023-10-16T12:58:55.679582+0000","last_undegraded":"2023-10-16T12:58:55.679582+0000","last_fullsized":"2023-10-16T12:58:55.679582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:18:46.943690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426512+0000","last_change":"2023-10-16T12:58:55.699182+0000","last_active":"2023-10-16T12:58:56.426512+0000","last_peered":"2023-10-16T12:58:56.426512+0000","last_clean":"2023-10-16T12:58:56.426512+0000","last_became_active":"2023-10-16T12:58:55.698738+0000","last_became_peered":"2023-10-16T12:58:55.698738+0000","last_unstale":"2023-10-16T12:58:56.426512+0000","last_undegraded":"2023-10-16T12:58:56.426512+0000","last_fullsized":"2023-10-16T12:58:56.426512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:41:37.375395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705027+0000","last_change":"2023-10-16T12:58:50.680255+0000","last_active":"2023-10-16T12:58:55.705027+0000","last_peered":"2023-10-16T12:58:55.705027+0000","last_clean":"2023-10-16T12:58:55.705027+0000","last_became_active":"2023-10-16T12:58:50.679975+0000","last_became_peered":"2023-10-16T12:58:50.679975+0000","last_unstale":"2023-10-16T12:58:55.705027+0000","last_undegraded":"2023-10-16T12:58:55.705027+0000","last_fullsized":"2023-10-16T12:58:55.705027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:10.863857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.681187+0000","last_change":"2023-10-16T12:58:51.443585+0000","last_active":"2023-10-16T12:58:55.681187+0000","last_peered":"2023-10-16T12:58:55.681187+0000","last_clean":"2023-10-16T12:58:55.681187+0000","last_became_active":"2023-10-16T12:58:51.443200+0000","last_became_peered":"2023-10-16T12:58:51.443200+0000","last_unstale":"2023-10-16T12:58:55.681187+0000","last_undegraded":"2023-10-16T12:58:55.681187+0000","last_fullsized":"2023-10-16T12:58:55.681187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:46:33.298597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.074615+0000","last_change":"2023-10-16T12:58:55.696218+0000","last_active":"2023-10-16T12:58:57.074615+0000","last_peered":"2023-10-16T12:58:57.074615+0000","last_clean":"2023-10-16T12:58:57.074615+0000","last_became_active":"2023-10-16T12:58:55.695835+0000","last_became_peered":"2023-10-16T12:58:55.695835+0000","last_unstale":"2023-10-16T12:58:57.074615+0000","last_undegraded":"2023-10-16T12:58:57.074615+0000","last_fullsized":"2023-10-16T12:58:57.074615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:51:25.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.683294+0000","last_change":"2023-10-16T12:58:50.675887+0000","last_active":"2023-10-16T12:58:55.683294+0000","last_peered":"2023-10-16T12:58:55.683294+0000","last_clean":"2023-10-16T12:58:55.683294+0000","last_became_active":"2023-10-16T12:58:50.675649+0000","last_became_peered":"2023-10-16T12:58:50.675649+0000","last_unstale":"2023-10-16T12:58:55.683294+0000","last_undegraded":"2023-10-16T12:58:55.683294+0000","last_fullsized":"2023-10-16T12:58:55.683294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:31.078563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.681802+0000","last_change":"2023-10-16T12:58:51.435387+0000","last_active":"2023-10-16T12:58:55.681802+0000","last_peered":"2023-10-16T12:58:55.681802+0000","last_clean":"2023-10-16T12:58:55.681802+0000","last_became_active":"2023-10-16T12:58:51.435106+0000","last_became_peered":"2023-10-16T12:58:51.435106+0000","last_unstale":"2023-10-16T12:58:55.681802+0000","last_undegraded":"2023-10-16T12:58:55.681802+0000","last_fullsized":"2023-10-16T12:58:55.681802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:56.488214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.424372+0000","last_change":"2023-10-16T12:58:55.699076+0000","last_active":"2023-10-16T12:58:56.424372+0000","last_peered":"2023-10-16T12:58:56.424372+0000","last_clean":"2023-10-16T12:58:56.424372+0000","last_became_active":"2023-10-16T12:58:55.698670+0000","last_became_peered":"2023-10-16T12:58:55.698670+0000","last_unstale":"2023-10-16T12:58:56.424372+0000","last_undegraded":"2023-10-16T12:58:56.424372+0000","last_fullsized":"2023-10-16T12:58:56.424372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:51.536207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.687076+0000","last_change":"2023-10-16T12:58:50.670932+0000","last_active":"2023-10-16T12:58:55.687076+0000","last_peered":"2023-10-16T12:58:55.687076+0000","last_clean":"2023-10-16T12:58:55.687076+0000","last_became_active":"2023-10-16T12:58:50.670622+0000","last_became_peered":"2023-10-16T12:58:50.670622+0000","last_unstale":"2023-10-16T12:58:55.687076+0000","last_undegraded":"2023-10-16T12:58:55.687076+0000","last_fullsized":"2023-10-16T12:58:55.687076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:31.078563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.692398+0000","last_change":"2023-10-16T12:58:51.440771+0000","last_active":"2023-10-16T12:58:55.692398+0000","last_peered":"2023-10-16T12:58:55.692398+0000","last_clean":"2023-10-16T12:58:55.692398+0000","last_became_active":"2023-10-16T12:58:51.440502+0000","last_became_peered":"2023-10-16T12:58:51.440502+0000","last_unstale":"2023-10-16T12:58:55.692398+0000","last_undegraded":"2023-10-16T12:58:55.692398+0000","last_fullsized":"2023-10-16T12:58:55.692398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:51.422601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426179+0000","last_change":"2023-10-16T12:58:55.703710+0000","last_active":"2023-10-16T12:58:56.426179+0000","last_peered":"2023-10-16T12:58:56.426179+0000","last_clean":"2023-10-16T12:58:56.426179+0000","last_became_active":"2023-10-16T12:58:55.702784+0000","last_became_peered":"2023-10-16T12:58:55.702784+0000","last_unstale":"2023-10-16T12:58:56.426179+0000","last_undegraded":"2023-10-16T12:58:56.426179+0000","last_fullsized":"2023-10-16T12:58:56.426179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:19.721283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688901+0000","last_change":"2023-10-16T12:58:50.670749+0000","last_active":"2023-10-16T12:58:55.688901+0000","last_peered":"2023-10-16T12:58:55.688901+0000","last_clean":"2023-10-16T12:58:55.688901+0000","last_became_active":"2023-10-16T12:58:50.670491+0000","last_became_peered":"2023-10-16T12:58:50.670491+0000","last_unstale":"2023-10-16T12:58:55.688901+0000","last_undegraded":"2023-10-16T12:58:55.688901+0000","last_fullsized":"2023-10-16T12:58:55.688901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:10.863857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684097+0000","last_change":"2023-10-16T12:58:51.441981+0000","last_active":"2023-10-16T12:58:55.684097+0000","last_peered":"2023-10-16T12:58:55.684097+0000","last_clean":"2023-10-16T12:58:55.684097+0000","last_became_active":"2023-10-16T12:58:51.441704+0000","last_became_peered":"2023-10-16T12:58:51.441704+0000","last_unstale":"2023-10-16T12:58:55.684097+0000","last_undegraded":"2023-10-16T12:58:55.684097+0000","last_fullsized":"2023-10-16T12:58:55.684097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:51.422601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072432+0000","last_change":"2023-10-16T12:58:55.709709+0000","last_active":"2023-10-16T12:58:57.072432+0000","last_peered":"2023-10-16T12:58:57.072432+0000","last_clean":"2023-10-16T12:58:57.072432+0000","last_became_active":"2023-10-16T12:58:55.709039+0000","last_became_peered":"2023-10-16T12:58:55.709039+0000","last_unstale":"2023-10-16T12:58:57.072432+0000","last_undegraded":"2023-10-16T12:58:57.072432+0000","last_fullsized":"2023-10-16T12:58:57.072432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:29:11.416516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.680211+0000","last_change":"2023-10-16T12:58:50.678872+0000","last_active":"2023-10-16T12:58:55.680211+0000","last_peered":"2023-10-16T12:58:55.680211+0000","last_clean":"2023-10-16T12:58:55.680211+0000","last_became_active":"2023-10-16T12:58:50.678579+0000","last_became_peered":"2023-10-16T12:58:50.678579+0000","last_unstale":"2023-10-16T12:58:55.680211+0000","last_undegraded":"2023-10-16T12:58:55.680211+0000","last_fullsized":"2023-10-16T12:58:55.680211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:26:08.653026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.677699+0000","last_change":"2023-10-16T12:58:51.437769+0000","last_active":"2023-10-16T12:58:55.677699+0000","last_peered":"2023-10-16T12:58:55.677699+0000","last_clean":"2023-10-16T12:58:55.677699+0000","last_became_active":"2023-10-16T12:58:51.437507+0000","last_became_peered":"2023-10-16T12:58:51.437507+0000","last_unstale":"2023-10-16T12:58:55.677699+0000","last_undegraded":"2023-10-16T12:58:55.677699+0000","last_fullsized":"2023-10-16T12:58:55.677699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:59.501942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.074906+0000","last_change":"2023-10-16T12:58:55.708558+0000","last_active":"2023-10-16T12:58:57.074906+0000","last_peered":"2023-10-16T12:58:57.074906+0000","last_clean":"2023-10-16T12:58:57.074906+0000","last_became_active":"2023-10-16T12:58:55.708150+0000","last_became_peered":"2023-10-16T12:58:55.708150+0000","last_unstale":"2023-10-16T12:58:57.074906+0000","last_undegraded":"2023-10-16T12:58:57.074906+0000","last_fullsized":"2023-10-16T12:58:57.074906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:44:45.372869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686651+0000","last_change":"2023-10-16T12:58:50.670702+0000","last_active":"2023-10-16T12:58:55.686651+0000","last_peered":"2023-10-16T12:58:55.686651+0000","last_clean":"2023-10-16T12:58:55.686651+0000","last_became_active":"2023-10-16T12:58:50.670419+0000","last_became_peered":"2023-10-16T12:58:50.670419+0000","last_unstale":"2023-10-16T12:58:55.686651+0000","last_undegraded":"2023-10-16T12:58:55.686651+0000","last_fullsized":"2023-10-16T12:58:55.686651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:34.579436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.680401+0000","last_change":"2023-10-16T12:58:51.449669+0000","last_active":"2023-10-16T12:58:55.680401+0000","last_peered":"2023-10-16T12:58:55.680401+0000","last_clean":"2023-10-16T12:58:55.680401+0000","last_became_active":"2023-10-16T12:58:51.449350+0000","last_became_peered":"2023-10-16T12:58:51.449350+0000","last_unstale":"2023-10-16T12:58:55.680401+0000","last_undegraded":"2023-10-16T12:58:55.680401+0000","last_fullsized":"2023-10-16T12:58:55.680401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:33.724803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.075082+0000","last_change":"2023-10-16T12:58:55.702198+0000","last_active":"2023-10-16T12:58:57.075082+0000","last_peered":"2023-10-16T12:58:57.075082+0000","last_clean":"2023-10-16T12:58:57.075082+0000","last_became_active":"2023-10-16T12:58:55.701858+0000","last_became_peered":"2023-10-16T12:58:55.701858+0000","last_unstale":"2023-10-16T12:58:57.075082+0000","last_undegraded":"2023-10-16T12:58:57.075082+0000","last_fullsized":"2023-10-16T12:58:57.075082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:44:31.688200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.680381+0000","last_change":"2023-10-16T12:58:50.676760+0000","last_active":"2023-10-16T12:58:55.680381+0000","last_peered":"2023-10-16T12:58:55.680381+0000","last_clean":"2023-10-16T12:58:55.680381+0000","last_became_active":"2023-10-16T12:58:50.676461+0000","last_became_peered":"2023-10-16T12:58:50.676461+0000","last_unstale":"2023-10-16T12:58:55.680381+0000","last_undegraded":"2023-10-16T12:58:55.680381+0000","last_fullsized":"2023-10-16T12:58:55.680381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:43:43.356254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684505+0000","last_change":"2023-10-16T12:58:51.444087+0000","last_active":"2023-10-16T12:58:55.684505+0000","last_peered":"2023-10-16T12:58:55.684505+0000","last_clean":"2023-10-16T12:58:55.684505+0000","last_became_active":"2023-10-16T12:58:51.443844+0000","last_became_peered":"2023-10-16T12:58:51.443844+0000","last_unstale":"2023-10-16T12:58:55.684505+0000","last_undegraded":"2023-10-16T12:58:55.684505+0000","last_fullsized":"2023-10-16T12:58:55.684505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:48:37.180712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426810+0000","last_change":"2023-10-16T12:58:55.688731+0000","last_active":"2023-10-16T12:58:56.426810+0000","last_peered":"2023-10-16T12:58:56.426810+0000","last_clean":"2023-10-16T12:58:56.426810+0000","last_became_active":"2023-10-16T12:58:55.688216+0000","last_became_peered":"2023-10-16T12:58:55.688216+0000","last_unstale":"2023-10-16T12:58:56.426810+0000","last_undegraded":"2023-10-16T12:58:56.426810+0000","last_fullsized":"2023-10-16T12:58:56.426810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:19.721283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679599+0000","last_change":"2023-10-16T12:58:50.679739+0000","last_active":"2023-10-16T12:58:55.679599+0000","last_peered":"2023-10-16T12:58:55.679599+0000","last_clean":"2023-10-16T12:58:55.679599+0000","last_became_active":"2023-10-16T12:58:50.679385+0000","last_became_peered":"2023-10-16T12:58:50.679385+0000","last_unstale":"2023-10-16T12:58:55.679599+0000","last_undegraded":"2023-10-16T12:58:55.679599+0000","last_fullsized":"2023-10-16T12:58:55.679599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:31.078563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.681075+0000","last_change":"2023-10-16T12:58:51.449711+0000","last_active":"2023-10-16T12:58:55.681075+0000","last_peered":"2023-10-16T12:58:55.681075+0000","last_clean":"2023-10-16T12:58:55.681075+0000","last_became_active":"2023-10-16T12:58:51.449453+0000","last_became_peered":"2023-10-16T12:58:51.449453+0000","last_unstale":"2023-10-16T12:58:55.681075+0000","last_undegraded":"2023-10-16T12:58:55.681075+0000","last_fullsized":"2023-10-16T12:58:55.681075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:11.869582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.073118+0000","last_change":"2023-10-16T12:58:55.696432+0000","last_active":"2023-10-16T12:58:57.073118+0000","last_peered":"2023-10-16T12:58:57.073118+0000","last_clean":"2023-10-16T12:58:57.073118+0000","last_became_active":"2023-10-16T12:58:55.696015+0000","last_became_peered":"2023-10-16T12:58:55.696015+0000","last_unstale":"2023-10-16T12:58:57.073118+0000","last_undegraded":"2023-10-16T12:58:57.073118+0000","last_fullsized":"2023-10-16T12:58:57.073118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:46:37.320993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:59:01.634183+0000","last_change":"2023-10-16T12:58:50.672122+0000","last_active":"2023-10-16T12:59:01.634183+0000","last_peered":"2023-10-16T12:59:01.634183+0000","last_clean":"2023-10-16T12:59:01.634183+0000","last_became_active":"2023-10-16T12:58:50.671817+0000","last_became_peered":"2023-10-16T12:58:50.671817+0000","last_unstale":"2023-10-16T12:59:01.634183+0000","last_undegraded":"2023-10-16T12:59:01.634183+0000","last_fullsized":"2023-10-16T12:59:01.634183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:46.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705985+0000","last_change":"2023-10-16T12:58:51.446766+0000","last_active":"2023-10-16T12:58:55.705985+0000","last_peered":"2023-10-16T12:58:55.705985+0000","last_clean":"2023-10-16T12:58:55.705985+0000","last_became_active":"2023-10-16T12:58:51.446573+0000","last_became_peered":"2023-10-16T12:58:51.446573+0000","last_unstale":"2023-10-16T12:58:55.705985+0000","last_undegraded":"2023-10-16T12:58:55.705985+0000","last_fullsized":"2023-10-16T12:58:55.705985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:18:46.943690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072803+0000","last_change":"2023-10-16T12:58:55.708591+0000","last_active":"2023-10-16T12:58:57.072803+0000","last_peered":"2023-10-16T12:58:57.072803+0000","last_clean":"2023-10-16T12:58:57.072803+0000","last_became_active":"2023-10-16T12:58:55.708210+0000","last_became_peered":"2023-10-16T12:58:55.708210+0000","last_unstale":"2023-10-16T12:58:57.072803+0000","last_undegraded":"2023-10-16T12:58:57.072803+0000","last_fullsized":"2023-10-16T12:58:57.072803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:51:25.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.692682+0000","last_change":"2023-10-16T12:58:50.671656+0000","last_active":"2023-10-16T12:58:55.692682+0000","last_peered":"2023-10-16T12:58:55.692682+0000","last_clean":"2023-10-16T12:58:55.692682+0000","last_became_active":"2023-10-16T12:58:50.671397+0000","last_became_peered":"2023-10-16T12:58:50.671397+0000","last_unstale":"2023-10-16T12:58:55.692682+0000","last_undegraded":"2023-10-16T12:58:55.692682+0000","last_fullsized":"2023-10-16T12:58:55.692682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:00:22.709075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.690350+0000","last_change":"2023-10-16T12:58:51.446368+0000","last_active":"2023-10-16T12:58:55.690350+0000","last_peered":"2023-10-16T12:58:55.690350+0000","last_clean":"2023-10-16T12:58:55.690350+0000","last_became_active":"2023-10-16T12:58:51.446071+0000","last_became_peered":"2023-10-16T12:58:51.446071+0000","last_unstale":"2023-10-16T12:58:55.690350+0000","last_undegraded":"2023-10-16T12:58:55.690350+0000","last_fullsized":"2023-10-16T12:58:55.690350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:48.087275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.074774+0000","last_change":"2023-10-16T12:58:55.705522+0000","last_active":"2023-10-16T12:58:57.074774+0000","last_peered":"2023-10-16T12:58:57.074774+0000","last_clean":"2023-10-16T12:58:57.074774+0000","last_became_active":"2023-10-16T12:58:55.705089+0000","last_became_peered":"2023-10-16T12:58:55.705089+0000","last_unstale":"2023-10-16T12:58:57.074774+0000","last_undegraded":"2023-10-16T12:58:57.074774+0000","last_fullsized":"2023-10-16T12:58:57.074774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:04:01.613449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.678720+0000","last_change":"2023-10-16T12:58:50.673340+0000","last_active":"2023-10-16T12:58:55.678720+0000","last_peered":"2023-10-16T12:58:55.678720+0000","last_clean":"2023-10-16T12:58:55.678720+0000","last_became_active":"2023-10-16T12:58:50.672323+0000","last_became_peered":"2023-10-16T12:58:50.672323+0000","last_unstale":"2023-10-16T12:58:55.678720+0000","last_undegraded":"2023-10-16T12:58:55.678720+0000","last_fullsized":"2023-10-16T12:58:55.678720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:31.078563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705522+0000","last_change":"2023-10-16T12:58:51.448920+0000","last_active":"2023-10-16T12:58:55.705522+0000","last_peered":"2023-10-16T12:58:55.705522+0000","last_clean":"2023-10-16T12:58:55.705522+0000","last_became_active":"2023-10-16T12:58:51.448634+0000","last_became_peered":"2023-10-16T12:58:51.448634+0000","last_unstale":"2023-10-16T12:58:55.705522+0000","last_undegraded":"2023-10-16T12:58:55.705522+0000","last_fullsized":"2023-10-16T12:58:55.705522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:31:13.605999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.075154+0000","last_change":"2023-10-16T12:58:55.713528+0000","last_active":"2023-10-16T12:58:57.075154+0000","last_peered":"2023-10-16T12:58:57.075154+0000","last_clean":"2023-10-16T12:58:57.075154+0000","last_became_active":"2023-10-16T12:58:55.712996+0000","last_became_peered":"2023-10-16T12:58:55.712996+0000","last_unstale":"2023-10-16T12:58:57.075154+0000","last_undegraded":"2023-10-16T12:58:57.075154+0000","last_fullsized":"2023-10-16T12:58:57.075154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:20.622883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686054+0000","last_change":"2023-10-16T12:58:50.667418+0000","last_active":"2023-10-16T12:58:55.686054+0000","last_peered":"2023-10-16T12:58:55.686054+0000","last_clean":"2023-10-16T12:58:55.686054+0000","last_became_active":"2023-10-16T12:58:50.667102+0000","last_became_peered":"2023-10-16T12:58:50.667102+0000","last_unstale":"2023-10-16T12:58:55.686054+0000","last_undegraded":"2023-10-16T12:58:55.686054+0000","last_fullsized":"2023-10-16T12:58:55.686054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:10.863857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.685920+0000","last_change":"2023-10-16T12:58:51.441514+0000","last_active":"2023-10-16T12:58:55.685920+0000","last_peered":"2023-10-16T12:58:55.685920+0000","last_clean":"2023-10-16T12:58:55.685920+0000","last_became_active":"2023-10-16T12:58:51.441211+0000","last_became_peered":"2023-10-16T12:58:51.441211+0000","last_unstale":"2023-10-16T12:58:55.685920+0000","last_undegraded":"2023-10-16T12:58:55.685920+0000","last_fullsized":"2023-10-16T12:58:55.685920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:28:04.262253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072161+0000","last_change":"2023-10-16T12:58:55.698601+0000","last_active":"2023-10-16T12:58:57.072161+0000","last_peered":"2023-10-16T12:58:57.072161+0000","last_clean":"2023-10-16T12:58:57.072161+0000","last_became_active":"2023-10-16T12:58:55.697802+0000","last_became_peered":"2023-10-16T12:58:55.697802+0000","last_unstale":"2023-10-16T12:58:57.072161+0000","last_undegraded":"2023-10-16T12:58:57.072161+0000","last_fullsized":"2023-10-16T12:58:57.072161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:19.721283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684515+0000","last_change":"2023-10-16T12:58:50.679915+0000","last_active":"2023-10-16T12:58:55.684515+0000","last_peered":"2023-10-16T12:58:55.684515+0000","last_clean":"2023-10-16T12:58:55.684515+0000","last_became_active":"2023-10-16T12:58:50.679550+0000","last_became_peered":"2023-10-16T12:58:50.679550+0000","last_unstale":"2023-10-16T12:58:55.684515+0000","last_undegraded":"2023-10-16T12:58:55.684515+0000","last_fullsized":"2023-10-16T12:58:55.684515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:33.218756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705896+0000","last_change":"2023-10-16T12:58:51.450989+0000","last_active":"2023-10-16T12:58:55.705896+0000","last_peered":"2023-10-16T12:58:55.705896+0000","last_clean":"2023-10-16T12:58:55.705896+0000","last_became_active":"2023-10-16T12:58:51.450681+0000","last_became_peered":"2023-10-16T12:58:51.450681+0000","last_unstale":"2023-10-16T12:58:55.705896+0000","last_undegraded":"2023-10-16T12:58:55.705896+0000","last_fullsized":"2023-10-16T12:58:55.705896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:17:35.655947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.425612+0000","last_change":"2023-10-16T12:58:55.694540+0000","last_active":"2023-10-16T12:58:56.425612+0000","last_peered":"2023-10-16T12:58:56.425612+0000","last_clean":"2023-10-16T12:58:56.425612+0000","last_became_active":"2023-10-16T12:58:55.694116+0000","last_became_peered":"2023-10-16T12:58:55.694116+0000","last_unstale":"2023-10-16T12:58:56.425612+0000","last_undegraded":"2023-10-16T12:58:56.425612+0000","last_fullsized":"2023-10-16T12:58:56.425612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:21.779599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.681959+0000","last_change":"2023-10-16T12:58:50.673412+0000","last_active":"2023-10-16T12:58:55.681959+0000","last_peered":"2023-10-16T12:58:55.681959+0000","last_clean":"2023-10-16T12:58:55.681959+0000","last_became_active":"2023-10-16T12:58:50.672849+0000","last_became_peered":"2023-10-16T12:58:50.672849+0000","last_unstale":"2023-10-16T12:58:55.681959+0000","last_undegraded":"2023-10-16T12:58:55.681959+0000","last_fullsized":"2023-10-16T12:58:55.681959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:35:18.620321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705273+0000","last_change":"2023-10-16T12:58:51.449246+0000","last_active":"2023-10-16T12:58:55.705273+0000","last_peered":"2023-10-16T12:58:55.705273+0000","last_clean":"2023-10-16T12:58:55.705273+0000","last_became_active":"2023-10-16T12:58:51.448956+0000","last_became_peered":"2023-10-16T12:58:51.448956+0000","last_unstale":"2023-10-16T12:58:55.705273+0000","last_undegraded":"2023-10-16T12:58:55.705273+0000","last_fullsized":"2023-10-16T12:58:55.705273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:29:58.046253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072974+0000","last_change":"2023-10-16T12:58:55.698954+0000","last_active":"2023-10-16T12:58:57.072974+0000","last_peered":"2023-10-16T12:58:57.072974+0000","last_clean":"2023-10-16T12:58:57.072974+0000","last_became_active":"2023-10-16T12:58:55.698587+0000","last_became_peered":"2023-10-16T12:58:55.698587+0000","last_unstale":"2023-10-16T12:58:57.072974+0000","last_undegraded":"2023-10-16T12:58:57.072974+0000","last_fullsized":"2023-10-16T12:58:57.072974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:37.747199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679241+0000","last_change":"2023-10-16T12:58:50.673554+0000","last_active":"2023-10-16T12:58:55.679241+0000","last_peered":"2023-10-16T12:58:55.679241+0000","last_clean":"2023-10-16T12:58:55.679241+0000","last_became_active":"2023-10-16T12:58:50.673154+0000","last_became_peered":"2023-10-16T12:58:50.673154+0000","last_unstale":"2023-10-16T12:58:55.679241+0000","last_undegraded":"2023-10-16T12:58:55.679241+0000","last_fullsized":"2023-10-16T12:58:55.679241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:34.579436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.681355+0000","last_change":"2023-10-16T12:58:51.439381+0000","last_active":"2023-10-16T12:58:55.681355+0000","last_peered":"2023-10-16T12:58:55.681355+0000","last_clean":"2023-10-16T12:58:55.681355+0000","last_became_active":"2023-10-16T12:58:51.439106+0000","last_became_peered":"2023-10-16T12:58:51.439106+0000","last_unstale":"2023-10-16T12:58:55.681355+0000","last_undegraded":"2023-10-16T12:58:55.681355+0000","last_fullsized":"2023-10-16T12:58:55.681355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:15.698887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072598+0000","last_change":"2023-10-16T12:58:55.703026+0000","last_active":"2023-10-16T12:58:57.072598+0000","last_peered":"2023-10-16T12:58:57.072598+0000","last_clean":"2023-10-16T12:58:57.072598+0000","last_became_active":"2023-10-16T12:58:55.702114+0000","last_became_peered":"2023-10-16T12:58:55.702114+0000","last_unstale":"2023-10-16T12:58:57.072598+0000","last_undegraded":"2023-10-16T12:58:57.072598+0000","last_fullsized":"2023-10-16T12:58:57.072598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:19.721283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.678615+0000","last_change":"2023-10-16T12:58:50.674212+0000","last_active":"2023-10-16T12:58:55.678615+0000","last_peered":"2023-10-16T12:58:55.678615+0000","last_clean":"2023-10-16T12:58:55.678615+0000","last_became_active":"2023-10-16T12:58:50.673650+0000","last_became_peered":"2023-10-16T12:58:50.673650+0000","last_unstale":"2023-10-16T12:58:55.678615+0000","last_undegraded":"2023-10-16T12:58:55.678615+0000","last_fullsized":"2023-10-16T12:58:55.678615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:46.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.683223+0000","last_change":"2023-10-16T12:58:51.438475+0000","last_active":"2023-10-16T12:58:55.683223+0000","last_peered":"2023-10-16T12:58:55.683223+0000","last_clean":"2023-10-16T12:58:55.683223+0000","last_became_active":"2023-10-16T12:58:51.438151+0000","last_became_peered":"2023-10-16T12:58:51.438151+0000","last_unstale":"2023-10-16T12:58:55.683223+0000","last_undegraded":"2023-10-16T12:58:55.683223+0000","last_fullsized":"2023-10-16T12:58:55.683223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:22:35.314558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.073288+0000","last_change":"2023-10-16T12:58:55.699995+0000","last_active":"2023-10-16T12:58:57.073288+0000","last_peered":"2023-10-16T12:58:57.073288+0000","last_clean":"2023-10-16T12:58:57.073288+0000","last_became_active":"2023-10-16T12:58:55.699645+0000","last_became_peered":"2023-10-16T12:58:55.699645+0000","last_unstale":"2023-10-16T12:58:57.073288+0000","last_undegraded":"2023-10-16T12:58:57.073288+0000","last_fullsized":"2023-10-16T12:58:57.073288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:29:11.416516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.677592+0000","last_change":"2023-10-16T12:58:51.438846+0000","last_active":"2023-10-16T12:58:55.677592+0000","last_peered":"2023-10-16T12:58:55.677592+0000","last_clean":"2023-10-16T12:58:55.677592+0000","last_became_active":"2023-10-16T12:58:51.438601+0000","last_became_peered":"2023-10-16T12:58:51.438601+0000","last_unstale":"2023-10-16T12:58:55.677592+0000","last_undegraded":"2023-10-16T12:58:55.677592+0000","last_fullsized":"2023-10-16T12:58:55.677592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:48:37.180712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684696+0000","last_change":"2023-10-16T12:58:50.685058+0000","last_active":"2023-10-16T12:58:55.684696+0000","last_peered":"2023-10-16T12:58:55.684696+0000","last_clean":"2023-10-16T12:58:55.684696+0000","last_became_active":"2023-10-16T12:58:50.684800+0000","last_became_peered":"2023-10-16T12:58:50.684800+0000","last_unstale":"2023-10-16T12:58:55.684696+0000","last_undegraded":"2023-10-16T12:58:55.684696+0000","last_fullsized":"2023-10-16T12:58:55.684696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:22:34.308834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426188+0000","last_change":"2023-10-16T12:58:55.705646+0000","last_active":"2023-10-16T12:58:56.426188+0000","last_peered":"2023-10-16T12:58:56.426188+0000","last_clean":"2023-10-16T12:58:56.426188+0000","last_became_active":"2023-10-16T12:58:55.705247+0000","last_became_peered":"2023-10-16T12:58:55.705247+0000","last_unstale":"2023-10-16T12:58:56.426188+0000","last_undegraded":"2023-10-16T12:58:56.426188+0000","last_fullsized":"2023-10-16T12:58:56.426188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:37.747199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.685428+0000","last_change":"2023-10-16T12:58:51.436519+0000","last_active":"2023-10-16T12:58:55.685428+0000","last_peered":"2023-10-16T12:58:55.685428+0000","last_clean":"2023-10-16T12:58:55.685428+0000","last_became_active":"2023-10-16T12:58:51.436320+0000","last_became_peered":"2023-10-16T12:58:51.436320+0000","last_unstale":"2023-10-16T12:58:55.685428+0000","last_undegraded":"2023-10-16T12:58:55.685428+0000","last_fullsized":"2023-10-16T12:58:55.685428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:48:37.180712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679659+0000","last_change":"2023-10-16T12:58:50.682408+0000","last_active":"2023-10-16T12:58:55.679659+0000","last_peered":"2023-10-16T12:58:55.679659+0000","last_clean":"2023-10-16T12:58:55.679659+0000","last_became_active":"2023-10-16T12:58:50.682084+0000","last_became_peered":"2023-10-16T12:58:50.682084+0000","last_unstale":"2023-10-16T12:58:55.679659+0000","last_undegraded":"2023-10-16T12:58:55.679659+0000","last_fullsized":"2023-10-16T12:58:55.679659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:20.511820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.704719+0000","last_change":"2023-10-16T12:58:40.198340+0000","last_active":"2023-10-16T12:58:55.704719+0000","last_peered":"2023-10-16T12:58:55.704719+0000","last_clean":"2023-10-16T12:58:55.704719+0000","last_became_active":"2023-10-16T12:58:40.197354+0000","last_became_peered":"2023-10-16T12:58:40.197354+0000","last_unstale":"2023-10-16T12:58:55.704719+0000","last_undegraded":"2023-10-16T12:58:55.704719+0000","last_fullsized":"2023-10-16T12:58:55.704719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:39.025347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:39.025347+0000","last_clean_scrub_stamp":"2023-10-16T12:58:39.025347+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:22:36.722419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072318+0000","last_change":"2023-10-16T12:58:55.709450+0000","last_active":"2023-10-16T12:58:57.072318+0000","last_peered":"2023-10-16T12:58:57.072318+0000","last_clean":"2023-10-16T12:58:57.072318+0000","last_became_active":"2023-10-16T12:58:55.708457+0000","last_became_peered":"2023-10-16T12:58:55.708457+0000","last_unstale":"2023-10-16T12:58:57.072318+0000","last_undegraded":"2023-10-16T12:58:57.072318+0000","last_fullsized":"2023-10-16T12:58:57.072318+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:46:37.320993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684401+0000","last_change":"2023-10-16T12:58:51.440843+0000","last_active":"2023-10-16T12:58:55.684401+0000","last_peered":"2023-10-16T12:58:55.684401+0000","last_clean":"2023-10-16T12:58:55.684401+0000","last_became_active":"2023-10-16T12:58:51.440584+0000","last_became_peered":"2023-10-16T12:58:51.440584+0000","last_unstale":"2023-10-16T12:58:55.684401+0000","last_undegraded":"2023-10-16T12:58:55.684401+0000","last_fullsized":"2023-10-16T12:58:55.684401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:47.513811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.704824+0000","last_change":"2023-10-16T12:58:50.672662+0000","last_active":"2023-10-16T12:58:55.704824+0000","last_peered":"2023-10-16T12:58:55.704824+0000","last_clean":"2023-10-16T12:58:55.704824+0000","last_became_active":"2023-10-16T12:58:50.672268+0000","last_became_peered":"2023-10-16T12:58:50.672268+0000","last_unstale":"2023-10-16T12:58:55.704824+0000","last_undegraded":"2023-10-16T12:58:55.704824+0000","last_fullsized":"2023-10-16T12:58:55.704824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:22:34.308834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072561+0000","last_change":"2023-10-16T12:58:55.708627+0000","last_active":"2023-10-16T12:58:57.072561+0000","last_peered":"2023-10-16T12:58:57.072561+0000","last_clean":"2023-10-16T12:58:57.072561+0000","last_became_active":"2023-10-16T12:58:55.708171+0000","last_became_peered":"2023-10-16T12:58:55.708171+0000","last_unstale":"2023-10-16T12:58:57.072561+0000","last_undegraded":"2023-10-16T12:58:57.072561+0000","last_fullsized":"2023-10-16T12:58:57.072561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:42:30.929517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705826+0000","last_change":"2023-10-16T12:58:50.678911+0000","last_active":"2023-10-16T12:58:55.705826+0000","last_peered":"2023-10-16T12:58:55.705826+0000","last_clean":"2023-10-16T12:58:55.705826+0000","last_became_active":"2023-10-16T12:58:50.678642+0000","last_became_peered":"2023-10-16T12:58:50.678642+0000","last_unstale":"2023-10-16T12:58:55.705826+0000","last_undegraded":"2023-10-16T12:58:55.705826+0000","last_fullsized":"2023-10-16T12:58:55.705826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:46.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.680176+0000","last_change":"2023-10-16T12:58:51.439513+0000","last_active":"2023-10-16T12:58:55.680176+0000","last_peered":"2023-10-16T12:58:55.680176+0000","last_clean":"2023-10-16T12:58:55.680176+0000","last_became_active":"2023-10-16T12:58:51.439294+0000","last_became_peered":"2023-10-16T12:58:51.439294+0000","last_unstale":"2023-10-16T12:58:55.680176+0000","last_undegraded":"2023-10-16T12:58:55.680176+0000","last_fullsized":"2023-10-16T12:58:55.680176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:17.757203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.074246+0000","last_change":"2023-10-16T12:58:55.709315+0000","last_active":"2023-10-16T12:58:57.074246+0000","last_peered":"2023-10-16T12:58:57.074246+0000","last_clean":"2023-10-16T12:58:57.074246+0000","last_became_active":"2023-10-16T12:58:55.708910+0000","last_became_peered":"2023-10-16T12:58:55.708910+0000","last_unstale":"2023-10-16T12:58:57.074246+0000","last_undegraded":"2023-10-16T12:58:57.074246+0000","last_fullsized":"2023-10-16T12:58:57.074246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:05:40.393225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679472+0000","last_change":"2023-10-16T12:58:50.673963+0000","last_active":"2023-10-16T12:58:55.679472+0000","last_peered":"2023-10-16T12:58:55.679472+0000","last_clean":"2023-10-16T12:58:55.679472+0000","last_became_active":"2023-10-16T12:58:50.673711+0000","last_became_peered":"2023-10-16T12:58:50.673711+0000","last_unstale":"2023-10-16T12:58:55.679472+0000","last_undegraded":"2023-10-16T12:58:55.679472+0000","last_fullsized":"2023-10-16T12:58:55.679472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:20.511820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688867+0000","last_change":"2023-10-16T12:58:51.446153+0000","last_active":"2023-10-16T12:58:55.688867+0000","last_peered":"2023-10-16T12:58:55.688867+0000","last_clean":"2023-10-16T12:58:55.688867+0000","last_became_active":"2023-10-16T12:58:51.445929+0000","last_became_peered":"2023-10-16T12:58:51.445929+0000","last_unstale":"2023-10-16T12:58:55.688867+0000","last_undegraded":"2023-10-16T12:58:55.688867+0000","last_fullsized":"2023-10-16T12:58:55.688867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:42:07.880003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.425788+0000","last_change":"2023-10-16T12:58:55.708698+0000","last_active":"2023-10-16T12:58:56.425788+0000","last_peered":"2023-10-16T12:58:56.425788+0000","last_clean":"2023-10-16T12:58:56.425788+0000","last_became_active":"2023-10-16T12:58:55.708320+0000","last_became_peered":"2023-10-16T12:58:55.708320+0000","last_unstale":"2023-10-16T12:58:56.425788+0000","last_undegraded":"2023-10-16T12:58:56.425788+0000","last_fullsized":"2023-10-16T12:58:56.425788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:55.444997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686576+0000","last_change":"2023-10-16T12:58:50.673507+0000","last_active":"2023-10-16T12:58:55.686576+0000","last_peered":"2023-10-16T12:58:55.686576+0000","last_clean":"2023-10-16T12:58:55.686576+0000","last_became_active":"2023-10-16T12:58:50.672980+0000","last_became_peered":"2023-10-16T12:58:50.672980+0000","last_unstale":"2023-10-16T12:58:55.686576+0000","last_undegraded":"2023-10-16T12:58:55.686576+0000","last_fullsized":"2023-10-16T12:58:55.686576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:33.218756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.692578+0000","last_change":"2023-10-16T12:58:51.439054+0000","last_active":"2023-10-16T12:58:55.692578+0000","last_peered":"2023-10-16T12:58:55.692578+0000","last_clean":"2023-10-16T12:58:55.692578+0000","last_became_active":"2023-10-16T12:58:51.438776+0000","last_became_peered":"2023-10-16T12:58:51.438776+0000","last_unstale":"2023-10-16T12:58:55.692578+0000","last_undegraded":"2023-10-16T12:58:55.692578+0000","last_fullsized":"2023-10-16T12:58:55.692578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:17.757203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.425860+0000","last_change":"2023-10-16T12:58:55.694414+0000","last_active":"2023-10-16T12:58:56.425860+0000","last_peered":"2023-10-16T12:58:56.425860+0000","last_clean":"2023-10-16T12:58:56.425860+0000","last_became_active":"2023-10-16T12:58:55.694003+0000","last_became_peered":"2023-10-16T12:58:55.694003+0000","last_unstale":"2023-10-16T12:58:56.425860+0000","last_undegraded":"2023-10-16T12:58:56.425860+0000","last_fullsized":"2023-10-16T12:58:56.425860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:17:39.678343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.704716+0000","last_change":"2023-10-16T12:58:50.678331+0000","last_active":"2023-10-16T12:58:55.704716+0000","last_peered":"2023-10-16T12:58:55.704716+0000","last_clean":"2023-10-16T12:58:55.704716+0000","last_became_active":"2023-10-16T12:58:50.674513+0000","last_became_peered":"2023-10-16T12:58:50.674513+0000","last_unstale":"2023-10-16T12:58:55.704716+0000","last_undegraded":"2023-10-16T12:58:55.704716+0000","last_fullsized":"2023-10-16T12:58:55.704716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:33.218756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.682143+0000","last_change":"2023-10-16T12:58:51.438953+0000","last_active":"2023-10-16T12:58:55.682143+0000","last_peered":"2023-10-16T12:58:55.682143+0000","last_clean":"2023-10-16T12:58:55.682143+0000","last_became_active":"2023-10-16T12:58:51.438670+0000","last_became_peered":"2023-10-16T12:58:51.438670+0000","last_unstale":"2023-10-16T12:58:55.682143+0000","last_undegraded":"2023-10-16T12:58:55.682143+0000","last_fullsized":"2023-10-16T12:58:55.682143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:34.224481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.073430+0000","last_change":"2023-10-16T12:58:55.711548+0000","last_active":"2023-10-16T12:58:57.073430+0000","last_peered":"2023-10-16T12:58:57.073430+0000","last_clean":"2023-10-16T12:58:57.073430+0000","last_became_active":"2023-10-16T12:58:55.711144+0000","last_became_peered":"2023-10-16T12:58:55.711144+0000","last_unstale":"2023-10-16T12:58:57.073430+0000","last_undegraded":"2023-10-16T12:58:57.073430+0000","last_fullsized":"2023-10-16T12:58:57.073430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:42:30.929517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.677592+0000","last_change":"2023-10-16T12:58:50.674933+0000","last_active":"2023-10-16T12:58:55.677592+0000","last_peered":"2023-10-16T12:58:55.677592+0000","last_clean":"2023-10-16T12:58:55.677592+0000","last_became_active":"2023-10-16T12:58:50.674678+0000","last_became_peered":"2023-10-16T12:58:50.674678+0000","last_unstale":"2023-10-16T12:58:55.677592+0000","last_undegraded":"2023-10-16T12:58:55.677592+0000","last_fullsized":"2023-10-16T12:58:55.677592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:22:34.308834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688629+0000","last_change":"2023-10-16T12:58:51.438422+0000","last_active":"2023-10-16T12:58:55.688629+0000","last_peered":"2023-10-16T12:58:55.688629+0000","last_clean":"2023-10-16T12:58:55.688629+0000","last_became_active":"2023-10-16T12:58:51.437341+0000","last_became_peered":"2023-10-16T12:58:51.437341+0000","last_unstale":"2023-10-16T12:58:55.688629+0000","last_undegraded":"2023-10-16T12:58:55.688629+0000","last_fullsized":"2023-10-16T12:58:55.688629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:59.501942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426422+0000","last_change":"2023-10-16T12:58:55.702372+0000","last_active":"2023-10-16T12:58:56.426422+0000","last_peered":"2023-10-16T12:58:56.426422+0000","last_clean":"2023-10-16T12:58:56.426422+0000","last_became_active":"2023-10-16T12:58:55.701933+0000","last_became_peered":"2023-10-16T12:58:55.701933+0000","last_unstale":"2023-10-16T12:58:56.426422+0000","last_undegraded":"2023-10-16T12:58:56.426422+0000","last_fullsized":"2023-10-16T12:58:56.426422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:18:50.966086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.677714+0000","last_change":"2023-10-16T12:58:50.669022+0000","last_active":"2023-10-16T12:58:55.677714+0000","last_peered":"2023-10-16T12:58:55.677714+0000","last_clean":"2023-10-16T12:58:55.677714+0000","last_became_active":"2023-10-16T12:58:50.668730+0000","last_became_peered":"2023-10-16T12:58:50.668730+0000","last_unstale":"2023-10-16T12:58:55.677714+0000","last_undegraded":"2023-10-16T12:58:55.677714+0000","last_fullsized":"2023-10-16T12:58:55.677714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:10.863857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.683389+0000","last_change":"2023-10-16T12:58:51.442613+0000","last_active":"2023-10-16T12:58:55.683389+0000","last_peered":"2023-10-16T12:58:55.683389+0000","last_clean":"2023-10-16T12:58:55.683389+0000","last_became_active":"2023-10-16T12:58:51.442369+0000","last_became_peered":"2023-10-16T12:58:51.442369+0000","last_unstale":"2023-10-16T12:58:55.683389+0000","last_undegraded":"2023-10-16T12:58:55.683389+0000","last_fullsized":"2023-10-16T12:58:55.683389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:40:36.060468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426204+0000","last_change":"2023-10-16T12:58:55.698038+0000","last_active":"2023-10-16T12:58:56.426204+0000","last_peered":"2023-10-16T12:58:56.426204+0000","last_clean":"2023-10-16T12:58:56.426204+0000","last_became_active":"2023-10-16T12:58:55.697543+0000","last_became_peered":"2023-10-16T12:58:55.697543+0000","last_unstale":"2023-10-16T12:58:56.426204+0000","last_undegraded":"2023-10-16T12:58:56.426204+0000","last_fullsized":"2023-10-16T12:58:56.426204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:31:17.628395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705613+0000","last_change":"2023-10-16T12:58:50.682262+0000","last_active":"2023-10-16T12:58:55.705613+0000","last_peered":"2023-10-16T12:58:55.705613+0000","last_clean":"2023-10-16T12:58:55.705613+0000","last_became_active":"2023-10-16T12:58:50.681971+0000","last_became_peered":"2023-10-16T12:58:50.681971+0000","last_unstale":"2023-10-16T12:58:55.705613+0000","last_undegraded":"2023-10-16T12:58:55.705613+0000","last_fullsized":"2023-10-16T12:58:55.705613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:48:36.174987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.687168+0000","last_change":"2023-10-16T12:58:51.444120+0000","last_active":"2023-10-16T12:58:55.687168+0000","last_peered":"2023-10-16T12:58:55.687168+0000","last_clean":"2023-10-16T12:58:55.687168+0000","last_became_active":"2023-10-16T12:58:51.443932+0000","last_became_peered":"2023-10-16T12:58:51.443932+0000","last_unstale":"2023-10-16T12:58:55.687168+0000","last_undegraded":"2023-10-16T12:58:55.687168+0000","last_fullsized":"2023-10-16T12:58:55.687168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:59.501942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.425527+0000","last_change":"2023-10-16T12:58:55.705568+0000","last_active":"2023-10-16T12:58:56.425527+0000","last_peered":"2023-10-16T12:58:56.425527+0000","last_clean":"2023-10-16T12:58:56.425527+0000","last_became_active":"2023-10-16T12:58:55.705195+0000","last_became_peered":"2023-10-16T12:58:55.705195+0000","last_unstale":"2023-10-16T12:58:56.425527+0000","last_undegraded":"2023-10-16T12:58:56.425527+0000","last_fullsized":"2023-10-16T12:58:56.425527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:30:02.068649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.685246+0000","last_change":"2023-10-16T12:58:50.680178+0000","last_active":"2023-10-16T12:58:55.685246+0000","last_peered":"2023-10-16T12:58:55.685246+0000","last_clean":"2023-10-16T12:58:55.685246+0000","last_became_active":"2023-10-16T12:58:50.679945+0000","last_became_peered":"2023-10-16T12:58:50.679945+0000","last_unstale":"2023-10-16T12:58:55.685246+0000","last_undegraded":"2023-10-16T12:58:55.685246+0000","last_fullsized":"2023-10-16T12:58:55.685246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:10.863857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.706307+0000","last_change":"2023-10-16T12:58:51.449653+0000","last_active":"2023-10-16T12:58:55.706307+0000","last_peered":"2023-10-16T12:58:55.706307+0000","last_clean":"2023-10-16T12:58:55.706307+0000","last_became_active":"2023-10-16T12:58:51.449109+0000","last_became_peered":"2023-10-16T12:58:51.449109+0000","last_unstale":"2023-10-16T12:58:55.706307+0000","last_undegraded":"2023-10-16T12:58:55.706307+0000","last_fullsized":"2023-10-16T12:58:55.706307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:15.698887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072205+0000","last_change":"2023-10-16T12:58:55.702012+0000","last_active":"2023-10-16T12:58:57.072205+0000","last_peered":"2023-10-16T12:58:57.072205+0000","last_clean":"2023-10-16T12:58:57.072205+0000","last_became_active":"2023-10-16T12:58:55.701622+0000","last_became_peered":"2023-10-16T12:58:55.701622+0000","last_unstale":"2023-10-16T12:58:57.072205+0000","last_undegraded":"2023-10-16T12:58:57.072205+0000","last_fullsized":"2023-10-16T12:58:57.072205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:37.747199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679482+0000","last_change":"2023-10-16T12:58:50.669769+0000","last_active":"2023-10-16T12:58:55.679482+0000","last_peered":"2023-10-16T12:58:55.679482+0000","last_clean":"2023-10-16T12:58:55.679482+0000","last_became_active":"2023-10-16T12:58:50.669513+0000","last_became_peered":"2023-10-16T12:58:50.669513+0000","last_unstale":"2023-10-16T12:58:55.679482+0000","last_undegraded":"2023-10-16T12:58:55.679482+0000","last_fullsized":"2023-10-16T12:58:55.679482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:00:22.709075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679131+0000","last_change":"2023-10-16T12:58:51.440492+0000","last_active":"2023-10-16T12:58:55.679131+0000","last_peered":"2023-10-16T12:58:55.679131+0000","last_clean":"2023-10-16T12:58:55.679131+0000","last_became_active":"2023-10-16T12:58:51.440223+0000","last_became_peered":"2023-10-16T12:58:51.440223+0000","last_unstale":"2023-10-16T12:58:55.679131+0000","last_undegraded":"2023-10-16T12:58:55.679131+0000","last_fullsized":"2023-10-16T12:58:55.679131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:29:58.046253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072507+0000","last_change":"2023-10-16T12:58:55.709910+0000","last_active":"2023-10-16T12:58:57.072507+0000","last_peered":"2023-10-16T12:58:57.072507+0000","last_clean":"2023-10-16T12:58:57.072507+0000","last_became_active":"2023-10-16T12:58:55.709448+0000","last_became_peered":"2023-10-16T12:58:55.709448+0000","last_unstale":"2023-10-16T12:58:57.072507+0000","last_undegraded":"2023-10-16T12:58:57.072507+0000","last_fullsized":"2023-10-16T12:58:57.072507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:10:14.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686015+0000","last_change":"2023-10-16T12:58:50.677056+0000","last_active":"2023-10-16T12:58:55.686015+0000","last_peered":"2023-10-16T12:58:55.686015+0000","last_clean":"2023-10-16T12:58:55.686015+0000","last_became_active":"2023-10-16T12:58:50.676784+0000","last_became_peered":"2023-10-16T12:58:50.676784+0000","last_unstale":"2023-10-16T12:58:55.686015+0000","last_undegraded":"2023-10-16T12:58:55.686015+0000","last_fullsized":"2023-10-16T12:58:55.686015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:20.511820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705640+0000","last_change":"2023-10-16T12:58:51.451103+0000","last_active":"2023-10-16T12:58:55.705640+0000","last_peered":"2023-10-16T12:58:55.705640+0000","last_clean":"2023-10-16T12:58:55.705640+0000","last_became_active":"2023-10-16T12:58:51.449605+0000","last_became_peered":"2023-10-16T12:58:51.449605+0000","last_unstale":"2023-10-16T12:58:55.705640+0000","last_undegraded":"2023-10-16T12:58:55.705640+0000","last_fullsized":"2023-10-16T12:58:55.705640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:33.724803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686013+0000","last_change":"2023-10-16T12:58:51.439877+0000","last_active":"2023-10-16T12:58:55.686013+0000","last_peered":"2023-10-16T12:58:55.686013+0000","last_clean":"2023-10-16T12:58:55.686013+0000","last_became_active":"2023-10-16T12:58:51.439574+0000","last_became_peered":"2023-10-16T12:58:51.439574+0000","last_unstale":"2023-10-16T12:58:55.686013+0000","last_undegraded":"2023-10-16T12:58:55.686013+0000","last_fullsized":"2023-10-16T12:58:55.686013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:40:36.060468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684614+0000","last_change":"2023-10-16T12:58:51.444297+0000","last_active":"2023-10-16T12:58:55.684614+0000","last_peered":"2023-10-16T12:58:55.684614+0000","last_clean":"2023-10-16T12:58:55.684614+0000","last_became_active":"2023-10-16T12:58:51.444044+0000","last_became_peered":"2023-10-16T12:58:51.444044+0000","last_unstale":"2023-10-16T12:58:55.684614+0000","last_undegraded":"2023-10-16T12:58:55.684614+0000","last_fullsized":"2023-10-16T12:58:55.684614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:56.488214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.678833+0000","last_change":"2023-10-16T12:58:51.438825+0000","last_active":"2023-10-16T12:58:55.678833+0000","last_peered":"2023-10-16T12:58:55.678833+0000","last_clean":"2023-10-16T12:58:55.678833+0000","last_became_active":"2023-10-16T12:58:51.438444+0000","last_became_peered":"2023-10-16T12:58:51.438444+0000","last_unstale":"2023-10-16T12:58:55.678833+0000","last_undegraded":"2023-10-16T12:58:55.678833+0000","last_fullsized":"2023-10-16T12:58:55.678833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:41:33.353000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.692498+0000","last_change":"2023-10-16T12:58:51.442368+0000","last_active":"2023-10-16T12:58:55.692498+0000","last_peered":"2023-10-16T12:58:55.692498+0000","last_clean":"2023-10-16T12:58:55.692498+0000","last_became_active":"2023-10-16T12:58:51.442108+0000","last_became_peered":"2023-10-16T12:58:51.442108+0000","last_unstale":"2023-10-16T12:58:55.692498+0000","last_undegraded":"2023-10-16T12:58:55.692498+0000","last_fullsized":"2023-10-16T12:58:55.692498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:59.501942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.693864+0000","last_change":"2023-10-16T12:58:51.441274+0000","last_active":"2023-10-16T12:58:55.693864+0000","last_peered":"2023-10-16T12:58:55.693864+0000","last_clean":"2023-10-16T12:58:55.693864+0000","last_became_active":"2023-10-16T12:58:51.441004+0000","last_became_peered":"2023-10-16T12:58:51.441004+0000","last_unstale":"2023-10-16T12:58:55.693864+0000","last_undegraded":"2023-10-16T12:58:55.693864+0000","last_fullsized":"2023-10-16T12:58:55.693864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:28:04.262253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679247+0000","last_change":"2023-10-16T12:58:51.437880+0000","last_active":"2023-10-16T12:58:55.679247+0000","last_peered":"2023-10-16T12:58:55.679247+0000","last_clean":"2023-10-16T12:58:55.679247+0000","last_became_active":"2023-10-16T12:58:51.437590+0000","last_became_peered":"2023-10-16T12:58:51.437590+0000","last_unstale":"2023-10-16T12:58:55.679247+0000","last_undegraded":"2023-10-16T12:58:55.679247+0000","last_fullsized":"2023-10-16T12:58:55.679247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:28:04.262253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686716+0000","last_change":"2023-10-16T12:58:51.447018+0000","last_active":"2023-10-16T12:58:55.686716+0000","last_peered":"2023-10-16T12:58:55.686716+0000","last_clean":"2023-10-16T12:58:55.686716+0000","last_became_active":"2023-10-16T12:58:51.446732+0000","last_became_peered":"2023-10-16T12:58:51.446732+0000","last_unstale":"2023-10-16T12:58:55.686716+0000","last_undegraded":"2023-10-16T12:58:55.686716+0000","last_fullsized":"2023-10-16T12:58:55.686716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:51.422601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688954+0000","last_change":"2023-10-16T12:58:51.441277+0000","last_active":"2023-10-16T12:58:55.688954+0000","last_peered":"2023-10-16T12:58:55.688954+0000","last_clean":"2023-10-16T12:58:55.688954+0000","last_became_active":"2023-10-16T12:58:51.441023+0000","last_became_peered":"2023-10-16T12:58:51.441023+0000","last_unstale":"2023-10-16T12:58:55.688954+0000","last_undegraded":"2023-10-16T12:58:55.688954+0000","last_fullsized":"2023-10-16T12:58:55.688954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:17:35.655947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.680294+0000","last_change":"2023-10-16T12:58:51.443020+0000","last_active":"2023-10-16T12:58:55.680294+0000","last_peered":"2023-10-16T12:58:55.680294+0000","last_clean":"2023-10-16T12:58:55.680294+0000","last_became_active":"2023-10-16T12:58:51.442541+0000","last_became_peered":"2023-10-16T12:58:51.442541+0000","last_unstale":"2023-10-16T12:58:55.680294+0000","last_undegraded":"2023-10-16T12:58:55.680294+0000","last_fullsized":"2023-10-16T12:58:55.680294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:31:13.605999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688993+0000","last_change":"2023-10-16T12:58:51.441436+0000","last_active":"2023-10-16T12:58:55.688993+0000","last_peered":"2023-10-16T12:58:55.688993+0000","last_clean":"2023-10-16T12:58:55.688993+0000","last_became_active":"2023-10-16T12:58:51.441145+0000","last_became_peered":"2023-10-16T12:58:51.441145+0000","last_unstale":"2023-10-16T12:58:55.688993+0000","last_undegraded":"2023-10-16T12:58:55.688993+0000","last_fullsized":"2023-10-16T12:58:55.688993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:48.087275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.678940+0000","last_change":"2023-10-16T12:58:51.449786+0000","last_active":"2023-10-16T12:58:55.678940+0000","last_peered":"2023-10-16T12:58:55.678940+0000","last_clean":"2023-10-16T12:58:55.678940+0000","last_became_active":"2023-10-16T12:58:51.449513+0000","last_became_peered":"2023-10-16T12:58:51.449513+0000","last_unstale":"2023-10-16T12:58:55.678940+0000","last_undegraded":"2023-10-16T12:58:55.678940+0000","last_fullsized":"2023-10-16T12:58:55.678940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:42:07.880003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.692580+0000","last_change":"2023-10-16T12:58:51.446178+0000","last_active":"2023-10-16T12:58:55.692580+0000","last_peered":"2023-10-16T12:58:55.692580+0000","last_clean":"2023-10-16T12:58:55.692580+0000","last_became_active":"2023-10-16T12:58:51.445995+0000","last_became_peered":"2023-10-16T12:58:51.445995+0000","last_unstale":"2023-10-16T12:58:55.692580+0000","last_undegraded":"2023-10-16T12:58:55.692580+0000","last_fullsized":"2023-10-16T12:58:55.692580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:40:36.060468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686445+0000","last_change":"2023-10-16T12:58:51.444064+0000","last_active":"2023-10-16T12:58:55.686445+0000","last_peered":"2023-10-16T12:58:55.686445+0000","last_clean":"2023-10-16T12:58:55.686445+0000","last_became_active":"2023-10-16T12:58:51.443873+0000","last_became_peered":"2023-10-16T12:58:51.443873+0000","last_unstale":"2023-10-16T12:58:55.686445+0000","last_undegraded":"2023-10-16T12:58:55.686445+0000","last_fullsized":"2023-10-16T12:58:55.686445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:48:37.180712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.58}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5129999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1190000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.090999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.076000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.883}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.993}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6150000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8210000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8559999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T12:59:14.530 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T12:59:14.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.684+0000 7f99bcc6b700 1 Processor -- start 2023-10-16T12:59:14.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.684+0000 7f99bcc6b700 1 -- start start 2023-10-16T12:59:14.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.685+0000 7f99bcc6b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f99b80ced40 0x7f99b806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:14.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.685+0000 7f99bcc6b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f99b815dea0 0x7f99b815e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:14.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.685+0000 7f99bcc6b700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b80cb3b0 con 0x7f99b80ce960 2023-10-16T12:59:14.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.685+0000 7f99bcc6b700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b815e850 con 0x7f99b815dea0 2023-10-16T12:59:14.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.685+0000 7f99bcc6b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b80cb690 con 0x7f99b80ced40 2023-10-16T12:59:14.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.685+0000 7f99b659c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f99b80ce960 0x7f99b80cab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42622/0 (socket says 172.21.15.124:42622) 2023-10-16T12:59:14.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.685+0000 7f99b659c700 1 -- 172.21.15.124:0/680175507 learned_addr learned my addr 172.21.15.124:0/680175507 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:14.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.685+0000 7f99b6d9d700 1 --2- 172.21.15.124:0/680175507 >> v2:172.21.15.124:3300/0 conn(0x7f99b815dea0 0x7f99b815e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:14.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.685+0000 7f99b5d9b700 1 --2- 172.21.15.124:0/680175507 >> v2:172.21.15.192:3300/0 conn(0x7f99b80ced40 0x7f99b806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:14.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.685+0000 7f99b559a700 1 -- 172.21.15.124:0/680175507 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2344414927 0 0) 0x7f99b80cb3b0 con 0x7f99b80ce960 2023-10-16T12:59:14.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.685+0000 7f99b559a700 1 -- 172.21.15.124:0/680175507 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99a00035b0 con 0x7f99b80ce960 2023-10-16T12:59:14.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.685+0000 7f99b6d9d700 1 -- 172.21.15.124:0/680175507 >> v2:172.21.15.192:3300/0 conn(0x7f99b80ced40 msgr2=0x7f99b806e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:14.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.685+0000 7f99b6d9d700 1 --2- 172.21.15.124:0/680175507 >> v2:172.21.15.192:3300/0 conn(0x7f99b80ced40 0x7f99b806e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.685+0000 7f99b6d9d700 1 -- 172.21.15.124:0/680175507 >> v1:172.21.15.124:6789/0 conn(0x7f99b80ce960 legacy=0x7f99b80cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.685+0000 7f99b6d9d700 1 -- 172.21.15.124:0/680175507 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b80cb970 con 0x7f99b815dea0 2023-10-16T12:59:14.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.685+0000 7f99b6d9d700 1 --2- 172.21.15.124:0/680175507 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f99b815dea0 0x7f99b815e310 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f99b806d270 tx=0x7f99b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a2df52315c39ea server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:14.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.685+0000 7f99b559a700 1 -- 172.21.15.124:0/680175507 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b000e070 con 0x7f99b815dea0 2023-10-16T12:59:14.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.685+0000 7f99b559a700 1 -- 172.21.15.124:0/680175507 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b000bb20 con 0x7f99b815dea0 2023-10-16T12:59:14.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.685+0000 7f99b559a700 1 -- 172.21.15.124:0/680175507 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0012430 con 0x7f99b815dea0 2023-10-16T12:59:14.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.686+0000 7f99bcc6b700 1 -- 172.21.15.124:0/680175507 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f99b815dea0 msgr2=0x7f99b815e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.686+0000 7f99bcc6b700 1 --2- 172.21.15.124:0/680175507 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f99b815dea0 0x7f99b815e310 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f99b806d270 tx=0x7f99b000b330 comp rx=0 tx=0).stop 2023-10-16T12:59:14.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.686+0000 7f99bcc6b700 1 -- 172.21.15.124:0/680175507 shutdown_connections 2023-10-16T12:59:14.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.686+0000 7f99bcc6b700 1 --2- 172.21.15.124:0/680175507 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f99b815dea0 0x7f99b815e310 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.686+0000 7f99bcc6b700 1 --2- 172.21.15.124:0/680175507 >> v2:172.21.15.192:3300/0 conn(0x7f99b80ced40 0x7f99b806e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.686+0000 7f99bcc6b700 1 -- 172.21.15.124:0/680175507 >> 172.21.15.124:0/680175507 conn(0x7f99b80cfcd0 msgr2=0x7f99b80d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:14.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.686+0000 7f99bcc6b700 1 -- 172.21.15.124:0/680175507 shutdown_connections 2023-10-16T12:59:14.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.686+0000 7f99bcc6b700 1 -- 172.21.15.124:0/680175507 wait complete. 2023-10-16T12:59:14.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.687+0000 7f99bcc6b700 1 Processor -- start 2023-10-16T12:59:14.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.687+0000 7f99bcc6b700 1 -- start start 2023-10-16T12:59:14.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.688+0000 7f99bcc6b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99b80ce960 0x7f99b8151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:14.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.688+0000 7f99bcc6b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f99b80ced40 0x7f99b80c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:14.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.688+0000 7f99bcc6b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99b815dea0 0x7f99b815c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:14.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.688+0000 7f99bcc6b700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b815a000 con 0x7f99b80ced40 2023-10-16T12:59:14.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.688+0000 7f99bcc6b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b80c8530 con 0x7f99b815dea0 2023-10-16T12:59:14.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.688+0000 7f99bcc6b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b8159240 con 0x7f99b80ce960 2023-10-16T12:59:14.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.688+0000 7f99b5d9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f99b80ced40 0x7f99b80c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:14.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.688+0000 7f99b5d9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f99b80ced40 0x7f99b80c7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53962/0 (socket says 172.21.15.124:53962) 2023-10-16T12:59:14.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.688+0000 7f99b5d9b700 1 -- 172.21.15.124:0/1154123369 learned_addr learned my addr 172.21.15.124:0/1154123369 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:14.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.689+0000 7f99b6d9d700 1 --2- 172.21.15.124:0/1154123369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99b815dea0 0x7f99b815c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:14.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.689+0000 7f99b659c700 1 --2- 172.21.15.124:0/1154123369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99b80ce960 0x7f99b8151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:14.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.689+0000 7f99b5d9b700 1 -- 172.21.15.124:0/1154123369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99b80ce960 msgr2=0x7f99b8151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.689+0000 7f99b5d9b700 1 --2- 172.21.15.124:0/1154123369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99b80ce960 0x7f99b8151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.689+0000 7f99b5d9b700 1 -- 172.21.15.124:0/1154123369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99b815dea0 msgr2=0x7f99b815c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.689+0000 7f99b5d9b700 1 --2- 172.21.15.124:0/1154123369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99b815dea0 0x7f99b815c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.689+0000 7f99b5d9b700 1 -- 172.21.15.124:0/1154123369 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b0009a70 con 0x7f99b80ced40 2023-10-16T12:59:14.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.689+0000 7f99b6d9d700 1 --2- 172.21.15.124:0/1154123369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99b815dea0 0x7f99b815c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:14.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.689+0000 7f99b659c700 1 --2- 172.21.15.124:0/1154123369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99b80ce960 0x7f99b8151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:14.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.689+0000 7f99b5d9b700 1 --2- 172.21.15.124:0/1154123369 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f99b80ced40 0x7f99b80c7b00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00e9b0 tx=0x7f99ac00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:14.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.689+0000 7f99a6ffd700 1 -- 172.21.15.124:0/1154123369 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac009710 con 0x7f99b80ced40 2023-10-16T12:59:14.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.689+0000 7f99a6ffd700 1 -- 172.21.15.124:0/1154123369 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac00c850 con 0x7f99b80ced40 2023-10-16T12:59:14.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.689+0000 7f99a6ffd700 1 -- 172.21.15.124:0/1154123369 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac00cbc0 con 0x7f99b80ced40 2023-10-16T12:59:14.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.689+0000 7f99bcc6b700 1 -- 172.21.15.124:0/1154123369 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b8159520 con 0x7f99b80ced40 2023-10-16T12:59:14.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.689+0000 7f99bcc6b700 1 -- 172.21.15.124:0/1154123369 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b8159ae0 con 0x7f99b80ced40 2023-10-16T12:59:14.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.690+0000 7f99bcc6b700 1 -- 172.21.15.124:0/1154123369 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b8159ca0 con 0x7f99b80ced40 2023-10-16T12:59:14.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.690+0000 7f99a6ffd700 1 -- 172.21.15.124:0/1154123369 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f99ac00cd20 con 0x7f99b80ced40 2023-10-16T12:59:14.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.691+0000 7f99a6ffd700 1 --2- 172.21.15.124:0/1154123369 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f999806af00 0x7f999806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:14.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.691+0000 7f99a6ffd700 1 -- 172.21.15.124:0/1154123369 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f99ac0899c0 con 0x7f99b80ced40 2023-10-16T12:59:14.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.691+0000 7f99b659c700 1 --2- 172.21.15.124:0/1154123369 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f999806af00 0x7f999806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:14.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.691+0000 7f99b659c700 1 --2- 172.21.15.124:0/1154123369 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f999806af00 0x7f999806d3c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f99a80011e0 tx=0x7f99a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:14.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.695+0000 7f99a6ffd700 1 -- 172.21.15.124:0/1154123369 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f99ac054780 con 0x7f99b80ced40 2023-10-16T12:59:14.886 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.885+0000 7f99bcc6b700 1 -- 172.21.15.124:0/1154123369 --> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99b80cbf30 con 0x7f999806af00 2023-10-16T12:59:14.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.894+0000 7f99a6ffd700 1 -- 172.21.15.124:0/1154123369 <== mgr.4104 v2:172.21.15.124:6832/2391611330 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345179 (secure 0 0 0) 0x7f99a8001c90 con 0x7f999806af00 2023-10-16T12:59:14.899 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:14.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.897+0000 7f99bcc6b700 1 -- 172.21.15.124:0/1154123369 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f999806af00 msgr2=0x7f999806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.897+0000 7f99bcc6b700 1 --2- 172.21.15.124:0/1154123369 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f999806af00 0x7f999806d3c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f99a80011e0 tx=0x7f99a8009040 comp rx=0 tx=0).stop 2023-10-16T12:59:14.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.897+0000 7f99bcc6b700 1 -- 172.21.15.124:0/1154123369 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f99b80ced40 msgr2=0x7f99b80c7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:14.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.897+0000 7f99bcc6b700 1 --2- 172.21.15.124:0/1154123369 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f99b80ced40 0x7f99b80c7b00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00e9b0 tx=0x7f99ac00ed70 comp rx=0 tx=0).stop 2023-10-16T12:59:14.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.897+0000 7f99bcc6b700 1 -- 172.21.15.124:0/1154123369 shutdown_connections 2023-10-16T12:59:14.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.897+0000 7f99bcc6b700 1 --2- 172.21.15.124:0/1154123369 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f999806af00 0x7f999806d3c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.897+0000 7f99bcc6b700 1 --2- 172.21.15.124:0/1154123369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99b815dea0 0x7f99b815c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.897+0000 7f99bcc6b700 1 --2- 172.21.15.124:0/1154123369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99b80ce960 0x7f99b8151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.897+0000 7f99bcc6b700 1 --2- 172.21.15.124:0/1154123369 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f99b80ced40 0x7f99b80c7b00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:14.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.897+0000 7f99bcc6b700 1 -- 172.21.15.124:0/1154123369 >> 172.21.15.124:0/1154123369 conn(0x7f99b80cfcd0 msgr2=0x7f99b80733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:14.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.898+0000 7f99bcc6b700 1 -- 172.21.15.124:0/1154123369 shutdown_connections 2023-10-16T12:59:14.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:14.898+0000 7f99bcc6b700 1 -- 172.21.15.124:0/1154123369 wait complete. 2023-10-16T12:59:14.906 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-16T12:59:14.911 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-10-16T12:59:14.625764+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219380,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755340,"statfs":{"total":773094113280,"available":772869468160,"internally_reserved":0,"allocated":3284992,"data_stored":1988256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003408"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705875+0000","last_change":"2023-10-16T12:58:51.447948+0000","last_active":"2023-10-16T12:58:55.705875+0000","last_peered":"2023-10-16T12:58:55.705875+0000","last_clean":"2023-10-16T12:58:55.705875+0000","last_became_active":"2023-10-16T12:58:51.447661+0000","last_became_peered":"2023-10-16T12:58:51.447661+0000","last_unstale":"2023-10-16T12:58:55.705875+0000","last_undegraded":"2023-10-16T12:58:55.705875+0000","last_fullsized":"2023-10-16T12:58:55.705875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:29:07.394120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679949+0000","last_change":"2023-10-16T12:58:51.439340+0000","last_active":"2023-10-16T12:58:55.679949+0000","last_peered":"2023-10-16T12:58:55.679949+0000","last_clean":"2023-10-16T12:58:55.679949+0000","last_became_active":"2023-10-16T12:58:51.439064+0000","last_became_peered":"2023-10-16T12:58:51.439064+0000","last_unstale":"2023-10-16T12:58:55.679949+0000","last_undegraded":"2023-10-16T12:58:55.679949+0000","last_fullsized":"2023-10-16T12:58:55.679949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:51.422601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.689332+0000","last_change":"2023-10-16T12:58:51.441634+0000","last_active":"2023-10-16T12:58:55.689332+0000","last_peered":"2023-10-16T12:58:55.689332+0000","last_clean":"2023-10-16T12:58:55.689332+0000","last_became_active":"2023-10-16T12:58:51.441380+0000","last_became_peered":"2023-10-16T12:58:51.441380+0000","last_unstale":"2023-10-16T12:58:55.689332+0000","last_undegraded":"2023-10-16T12:58:55.689332+0000","last_fullsized":"2023-10-16T12:58:55.689332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:28:04.262253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679334+0000","last_change":"2023-10-16T12:58:51.442103+0000","last_active":"2023-10-16T12:58:55.679334+0000","last_peered":"2023-10-16T12:58:55.679334+0000","last_clean":"2023-10-16T12:58:55.679334+0000","last_became_active":"2023-10-16T12:58:51.438544+0000","last_became_peered":"2023-10-16T12:58:51.438544+0000","last_unstale":"2023-10-16T12:58:55.679334+0000","last_undegraded":"2023-10-16T12:58:55.679334+0000","last_fullsized":"2023-10-16T12:58:55.679334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:29:07.394120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705435+0000","last_change":"2023-10-16T12:58:51.447862+0000","last_active":"2023-10-16T12:58:55.705435+0000","last_peered":"2023-10-16T12:58:55.705435+0000","last_clean":"2023-10-16T12:58:55.705435+0000","last_became_active":"2023-10-16T12:58:51.447596+0000","last_became_peered":"2023-10-16T12:58:51.447596+0000","last_unstale":"2023-10-16T12:58:55.705435+0000","last_undegraded":"2023-10-16T12:58:55.705435+0000","last_fullsized":"2023-10-16T12:58:55.705435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:42:07.880003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679036+0000","last_change":"2023-10-16T12:58:51.439890+0000","last_active":"2023-10-16T12:58:55.679036+0000","last_peered":"2023-10-16T12:58:55.679036+0000","last_clean":"2023-10-16T12:58:55.679036+0000","last_became_active":"2023-10-16T12:58:51.439624+0000","last_became_peered":"2023-10-16T12:58:51.439624+0000","last_unstale":"2023-10-16T12:58:55.679036+0000","last_undegraded":"2023-10-16T12:58:55.679036+0000","last_fullsized":"2023-10-16T12:58:55.679036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:17:35.655947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705720+0000","last_change":"2023-10-16T12:58:51.446245+0000","last_active":"2023-10-16T12:58:55.705720+0000","last_peered":"2023-10-16T12:58:55.705720+0000","last_clean":"2023-10-16T12:58:55.705720+0000","last_became_active":"2023-10-16T12:58:51.445888+0000","last_became_peered":"2023-10-16T12:58:51.445888+0000","last_unstale":"2023-10-16T12:58:55.705720+0000","last_undegraded":"2023-10-16T12:58:55.705720+0000","last_fullsized":"2023-10-16T12:58:55.705720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:51.422601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688745+0000","last_change":"2023-10-16T12:58:51.444473+0000","last_active":"2023-10-16T12:58:55.688745+0000","last_peered":"2023-10-16T12:58:55.688745+0000","last_clean":"2023-10-16T12:58:55.688745+0000","last_became_active":"2023-10-16T12:58:51.444135+0000","last_became_peered":"2023-10-16T12:58:51.444135+0000","last_unstale":"2023-10-16T12:58:55.688745+0000","last_undegraded":"2023-10-16T12:58:55.688745+0000","last_fullsized":"2023-10-16T12:58:55.688745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:35.585161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705821+0000","last_change":"2023-10-16T12:58:51.450649+0000","last_active":"2023-10-16T12:58:55.705821+0000","last_peered":"2023-10-16T12:58:55.705821+0000","last_clean":"2023-10-16T12:58:55.705821+0000","last_became_active":"2023-10-16T12:58:51.450086+0000","last_became_peered":"2023-10-16T12:58:51.450086+0000","last_unstale":"2023-10-16T12:58:55.705821+0000","last_undegraded":"2023-10-16T12:58:55.705821+0000","last_fullsized":"2023-10-16T12:58:55.705821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:46:33.298597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686340+0000","last_change":"2023-10-16T12:58:51.443152+0000","last_active":"2023-10-16T12:58:55.686340+0000","last_peered":"2023-10-16T12:58:55.686340+0000","last_clean":"2023-10-16T12:58:55.686340+0000","last_became_active":"2023-10-16T12:58:51.442907+0000","last_became_peered":"2023-10-16T12:58:51.442907+0000","last_unstale":"2023-10-16T12:58:55.686340+0000","last_undegraded":"2023-10-16T12:58:55.686340+0000","last_fullsized":"2023-10-16T12:58:55.686340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:17:35.655947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686659+0000","last_change":"2023-10-16T12:58:51.445780+0000","last_active":"2023-10-16T12:58:55.686659+0000","last_peered":"2023-10-16T12:58:55.686659+0000","last_clean":"2023-10-16T12:58:55.686659+0000","last_became_active":"2023-10-16T12:58:51.445488+0000","last_became_peered":"2023-10-16T12:58:51.445488+0000","last_unstale":"2023-10-16T12:58:55.686659+0000","last_undegraded":"2023-10-16T12:58:55.686659+0000","last_fullsized":"2023-10-16T12:58:55.686659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:17.757203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.681164+0000","last_change":"2023-10-16T12:58:51.443335+0000","last_active":"2023-10-16T12:58:55.681164+0000","last_peered":"2023-10-16T12:58:55.681164+0000","last_clean":"2023-10-16T12:58:55.681164+0000","last_became_active":"2023-10-16T12:58:51.443022+0000","last_became_peered":"2023-10-16T12:58:51.443022+0000","last_unstale":"2023-10-16T12:58:55.681164+0000","last_undegraded":"2023-10-16T12:58:55.681164+0000","last_fullsized":"2023-10-16T12:58:55.681164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:21.517544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.683113+0000","last_change":"2023-10-16T12:58:51.442753+0000","last_active":"2023-10-16T12:58:55.683113+0000","last_peered":"2023-10-16T12:58:55.683113+0000","last_clean":"2023-10-16T12:58:55.683113+0000","last_became_active":"2023-10-16T12:58:51.442501+0000","last_became_peered":"2023-10-16T12:58:51.442501+0000","last_unstale":"2023-10-16T12:58:55.683113+0000","last_undegraded":"2023-10-16T12:58:55.683113+0000","last_fullsized":"2023-10-16T12:58:55.683113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:17.757203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.690094+0000","last_change":"2023-10-16T12:58:51.439019+0000","last_active":"2023-10-16T12:58:55.690094+0000","last_peered":"2023-10-16T12:58:55.690094+0000","last_clean":"2023-10-16T12:58:55.690094+0000","last_became_active":"2023-10-16T12:58:51.438742+0000","last_became_peered":"2023-10-16T12:58:51.438742+0000","last_unstale":"2023-10-16T12:58:55.690094+0000","last_undegraded":"2023-10-16T12:58:55.690094+0000","last_fullsized":"2023-10-16T12:58:55.690094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:35.585161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.678142+0000","last_change":"2023-10-16T12:58:51.431552+0000","last_active":"2023-10-16T12:58:55.678142+0000","last_peered":"2023-10-16T12:58:55.678142+0000","last_clean":"2023-10-16T12:58:55.678142+0000","last_became_active":"2023-10-16T12:58:51.431302+0000","last_became_peered":"2023-10-16T12:58:51.431302+0000","last_unstale":"2023-10-16T12:58:55.678142+0000","last_undegraded":"2023-10-16T12:58:55.678142+0000","last_fullsized":"2023-10-16T12:58:55.678142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:40:36.060468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.680089+0000","last_change":"2023-10-16T12:58:51.442937+0000","last_active":"2023-10-16T12:58:55.680089+0000","last_peered":"2023-10-16T12:58:55.680089+0000","last_clean":"2023-10-16T12:58:55.680089+0000","last_became_active":"2023-10-16T12:58:51.442503+0000","last_became_peered":"2023-10-16T12:58:51.442503+0000","last_unstale":"2023-10-16T12:58:55.680089+0000","last_undegraded":"2023-10-16T12:58:55.680089+0000","last_fullsized":"2023-10-16T12:58:55.680089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:51.422601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.678499+0000","last_change":"2023-10-16T12:58:51.447014+0000","last_active":"2023-10-16T12:58:55.678499+0000","last_peered":"2023-10-16T12:58:55.678499+0000","last_clean":"2023-10-16T12:58:55.678499+0000","last_became_active":"2023-10-16T12:58:51.446752+0000","last_became_peered":"2023-10-16T12:58:51.446752+0000","last_unstale":"2023-10-16T12:58:55.678499+0000","last_undegraded":"2023-10-16T12:58:55.678499+0000","last_fullsized":"2023-10-16T12:58:55.678499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:42:26.907121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686121+0000","last_change":"2023-10-16T12:58:51.442299+0000","last_active":"2023-10-16T12:58:55.686121+0000","last_peered":"2023-10-16T12:58:55.686121+0000","last_clean":"2023-10-16T12:58:55.686121+0000","last_became_active":"2023-10-16T12:58:51.442028+0000","last_became_peered":"2023-10-16T12:58:51.442028+0000","last_unstale":"2023-10-16T12:58:55.686121+0000","last_undegraded":"2023-10-16T12:58:55.686121+0000","last_fullsized":"2023-10-16T12:58:55.686121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:26:09.658750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.706083+0000","last_change":"2023-10-16T12:58:51.446159+0000","last_active":"2023-10-16T12:58:55.706083+0000","last_peered":"2023-10-16T12:58:55.706083+0000","last_clean":"2023-10-16T12:58:55.706083+0000","last_became_active":"2023-10-16T12:58:51.445862+0000","last_became_peered":"2023-10-16T12:58:51.445862+0000","last_unstale":"2023-10-16T12:58:55.706083+0000","last_undegraded":"2023-10-16T12:58:55.706083+0000","last_fullsized":"2023-10-16T12:58:55.706083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:41:33.353000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.074473+0000","last_change":"2023-10-16T12:58:55.710385+0000","last_active":"2023-10-16T12:58:57.074473+0000","last_peered":"2023-10-16T12:58:57.074473+0000","last_clean":"2023-10-16T12:58:57.074473+0000","last_became_active":"2023-10-16T12:58:55.709936+0000","last_became_peered":"2023-10-16T12:58:55.709936+0000","last_unstale":"2023-10-16T12:58:57.074473+0000","last_undegraded":"2023-10-16T12:58:57.074473+0000","last_fullsized":"2023-10-16T12:58:57.074473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:10:14.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684401+0000","last_change":"2023-10-16T12:58:50.682380+0000","last_active":"2023-10-16T12:58:55.684401+0000","last_peered":"2023-10-16T12:58:55.684401+0000","last_clean":"2023-10-16T12:58:55.684401+0000","last_became_active":"2023-10-16T12:58:50.682119+0000","last_became_peered":"2023-10-16T12:58:50.682119+0000","last_unstale":"2023-10-16T12:58:55.684401+0000","last_undegraded":"2023-10-16T12:58:55.684401+0000","last_fullsized":"2023-10-16T12:58:55.684401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:43:43.356254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688115+0000","last_change":"2023-10-16T12:58:51.442218+0000","last_active":"2023-10-16T12:58:55.688115+0000","last_peered":"2023-10-16T12:58:55.688115+0000","last_clean":"2023-10-16T12:58:55.688115+0000","last_became_active":"2023-10-16T12:58:51.441929+0000","last_became_peered":"2023-10-16T12:58:51.441929+0000","last_unstale":"2023-10-16T12:58:55.688115+0000","last_undegraded":"2023-10-16T12:58:55.688115+0000","last_fullsized":"2023-10-16T12:58:55.688115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:31:13.605999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.425885+0000","last_change":"2023-10-16T12:58:55.694446+0000","last_active":"2023-10-16T12:58:56.425885+0000","last_peered":"2023-10-16T12:58:56.425885+0000","last_clean":"2023-10-16T12:58:56.425885+0000","last_became_active":"2023-10-16T12:58:55.694006+0000","last_became_peered":"2023-10-16T12:58:55.694006+0000","last_unstale":"2023-10-16T12:58:56.425885+0000","last_undegraded":"2023-10-16T12:58:56.425885+0000","last_fullsized":"2023-10-16T12:58:56.425885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:42:11.902399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688217+0000","last_change":"2023-10-16T12:58:50.672891+0000","last_active":"2023-10-16T12:58:55.688217+0000","last_peered":"2023-10-16T12:58:55.688217+0000","last_clean":"2023-10-16T12:58:55.688217+0000","last_became_active":"2023-10-16T12:58:50.672632+0000","last_became_peered":"2023-10-16T12:58:50.672632+0000","last_unstale":"2023-10-16T12:58:55.688217+0000","last_undegraded":"2023-10-16T12:58:55.688217+0000","last_fullsized":"2023-10-16T12:58:55.688217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:00:22.709075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684236+0000","last_change":"2023-10-16T12:58:51.444115+0000","last_active":"2023-10-16T12:58:55.684236+0000","last_peered":"2023-10-16T12:58:55.684236+0000","last_clean":"2023-10-16T12:58:55.684236+0000","last_became_active":"2023-10-16T12:58:51.443884+0000","last_became_peered":"2023-10-16T12:58:51.443884+0000","last_unstale":"2023-10-16T12:58:55.684236+0000","last_undegraded":"2023-10-16T12:58:55.684236+0000","last_fullsized":"2023-10-16T12:58:55.684236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:32.084288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426516+0000","last_change":"2023-10-16T12:58:55.697719+0000","last_active":"2023-10-16T12:58:56.426516+0000","last_peered":"2023-10-16T12:58:56.426516+0000","last_clean":"2023-10-16T12:58:56.426516+0000","last_became_active":"2023-10-16T12:58:55.697330+0000","last_became_peered":"2023-10-16T12:58:55.697330+0000","last_unstale":"2023-10-16T12:58:56.426516+0000","last_undegraded":"2023-10-16T12:58:56.426516+0000","last_fullsized":"2023-10-16T12:58:56.426516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:30:02.068649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705908+0000","last_change":"2023-10-16T12:58:50.678753+0000","last_active":"2023-10-16T12:58:55.705908+0000","last_peered":"2023-10-16T12:58:55.705908+0000","last_clean":"2023-10-16T12:58:55.705908+0000","last_became_active":"2023-10-16T12:58:50.674216+0000","last_became_peered":"2023-10-16T12:58:50.674216+0000","last_unstale":"2023-10-16T12:58:55.705908+0000","last_undegraded":"2023-10-16T12:58:55.705908+0000","last_fullsized":"2023-10-16T12:58:55.705908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:34.579436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679582+0000","last_change":"2023-10-16T12:58:51.442758+0000","last_active":"2023-10-16T12:58:55.679582+0000","last_peered":"2023-10-16T12:58:55.679582+0000","last_clean":"2023-10-16T12:58:55.679582+0000","last_became_active":"2023-10-16T12:58:51.442485+0000","last_became_peered":"2023-10-16T12:58:51.442485+0000","last_unstale":"2023-10-16T12:58:55.679582+0000","last_undegraded":"2023-10-16T12:58:55.679582+0000","last_fullsized":"2023-10-16T12:58:55.679582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:18:46.943690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426512+0000","last_change":"2023-10-16T12:58:55.699182+0000","last_active":"2023-10-16T12:58:56.426512+0000","last_peered":"2023-10-16T12:58:56.426512+0000","last_clean":"2023-10-16T12:58:56.426512+0000","last_became_active":"2023-10-16T12:58:55.698738+0000","last_became_peered":"2023-10-16T12:58:55.698738+0000","last_unstale":"2023-10-16T12:58:56.426512+0000","last_undegraded":"2023-10-16T12:58:56.426512+0000","last_fullsized":"2023-10-16T12:58:56.426512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:41:37.375395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705027+0000","last_change":"2023-10-16T12:58:50.680255+0000","last_active":"2023-10-16T12:58:55.705027+0000","last_peered":"2023-10-16T12:58:55.705027+0000","last_clean":"2023-10-16T12:58:55.705027+0000","last_became_active":"2023-10-16T12:58:50.679975+0000","last_became_peered":"2023-10-16T12:58:50.679975+0000","last_unstale":"2023-10-16T12:58:55.705027+0000","last_undegraded":"2023-10-16T12:58:55.705027+0000","last_fullsized":"2023-10-16T12:58:55.705027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:10.863857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.681187+0000","last_change":"2023-10-16T12:58:51.443585+0000","last_active":"2023-10-16T12:58:55.681187+0000","last_peered":"2023-10-16T12:58:55.681187+0000","last_clean":"2023-10-16T12:58:55.681187+0000","last_became_active":"2023-10-16T12:58:51.443200+0000","last_became_peered":"2023-10-16T12:58:51.443200+0000","last_unstale":"2023-10-16T12:58:55.681187+0000","last_undegraded":"2023-10-16T12:58:55.681187+0000","last_fullsized":"2023-10-16T12:58:55.681187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:46:33.298597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.074615+0000","last_change":"2023-10-16T12:58:55.696218+0000","last_active":"2023-10-16T12:58:57.074615+0000","last_peered":"2023-10-16T12:58:57.074615+0000","last_clean":"2023-10-16T12:58:57.074615+0000","last_became_active":"2023-10-16T12:58:55.695835+0000","last_became_peered":"2023-10-16T12:58:55.695835+0000","last_unstale":"2023-10-16T12:58:57.074615+0000","last_undegraded":"2023-10-16T12:58:57.074615+0000","last_fullsized":"2023-10-16T12:58:57.074615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:51:25.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.683294+0000","last_change":"2023-10-16T12:58:50.675887+0000","last_active":"2023-10-16T12:58:55.683294+0000","last_peered":"2023-10-16T12:58:55.683294+0000","last_clean":"2023-10-16T12:58:55.683294+0000","last_became_active":"2023-10-16T12:58:50.675649+0000","last_became_peered":"2023-10-16T12:58:50.675649+0000","last_unstale":"2023-10-16T12:58:55.683294+0000","last_undegraded":"2023-10-16T12:58:55.683294+0000","last_fullsized":"2023-10-16T12:58:55.683294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:31.078563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.681802+0000","last_change":"2023-10-16T12:58:51.435387+0000","last_active":"2023-10-16T12:58:55.681802+0000","last_peered":"2023-10-16T12:58:55.681802+0000","last_clean":"2023-10-16T12:58:55.681802+0000","last_became_active":"2023-10-16T12:58:51.435106+0000","last_became_peered":"2023-10-16T12:58:51.435106+0000","last_unstale":"2023-10-16T12:58:55.681802+0000","last_undegraded":"2023-10-16T12:58:55.681802+0000","last_fullsized":"2023-10-16T12:58:55.681802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:56.488214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.424372+0000","last_change":"2023-10-16T12:58:55.699076+0000","last_active":"2023-10-16T12:58:56.424372+0000","last_peered":"2023-10-16T12:58:56.424372+0000","last_clean":"2023-10-16T12:58:56.424372+0000","last_became_active":"2023-10-16T12:58:55.698670+0000","last_became_peered":"2023-10-16T12:58:55.698670+0000","last_unstale":"2023-10-16T12:58:56.424372+0000","last_undegraded":"2023-10-16T12:58:56.424372+0000","last_fullsized":"2023-10-16T12:58:56.424372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:51.536207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.687076+0000","last_change":"2023-10-16T12:58:50.670932+0000","last_active":"2023-10-16T12:58:55.687076+0000","last_peered":"2023-10-16T12:58:55.687076+0000","last_clean":"2023-10-16T12:58:55.687076+0000","last_became_active":"2023-10-16T12:58:50.670622+0000","last_became_peered":"2023-10-16T12:58:50.670622+0000","last_unstale":"2023-10-16T12:58:55.687076+0000","last_undegraded":"2023-10-16T12:58:55.687076+0000","last_fullsized":"2023-10-16T12:58:55.687076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:31.078563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.692398+0000","last_change":"2023-10-16T12:58:51.440771+0000","last_active":"2023-10-16T12:58:55.692398+0000","last_peered":"2023-10-16T12:58:55.692398+0000","last_clean":"2023-10-16T12:58:55.692398+0000","last_became_active":"2023-10-16T12:58:51.440502+0000","last_became_peered":"2023-10-16T12:58:51.440502+0000","last_unstale":"2023-10-16T12:58:55.692398+0000","last_undegraded":"2023-10-16T12:58:55.692398+0000","last_fullsized":"2023-10-16T12:58:55.692398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:51.422601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426179+0000","last_change":"2023-10-16T12:58:55.703710+0000","last_active":"2023-10-16T12:58:56.426179+0000","last_peered":"2023-10-16T12:58:56.426179+0000","last_clean":"2023-10-16T12:58:56.426179+0000","last_became_active":"2023-10-16T12:58:55.702784+0000","last_became_peered":"2023-10-16T12:58:55.702784+0000","last_unstale":"2023-10-16T12:58:56.426179+0000","last_undegraded":"2023-10-16T12:58:56.426179+0000","last_fullsized":"2023-10-16T12:58:56.426179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:19.721283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688901+0000","last_change":"2023-10-16T12:58:50.670749+0000","last_active":"2023-10-16T12:58:55.688901+0000","last_peered":"2023-10-16T12:58:55.688901+0000","last_clean":"2023-10-16T12:58:55.688901+0000","last_became_active":"2023-10-16T12:58:50.670491+0000","last_became_peered":"2023-10-16T12:58:50.670491+0000","last_unstale":"2023-10-16T12:58:55.688901+0000","last_undegraded":"2023-10-16T12:58:55.688901+0000","last_fullsized":"2023-10-16T12:58:55.688901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:10.863857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684097+0000","last_change":"2023-10-16T12:58:51.441981+0000","last_active":"2023-10-16T12:58:55.684097+0000","last_peered":"2023-10-16T12:58:55.684097+0000","last_clean":"2023-10-16T12:58:55.684097+0000","last_became_active":"2023-10-16T12:58:51.441704+0000","last_became_peered":"2023-10-16T12:58:51.441704+0000","last_unstale":"2023-10-16T12:58:55.684097+0000","last_undegraded":"2023-10-16T12:58:55.684097+0000","last_fullsized":"2023-10-16T12:58:55.684097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:51.422601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072432+0000","last_change":"2023-10-16T12:58:55.709709+0000","last_active":"2023-10-16T12:58:57.072432+0000","last_peered":"2023-10-16T12:58:57.072432+0000","last_clean":"2023-10-16T12:58:57.072432+0000","last_became_active":"2023-10-16T12:58:55.709039+0000","last_became_peered":"2023-10-16T12:58:55.709039+0000","last_unstale":"2023-10-16T12:58:57.072432+0000","last_undegraded":"2023-10-16T12:58:57.072432+0000","last_fullsized":"2023-10-16T12:58:57.072432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:29:11.416516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.680211+0000","last_change":"2023-10-16T12:58:50.678872+0000","last_active":"2023-10-16T12:58:55.680211+0000","last_peered":"2023-10-16T12:58:55.680211+0000","last_clean":"2023-10-16T12:58:55.680211+0000","last_became_active":"2023-10-16T12:58:50.678579+0000","last_became_peered":"2023-10-16T12:58:50.678579+0000","last_unstale":"2023-10-16T12:58:55.680211+0000","last_undegraded":"2023-10-16T12:58:55.680211+0000","last_fullsized":"2023-10-16T12:58:55.680211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:26:08.653026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.677699+0000","last_change":"2023-10-16T12:58:51.437769+0000","last_active":"2023-10-16T12:58:55.677699+0000","last_peered":"2023-10-16T12:58:55.677699+0000","last_clean":"2023-10-16T12:58:55.677699+0000","last_became_active":"2023-10-16T12:58:51.437507+0000","last_became_peered":"2023-10-16T12:58:51.437507+0000","last_unstale":"2023-10-16T12:58:55.677699+0000","last_undegraded":"2023-10-16T12:58:55.677699+0000","last_fullsized":"2023-10-16T12:58:55.677699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:59.501942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.074906+0000","last_change":"2023-10-16T12:58:55.708558+0000","last_active":"2023-10-16T12:58:57.074906+0000","last_peered":"2023-10-16T12:58:57.074906+0000","last_clean":"2023-10-16T12:58:57.074906+0000","last_became_active":"2023-10-16T12:58:55.708150+0000","last_became_peered":"2023-10-16T12:58:55.708150+0000","last_unstale":"2023-10-16T12:58:57.074906+0000","last_undegraded":"2023-10-16T12:58:57.074906+0000","last_fullsized":"2023-10-16T12:58:57.074906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:44:45.372869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686651+0000","last_change":"2023-10-16T12:58:50.670702+0000","last_active":"2023-10-16T12:58:55.686651+0000","last_peered":"2023-10-16T12:58:55.686651+0000","last_clean":"2023-10-16T12:58:55.686651+0000","last_became_active":"2023-10-16T12:58:50.670419+0000","last_became_peered":"2023-10-16T12:58:50.670419+0000","last_unstale":"2023-10-16T12:58:55.686651+0000","last_undegraded":"2023-10-16T12:58:55.686651+0000","last_fullsized":"2023-10-16T12:58:55.686651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:34.579436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.680401+0000","last_change":"2023-10-16T12:58:51.449669+0000","last_active":"2023-10-16T12:58:55.680401+0000","last_peered":"2023-10-16T12:58:55.680401+0000","last_clean":"2023-10-16T12:58:55.680401+0000","last_became_active":"2023-10-16T12:58:51.449350+0000","last_became_peered":"2023-10-16T12:58:51.449350+0000","last_unstale":"2023-10-16T12:58:55.680401+0000","last_undegraded":"2023-10-16T12:58:55.680401+0000","last_fullsized":"2023-10-16T12:58:55.680401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:33.724803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.075082+0000","last_change":"2023-10-16T12:58:55.702198+0000","last_active":"2023-10-16T12:58:57.075082+0000","last_peered":"2023-10-16T12:58:57.075082+0000","last_clean":"2023-10-16T12:58:57.075082+0000","last_became_active":"2023-10-16T12:58:55.701858+0000","last_became_peered":"2023-10-16T12:58:55.701858+0000","last_unstale":"2023-10-16T12:58:57.075082+0000","last_undegraded":"2023-10-16T12:58:57.075082+0000","last_fullsized":"2023-10-16T12:58:57.075082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:44:31.688200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.680381+0000","last_change":"2023-10-16T12:58:50.676760+0000","last_active":"2023-10-16T12:58:55.680381+0000","last_peered":"2023-10-16T12:58:55.680381+0000","last_clean":"2023-10-16T12:58:55.680381+0000","last_became_active":"2023-10-16T12:58:50.676461+0000","last_became_peered":"2023-10-16T12:58:50.676461+0000","last_unstale":"2023-10-16T12:58:55.680381+0000","last_undegraded":"2023-10-16T12:58:55.680381+0000","last_fullsized":"2023-10-16T12:58:55.680381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:43:43.356254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684505+0000","last_change":"2023-10-16T12:58:51.444087+0000","last_active":"2023-10-16T12:58:55.684505+0000","last_peered":"2023-10-16T12:58:55.684505+0000","last_clean":"2023-10-16T12:58:55.684505+0000","last_became_active":"2023-10-16T12:58:51.443844+0000","last_became_peered":"2023-10-16T12:58:51.443844+0000","last_unstale":"2023-10-16T12:58:55.684505+0000","last_undegraded":"2023-10-16T12:58:55.684505+0000","last_fullsized":"2023-10-16T12:58:55.684505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:48:37.180712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426810+0000","last_change":"2023-10-16T12:58:55.688731+0000","last_active":"2023-10-16T12:58:56.426810+0000","last_peered":"2023-10-16T12:58:56.426810+0000","last_clean":"2023-10-16T12:58:56.426810+0000","last_became_active":"2023-10-16T12:58:55.688216+0000","last_became_peered":"2023-10-16T12:58:55.688216+0000","last_unstale":"2023-10-16T12:58:56.426810+0000","last_undegraded":"2023-10-16T12:58:56.426810+0000","last_fullsized":"2023-10-16T12:58:56.426810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:19.721283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679599+0000","last_change":"2023-10-16T12:58:50.679739+0000","last_active":"2023-10-16T12:58:55.679599+0000","last_peered":"2023-10-16T12:58:55.679599+0000","last_clean":"2023-10-16T12:58:55.679599+0000","last_became_active":"2023-10-16T12:58:50.679385+0000","last_became_peered":"2023-10-16T12:58:50.679385+0000","last_unstale":"2023-10-16T12:58:55.679599+0000","last_undegraded":"2023-10-16T12:58:55.679599+0000","last_fullsized":"2023-10-16T12:58:55.679599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:31.078563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.681075+0000","last_change":"2023-10-16T12:58:51.449711+0000","last_active":"2023-10-16T12:58:55.681075+0000","last_peered":"2023-10-16T12:58:55.681075+0000","last_clean":"2023-10-16T12:58:55.681075+0000","last_became_active":"2023-10-16T12:58:51.449453+0000","last_became_peered":"2023-10-16T12:58:51.449453+0000","last_unstale":"2023-10-16T12:58:55.681075+0000","last_undegraded":"2023-10-16T12:58:55.681075+0000","last_fullsized":"2023-10-16T12:58:55.681075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:11.869582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.073118+0000","last_change":"2023-10-16T12:58:55.696432+0000","last_active":"2023-10-16T12:58:57.073118+0000","last_peered":"2023-10-16T12:58:57.073118+0000","last_clean":"2023-10-16T12:58:57.073118+0000","last_became_active":"2023-10-16T12:58:55.696015+0000","last_became_peered":"2023-10-16T12:58:55.696015+0000","last_unstale":"2023-10-16T12:58:57.073118+0000","last_undegraded":"2023-10-16T12:58:57.073118+0000","last_fullsized":"2023-10-16T12:58:57.073118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:46:37.320993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:59:01.634183+0000","last_change":"2023-10-16T12:58:50.672122+0000","last_active":"2023-10-16T12:59:01.634183+0000","last_peered":"2023-10-16T12:59:01.634183+0000","last_clean":"2023-10-16T12:59:01.634183+0000","last_became_active":"2023-10-16T12:58:50.671817+0000","last_became_peered":"2023-10-16T12:58:50.671817+0000","last_unstale":"2023-10-16T12:59:01.634183+0000","last_undegraded":"2023-10-16T12:59:01.634183+0000","last_fullsized":"2023-10-16T12:59:01.634183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:46.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705985+0000","last_change":"2023-10-16T12:58:51.446766+0000","last_active":"2023-10-16T12:58:55.705985+0000","last_peered":"2023-10-16T12:58:55.705985+0000","last_clean":"2023-10-16T12:58:55.705985+0000","last_became_active":"2023-10-16T12:58:51.446573+0000","last_became_peered":"2023-10-16T12:58:51.446573+0000","last_unstale":"2023-10-16T12:58:55.705985+0000","last_undegraded":"2023-10-16T12:58:55.705985+0000","last_fullsized":"2023-10-16T12:58:55.705985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:18:46.943690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072803+0000","last_change":"2023-10-16T12:58:55.708591+0000","last_active":"2023-10-16T12:58:57.072803+0000","last_peered":"2023-10-16T12:58:57.072803+0000","last_clean":"2023-10-16T12:58:57.072803+0000","last_became_active":"2023-10-16T12:58:55.708210+0000","last_became_peered":"2023-10-16T12:58:55.708210+0000","last_unstale":"2023-10-16T12:58:57.072803+0000","last_undegraded":"2023-10-16T12:58:57.072803+0000","last_fullsized":"2023-10-16T12:58:57.072803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:51:25.849343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.692682+0000","last_change":"2023-10-16T12:58:50.671656+0000","last_active":"2023-10-16T12:58:55.692682+0000","last_peered":"2023-10-16T12:58:55.692682+0000","last_clean":"2023-10-16T12:58:55.692682+0000","last_became_active":"2023-10-16T12:58:50.671397+0000","last_became_peered":"2023-10-16T12:58:50.671397+0000","last_unstale":"2023-10-16T12:58:55.692682+0000","last_undegraded":"2023-10-16T12:58:55.692682+0000","last_fullsized":"2023-10-16T12:58:55.692682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:00:22.709075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.690350+0000","last_change":"2023-10-16T12:58:51.446368+0000","last_active":"2023-10-16T12:58:55.690350+0000","last_peered":"2023-10-16T12:58:55.690350+0000","last_clean":"2023-10-16T12:58:55.690350+0000","last_became_active":"2023-10-16T12:58:51.446071+0000","last_became_peered":"2023-10-16T12:58:51.446071+0000","last_unstale":"2023-10-16T12:58:55.690350+0000","last_undegraded":"2023-10-16T12:58:55.690350+0000","last_fullsized":"2023-10-16T12:58:55.690350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:48.087275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.074774+0000","last_change":"2023-10-16T12:58:55.705522+0000","last_active":"2023-10-16T12:58:57.074774+0000","last_peered":"2023-10-16T12:58:57.074774+0000","last_clean":"2023-10-16T12:58:57.074774+0000","last_became_active":"2023-10-16T12:58:55.705089+0000","last_became_peered":"2023-10-16T12:58:55.705089+0000","last_unstale":"2023-10-16T12:58:57.074774+0000","last_undegraded":"2023-10-16T12:58:57.074774+0000","last_fullsized":"2023-10-16T12:58:57.074774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:04:01.613449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.678720+0000","last_change":"2023-10-16T12:58:50.673340+0000","last_active":"2023-10-16T12:58:55.678720+0000","last_peered":"2023-10-16T12:58:55.678720+0000","last_clean":"2023-10-16T12:58:55.678720+0000","last_became_active":"2023-10-16T12:58:50.672323+0000","last_became_peered":"2023-10-16T12:58:50.672323+0000","last_unstale":"2023-10-16T12:58:55.678720+0000","last_undegraded":"2023-10-16T12:58:55.678720+0000","last_fullsized":"2023-10-16T12:58:55.678720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:31.078563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705522+0000","last_change":"2023-10-16T12:58:51.448920+0000","last_active":"2023-10-16T12:58:55.705522+0000","last_peered":"2023-10-16T12:58:55.705522+0000","last_clean":"2023-10-16T12:58:55.705522+0000","last_became_active":"2023-10-16T12:58:51.448634+0000","last_became_peered":"2023-10-16T12:58:51.448634+0000","last_unstale":"2023-10-16T12:58:55.705522+0000","last_undegraded":"2023-10-16T12:58:55.705522+0000","last_fullsized":"2023-10-16T12:58:55.705522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:31:13.605999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.075154+0000","last_change":"2023-10-16T12:58:55.713528+0000","last_active":"2023-10-16T12:58:57.075154+0000","last_peered":"2023-10-16T12:58:57.075154+0000","last_clean":"2023-10-16T12:58:57.075154+0000","last_became_active":"2023-10-16T12:58:55.712996+0000","last_became_peered":"2023-10-16T12:58:55.712996+0000","last_unstale":"2023-10-16T12:58:57.075154+0000","last_undegraded":"2023-10-16T12:58:57.075154+0000","last_fullsized":"2023-10-16T12:58:57.075154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:31:20.622883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686054+0000","last_change":"2023-10-16T12:58:50.667418+0000","last_active":"2023-10-16T12:58:55.686054+0000","last_peered":"2023-10-16T12:58:55.686054+0000","last_clean":"2023-10-16T12:58:55.686054+0000","last_became_active":"2023-10-16T12:58:50.667102+0000","last_became_peered":"2023-10-16T12:58:50.667102+0000","last_unstale":"2023-10-16T12:58:55.686054+0000","last_undegraded":"2023-10-16T12:58:55.686054+0000","last_fullsized":"2023-10-16T12:58:55.686054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:10.863857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.685920+0000","last_change":"2023-10-16T12:58:51.441514+0000","last_active":"2023-10-16T12:58:55.685920+0000","last_peered":"2023-10-16T12:58:55.685920+0000","last_clean":"2023-10-16T12:58:55.685920+0000","last_became_active":"2023-10-16T12:58:51.441211+0000","last_became_peered":"2023-10-16T12:58:51.441211+0000","last_unstale":"2023-10-16T12:58:55.685920+0000","last_undegraded":"2023-10-16T12:58:55.685920+0000","last_fullsized":"2023-10-16T12:58:55.685920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:28:04.262253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072161+0000","last_change":"2023-10-16T12:58:55.698601+0000","last_active":"2023-10-16T12:58:57.072161+0000","last_peered":"2023-10-16T12:58:57.072161+0000","last_clean":"2023-10-16T12:58:57.072161+0000","last_became_active":"2023-10-16T12:58:55.697802+0000","last_became_peered":"2023-10-16T12:58:55.697802+0000","last_unstale":"2023-10-16T12:58:57.072161+0000","last_undegraded":"2023-10-16T12:58:57.072161+0000","last_fullsized":"2023-10-16T12:58:57.072161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:19.721283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684515+0000","last_change":"2023-10-16T12:58:50.679915+0000","last_active":"2023-10-16T12:58:55.684515+0000","last_peered":"2023-10-16T12:58:55.684515+0000","last_clean":"2023-10-16T12:58:55.684515+0000","last_became_active":"2023-10-16T12:58:50.679550+0000","last_became_peered":"2023-10-16T12:58:50.679550+0000","last_unstale":"2023-10-16T12:58:55.684515+0000","last_undegraded":"2023-10-16T12:58:55.684515+0000","last_fullsized":"2023-10-16T12:58:55.684515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:33.218756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705896+0000","last_change":"2023-10-16T12:58:51.450989+0000","last_active":"2023-10-16T12:58:55.705896+0000","last_peered":"2023-10-16T12:58:55.705896+0000","last_clean":"2023-10-16T12:58:55.705896+0000","last_became_active":"2023-10-16T12:58:51.450681+0000","last_became_peered":"2023-10-16T12:58:51.450681+0000","last_unstale":"2023-10-16T12:58:55.705896+0000","last_undegraded":"2023-10-16T12:58:55.705896+0000","last_fullsized":"2023-10-16T12:58:55.705896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:17:35.655947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.425612+0000","last_change":"2023-10-16T12:58:55.694540+0000","last_active":"2023-10-16T12:58:56.425612+0000","last_peered":"2023-10-16T12:58:56.425612+0000","last_clean":"2023-10-16T12:58:56.425612+0000","last_became_active":"2023-10-16T12:58:55.694116+0000","last_became_peered":"2023-10-16T12:58:55.694116+0000","last_unstale":"2023-10-16T12:58:56.425612+0000","last_undegraded":"2023-10-16T12:58:56.425612+0000","last_fullsized":"2023-10-16T12:58:56.425612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:21.779599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.681959+0000","last_change":"2023-10-16T12:58:50.673412+0000","last_active":"2023-10-16T12:58:55.681959+0000","last_peered":"2023-10-16T12:58:55.681959+0000","last_clean":"2023-10-16T12:58:55.681959+0000","last_became_active":"2023-10-16T12:58:50.672849+0000","last_became_peered":"2023-10-16T12:58:50.672849+0000","last_unstale":"2023-10-16T12:58:55.681959+0000","last_undegraded":"2023-10-16T12:58:55.681959+0000","last_fullsized":"2023-10-16T12:58:55.681959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:35:18.620321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705273+0000","last_change":"2023-10-16T12:58:51.449246+0000","last_active":"2023-10-16T12:58:55.705273+0000","last_peered":"2023-10-16T12:58:55.705273+0000","last_clean":"2023-10-16T12:58:55.705273+0000","last_became_active":"2023-10-16T12:58:51.448956+0000","last_became_peered":"2023-10-16T12:58:51.448956+0000","last_unstale":"2023-10-16T12:58:55.705273+0000","last_undegraded":"2023-10-16T12:58:55.705273+0000","last_fullsized":"2023-10-16T12:58:55.705273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:29:58.046253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072974+0000","last_change":"2023-10-16T12:58:55.698954+0000","last_active":"2023-10-16T12:58:57.072974+0000","last_peered":"2023-10-16T12:58:57.072974+0000","last_clean":"2023-10-16T12:58:57.072974+0000","last_became_active":"2023-10-16T12:58:55.698587+0000","last_became_peered":"2023-10-16T12:58:55.698587+0000","last_unstale":"2023-10-16T12:58:57.072974+0000","last_undegraded":"2023-10-16T12:58:57.072974+0000","last_fullsized":"2023-10-16T12:58:57.072974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:37.747199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679241+0000","last_change":"2023-10-16T12:58:50.673554+0000","last_active":"2023-10-16T12:58:55.679241+0000","last_peered":"2023-10-16T12:58:55.679241+0000","last_clean":"2023-10-16T12:58:55.679241+0000","last_became_active":"2023-10-16T12:58:50.673154+0000","last_became_peered":"2023-10-16T12:58:50.673154+0000","last_unstale":"2023-10-16T12:58:55.679241+0000","last_undegraded":"2023-10-16T12:58:55.679241+0000","last_fullsized":"2023-10-16T12:58:55.679241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:34.579436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.681355+0000","last_change":"2023-10-16T12:58:51.439381+0000","last_active":"2023-10-16T12:58:55.681355+0000","last_peered":"2023-10-16T12:58:55.681355+0000","last_clean":"2023-10-16T12:58:55.681355+0000","last_became_active":"2023-10-16T12:58:51.439106+0000","last_became_peered":"2023-10-16T12:58:51.439106+0000","last_unstale":"2023-10-16T12:58:55.681355+0000","last_undegraded":"2023-10-16T12:58:55.681355+0000","last_fullsized":"2023-10-16T12:58:55.681355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:15.698887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072598+0000","last_change":"2023-10-16T12:58:55.703026+0000","last_active":"2023-10-16T12:58:57.072598+0000","last_peered":"2023-10-16T12:58:57.072598+0000","last_clean":"2023-10-16T12:58:57.072598+0000","last_became_active":"2023-10-16T12:58:55.702114+0000","last_became_peered":"2023-10-16T12:58:55.702114+0000","last_unstale":"2023-10-16T12:58:57.072598+0000","last_undegraded":"2023-10-16T12:58:57.072598+0000","last_fullsized":"2023-10-16T12:58:57.072598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:19.721283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.678615+0000","last_change":"2023-10-16T12:58:50.674212+0000","last_active":"2023-10-16T12:58:55.678615+0000","last_peered":"2023-10-16T12:58:55.678615+0000","last_clean":"2023-10-16T12:58:55.678615+0000","last_became_active":"2023-10-16T12:58:50.673650+0000","last_became_peered":"2023-10-16T12:58:50.673650+0000","last_unstale":"2023-10-16T12:58:55.678615+0000","last_undegraded":"2023-10-16T12:58:55.678615+0000","last_fullsized":"2023-10-16T12:58:55.678615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:46.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.683223+0000","last_change":"2023-10-16T12:58:51.438475+0000","last_active":"2023-10-16T12:58:55.683223+0000","last_peered":"2023-10-16T12:58:55.683223+0000","last_clean":"2023-10-16T12:58:55.683223+0000","last_became_active":"2023-10-16T12:58:51.438151+0000","last_became_peered":"2023-10-16T12:58:51.438151+0000","last_unstale":"2023-10-16T12:58:55.683223+0000","last_undegraded":"2023-10-16T12:58:55.683223+0000","last_fullsized":"2023-10-16T12:58:55.683223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:22:35.314558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.073288+0000","last_change":"2023-10-16T12:58:55.699995+0000","last_active":"2023-10-16T12:58:57.073288+0000","last_peered":"2023-10-16T12:58:57.073288+0000","last_clean":"2023-10-16T12:58:57.073288+0000","last_became_active":"2023-10-16T12:58:55.699645+0000","last_became_peered":"2023-10-16T12:58:55.699645+0000","last_unstale":"2023-10-16T12:58:57.073288+0000","last_undegraded":"2023-10-16T12:58:57.073288+0000","last_fullsized":"2023-10-16T12:58:57.073288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:29:11.416516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.677592+0000","last_change":"2023-10-16T12:58:51.438846+0000","last_active":"2023-10-16T12:58:55.677592+0000","last_peered":"2023-10-16T12:58:55.677592+0000","last_clean":"2023-10-16T12:58:55.677592+0000","last_became_active":"2023-10-16T12:58:51.438601+0000","last_became_peered":"2023-10-16T12:58:51.438601+0000","last_unstale":"2023-10-16T12:58:55.677592+0000","last_undegraded":"2023-10-16T12:58:55.677592+0000","last_fullsized":"2023-10-16T12:58:55.677592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:48:37.180712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684696+0000","last_change":"2023-10-16T12:58:50.685058+0000","last_active":"2023-10-16T12:58:55.684696+0000","last_peered":"2023-10-16T12:58:55.684696+0000","last_clean":"2023-10-16T12:58:55.684696+0000","last_became_active":"2023-10-16T12:58:50.684800+0000","last_became_peered":"2023-10-16T12:58:50.684800+0000","last_unstale":"2023-10-16T12:58:55.684696+0000","last_undegraded":"2023-10-16T12:58:55.684696+0000","last_fullsized":"2023-10-16T12:58:55.684696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:22:34.308834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426188+0000","last_change":"2023-10-16T12:58:55.705646+0000","last_active":"2023-10-16T12:58:56.426188+0000","last_peered":"2023-10-16T12:58:56.426188+0000","last_clean":"2023-10-16T12:58:56.426188+0000","last_became_active":"2023-10-16T12:58:55.705247+0000","last_became_peered":"2023-10-16T12:58:55.705247+0000","last_unstale":"2023-10-16T12:58:56.426188+0000","last_undegraded":"2023-10-16T12:58:56.426188+0000","last_fullsized":"2023-10-16T12:58:56.426188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:37.747199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.685428+0000","last_change":"2023-10-16T12:58:51.436519+0000","last_active":"2023-10-16T12:58:55.685428+0000","last_peered":"2023-10-16T12:58:55.685428+0000","last_clean":"2023-10-16T12:58:55.685428+0000","last_became_active":"2023-10-16T12:58:51.436320+0000","last_became_peered":"2023-10-16T12:58:51.436320+0000","last_unstale":"2023-10-16T12:58:55.685428+0000","last_undegraded":"2023-10-16T12:58:55.685428+0000","last_fullsized":"2023-10-16T12:58:55.685428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:48:37.180712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679659+0000","last_change":"2023-10-16T12:58:50.682408+0000","last_active":"2023-10-16T12:58:55.679659+0000","last_peered":"2023-10-16T12:58:55.679659+0000","last_clean":"2023-10-16T12:58:55.679659+0000","last_became_active":"2023-10-16T12:58:50.682084+0000","last_became_peered":"2023-10-16T12:58:50.682084+0000","last_unstale":"2023-10-16T12:58:55.679659+0000","last_undegraded":"2023-10-16T12:58:55.679659+0000","last_fullsized":"2023-10-16T12:58:55.679659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:20.511820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.704719+0000","last_change":"2023-10-16T12:58:40.198340+0000","last_active":"2023-10-16T12:58:55.704719+0000","last_peered":"2023-10-16T12:58:55.704719+0000","last_clean":"2023-10-16T12:58:55.704719+0000","last_became_active":"2023-10-16T12:58:40.197354+0000","last_became_peered":"2023-10-16T12:58:40.197354+0000","last_unstale":"2023-10-16T12:58:55.704719+0000","last_undegraded":"2023-10-16T12:58:55.704719+0000","last_fullsized":"2023-10-16T12:58:55.704719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:39.025347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:39.025347+0000","last_clean_scrub_stamp":"2023-10-16T12:58:39.025347+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:22:36.722419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072318+0000","last_change":"2023-10-16T12:58:55.709450+0000","last_active":"2023-10-16T12:58:57.072318+0000","last_peered":"2023-10-16T12:58:57.072318+0000","last_clean":"2023-10-16T12:58:57.072318+0000","last_became_active":"2023-10-16T12:58:55.708457+0000","last_became_peered":"2023-10-16T12:58:55.708457+0000","last_unstale":"2023-10-16T12:58:57.072318+0000","last_undegraded":"2023-10-16T12:58:57.072318+0000","last_fullsized":"2023-10-16T12:58:57.072318+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:46:37.320993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684401+0000","last_change":"2023-10-16T12:58:51.440843+0000","last_active":"2023-10-16T12:58:55.684401+0000","last_peered":"2023-10-16T12:58:55.684401+0000","last_clean":"2023-10-16T12:58:55.684401+0000","last_became_active":"2023-10-16T12:58:51.440584+0000","last_became_peered":"2023-10-16T12:58:51.440584+0000","last_unstale":"2023-10-16T12:58:55.684401+0000","last_undegraded":"2023-10-16T12:58:55.684401+0000","last_fullsized":"2023-10-16T12:58:55.684401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:47.513811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.704824+0000","last_change":"2023-10-16T12:58:50.672662+0000","last_active":"2023-10-16T12:58:55.704824+0000","last_peered":"2023-10-16T12:58:55.704824+0000","last_clean":"2023-10-16T12:58:55.704824+0000","last_became_active":"2023-10-16T12:58:50.672268+0000","last_became_peered":"2023-10-16T12:58:50.672268+0000","last_unstale":"2023-10-16T12:58:55.704824+0000","last_undegraded":"2023-10-16T12:58:55.704824+0000","last_fullsized":"2023-10-16T12:58:55.704824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:22:34.308834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072561+0000","last_change":"2023-10-16T12:58:55.708627+0000","last_active":"2023-10-16T12:58:57.072561+0000","last_peered":"2023-10-16T12:58:57.072561+0000","last_clean":"2023-10-16T12:58:57.072561+0000","last_became_active":"2023-10-16T12:58:55.708171+0000","last_became_peered":"2023-10-16T12:58:55.708171+0000","last_unstale":"2023-10-16T12:58:57.072561+0000","last_undegraded":"2023-10-16T12:58:57.072561+0000","last_fullsized":"2023-10-16T12:58:57.072561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:42:30.929517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705826+0000","last_change":"2023-10-16T12:58:50.678911+0000","last_active":"2023-10-16T12:58:55.705826+0000","last_peered":"2023-10-16T12:58:55.705826+0000","last_clean":"2023-10-16T12:58:55.705826+0000","last_became_active":"2023-10-16T12:58:50.678642+0000","last_became_peered":"2023-10-16T12:58:50.678642+0000","last_unstale":"2023-10-16T12:58:55.705826+0000","last_undegraded":"2023-10-16T12:58:55.705826+0000","last_fullsized":"2023-10-16T12:58:55.705826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:46.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.680176+0000","last_change":"2023-10-16T12:58:51.439513+0000","last_active":"2023-10-16T12:58:55.680176+0000","last_peered":"2023-10-16T12:58:55.680176+0000","last_clean":"2023-10-16T12:58:55.680176+0000","last_became_active":"2023-10-16T12:58:51.439294+0000","last_became_peered":"2023-10-16T12:58:51.439294+0000","last_unstale":"2023-10-16T12:58:55.680176+0000","last_undegraded":"2023-10-16T12:58:55.680176+0000","last_fullsized":"2023-10-16T12:58:55.680176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:17.757203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.074246+0000","last_change":"2023-10-16T12:58:55.709315+0000","last_active":"2023-10-16T12:58:57.074246+0000","last_peered":"2023-10-16T12:58:57.074246+0000","last_clean":"2023-10-16T12:58:57.074246+0000","last_became_active":"2023-10-16T12:58:55.708910+0000","last_became_peered":"2023-10-16T12:58:55.708910+0000","last_unstale":"2023-10-16T12:58:57.074246+0000","last_undegraded":"2023-10-16T12:58:57.074246+0000","last_fullsized":"2023-10-16T12:58:57.074246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:05:40.393225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679472+0000","last_change":"2023-10-16T12:58:50.673963+0000","last_active":"2023-10-16T12:58:55.679472+0000","last_peered":"2023-10-16T12:58:55.679472+0000","last_clean":"2023-10-16T12:58:55.679472+0000","last_became_active":"2023-10-16T12:58:50.673711+0000","last_became_peered":"2023-10-16T12:58:50.673711+0000","last_unstale":"2023-10-16T12:58:55.679472+0000","last_undegraded":"2023-10-16T12:58:55.679472+0000","last_fullsized":"2023-10-16T12:58:55.679472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:20.511820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688867+0000","last_change":"2023-10-16T12:58:51.446153+0000","last_active":"2023-10-16T12:58:55.688867+0000","last_peered":"2023-10-16T12:58:55.688867+0000","last_clean":"2023-10-16T12:58:55.688867+0000","last_became_active":"2023-10-16T12:58:51.445929+0000","last_became_peered":"2023-10-16T12:58:51.445929+0000","last_unstale":"2023-10-16T12:58:55.688867+0000","last_undegraded":"2023-10-16T12:58:55.688867+0000","last_fullsized":"2023-10-16T12:58:55.688867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:42:07.880003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.425788+0000","last_change":"2023-10-16T12:58:55.708698+0000","last_active":"2023-10-16T12:58:56.425788+0000","last_peered":"2023-10-16T12:58:56.425788+0000","last_clean":"2023-10-16T12:58:56.425788+0000","last_became_active":"2023-10-16T12:58:55.708320+0000","last_became_peered":"2023-10-16T12:58:55.708320+0000","last_unstale":"2023-10-16T12:58:56.425788+0000","last_undegraded":"2023-10-16T12:58:56.425788+0000","last_fullsized":"2023-10-16T12:58:56.425788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:55.444997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686576+0000","last_change":"2023-10-16T12:58:50.673507+0000","last_active":"2023-10-16T12:58:55.686576+0000","last_peered":"2023-10-16T12:58:55.686576+0000","last_clean":"2023-10-16T12:58:55.686576+0000","last_became_active":"2023-10-16T12:58:50.672980+0000","last_became_peered":"2023-10-16T12:58:50.672980+0000","last_unstale":"2023-10-16T12:58:55.686576+0000","last_undegraded":"2023-10-16T12:58:55.686576+0000","last_fullsized":"2023-10-16T12:58:55.686576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:33.218756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.692578+0000","last_change":"2023-10-16T12:58:51.439054+0000","last_active":"2023-10-16T12:58:55.692578+0000","last_peered":"2023-10-16T12:58:55.692578+0000","last_clean":"2023-10-16T12:58:55.692578+0000","last_became_active":"2023-10-16T12:58:51.438776+0000","last_became_peered":"2023-10-16T12:58:51.438776+0000","last_unstale":"2023-10-16T12:58:55.692578+0000","last_undegraded":"2023-10-16T12:58:55.692578+0000","last_fullsized":"2023-10-16T12:58:55.692578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:17.757203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.425860+0000","last_change":"2023-10-16T12:58:55.694414+0000","last_active":"2023-10-16T12:58:56.425860+0000","last_peered":"2023-10-16T12:58:56.425860+0000","last_clean":"2023-10-16T12:58:56.425860+0000","last_became_active":"2023-10-16T12:58:55.694003+0000","last_became_peered":"2023-10-16T12:58:55.694003+0000","last_unstale":"2023-10-16T12:58:56.425860+0000","last_undegraded":"2023-10-16T12:58:56.425860+0000","last_fullsized":"2023-10-16T12:58:56.425860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:17:39.678343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.704716+0000","last_change":"2023-10-16T12:58:50.678331+0000","last_active":"2023-10-16T12:58:55.704716+0000","last_peered":"2023-10-16T12:58:55.704716+0000","last_clean":"2023-10-16T12:58:55.704716+0000","last_became_active":"2023-10-16T12:58:50.674513+0000","last_became_peered":"2023-10-16T12:58:50.674513+0000","last_unstale":"2023-10-16T12:58:55.704716+0000","last_undegraded":"2023-10-16T12:58:55.704716+0000","last_fullsized":"2023-10-16T12:58:55.704716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:33.218756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.682143+0000","last_change":"2023-10-16T12:58:51.438953+0000","last_active":"2023-10-16T12:58:55.682143+0000","last_peered":"2023-10-16T12:58:55.682143+0000","last_clean":"2023-10-16T12:58:55.682143+0000","last_became_active":"2023-10-16T12:58:51.438670+0000","last_became_peered":"2023-10-16T12:58:51.438670+0000","last_unstale":"2023-10-16T12:58:55.682143+0000","last_undegraded":"2023-10-16T12:58:55.682143+0000","last_fullsized":"2023-10-16T12:58:55.682143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:34.224481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.073430+0000","last_change":"2023-10-16T12:58:55.711548+0000","last_active":"2023-10-16T12:58:57.073430+0000","last_peered":"2023-10-16T12:58:57.073430+0000","last_clean":"2023-10-16T12:58:57.073430+0000","last_became_active":"2023-10-16T12:58:55.711144+0000","last_became_peered":"2023-10-16T12:58:55.711144+0000","last_unstale":"2023-10-16T12:58:57.073430+0000","last_undegraded":"2023-10-16T12:58:57.073430+0000","last_fullsized":"2023-10-16T12:58:57.073430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:42:30.929517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.677592+0000","last_change":"2023-10-16T12:58:50.674933+0000","last_active":"2023-10-16T12:58:55.677592+0000","last_peered":"2023-10-16T12:58:55.677592+0000","last_clean":"2023-10-16T12:58:55.677592+0000","last_became_active":"2023-10-16T12:58:50.674678+0000","last_became_peered":"2023-10-16T12:58:50.674678+0000","last_unstale":"2023-10-16T12:58:55.677592+0000","last_undegraded":"2023-10-16T12:58:55.677592+0000","last_fullsized":"2023-10-16T12:58:55.677592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:22:34.308834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688629+0000","last_change":"2023-10-16T12:58:51.438422+0000","last_active":"2023-10-16T12:58:55.688629+0000","last_peered":"2023-10-16T12:58:55.688629+0000","last_clean":"2023-10-16T12:58:55.688629+0000","last_became_active":"2023-10-16T12:58:51.437341+0000","last_became_peered":"2023-10-16T12:58:51.437341+0000","last_unstale":"2023-10-16T12:58:55.688629+0000","last_undegraded":"2023-10-16T12:58:55.688629+0000","last_fullsized":"2023-10-16T12:58:55.688629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:59.501942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426422+0000","last_change":"2023-10-16T12:58:55.702372+0000","last_active":"2023-10-16T12:58:56.426422+0000","last_peered":"2023-10-16T12:58:56.426422+0000","last_clean":"2023-10-16T12:58:56.426422+0000","last_became_active":"2023-10-16T12:58:55.701933+0000","last_became_peered":"2023-10-16T12:58:55.701933+0000","last_unstale":"2023-10-16T12:58:56.426422+0000","last_undegraded":"2023-10-16T12:58:56.426422+0000","last_fullsized":"2023-10-16T12:58:56.426422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:18:50.966086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.677714+0000","last_change":"2023-10-16T12:58:50.669022+0000","last_active":"2023-10-16T12:58:55.677714+0000","last_peered":"2023-10-16T12:58:55.677714+0000","last_clean":"2023-10-16T12:58:55.677714+0000","last_became_active":"2023-10-16T12:58:50.668730+0000","last_became_peered":"2023-10-16T12:58:50.668730+0000","last_unstale":"2023-10-16T12:58:55.677714+0000","last_undegraded":"2023-10-16T12:58:55.677714+0000","last_fullsized":"2023-10-16T12:58:55.677714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:10.863857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.683389+0000","last_change":"2023-10-16T12:58:51.442613+0000","last_active":"2023-10-16T12:58:55.683389+0000","last_peered":"2023-10-16T12:58:55.683389+0000","last_clean":"2023-10-16T12:58:55.683389+0000","last_became_active":"2023-10-16T12:58:51.442369+0000","last_became_peered":"2023-10-16T12:58:51.442369+0000","last_unstale":"2023-10-16T12:58:55.683389+0000","last_undegraded":"2023-10-16T12:58:55.683389+0000","last_fullsized":"2023-10-16T12:58:55.683389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:40:36.060468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.426204+0000","last_change":"2023-10-16T12:58:55.698038+0000","last_active":"2023-10-16T12:58:56.426204+0000","last_peered":"2023-10-16T12:58:56.426204+0000","last_clean":"2023-10-16T12:58:56.426204+0000","last_became_active":"2023-10-16T12:58:55.697543+0000","last_became_peered":"2023-10-16T12:58:55.697543+0000","last_unstale":"2023-10-16T12:58:56.426204+0000","last_undegraded":"2023-10-16T12:58:56.426204+0000","last_fullsized":"2023-10-16T12:58:56.426204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:31:17.628395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705613+0000","last_change":"2023-10-16T12:58:50.682262+0000","last_active":"2023-10-16T12:58:55.705613+0000","last_peered":"2023-10-16T12:58:55.705613+0000","last_clean":"2023-10-16T12:58:55.705613+0000","last_became_active":"2023-10-16T12:58:50.681971+0000","last_became_peered":"2023-10-16T12:58:50.681971+0000","last_unstale":"2023-10-16T12:58:55.705613+0000","last_undegraded":"2023-10-16T12:58:55.705613+0000","last_fullsized":"2023-10-16T12:58:55.705613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:48:36.174987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.687168+0000","last_change":"2023-10-16T12:58:51.444120+0000","last_active":"2023-10-16T12:58:55.687168+0000","last_peered":"2023-10-16T12:58:55.687168+0000","last_clean":"2023-10-16T12:58:55.687168+0000","last_became_active":"2023-10-16T12:58:51.443932+0000","last_became_peered":"2023-10-16T12:58:51.443932+0000","last_unstale":"2023-10-16T12:58:55.687168+0000","last_undegraded":"2023-10-16T12:58:55.687168+0000","last_fullsized":"2023-10-16T12:58:55.687168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:59.501942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:56.425527+0000","last_change":"2023-10-16T12:58:55.705568+0000","last_active":"2023-10-16T12:58:56.425527+0000","last_peered":"2023-10-16T12:58:56.425527+0000","last_clean":"2023-10-16T12:58:56.425527+0000","last_became_active":"2023-10-16T12:58:55.705195+0000","last_became_peered":"2023-10-16T12:58:55.705195+0000","last_unstale":"2023-10-16T12:58:56.425527+0000","last_undegraded":"2023-10-16T12:58:56.425527+0000","last_fullsized":"2023-10-16T12:58:56.425527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:30:02.068649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.685246+0000","last_change":"2023-10-16T12:58:50.680178+0000","last_active":"2023-10-16T12:58:55.685246+0000","last_peered":"2023-10-16T12:58:55.685246+0000","last_clean":"2023-10-16T12:58:55.685246+0000","last_became_active":"2023-10-16T12:58:50.679945+0000","last_became_peered":"2023-10-16T12:58:50.679945+0000","last_unstale":"2023-10-16T12:58:55.685246+0000","last_undegraded":"2023-10-16T12:58:55.685246+0000","last_fullsized":"2023-10-16T12:58:55.685246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:10.863857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.706307+0000","last_change":"2023-10-16T12:58:51.449653+0000","last_active":"2023-10-16T12:58:55.706307+0000","last_peered":"2023-10-16T12:58:55.706307+0000","last_clean":"2023-10-16T12:58:55.706307+0000","last_became_active":"2023-10-16T12:58:51.449109+0000","last_became_peered":"2023-10-16T12:58:51.449109+0000","last_unstale":"2023-10-16T12:58:55.706307+0000","last_undegraded":"2023-10-16T12:58:55.706307+0000","last_fullsized":"2023-10-16T12:58:55.706307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:15.698887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072205+0000","last_change":"2023-10-16T12:58:55.702012+0000","last_active":"2023-10-16T12:58:57.072205+0000","last_peered":"2023-10-16T12:58:57.072205+0000","last_clean":"2023-10-16T12:58:57.072205+0000","last_became_active":"2023-10-16T12:58:55.701622+0000","last_became_peered":"2023-10-16T12:58:55.701622+0000","last_unstale":"2023-10-16T12:58:57.072205+0000","last_undegraded":"2023-10-16T12:58:57.072205+0000","last_fullsized":"2023-10-16T12:58:57.072205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:37.747199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679482+0000","last_change":"2023-10-16T12:58:50.669769+0000","last_active":"2023-10-16T12:58:55.679482+0000","last_peered":"2023-10-16T12:58:55.679482+0000","last_clean":"2023-10-16T12:58:55.679482+0000","last_became_active":"2023-10-16T12:58:50.669513+0000","last_became_peered":"2023-10-16T12:58:50.669513+0000","last_unstale":"2023-10-16T12:58:55.679482+0000","last_undegraded":"2023-10-16T12:58:55.679482+0000","last_fullsized":"2023-10-16T12:58:55.679482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:00:22.709075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679131+0000","last_change":"2023-10-16T12:58:51.440492+0000","last_active":"2023-10-16T12:58:55.679131+0000","last_peered":"2023-10-16T12:58:55.679131+0000","last_clean":"2023-10-16T12:58:55.679131+0000","last_became_active":"2023-10-16T12:58:51.440223+0000","last_became_peered":"2023-10-16T12:58:51.440223+0000","last_unstale":"2023-10-16T12:58:55.679131+0000","last_undegraded":"2023-10-16T12:58:55.679131+0000","last_fullsized":"2023-10-16T12:58:55.679131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:29:58.046253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T12:58:57.072507+0000","last_change":"2023-10-16T12:58:55.709910+0000","last_active":"2023-10-16T12:58:57.072507+0000","last_peered":"2023-10-16T12:58:57.072507+0000","last_clean":"2023-10-16T12:58:57.072507+0000","last_became_active":"2023-10-16T12:58:55.709448+0000","last_became_peered":"2023-10-16T12:58:55.709448+0000","last_unstale":"2023-10-16T12:58:57.072507+0000","last_undegraded":"2023-10-16T12:58:57.072507+0000","last_fullsized":"2023-10-16T12:58:57.072507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:54.671733+0000","last_clean_scrub_stamp":"2023-10-16T12:58:54.671733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:10:14.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686015+0000","last_change":"2023-10-16T12:58:50.677056+0000","last_active":"2023-10-16T12:58:55.686015+0000","last_peered":"2023-10-16T12:58:55.686015+0000","last_clean":"2023-10-16T12:58:55.686015+0000","last_became_active":"2023-10-16T12:58:50.676784+0000","last_became_peered":"2023-10-16T12:58:50.676784+0000","last_unstale":"2023-10-16T12:58:55.686015+0000","last_undegraded":"2023-10-16T12:58:55.686015+0000","last_fullsized":"2023-10-16T12:58:55.686015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:49.643612+0000","last_clean_scrub_stamp":"2023-10-16T12:58:49.643612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:20.511820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.705640+0000","last_change":"2023-10-16T12:58:51.451103+0000","last_active":"2023-10-16T12:58:55.705640+0000","last_peered":"2023-10-16T12:58:55.705640+0000","last_clean":"2023-10-16T12:58:55.705640+0000","last_became_active":"2023-10-16T12:58:51.449605+0000","last_became_peered":"2023-10-16T12:58:51.449605+0000","last_unstale":"2023-10-16T12:58:55.705640+0000","last_undegraded":"2023-10-16T12:58:55.705640+0000","last_fullsized":"2023-10-16T12:58:55.705640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:36:33.724803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686013+0000","last_change":"2023-10-16T12:58:51.439877+0000","last_active":"2023-10-16T12:58:55.686013+0000","last_peered":"2023-10-16T12:58:55.686013+0000","last_clean":"2023-10-16T12:58:55.686013+0000","last_became_active":"2023-10-16T12:58:51.439574+0000","last_became_peered":"2023-10-16T12:58:51.439574+0000","last_unstale":"2023-10-16T12:58:55.686013+0000","last_undegraded":"2023-10-16T12:58:55.686013+0000","last_fullsized":"2023-10-16T12:58:55.686013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:40:36.060468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.684614+0000","last_change":"2023-10-16T12:58:51.444297+0000","last_active":"2023-10-16T12:58:55.684614+0000","last_peered":"2023-10-16T12:58:55.684614+0000","last_clean":"2023-10-16T12:58:55.684614+0000","last_became_active":"2023-10-16T12:58:51.444044+0000","last_became_peered":"2023-10-16T12:58:51.444044+0000","last_unstale":"2023-10-16T12:58:55.684614+0000","last_undegraded":"2023-10-16T12:58:55.684614+0000","last_fullsized":"2023-10-16T12:58:55.684614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:56.488214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.678833+0000","last_change":"2023-10-16T12:58:51.438825+0000","last_active":"2023-10-16T12:58:55.678833+0000","last_peered":"2023-10-16T12:58:55.678833+0000","last_clean":"2023-10-16T12:58:55.678833+0000","last_became_active":"2023-10-16T12:58:51.438444+0000","last_became_peered":"2023-10-16T12:58:51.438444+0000","last_unstale":"2023-10-16T12:58:55.678833+0000","last_undegraded":"2023-10-16T12:58:55.678833+0000","last_fullsized":"2023-10-16T12:58:55.678833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:41:33.353000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.692498+0000","last_change":"2023-10-16T12:58:51.442368+0000","last_active":"2023-10-16T12:58:55.692498+0000","last_peered":"2023-10-16T12:58:55.692498+0000","last_clean":"2023-10-16T12:58:55.692498+0000","last_became_active":"2023-10-16T12:58:51.442108+0000","last_became_peered":"2023-10-16T12:58:51.442108+0000","last_unstale":"2023-10-16T12:58:55.692498+0000","last_undegraded":"2023-10-16T12:58:55.692498+0000","last_fullsized":"2023-10-16T12:58:55.692498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:08:59.501942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.693864+0000","last_change":"2023-10-16T12:58:51.441274+0000","last_active":"2023-10-16T12:58:55.693864+0000","last_peered":"2023-10-16T12:58:55.693864+0000","last_clean":"2023-10-16T12:58:55.693864+0000","last_became_active":"2023-10-16T12:58:51.441004+0000","last_became_peered":"2023-10-16T12:58:51.441004+0000","last_unstale":"2023-10-16T12:58:55.693864+0000","last_undegraded":"2023-10-16T12:58:55.693864+0000","last_fullsized":"2023-10-16T12:58:55.693864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:28:04.262253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.679247+0000","last_change":"2023-10-16T12:58:51.437880+0000","last_active":"2023-10-16T12:58:55.679247+0000","last_peered":"2023-10-16T12:58:55.679247+0000","last_clean":"2023-10-16T12:58:55.679247+0000","last_became_active":"2023-10-16T12:58:51.437590+0000","last_became_peered":"2023-10-16T12:58:51.437590+0000","last_unstale":"2023-10-16T12:58:55.679247+0000","last_undegraded":"2023-10-16T12:58:55.679247+0000","last_fullsized":"2023-10-16T12:58:55.679247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:28:04.262253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686716+0000","last_change":"2023-10-16T12:58:51.447018+0000","last_active":"2023-10-16T12:58:55.686716+0000","last_peered":"2023-10-16T12:58:55.686716+0000","last_clean":"2023-10-16T12:58:55.686716+0000","last_became_active":"2023-10-16T12:58:51.446732+0000","last_became_peered":"2023-10-16T12:58:51.446732+0000","last_unstale":"2023-10-16T12:58:55.686716+0000","last_undegraded":"2023-10-16T12:58:55.686716+0000","last_fullsized":"2023-10-16T12:58:55.686716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:29:51.422601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688954+0000","last_change":"2023-10-16T12:58:51.441277+0000","last_active":"2023-10-16T12:58:55.688954+0000","last_peered":"2023-10-16T12:58:55.688954+0000","last_clean":"2023-10-16T12:58:55.688954+0000","last_became_active":"2023-10-16T12:58:51.441023+0000","last_became_peered":"2023-10-16T12:58:51.441023+0000","last_unstale":"2023-10-16T12:58:55.688954+0000","last_undegraded":"2023-10-16T12:58:55.688954+0000","last_fullsized":"2023-10-16T12:58:55.688954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:17:35.655947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.680294+0000","last_change":"2023-10-16T12:58:51.443020+0000","last_active":"2023-10-16T12:58:55.680294+0000","last_peered":"2023-10-16T12:58:55.680294+0000","last_clean":"2023-10-16T12:58:55.680294+0000","last_became_active":"2023-10-16T12:58:51.442541+0000","last_became_peered":"2023-10-16T12:58:51.442541+0000","last_unstale":"2023-10-16T12:58:55.680294+0000","last_undegraded":"2023-10-16T12:58:55.680294+0000","last_fullsized":"2023-10-16T12:58:55.680294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:31:13.605999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.688993+0000","last_change":"2023-10-16T12:58:51.441436+0000","last_active":"2023-10-16T12:58:55.688993+0000","last_peered":"2023-10-16T12:58:55.688993+0000","last_clean":"2023-10-16T12:58:55.688993+0000","last_became_active":"2023-10-16T12:58:51.441145+0000","last_became_peered":"2023-10-16T12:58:51.441145+0000","last_unstale":"2023-10-16T12:58:55.688993+0000","last_undegraded":"2023-10-16T12:58:55.688993+0000","last_fullsized":"2023-10-16T12:58:55.688993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:17:48.087275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.678940+0000","last_change":"2023-10-16T12:58:51.449786+0000","last_active":"2023-10-16T12:58:55.678940+0000","last_peered":"2023-10-16T12:58:55.678940+0000","last_clean":"2023-10-16T12:58:55.678940+0000","last_became_active":"2023-10-16T12:58:51.449513+0000","last_became_peered":"2023-10-16T12:58:51.449513+0000","last_unstale":"2023-10-16T12:58:55.678940+0000","last_undegraded":"2023-10-16T12:58:55.678940+0000","last_fullsized":"2023-10-16T12:58:55.678940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:42:07.880003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.692580+0000","last_change":"2023-10-16T12:58:51.446178+0000","last_active":"2023-10-16T12:58:55.692580+0000","last_peered":"2023-10-16T12:58:55.692580+0000","last_clean":"2023-10-16T12:58:55.692580+0000","last_became_active":"2023-10-16T12:58:51.445995+0000","last_became_peered":"2023-10-16T12:58:51.445995+0000","last_unstale":"2023-10-16T12:58:55.692580+0000","last_undegraded":"2023-10-16T12:58:55.692580+0000","last_fullsized":"2023-10-16T12:58:55.692580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:40:36.060468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T12:58:55.686445+0000","last_change":"2023-10-16T12:58:51.444064+0000","last_active":"2023-10-16T12:58:55.686445+0000","last_peered":"2023-10-16T12:58:55.686445+0000","last_clean":"2023-10-16T12:58:55.686445+0000","last_became_active":"2023-10-16T12:58:51.443873+0000","last_became_peered":"2023-10-16T12:58:51.443873+0000","last_unstale":"2023-10-16T12:58:55.686445+0000","last_undegraded":"2023-10-16T12:58:55.686445+0000","last_fullsized":"2023-10-16T12:58:55.686445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:50.649337+0000","last_clean_scrub_stamp":"2023-10-16T12:58:50.649337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:48:37.180712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.58}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5129999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1190000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.090999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.076000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.883}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.993}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6150000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8210000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8559999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0190000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.873}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T12:59:14.919 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-16T12:59:14.919 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-16T12:59:14.919 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-16T12:59:14.920 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-16T12:59:15.070 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.069+0000 7f427ed07700 1 Processor -- start 2023-10-16T12:59:15.071 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.069+0000 7f427ed07700 1 -- start start 2023-10-16T12:59:15.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.069+0000 7f427ed07700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42780712e0 0x7f42780716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:15.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.069+0000 7f427ed07700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f427806cf10 0x7f427806d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:15.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.069+0000 7f427ed07700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f427806a820 0x7f427806acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:15.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.069+0000 7f427ed07700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4278071c00 con 0x7f427806cf10 2023-10-16T12:59:15.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.069+0000 7f427ed07700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f427806d9d0 con 0x7f427806a820 2023-10-16T12:59:15.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.069+0000 7f427ed07700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427806dcb0 con 0x7f42780712e0 2023-10-16T12:59:15.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.070+0000 7f4277fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f427806cf10 0x7f427806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:15.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.070+0000 7f4277fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f427806cf10 0x7f427806d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53970/0 (socket says 172.21.15.124:53970) 2023-10-16T12:59:15.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.070+0000 7f4277fff700 1 -- 172.21.15.124:0/1139416568 learned_addr learned my addr 172.21.15.124:0/1139416568 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:15.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.070+0000 7f427d2a4700 1 --2- 172.21.15.124:0/1139416568 >> v2:172.21.15.192:3300/0 conn(0x7f427806a820 0x7f427806acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:15.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.070+0000 7f4277fff700 1 -- 172.21.15.124:0/1139416568 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42780712e0 msgr2=0x7f42780716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:15.076 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.070+0000 7f427caa3700 1 --2- 172.21.15.124:0/1139416568 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42780712e0 0x7f42780716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:15.076 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.070+0000 7f4277fff700 1 --2- 172.21.15.124:0/1139416568 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42780712e0 0x7f42780716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.076 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.070+0000 7f4277fff700 1 -- 172.21.15.124:0/1139416568 >> v2:172.21.15.192:3300/0 conn(0x7f427806a820 msgr2=0x7f427806acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:15.076 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.070+0000 7f4277fff700 1 --2- 172.21.15.124:0/1139416568 >> v2:172.21.15.192:3300/0 conn(0x7f427806a820 0x7f427806acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.076 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.070+0000 7f4277fff700 1 -- 172.21.15.124:0/1139416568 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42780ca420 con 0x7f427806cf10 2023-10-16T12:59:15.077 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.070+0000 7f427d2a4700 1 --2- 172.21.15.124:0/1139416568 >> v2:172.21.15.192:3300/0 conn(0x7f427806a820 0x7f427806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:15.077 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.070+0000 7f4277fff700 1 --2- 172.21.15.124:0/1139416568 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f427806cf10 0x7f427806d390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f42780ca050 tx=0x7f426400ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8339d77e88005837 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:15.077 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.070+0000 7f42777fe700 1 -- 172.21.15.124:0/1139416568 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426400cb70 con 0x7f427806cf10 2023-10-16T12:59:15.077 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.070+0000 7f42777fe700 1 -- 172.21.15.124:0/1139416568 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426400ccd0 con 0x7f427806cf10 2023-10-16T12:59:15.077 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.070+0000 7f42777fe700 1 -- 172.21.15.124:0/1139416568 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264018620 con 0x7f427806cf10 2023-10-16T12:59:15.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.071+0000 7f427ed07700 1 -- 172.21.15.124:0/1139416568 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f427806cf10 msgr2=0x7f427806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:15.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.071+0000 7f427ed07700 1 --2- 172.21.15.124:0/1139416568 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f427806cf10 0x7f427806d390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f42780ca050 tx=0x7f426400ad70 comp rx=0 tx=0).stop 2023-10-16T12:59:15.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.071+0000 7f427ed07700 1 -- 172.21.15.124:0/1139416568 shutdown_connections 2023-10-16T12:59:15.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.071+0000 7f427ed07700 1 --2- 172.21.15.124:0/1139416568 >> v2:172.21.15.192:3300/0 conn(0x7f427806a820 0x7f427806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.071+0000 7f427ed07700 1 --2- 172.21.15.124:0/1139416568 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42780712e0 0x7f42780716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.071+0000 7f427ed07700 1 --2- 172.21.15.124:0/1139416568 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f427806cf10 0x7f427806d390 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.071+0000 7f427ed07700 1 -- 172.21.15.124:0/1139416568 >> 172.21.15.124:0/1139416568 conn(0x7f42780cfcd0 msgr2=0x7f42780d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:15.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.071+0000 7f427ed07700 1 -- 172.21.15.124:0/1139416568 shutdown_connections 2023-10-16T12:59:15.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.071+0000 7f427ed07700 1 -- 172.21.15.124:0/1139416568 wait complete. 2023-10-16T12:59:15.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.072+0000 7f427ed07700 1 Processor -- start 2023-10-16T12:59:15.080 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.072+0000 7f427ed07700 1 -- start start 2023-10-16T12:59:15.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.073+0000 7f427ed07700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f427806a820 0x7f4278145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:15.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.073+0000 7f427ed07700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f427806cf10 0x7f42780cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:15.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.073+0000 7f427ed07700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42780712e0 0x7f42780cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:15.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.073+0000 7f427ed07700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42780c8860 con 0x7f427806a820 2023-10-16T12:59:15.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.073+0000 7f427ed07700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42780c7a00 con 0x7f42780712e0 2023-10-16T12:59:15.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.073+0000 7f427ed07700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42780c7c50 con 0x7f427806cf10 2023-10-16T12:59:15.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.073+0000 7f427caa3700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f427806a820 0x7f4278145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:15.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.073+0000 7f427caa3700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f427806a820 0x7f4278145890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53974/0 (socket says 172.21.15.124:53974) 2023-10-16T12:59:15.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.073+0000 7f427caa3700 1 -- 172.21.15.124:0/2480622362 learned_addr learned my addr 172.21.15.124:0/2480622362 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:15.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.073+0000 7f427d2a4700 1 --2- 172.21.15.124:0/2480622362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42780712e0 0x7f42780cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:15.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.073+0000 7f4277fff700 1 --2- 172.21.15.124:0/2480622362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f427806cf10 0x7f42780cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:15.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.073+0000 7f427caa3700 1 -- 172.21.15.124:0/2480622362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f427806cf10 msgr2=0x7f42780cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:15.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.073+0000 7f427caa3700 1 --2- 172.21.15.124:0/2480622362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f427806cf10 0x7f42780cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.073+0000 7f427caa3700 1 -- 172.21.15.124:0/2480622362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42780712e0 msgr2=0x7f42780cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:15.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.073+0000 7f427caa3700 1 --2- 172.21.15.124:0/2480622362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42780712e0 0x7f42780cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.073+0000 7f427caa3700 1 -- 172.21.15.124:0/2480622362 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426400a6f0 con 0x7f427806a820 2023-10-16T12:59:15.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.073+0000 7f427caa3700 1 --2- 172.21.15.124:0/2480622362 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f427806a820 0x7f4278145890 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f426c00c7f0 tx=0x7f426c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:15.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.074+0000 7f42757fa700 1 -- 172.21.15.124:0/2480622362 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c011800 con 0x7f427806a820 2023-10-16T12:59:15.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.074+0000 7f42757fa700 1 -- 172.21.15.124:0/2480622362 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c011960 con 0x7f427806a820 2023-10-16T12:59:15.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.074+0000 7f427ed07700 1 -- 172.21.15.124:0/2480622362 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42780c7f30 con 0x7f427806a820 2023-10-16T12:59:15.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.074+0000 7f42757fa700 1 -- 172.21.15.124:0/2480622362 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c011cf0 con 0x7f427806a820 2023-10-16T12:59:15.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.074+0000 7f427ed07700 1 -- 172.21.15.124:0/2480622362 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42780c84f0 con 0x7f427806a820 2023-10-16T12:59:15.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.074+0000 7f427ed07700 1 -- 172.21.15.124:0/2480622362 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427804ebb0 con 0x7f427806a820 2023-10-16T12:59:15.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.075+0000 7f42757fa700 1 -- 172.21.15.124:0/2480622362 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f426c018360 con 0x7f427806a820 2023-10-16T12:59:15.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.075+0000 7f42757fa700 1 --2- 172.21.15.124:0/2480622362 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f425c06af30 0x7f425c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:15.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.075+0000 7f42757fa700 1 -- 172.21.15.124:0/2480622362 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f426c089890 con 0x7f427806a820 2023-10-16T12:59:15.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.075+0000 7f4277fff700 1 --2- 172.21.15.124:0/2480622362 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f425c06af30 0x7f425c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:15.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.076+0000 7f4277fff700 1 --2- 172.21.15.124:0/2480622362 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f425c06af30 0x7f425c06d3f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f42780c9050 tx=0x7f4264012000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:15.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.080+0000 7f42757fa700 1 -- 172.21.15.124:0/2480622362 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f426c054660 con 0x7f427806a820 2023-10-16T12:59:15.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.314+0000 7f427ed07700 1 -- 172.21.15.124:0/2480622362 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f42780b19b0 con 0x7f427806a820 2023-10-16T12:59:15.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.314+0000 7f42757fa700 1 -- 172.21.15.124:0/2480622362 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f426c057c80 con 0x7f427806a820 2023-10-16T12:59:15.317 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:15.317 INFO:teuthology.orchestra.run.smithi124.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-16T12:59:15.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.316+0000 7f427ed07700 1 -- 172.21.15.124:0/2480622362 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f425c06af30 msgr2=0x7f425c06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:15.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.316+0000 7f427ed07700 1 --2- 172.21.15.124:0/2480622362 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f425c06af30 0x7f425c06d3f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f42780c9050 tx=0x7f4264012000 comp rx=0 tx=0).stop 2023-10-16T12:59:15.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.316+0000 7f427ed07700 1 -- 172.21.15.124:0/2480622362 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f427806a820 msgr2=0x7f4278145890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:15.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.316+0000 7f427ed07700 1 --2- 172.21.15.124:0/2480622362 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f427806a820 0x7f4278145890 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f426c00c7f0 tx=0x7f426c00cbb0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.316+0000 7f427ed07700 1 -- 172.21.15.124:0/2480622362 shutdown_connections 2023-10-16T12:59:15.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.316+0000 7f427ed07700 1 --2- 172.21.15.124:0/2480622362 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f425c06af30 0x7f425c06d3f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.316+0000 7f427ed07700 1 --2- 172.21.15.124:0/2480622362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42780712e0 0x7f42780cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.316+0000 7f427ed07700 1 --2- 172.21.15.124:0/2480622362 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f427806a820 0x7f4278145890 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.316+0000 7f427ed07700 1 --2- 172.21.15.124:0/2480622362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f427806cf10 0x7f42780cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.316+0000 7f427ed07700 1 -- 172.21.15.124:0/2480622362 >> 172.21.15.124:0/2480622362 conn(0x7f42780cfcd0 msgr2=0x7f4278150e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:15.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.316+0000 7f427ed07700 1 -- 172.21.15.124:0/2480622362 shutdown_connections 2023-10-16T12:59:15.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.317+0000 7f427ed07700 1 -- 172.21.15.124:0/2480622362 wait complete. 2023-10-16T12:59:15.330 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-16T12:59:15.331 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:59:15.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.450+0000 7fa64907d700 1 Processor -- start 2023-10-16T12:59:15.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.450+0000 7fa64907d700 1 -- start start 2023-10-16T12:59:15.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.451+0000 7fa64907d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa64415e7f0 0x7fa644071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:15.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.451+0000 7fa64907d700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6440cfeb0 con 0x7fa6440cf7d0 2023-10-16T12:59:15.455 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.451+0000 7fa64907d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6440cfc30 con 0x7fa64406a820 2023-10-16T12:59:15.455 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.451+0000 7fa64907d700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6440ce410 con 0x7fa64415e7f0 2023-10-16T12:59:15.455 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.451+0000 7fa64359e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa64415e7f0 0x7fa644071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:15.455 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.451+0000 7fa64259c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fa6440cf7d0 0x7fa6440ca7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42650/0 (socket says 172.21.15.124:42650) 2023-10-16T12:59:15.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.451+0000 7fa64259c700 1 -- 172.21.15.124:0/2782060031 learned_addr learned my addr 172.21.15.124:0/2782060031 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:15.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.451+0000 7fa64359e700 1 -- 172.21.15.124:0/2782060031 >> v1:172.21.15.192:6789/0 conn(0x7fa64406a820 legacy=0x7fa64406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:15.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.451+0000 7fa64359e700 1 -- 172.21.15.124:0/2782060031 >> v1:172.21.15.124:6789/0 conn(0x7fa6440cf7d0 legacy=0x7fa6440ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:15.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.451+0000 7fa64359e700 1 -- 172.21.15.124:0/2782060031 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6440af9d0 con 0x7fa64415e7f0 2023-10-16T12:59:15.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.451+0000 7fa641d9b700 1 -- 172.21.15.124:0/2782060031 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 774522532 0 0) 0x7fa6440cfeb0 con 0x7fa6440cf7d0 2023-10-16T12:59:15.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.451+0000 7fa64359e700 1 --2- 172.21.15.124:0/2782060031 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa64415e7f0 0x7fa644071ea0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009d90 tx=0x7fa63c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf964072a498da6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:15.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.451+0000 7fa641d9b700 1 -- 172.21.15.124:0/2782060031 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c00e070 con 0x7fa64415e7f0 2023-10-16T12:59:15.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.452+0000 7fa641d9b700 1 -- 172.21.15.124:0/2782060031 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63c00bbd0 con 0x7fa64415e7f0 2023-10-16T12:59:15.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.452+0000 7fa641d9b700 1 -- 172.21.15.124:0/2782060031 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c003a70 con 0x7fa64415e7f0 2023-10-16T12:59:15.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.452+0000 7fa64907d700 1 -- 172.21.15.124:0/2782060031 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa64415e7f0 msgr2=0x7fa644071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:15.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.452+0000 7fa64907d700 1 --2- 172.21.15.124:0/2782060031 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa64415e7f0 0x7fa644071ea0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009d90 tx=0x7fa63c00b330 comp rx=0 tx=0).stop 2023-10-16T12:59:15.458 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.452+0000 7fa64907d700 1 -- 172.21.15.124:0/2782060031 shutdown_connections 2023-10-16T12:59:15.458 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.452+0000 7fa64907d700 1 --2- 172.21.15.124:0/2782060031 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa64415e7f0 0x7fa644071ea0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.458 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.452+0000 7fa64907d700 1 -- 172.21.15.124:0/2782060031 >> 172.21.15.124:0/2782060031 conn(0x7fa6440d0180 msgr2=0x7fa6440d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:15.458 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.452+0000 7fa64907d700 1 -- 172.21.15.124:0/2782060031 shutdown_connections 2023-10-16T12:59:15.458 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.452+0000 7fa64907d700 1 -- 172.21.15.124:0/2782060031 wait complete. 2023-10-16T12:59:15.461 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.454+0000 7fa64907d700 1 Processor -- start 2023-10-16T12:59:15.461 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.454+0000 7fa64907d700 1 -- start start 2023-10-16T12:59:15.461 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.454+0000 7fa64907d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa64406a820 0x7fa64414a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:15.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.454+0000 7fa64907d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa6440cf7d0 0x7fa644161260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:15.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.454+0000 7fa64907d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa64415e7f0 0x7fa6440afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:15.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.454+0000 7fa64907d700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6440b2b00 con 0x7fa6440cf7d0 2023-10-16T12:59:15.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.454+0000 7fa64907d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa644160dd0 con 0x7fa64406a820 2023-10-16T12:59:15.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.454+0000 7fa64907d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6440b2540 con 0x7fa64415e7f0 2023-10-16T12:59:15.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.454+0000 7fa64259c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa6440cf7d0 0x7fa644161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:15.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.454+0000 7fa64259c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa6440cf7d0 0x7fa644161260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:53988/0 (socket says 172.21.15.124:53988) 2023-10-16T12:59:15.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.454+0000 7fa64259c700 1 -- 172.21.15.124:0/1622637131 learned_addr learned my addr 172.21.15.124:0/1622637131 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:15.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.455+0000 7fa642d9d700 1 --2- 172.21.15.124:0/1622637131 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa64406a820 0x7fa64414a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:15.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.455+0000 7fa64359e700 1 --2- 172.21.15.124:0/1622637131 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa64415e7f0 0x7fa6440afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:15.464 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.455+0000 7fa64259c700 1 -- 172.21.15.124:0/1622637131 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa64415e7f0 msgr2=0x7fa6440afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:15.464 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.455+0000 7fa64259c700 1 --2- 172.21.15.124:0/1622637131 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa64415e7f0 0x7fa6440afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.464 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.455+0000 7fa64259c700 1 -- 172.21.15.124:0/1622637131 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa64406a820 msgr2=0x7fa64414a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:15.464 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.455+0000 7fa64259c700 1 --2- 172.21.15.124:0/1622637131 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa64406a820 0x7fa64414a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.464 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.455+0000 7fa64259c700 1 -- 172.21.15.124:0/1622637131 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c009a70 con 0x7fa6440cf7d0 2023-10-16T12:59:15.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.455+0000 7fa64259c700 1 --2- 172.21.15.124:0/1622637131 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa6440cf7d0 0x7fa644161260 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa63400c750 tx=0x7fa63400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:15.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.455+0000 7fa62b7fe700 1 -- 172.21.15.124:0/1622637131 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa634004c80 con 0x7fa6440cf7d0 2023-10-16T12:59:15.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.455+0000 7fa62b7fe700 1 -- 172.21.15.124:0/1622637131 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa634004e00 con 0x7fa6440cf7d0 2023-10-16T12:59:15.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.455+0000 7fa64907d700 1 -- 172.21.15.124:0/1622637131 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6440b2820 con 0x7fa6440cf7d0 2023-10-16T12:59:15.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.455+0000 7fa62b7fe700 1 -- 172.21.15.124:0/1622637131 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa634007310 con 0x7fa6440cf7d0 2023-10-16T12:59:15.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.455+0000 7fa64907d700 1 -- 172.21.15.124:0/1622637131 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6441617a0 con 0x7fa6440cf7d0 2023-10-16T12:59:15.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.456+0000 7fa64907d700 1 -- 172.21.15.124:0/1622637131 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa64404ebb0 con 0x7fa6440cf7d0 2023-10-16T12:59:15.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.456+0000 7fa62b7fe700 1 -- 172.21.15.124:0/1622637131 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa634007470 con 0x7fa6440cf7d0 2023-10-16T12:59:15.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.457+0000 7fa62b7fe700 1 --2- 172.21.15.124:0/1622637131 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa63006af00 0x7fa63006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:15.467 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.457+0000 7fa62b7fe700 1 -- 172.21.15.124:0/1622637131 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa634089590 con 0x7fa6440cf7d0 2023-10-16T12:59:15.467 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.457+0000 7fa642d9d700 1 --2- 172.21.15.124:0/1622637131 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa63006af00 0x7fa63006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:15.467 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.457+0000 7fa642d9d700 1 --2- 172.21.15.124:0/1622637131 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa63006af00 0x7fa63006d3c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa638004f30 tx=0x7fa638009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:15.467 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.461+0000 7fa62b7fe700 1 -- 172.21.15.124:0/1622637131 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa6340543e0 con 0x7fa6440cf7d0 2023-10-16T12:59:15.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.652+0000 7fa64907d700 1 -- 172.21.15.124:0/1622637131 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa644160f10 con 0x7fa6440cf7d0 2023-10-16T12:59:15.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.653+0000 7fa62b7fe700 1 -- 172.21.15.124:0/1622637131 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fa634057a00 con 0x7fa6440cf7d0 2023-10-16T12:59:15.657 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:15.657 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":24,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:58:56.089767+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:59:15.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.656+0000 7fa64907d700 1 -- 172.21.15.124:0/1622637131 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa63006af00 msgr2=0x7fa63006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:15.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.656+0000 7fa64907d700 1 --2- 172.21.15.124:0/1622637131 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa63006af00 0x7fa63006d3c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa638004f30 tx=0x7fa638009040 comp rx=0 tx=0).stop 2023-10-16T12:59:15.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.656+0000 7fa64907d700 1 -- 172.21.15.124:0/1622637131 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa6440cf7d0 msgr2=0x7fa644161260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:15.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.656+0000 7fa64907d700 1 --2- 172.21.15.124:0/1622637131 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa6440cf7d0 0x7fa644161260 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa63400c750 tx=0x7fa63400cb10 comp rx=0 tx=0).stop 2023-10-16T12:59:15.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.656+0000 7fa64907d700 1 -- 172.21.15.124:0/1622637131 shutdown_connections 2023-10-16T12:59:15.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.656+0000 7fa64907d700 1 --2- 172.21.15.124:0/1622637131 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa63006af00 0x7fa63006d3c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.656+0000 7fa64907d700 1 --2- 172.21.15.124:0/1622637131 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa64415e7f0 0x7fa6440afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.656+0000 7fa64907d700 1 --2- 172.21.15.124:0/1622637131 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa64406a820 0x7fa64414a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.656+0000 7fa64907d700 1 --2- 172.21.15.124:0/1622637131 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa6440cf7d0 0x7fa644161260 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.656+0000 7fa64907d700 1 -- 172.21.15.124:0/1622637131 >> 172.21.15.124:0/1622637131 conn(0x7fa6440d0180 msgr2=0x7fa64406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:15.661 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.656+0000 7fa64907d700 1 -- 172.21.15.124:0/1622637131 shutdown_connections 2023-10-16T12:59:15.661 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.656+0000 7fa64907d700 1 -- 172.21.15.124:0/1622637131 wait complete. 2023-10-16T12:59:15.670 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T12:58:38.667813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T12:58:49.562073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T12:58:50.011419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T12:58:53.692890+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T12:59:15.670 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T12:59:15.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.791+0000 7f6f277ac700 1 Processor -- start 2023-10-16T12:59:15.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.791+0000 7f6f277ac700 1 -- start start 2023-10-16T12:59:15.797 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.792+0000 7f6f277ac700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6f2015b4e0 0x7f6f2006f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:15.797 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.792+0000 7f6f277ac700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f200cd770 0x7f6f200b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:15.797 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.792+0000 7f6f277ac700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f20070620 con 0x7f6f200b3220 2023-10-16T12:59:15.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.792+0000 7f6f277ac700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f200b36b0 con 0x7f6f2015b4e0 2023-10-16T12:59:15.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.792+0000 7f6f277ac700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f20070900 con 0x7f6f200cd770 2023-10-16T12:59:15.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.792+0000 7f6f25d49700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f6f200b3220 0x7f6f200cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42666/0 (socket says 172.21.15.124:42666) 2023-10-16T12:59:15.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.792+0000 7f6f25d49700 1 -- 172.21.15.124:0/2363596427 learned_addr learned my addr 172.21.15.124:0/2363596427 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:15.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f25548700 1 --2- 172.21.15.124:0/2363596427 >> v2:172.21.15.192:3300/0 conn(0x7f6f2015b4e0 0x7f6f2006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:15.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f24d47700 1 --2- 172.21.15.124:0/2363596427 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f200cd770 0x7f6f200b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:15.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f17fff700 1 -- 172.21.15.124:0/2363596427 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1458019246 0 0) 0x7f6f20070620 con 0x7f6f200b3220 2023-10-16T12:59:15.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f17fff700 1 -- 172.21.15.124:0/2363596427 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f0c0035b0 con 0x7f6f200b3220 2023-10-16T12:59:15.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f17fff700 1 -- 172.21.15.124:0/2363596427 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3686714230 0 0) 0x7f6f0c0035b0 con 0x7f6f200b3220 2023-10-16T12:59:15.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f17fff700 1 -- 172.21.15.124:0/2363596427 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f200cd770 msgr2=0x7f6f200b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:15.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f17fff700 1 --2- 172.21.15.124:0/2363596427 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f200cd770 0x7f6f200b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f17fff700 1 -- 172.21.15.124:0/2363596427 >> v2:172.21.15.192:3300/0 conn(0x7f6f2015b4e0 msgr2=0x7f6f2006f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:15.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f17fff700 1 --2- 172.21.15.124:0/2363596427 >> v2:172.21.15.192:3300/0 conn(0x7f6f2015b4e0 0x7f6f2006f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f17fff700 1 -- 172.21.15.124:0/2363596427 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f20070be0 con 0x7f6f200b3220 2023-10-16T12:59:15.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f17fff700 1 -- 172.21.15.124:0/2363596427 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f6f180019f0 con 0x7f6f200b3220 2023-10-16T12:59:15.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f17fff700 1 -- 172.21.15.124:0/2363596427 >> v1:172.21.15.124:6789/0 conn(0x7f6f200b3220 legacy=0x7f6f200cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:15.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f17fff700 1 --2- 172.21.15.124:0/2363596427 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f0c003a00 0x7f6f0c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:15.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f17fff700 1 --2- 172.21.15.124:0/2363596427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f0c004850 0x7f6f0c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:15.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f17fff700 1 --2- 172.21.15.124:0/2363596427 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f200cd770 0x7f6f0c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:15.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f17fff700 1 -- 172.21.15.124:0/2363596427 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f200b36b0 con 0x7f6f0c003a00 2023-10-16T12:59:15.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f17fff700 1 -- 172.21.15.124:0/2363596427 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f20070900 con 0x7f6f0c004850 2023-10-16T12:59:15.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f17fff700 1 -- 172.21.15.124:0/2363596427 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c00ba10 con 0x7f6f200cd770 2023-10-16T12:59:15.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f25548700 1 --2- 172.21.15.124:0/2363596427 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f0c003a00 0x7f6f0c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:15.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f24d47700 1 --2- 172.21.15.124:0/2363596427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f0c004850 0x7f6f0c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:15.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f25d49700 1 --2- 172.21.15.124:0/2363596427 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f200cd770 0x7f6f0c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:15.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f25548700 1 -- 172.21.15.124:0/2363596427 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f200cd770 msgr2=0x7f6f0c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:15.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f25548700 1 --2- 172.21.15.124:0/2363596427 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f200cd770 0x7f6f0c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f25548700 1 -- 172.21.15.124:0/2363596427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f0c004850 msgr2=0x7f6f0c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:15.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f25548700 1 --2- 172.21.15.124:0/2363596427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f0c004850 0x7f6f0c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.793+0000 7f6f25548700 1 -- 172.21.15.124:0/2363596427 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0c0035b0 con 0x7f6f0c003a00 2023-10-16T12:59:15.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.794+0000 7f6f25548700 1 --2- 172.21.15.124:0/2363596427 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f0c003a00 0x7f6f0c003e20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6f10009b60 tx=0x7f6f0c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48bb573c63cc7e31 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:15.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.794+0000 7f6f17fff700 1 -- 172.21.15.124:0/2363596427 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1000e6c0 con 0x7f6f0c003a00 2023-10-16T12:59:15.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.794+0000 7f6f17fff700 1 -- 172.21.15.124:0/2363596427 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1000e820 con 0x7f6f0c003a00 2023-10-16T12:59:15.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.794+0000 7f6f17fff700 1 -- 172.21.15.124:0/2363596427 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1000eb90 con 0x7f6f0c003a00 2023-10-16T12:59:15.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.794+0000 7f6f277ac700 1 -- 172.21.15.124:0/2363596427 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f0c003a00 msgr2=0x7f6f0c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:15.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.794+0000 7f6f277ac700 1 --2- 172.21.15.124:0/2363596427 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f0c003a00 0x7f6f0c003e20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6f10009b60 tx=0x7f6f0c005880 comp rx=0 tx=0).stop 2023-10-16T12:59:15.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.794+0000 7f6f25d49700 1 -- 172.21.15.124:0/2363596427 reap_dead start 2023-10-16T12:59:15.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.794+0000 7f6f277ac700 1 -- 172.21.15.124:0/2363596427 shutdown_connections 2023-10-16T12:59:15.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.794+0000 7f6f277ac700 1 -- 172.21.15.124:0/2363596427 >> 172.21.15.124:0/2363596427 conn(0x7f6f200cdce0 msgr2=0x7f6f200ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:15.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.794+0000 7f6f277ac700 1 -- 172.21.15.124:0/2363596427 shutdown_connections 2023-10-16T12:59:15.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.794+0000 7f6f277ac700 1 -- 172.21.15.124:0/2363596427 wait complete. 2023-10-16T12:59:15.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.796+0000 7f6f277ac700 1 Processor -- start 2023-10-16T12:59:15.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.796+0000 7f6f277ac700 1 -- start start 2023-10-16T12:59:15.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.796+0000 7f6f277ac700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f0c003a00 0x7f6f2015a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:15.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.796+0000 7f6f277ac700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f201e4800 0x7f6f201e4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:15.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.796+0000 7f6f277ac700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f201f1080 0x7f6f201f1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:15.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.796+0000 7f6f277ac700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2015a630 con 0x7f6f201e4800 2023-10-16T12:59:15.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.796+0000 7f6f277ac700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f201e6170 con 0x7f6f201f1080 2023-10-16T12:59:15.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.796+0000 7f6f277ac700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f201e5560 con 0x7f6f0c003a00 2023-10-16T12:59:15.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.796+0000 7f6f24d47700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f201e4800 0x7f6f201e4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:15.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.796+0000 7f6f24d47700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f201e4800 0x7f6f201e4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54006/0 (socket says 172.21.15.124:54006) 2023-10-16T12:59:15.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.796+0000 7f6f24d47700 1 -- 172.21.15.124:0/539348440 learned_addr learned my addr 172.21.15.124:0/539348440 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:15.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.797+0000 7f6f25d49700 1 --2- 172.21.15.124:0/539348440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f201f1080 0x7f6f201f1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:15.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.797+0000 7f6f25548700 1 --2- 172.21.15.124:0/539348440 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f0c003a00 0x7f6f2015a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:15.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.797+0000 7f6f24d47700 1 -- 172.21.15.124:0/539348440 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f0c003a00 msgr2=0x7f6f2015a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:15.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.797+0000 7f6f24d47700 1 --2- 172.21.15.124:0/539348440 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f0c003a00 0x7f6f2015a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.797+0000 7f6f24d47700 1 -- 172.21.15.124:0/539348440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f201f1080 msgr2=0x7f6f201f1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:15.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.797+0000 7f6f24d47700 1 --2- 172.21.15.124:0/539348440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f201f1080 0x7f6f201f1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.797+0000 7f6f24d47700 1 -- 172.21.15.124:0/539348440 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f201e5840 con 0x7f6f201e4800 2023-10-16T12:59:15.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.797+0000 7f6f25548700 1 --2- 172.21.15.124:0/539348440 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f0c003a00 0x7f6f2015a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:15.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.797+0000 7f6f24d47700 1 --2- 172.21.15.124:0/539348440 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f201e4800 0x7f6f201e4c80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0119c0 tx=0x7f6f1c011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:15.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.797+0000 7f6f15ffb700 1 -- 172.21.15.124:0/539348440 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c004240 con 0x7f6f201e4800 2023-10-16T12:59:15.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.797+0000 7f6f15ffb700 1 -- 172.21.15.124:0/539348440 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1c0043a0 con 0x7f6f201e4800 2023-10-16T12:59:15.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.797+0000 7f6f277ac700 1 -- 172.21.15.124:0/539348440 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f201e5b20 con 0x7f6f201e4800 2023-10-16T12:59:15.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.797+0000 7f6f15ffb700 1 -- 172.21.15.124:0/539348440 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c00f730 con 0x7f6f201e4800 2023-10-16T12:59:15.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.797+0000 7f6f277ac700 1 -- 172.21.15.124:0/539348440 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f201e51c0 con 0x7f6f201e4800 2023-10-16T12:59:15.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.798+0000 7f6f277ac700 1 -- 172.21.15.124:0/539348440 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f2004ebb0 con 0x7f6f201e4800 2023-10-16T12:59:15.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.799+0000 7f6f15ffb700 1 -- 172.21.15.124:0/539348440 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6f1c00f890 con 0x7f6f201e4800 2023-10-16T12:59:15.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.799+0000 7f6f15ffb700 1 --2- 172.21.15.124:0/539348440 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6f0406af00 0x7f6f0406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:15.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.799+0000 7f6f15ffb700 1 -- 172.21.15.124:0/539348440 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6f1c08a220 con 0x7f6f201e4800 2023-10-16T12:59:15.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.799+0000 7f6f25548700 1 --2- 172.21.15.124:0/539348440 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6f0406af00 0x7f6f0406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:15.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.800+0000 7f6f25548700 1 --2- 172.21.15.124:0/539348440 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6f0406af00 0x7f6f0406d3c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6f100090b0 tx=0x7f6f10008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:15.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.803+0000 7f6f15ffb700 1 -- 172.21.15.124:0/539348440 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6f1c0550c0 con 0x7f6f201e4800 2023-10-16T12:59:15.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.993+0000 7f6f277ac700 1 -- 172.21.15.124:0/539348440 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f201f0d30 con 0x7f6f201e4800 2023-10-16T12:59:15.996 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.994+0000 7f6f15ffb700 1 -- 172.21.15.124:0/539348440 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6f1c0586e0 con 0x7f6f201e4800 2023-10-16T12:59:15.996 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-16T12:59:15.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.996+0000 7f6f277ac700 1 -- 172.21.15.124:0/539348440 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6f0406af00 msgr2=0x7f6f0406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:15.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.996+0000 7f6f277ac700 1 --2- 172.21.15.124:0/539348440 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6f0406af00 0x7f6f0406d3c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6f100090b0 tx=0x7f6f10008030 comp rx=0 tx=0).stop 2023-10-16T12:59:15.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.996+0000 7f6f277ac700 1 -- 172.21.15.124:0/539348440 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f201e4800 msgr2=0x7f6f201e4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:15.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.996+0000 7f6f277ac700 1 --2- 172.21.15.124:0/539348440 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f201e4800 0x7f6f201e4c80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0119c0 tx=0x7f6f1c011cd0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.996+0000 7f6f277ac700 1 -- 172.21.15.124:0/539348440 shutdown_connections 2023-10-16T12:59:15.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.996+0000 7f6f277ac700 1 --2- 172.21.15.124:0/539348440 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6f0406af00 0x7f6f0406d3c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.996+0000 7f6f277ac700 1 --2- 172.21.15.124:0/539348440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f201f1080 0x7f6f201f1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.996+0000 7f6f277ac700 1 --2- 172.21.15.124:0/539348440 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f0c003a00 0x7f6f2015a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:15.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.996+0000 7f6f277ac700 1 --2- 172.21.15.124:0/539348440 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f201e4800 0x7f6f201e4c80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.996+0000 7f6f277ac700 1 -- 172.21.15.124:0/539348440 >> 172.21.15.124:0/539348440 conn(0x7f6f200cdce0 msgr2=0x7f6f200ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:16.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.996+0000 7f6f277ac700 1 -- 172.21.15.124:0/539348440 shutdown_connections 2023-10-16T12:59:16.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:15.996+0000 7f6f277ac700 1 -- 172.21.15.124:0/539348440 wait complete. 2023-10-16T12:59:16.009 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T12:59:16.133 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.131+0000 7f591d53e700 1 Processor -- start 2023-10-16T12:59:16.133 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.131+0000 7f591d53e700 1 -- start start 2023-10-16T12:59:16.135 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.132+0000 7f591d53e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5918161f30 0x7f59180cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:16.135 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.132+0000 7f591d53e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5918143ae0 0x7f59180cf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:16.135 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.132+0000 7f591d53e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59180b34f0 con 0x7f591815b210 2023-10-16T12:59:16.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.132+0000 7f591d53e700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5918161240 con 0x7f5918143ae0 2023-10-16T12:59:16.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.132+0000 7f591d53e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5918161450 con 0x7f5918161f30 2023-10-16T12:59:16.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.132+0000 7f59177fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5918143ae0 0x7f59180cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:16.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.132+0000 7f59177fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5918143ae0 0x7f59180cf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54018/0 (socket says 172.21.15.124:54018) 2023-10-16T12:59:16.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.132+0000 7f59177fe700 1 -- 172.21.15.124:0/4272053797 learned_addr learned my addr 172.21.15.124:0/4272053797 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:16.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.132+0000 7f59167fc700 1 --2- 172.21.15.124:0/4272053797 >> v2:172.21.15.192:3300/0 conn(0x7f5918161f30 0x7f59180cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:16.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.132+0000 7f59177fe700 1 -- 172.21.15.124:0/4272053797 >> v2:172.21.15.192:3300/0 conn(0x7f5918161f30 msgr2=0x7f59180cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:16.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.132+0000 7f59177fe700 1 --2- 172.21.15.124:0/4272053797 >> v2:172.21.15.192:3300/0 conn(0x7f5918161f30 0x7f59180cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.132+0000 7f59177fe700 1 -- 172.21.15.124:0/4272053797 >> v1:172.21.15.192:6789/0 conn(0x7f591815b210 legacy=0x7f59180b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:16.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.132+0000 7f59177fe700 1 -- 172.21.15.124:0/4272053797 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5918161730 con 0x7f5918143ae0 2023-10-16T12:59:16.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.132+0000 7f59167fc700 1 --2- 172.21.15.124:0/4272053797 >> v2:172.21.15.192:3300/0 conn(0x7f5918161f30 0x7f59180cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:16.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.132+0000 7f59177fe700 1 --2- 172.21.15.124:0/4272053797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5918143ae0 0x7f59180cf370 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5910009e50 tx=0x7f591000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60818aa62f66b138 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:16.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.132+0000 7f5915ffb700 1 -- 172.21.15.124:0/4272053797 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591000e070 con 0x7f5918143ae0 2023-10-16T12:59:16.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.133+0000 7f5915ffb700 1 -- 172.21.15.124:0/4272053797 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5910003a20 con 0x7f5918143ae0 2023-10-16T12:59:16.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.133+0000 7f5915ffb700 1 -- 172.21.15.124:0/4272053797 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5910003dd0 con 0x7f5918143ae0 2023-10-16T12:59:16.139 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.133+0000 7f591d53e700 1 -- 172.21.15.124:0/4272053797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5918143ae0 msgr2=0x7f59180cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:16.139 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.133+0000 7f591d53e700 1 --2- 172.21.15.124:0/4272053797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5918143ae0 0x7f59180cf370 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5910009e50 tx=0x7f591000b330 comp rx=0 tx=0).stop 2023-10-16T12:59:16.139 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.133+0000 7f591d53e700 1 -- 172.21.15.124:0/4272053797 shutdown_connections 2023-10-16T12:59:16.139 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.133+0000 7f591d53e700 1 --2- 172.21.15.124:0/4272053797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5918143ae0 0x7f59180cf370 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.139 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.133+0000 7f591d53e700 1 --2- 172.21.15.124:0/4272053797 >> v2:172.21.15.192:3300/0 conn(0x7f5918161f30 0x7f59180cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.140 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.133+0000 7f591d53e700 1 -- 172.21.15.124:0/4272053797 >> 172.21.15.124:0/4272053797 conn(0x7f59180cdce0 msgr2=0x7f59180ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:16.140 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.133+0000 7f591d53e700 1 -- 172.21.15.124:0/4272053797 shutdown_connections 2023-10-16T12:59:16.140 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.133+0000 7f591d53e700 1 -- 172.21.15.124:0/4272053797 wait complete. 2023-10-16T12:59:16.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.134+0000 7f591d53e700 1 Processor -- start 2023-10-16T12:59:16.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.134+0000 7f591d53e700 1 -- start start 2023-10-16T12:59:16.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.135+0000 7f591d53e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5918143ae0 0x7f591815c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:16.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.135+0000 7f591d53e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f591815b210 0x7f59180c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:16.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.135+0000 7f591d53e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5918161f30 0x7f5918144000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:16.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.135+0000 7f591d53e700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591815c6c0 con 0x7f5918161f30 2023-10-16T12:59:16.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.135+0000 7f591d53e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59180c4380 con 0x7f5918143ae0 2023-10-16T12:59:16.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.135+0000 7f591d53e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591815d990 con 0x7f591815b210 2023-10-16T12:59:16.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.135+0000 7f59177fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5918161f30 0x7f5918144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:16.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.135+0000 7f59177fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5918161f30 0x7f5918144000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54024/0 (socket says 172.21.15.124:54024) 2023-10-16T12:59:16.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.135+0000 7f59177fe700 1 -- 172.21.15.124:0/3113602415 learned_addr learned my addr 172.21.15.124:0/3113602415 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:16.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.136+0000 7f5916ffd700 1 --2- 172.21.15.124:0/3113602415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5918143ae0 0x7f591815c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:16.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.136+0000 7f59167fc700 1 --2- 172.21.15.124:0/3113602415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f591815b210 0x7f59180c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:16.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.136+0000 7f59177fe700 1 -- 172.21.15.124:0/3113602415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f591815b210 msgr2=0x7f59180c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:16.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.136+0000 7f59177fe700 1 --2- 172.21.15.124:0/3113602415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f591815b210 0x7f59180c3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.136+0000 7f59177fe700 1 -- 172.21.15.124:0/3113602415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5918143ae0 msgr2=0x7f591815c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:16.146 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.136+0000 7f59177fe700 1 --2- 172.21.15.124:0/3113602415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5918143ae0 0x7f591815c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.146 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.136+0000 7f59177fe700 1 -- 172.21.15.124:0/3113602415 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5910009b30 con 0x7f5918161f30 2023-10-16T12:59:16.146 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.136+0000 7f59167fc700 1 --2- 172.21.15.124:0/3113602415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f591815b210 0x7f59180c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:16.146 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.136+0000 7f59177fe700 1 --2- 172.21.15.124:0/3113602415 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5918161f30 0x7f5918144000 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f59180b3970 tx=0x7f5910004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:16.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.136+0000 7f58ff7fe700 1 -- 172.21.15.124:0/3113602415 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5910004440 con 0x7f5918161f30 2023-10-16T12:59:16.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.136+0000 7f58ff7fe700 1 -- 172.21.15.124:0/3113602415 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59100045e0 con 0x7f5918161f30 2023-10-16T12:59:16.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.136+0000 7f591d53e700 1 -- 172.21.15.124:0/3113602415 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f591815c8f0 con 0x7f5918161f30 2023-10-16T12:59:16.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.136+0000 7f58ff7fe700 1 -- 172.21.15.124:0/3113602415 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5910012430 con 0x7f5918161f30 2023-10-16T12:59:16.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.136+0000 7f591d53e700 1 -- 172.21.15.124:0/3113602415 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f591815ceb0 con 0x7f5918161f30 2023-10-16T12:59:16.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.137+0000 7f591d53e700 1 -- 172.21.15.124:0/3113602415 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f591804ebb0 con 0x7f5918161f30 2023-10-16T12:59:16.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.137+0000 7f58ff7fe700 1 -- 172.21.15.124:0/3113602415 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5910012590 con 0x7f5918161f30 2023-10-16T12:59:16.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.138+0000 7f58ff7fe700 1 --2- 172.21.15.124:0/3113602415 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f590406af00 0x7f590406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:16.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.138+0000 7f58ff7fe700 1 -- 172.21.15.124:0/3113602415 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f591008ae50 con 0x7f5918161f30 2023-10-16T12:59:16.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.138+0000 7f5916ffd700 1 --2- 172.21.15.124:0/3113602415 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f590406af00 0x7f590406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:16.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.138+0000 7f5916ffd700 1 --2- 172.21.15.124:0/3113602415 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f590406af00 0x7f590406d3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5918159b90 tx=0x7f590c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:16.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.142+0000 7f58ff7fe700 1 -- 172.21.15.124:0/3113602415 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5910055ca0 con 0x7f5918161f30 2023-10-16T12:59:16.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.331+0000 7f591d53e700 1 -- 172.21.15.124:0/3113602415 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f59180b6e20 con 0x7f5918161f30 2023-10-16T12:59:16.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.332+0000 7f58ff7fe700 1 -- 172.21.15.124:0/3113602415 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5910017020 con 0x7f5918161f30 2023-10-16T12:59:16.334 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:16.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.334+0000 7f591d53e700 1 -- 172.21.15.124:0/3113602415 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f590406af00 msgr2=0x7f590406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:16.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.334+0000 7f591d53e700 1 --2- 172.21.15.124:0/3113602415 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f590406af00 0x7f590406d3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5918159b90 tx=0x7f590c009040 comp rx=0 tx=0).stop 2023-10-16T12:59:16.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.334+0000 7f591d53e700 1 -- 172.21.15.124:0/3113602415 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5918161f30 msgr2=0x7f5918144000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:16.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.334+0000 7f591d53e700 1 --2- 172.21.15.124:0/3113602415 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5918161f30 0x7f5918144000 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f59180b3970 tx=0x7f5910004ad0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.334+0000 7f591d53e700 1 -- 172.21.15.124:0/3113602415 shutdown_connections 2023-10-16T12:59:16.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.334+0000 7f591d53e700 1 --2- 172.21.15.124:0/3113602415 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f590406af00 0x7f590406d3c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.334+0000 7f591d53e700 1 --2- 172.21.15.124:0/3113602415 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5918161f30 0x7f5918144000 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.334+0000 7f591d53e700 1 --2- 172.21.15.124:0/3113602415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5918143ae0 0x7f591815c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.334+0000 7f591d53e700 1 --2- 172.21.15.124:0/3113602415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f591815b210 0x7f59180c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.334+0000 7f591d53e700 1 -- 172.21.15.124:0/3113602415 >> 172.21.15.124:0/3113602415 conn(0x7f59180cdce0 msgr2=0x7f59181590b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:16.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.334+0000 7f591d53e700 1 -- 172.21.15.124:0/3113602415 shutdown_connections 2023-10-16T12:59:16.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.334+0000 7f591d53e700 1 -- 172.21.15.124:0/3113602415 wait complete. 2023-10-16T12:59:16.347 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T12:59:16.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.469+0000 7f254f59e700 1 Processor -- start 2023-10-16T12:59:16.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.469+0000 7f254f59e700 1 -- start start 2023-10-16T12:59:16.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.470+0000 7f254f59e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f255015d5b0 0x7f25500d1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:16.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.470+0000 7f254f59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f25500d1090 0x7f25500cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:16.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.470+0000 7f254f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25500cfed0 0x7f25500d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:16.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.470+0000 7f254f59e700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25500d0880 con 0x7f255015d5b0 2023-10-16T12:59:16.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.470+0000 7f254f59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25500cdf60 con 0x7f25500d1090 2023-10-16T12:59:16.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.470+0000 7f254f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25500d23a0 con 0x7f25500cfed0 2023-10-16T12:59:16.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.470+0000 7f254e59c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f255015d5b0 0x7f25500d1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:16.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.470+0000 7f254e59c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f255015d5b0 0x7f25500d1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54028/0 (socket says 172.21.15.124:54028) 2023-10-16T12:59:16.476 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.470+0000 7f254e59c700 1 -- 172.21.15.124:0/1846026368 learned_addr learned my addr 172.21.15.124:0/1846026368 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:16.476 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.470+0000 7f254dd9b700 1 --2- 172.21.15.124:0/1846026368 >> v2:172.21.15.192:3300/0 conn(0x7f25500d1090 0x7f25500cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:16.476 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.471+0000 7f254ed9d700 1 --2- 172.21.15.124:0/1846026368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25500cfed0 0x7f25500d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:16.476 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.471+0000 7f254e59c700 1 -- 172.21.15.124:0/1846026368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25500cfed0 msgr2=0x7f25500d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:16.476 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.471+0000 7f254e59c700 1 --2- 172.21.15.124:0/1846026368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25500cfed0 0x7f25500d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.477 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.471+0000 7f254e59c700 1 -- 172.21.15.124:0/1846026368 >> v2:172.21.15.192:3300/0 conn(0x7f25500d1090 msgr2=0x7f25500cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:16.477 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.471+0000 7f254e59c700 1 --2- 172.21.15.124:0/1846026368 >> v2:172.21.15.192:3300/0 conn(0x7f25500d1090 0x7f25500cec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.477 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.471+0000 7f254e59c700 1 -- 172.21.15.124:0/1846026368 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25500ce7e0 con 0x7f255015d5b0 2023-10-16T12:59:16.477 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.471+0000 7f254e59c700 1 --2- 172.21.15.124:0/1846026368 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f255015d5b0 0x7f25500d1870 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f255008c260 tx=0x7f2544009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf15b12675ef4d89 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:16.477 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.471+0000 7f254d59a700 1 -- 172.21.15.124:0/1846026368 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254400b860 con 0x7f255015d5b0 2023-10-16T12:59:16.478 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.471+0000 7f254d59a700 1 -- 172.21.15.124:0/1846026368 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254400b9c0 con 0x7f255015d5b0 2023-10-16T12:59:16.478 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.471+0000 7f254d59a700 1 -- 172.21.15.124:0/1846026368 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254400bd50 con 0x7f255015d5b0 2023-10-16T12:59:16.478 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.471+0000 7f254f59e700 1 -- 172.21.15.124:0/1846026368 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f255015d5b0 msgr2=0x7f25500d1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:16.478 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.471+0000 7f254f59e700 1 --2- 172.21.15.124:0/1846026368 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f255015d5b0 0x7f25500d1870 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f255008c260 tx=0x7f2544009c00 comp rx=0 tx=0).stop 2023-10-16T12:59:16.479 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.472+0000 7f254f59e700 1 -- 172.21.15.124:0/1846026368 shutdown_connections 2023-10-16T12:59:16.479 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.472+0000 7f254f59e700 1 --2- 172.21.15.124:0/1846026368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25500cfed0 0x7f25500d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.479 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.472+0000 7f254f59e700 1 --2- 172.21.15.124:0/1846026368 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f255015d5b0 0x7f25500d1870 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.479 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.472+0000 7f254f59e700 1 --2- 172.21.15.124:0/1846026368 >> v2:172.21.15.192:3300/0 conn(0x7f25500d1090 0x7f25500cec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.479 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.472+0000 7f254f59e700 1 -- 172.21.15.124:0/1846026368 >> 172.21.15.124:0/1846026368 conn(0x7f255009c790 msgr2=0x7f25500d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:16.479 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.472+0000 7f254f59e700 1 -- 172.21.15.124:0/1846026368 shutdown_connections 2023-10-16T12:59:16.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.472+0000 7f254f59e700 1 -- 172.21.15.124:0/1846026368 wait complete. 2023-10-16T12:59:16.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.473+0000 7f254f59e700 1 Processor -- start 2023-10-16T12:59:16.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.473+0000 7f254f59e700 1 -- start start 2023-10-16T12:59:16.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.474+0000 7f254f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25500cfed0 0x7f255015a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:16.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.474+0000 7f254f59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25500d1090 0x7f25500c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:16.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.474+0000 7f254f59e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f255015d5b0 0x7f255015f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:16.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.474+0000 7f254f59e700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25500cb670 con 0x7f255015d5b0 2023-10-16T12:59:16.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.474+0000 7f254f59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2550160060 con 0x7f25500d1090 2023-10-16T12:59:16.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.474+0000 7f254f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2550160340 con 0x7f25500cfed0 2023-10-16T12:59:16.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.474+0000 7f254ed9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f255015d5b0 0x7f255015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:16.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.474+0000 7f254ed9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f255015d5b0 0x7f255015f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54038/0 (socket says 172.21.15.124:54038) 2023-10-16T12:59:16.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.474+0000 7f254ed9d700 1 -- 172.21.15.124:0/133050210 learned_addr learned my addr 172.21.15.124:0/133050210 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:16.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.474+0000 7f254e59c700 1 --2- 172.21.15.124:0/133050210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25500cfed0 0x7f255015a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:16.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.474+0000 7f254dd9b700 1 --2- 172.21.15.124:0/133050210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25500d1090 0x7f25500c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:16.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.474+0000 7f254ed9d700 1 -- 172.21.15.124:0/133050210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25500cfed0 msgr2=0x7f255015a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:16.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.474+0000 7f254ed9d700 1 --2- 172.21.15.124:0/133050210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25500cfed0 0x7f255015a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.474+0000 7f254ed9d700 1 -- 172.21.15.124:0/133050210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25500d1090 msgr2=0x7f25500c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:16.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.474+0000 7f254ed9d700 1 --2- 172.21.15.124:0/133050210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25500d1090 0x7f25500c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.474+0000 7f254ed9d700 1 -- 172.21.15.124:0/133050210 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2544009550 con 0x7f255015d5b0 2023-10-16T12:59:16.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.474+0000 7f254ed9d700 1 --2- 172.21.15.124:0/133050210 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f255015d5b0 0x7f255015f100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2548007e60 tx=0x7f254800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:16.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.474+0000 7f253effd700 1 -- 172.21.15.124:0/133050210 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254800ed30 con 0x7f255015d5b0 2023-10-16T12:59:16.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.474+0000 7f253effd700 1 -- 172.21.15.124:0/133050210 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2548014420 con 0x7f255015d5b0 2023-10-16T12:59:16.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.474+0000 7f254f59e700 1 -- 172.21.15.124:0/133050210 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2550160620 con 0x7f255015d5b0 2023-10-16T12:59:16.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.474+0000 7f253effd700 1 -- 172.21.15.124:0/133050210 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25480147d0 con 0x7f255015d5b0 2023-10-16T12:59:16.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.474+0000 7f254f59e700 1 -- 172.21.15.124:0/133050210 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f255015ae80 con 0x7f255015d5b0 2023-10-16T12:59:16.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.475+0000 7f254f59e700 1 -- 172.21.15.124:0/133050210 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255004ebb0 con 0x7f255015d5b0 2023-10-16T12:59:16.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.476+0000 7f253effd700 1 -- 172.21.15.124:0/133050210 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2548014930 con 0x7f255015d5b0 2023-10-16T12:59:16.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.476+0000 7f253effd700 1 --2- 172.21.15.124:0/133050210 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f253006af00 0x7f253006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:16.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.476+0000 7f253effd700 1 -- 172.21.15.124:0/133050210 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2548089ef0 con 0x7f255015d5b0 2023-10-16T12:59:16.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.476+0000 7f254e59c700 1 --2- 172.21.15.124:0/133050210 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f253006af00 0x7f253006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:16.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.477+0000 7f254e59c700 1 --2- 172.21.15.124:0/133050210 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f253006af00 0x7f253006d3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2544000c00 tx=0x7f2544008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:16.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.481+0000 7f253effd700 1 -- 172.21.15.124:0/133050210 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2548054d60 con 0x7f255015d5b0 2023-10-16T12:59:16.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.667+0000 7f254f59e700 1 -- 172.21.15.124:0/133050210 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f25500cb7b0 con 0x7f255015d5b0 2023-10-16T12:59:16.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.668+0000 7f253effd700 1 -- 172.21.15.124:0/133050210 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2548058380 con 0x7f255015d5b0 2023-10-16T12:59:16.670 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2023-10-16T12:59:16.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.670+0000 7f254f59e700 1 -- 172.21.15.124:0/133050210 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f253006af00 msgr2=0x7f253006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:16.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.670+0000 7f254f59e700 1 --2- 172.21.15.124:0/133050210 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f253006af00 0x7f253006d3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2544000c00 tx=0x7f2544008030 comp rx=0 tx=0).stop 2023-10-16T12:59:16.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.670+0000 7f254f59e700 1 -- 172.21.15.124:0/133050210 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f255015d5b0 msgr2=0x7f255015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:16.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.670+0000 7f254f59e700 1 --2- 172.21.15.124:0/133050210 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f255015d5b0 0x7f255015f100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2548007e60 tx=0x7f254800e3c0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.670+0000 7f254f59e700 1 -- 172.21.15.124:0/133050210 shutdown_connections 2023-10-16T12:59:16.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.670+0000 7f254f59e700 1 --2- 172.21.15.124:0/133050210 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f253006af00 0x7f253006d3c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.670+0000 7f254f59e700 1 --2- 172.21.15.124:0/133050210 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f255015d5b0 0x7f255015f100 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.670+0000 7f254f59e700 1 --2- 172.21.15.124:0/133050210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25500cfed0 0x7f255015a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.670+0000 7f254f59e700 1 --2- 172.21.15.124:0/133050210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25500d1090 0x7f25500c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.670+0000 7f254f59e700 1 -- 172.21.15.124:0/133050210 >> 172.21.15.124:0/133050210 conn(0x7f255009c790 msgr2=0x7f25500b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:16.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.670+0000 7f254f59e700 1 -- 172.21.15.124:0/133050210 shutdown_connections 2023-10-16T12:59:16.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.670+0000 7f254f59e700 1 -- 172.21.15.124:0/133050210 wait complete. 2023-10-16T12:59:16.684 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T12:59:16.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.805+0000 7f9d35af6700 1 Processor -- start 2023-10-16T12:59:16.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.805+0000 7f9d35af6700 1 -- start start 2023-10-16T12:59:16.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.806+0000 7f9d35af6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9d3015a250 0x7f9d300717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:16.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.806+0000 7f9d35af6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d3006dcc0 0x7f9d300cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:16.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.806+0000 7f9d35af6700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d300cba90 con 0x7f9d3015dec0 2023-10-16T12:59:16.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.806+0000 7f9d35af6700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d300cb510 con 0x7f9d3015a250 2023-10-16T12:59:16.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.806+0000 7f9d35af6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3015ee40 con 0x7f9d3006dcc0 2023-10-16T12:59:16.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.806+0000 7f9d2f7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9d3015a250 0x7f9d300717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:16.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.806+0000 7f9d2ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d3006dcc0 0x7f9d300cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:16.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.806+0000 7f9d2f7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9d3015a250 0x7f9d300717b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:34208/0 (socket says 172.21.15.124:34208) 2023-10-16T12:59:16.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.806+0000 7f9d2effd700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f9d3015dec0 0x7f9d3006d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.124:54708/0 (socket says 172.21.15.124:54708) 2023-10-16T12:59:16.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.806+0000 7f9d2f7fe700 1 -- 172.21.15.124:0/1180028718 learned_addr learned my addr 172.21.15.124:0/1180028718 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:16.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.806+0000 7f9d2ffff700 1 -- 172.21.15.124:0/1180028718 >> v2:172.21.15.192:3300/0 conn(0x7f9d3015a250 msgr2=0x7f9d300717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:16.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.806+0000 7f9d2ffff700 1 --2- 172.21.15.124:0/1180028718 >> v2:172.21.15.192:3300/0 conn(0x7f9d3015a250 0x7f9d300717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.806+0000 7f9d2ffff700 1 -- 172.21.15.124:0/1180028718 >> v1:172.21.15.192:6789/0 conn(0x7f9d3015dec0 legacy=0x7f9d3006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:16.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.806+0000 7f9d2ffff700 1 -- 172.21.15.124:0/1180028718 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3015e880 con 0x7f9d3006dcc0 2023-10-16T12:59:16.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.807+0000 7f9d2ffff700 1 --2- 172.21.15.124:0/1180028718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d3006dcc0 0x7f9d300cbf20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800bfa0 tx=0x7f9d2800d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc86f1b78cb69ab5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:16.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.807+0000 7f9d2e7fc700 1 -- 172.21.15.124:0/1180028718 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d28010070 con 0x7f9d3006dcc0 2023-10-16T12:59:16.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.807+0000 7f9d2e7fc700 1 -- 172.21.15.124:0/1180028718 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2800b2e0 con 0x7f9d3006dcc0 2023-10-16T12:59:16.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.807+0000 7f9d2e7fc700 1 -- 172.21.15.124:0/1180028718 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2800dc40 con 0x7f9d3006dcc0 2023-10-16T12:59:16.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.807+0000 7f9d35af6700 1 -- 172.21.15.124:0/1180028718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d3006dcc0 msgr2=0x7f9d300cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:16.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.807+0000 7f9d35af6700 1 --2- 172.21.15.124:0/1180028718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d3006dcc0 0x7f9d300cbf20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800bfa0 tx=0x7f9d2800d330 comp rx=0 tx=0).stop 2023-10-16T12:59:16.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.807+0000 7f9d35af6700 1 -- 172.21.15.124:0/1180028718 shutdown_connections 2023-10-16T12:59:16.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.807+0000 7f9d35af6700 1 --2- 172.21.15.124:0/1180028718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d3006dcc0 0x7f9d300cbf20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.807+0000 7f9d35af6700 1 --2- 172.21.15.124:0/1180028718 >> v2:172.21.15.192:3300/0 conn(0x7f9d3015a250 0x7f9d300717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.807+0000 7f9d35af6700 1 -- 172.21.15.124:0/1180028718 >> 172.21.15.124:0/1180028718 conn(0x7f9d300ccbe0 msgr2=0x7f9d300ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:16.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.807+0000 7f9d35af6700 1 -- 172.21.15.124:0/1180028718 shutdown_connections 2023-10-16T12:59:16.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.807+0000 7f9d35af6700 1 -- 172.21.15.124:0/1180028718 wait complete. 2023-10-16T12:59:16.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.808+0000 7f9d35af6700 1 Processor -- start 2023-10-16T12:59:16.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.809+0000 7f9d35af6700 1 -- start start 2023-10-16T12:59:16.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.809+0000 7f9d35af6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d3006dcc0 0x7f9d300b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:16.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.809+0000 7f9d35af6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d3015a250 0x7f9d300c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:16.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.809+0000 7f9d35af6700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d3015dec0 0x7f9d3014f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:16.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.809+0000 7f9d35af6700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d300c9510 con 0x7f9d3015dec0 2023-10-16T12:59:16.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.809+0000 7f9d35af6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d300b0ab0 con 0x7f9d3015a250 2023-10-16T12:59:16.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.809+0000 7f9d35af6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d300b0d90 con 0x7f9d3006dcc0 2023-10-16T12:59:16.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.809+0000 7f9d2ffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d3015dec0 0x7f9d3014f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:16.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.810+0000 7f9d2ffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d3015dec0 0x7f9d3014f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54052/0 (socket says 172.21.15.124:54052) 2023-10-16T12:59:16.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.810+0000 7f9d2ffff700 1 -- 172.21.15.124:0/1805846536 learned_addr learned my addr 172.21.15.124:0/1805846536 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:16.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.810+0000 7f9d2f7fe700 1 --2- 172.21.15.124:0/1805846536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d3006dcc0 0x7f9d300b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:16.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.810+0000 7f9d2effd700 1 --2- 172.21.15.124:0/1805846536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d3015a250 0x7f9d300c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:16.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.810+0000 7f9d2ffff700 1 -- 172.21.15.124:0/1805846536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d3006dcc0 msgr2=0x7f9d300b0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:16.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.810+0000 7f9d2ffff700 1 --2- 172.21.15.124:0/1805846536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d3006dcc0 0x7f9d300b0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.810+0000 7f9d2ffff700 1 -- 172.21.15.124:0/1805846536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d3015a250 msgr2=0x7f9d300c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:16.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.810+0000 7f9d2ffff700 1 --2- 172.21.15.124:0/1805846536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d3015a250 0x7f9d300c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:16.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.810+0000 7f9d2ffff700 1 -- 172.21.15.124:0/1805846536 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2800bc80 con 0x7f9d3015dec0 2023-10-16T12:59:16.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.810+0000 7f9d2f7fe700 1 --2- 172.21.15.124:0/1805846536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d3006dcc0 0x7f9d300b0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:16.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.810+0000 7f9d2effd700 1 --2- 172.21.15.124:0/1805846536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d3015a250 0x7f9d300c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:16.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.810+0000 7f9d2ffff700 1 --2- 172.21.15.124:0/1805846536 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d3015dec0 0x7f9d3014f660 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800d370 tx=0x7f9d28004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:16.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.810+0000 7f9d17fff700 1 -- 172.21.15.124:0/1805846536 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d28004250 con 0x7f9d3015dec0 2023-10-16T12:59:16.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.810+0000 7f9d17fff700 1 -- 172.21.15.124:0/1805846536 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d280043b0 con 0x7f9d3015dec0 2023-10-16T12:59:16.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.810+0000 7f9d35af6700 1 -- 172.21.15.124:0/1805846536 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d300b1070 con 0x7f9d3015dec0 2023-10-16T12:59:16.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.810+0000 7f9d17fff700 1 -- 172.21.15.124:0/1805846536 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d28004760 con 0x7f9d3015dec0 2023-10-16T12:59:16.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.810+0000 7f9d35af6700 1 -- 172.21.15.124:0/1805846536 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d300c5230 con 0x7f9d3015dec0 2023-10-16T12:59:16.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.811+0000 7f9d35af6700 1 -- 172.21.15.124:0/1805846536 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d3004ebb0 con 0x7f9d3015dec0 2023-10-16T12:59:16.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.812+0000 7f9d17fff700 1 -- 172.21.15.124:0/1805846536 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9d28009460 con 0x7f9d3015dec0 2023-10-16T12:59:16.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.812+0000 7f9d17fff700 1 --2- 172.21.15.124:0/1805846536 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f9d1c06af00 0x7f9d1c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:16.823 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.812+0000 7f9d17fff700 1 -- 172.21.15.124:0/1805846536 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9d2808ccf0 con 0x7f9d3015dec0 2023-10-16T12:59:16.823 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.812+0000 7f9d2f7fe700 1 --2- 172.21.15.124:0/1805846536 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f9d1c06af00 0x7f9d1c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:16.823 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.812+0000 7f9d2f7fe700 1 --2- 172.21.15.124:0/1805846536 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f9d1c06af00 0x7f9d1c06d3c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9d24009ab0 tx=0x7f9d24008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:16.824 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:16.816+0000 7f9d17fff700 1 -- 172.21.15.124:0/1805846536 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9d28091070 con 0x7f9d3015dec0 2023-10-16T12:59:17.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.008+0000 7f9d35af6700 1 -- 172.21.15.124:0/1805846536 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9d300b60e0 con 0x7f9d3015dec0 2023-10-16T12:59:17.011 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.008+0000 7f9d17fff700 1 -- 172.21.15.124:0/1805846536 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9d28021020 con 0x7f9d3015dec0 2023-10-16T12:59:17.011 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:17.012 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.010+0000 7f9d35af6700 1 -- 172.21.15.124:0/1805846536 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f9d1c06af00 msgr2=0x7f9d1c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:17.012 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.010+0000 7f9d35af6700 1 --2- 172.21.15.124:0/1805846536 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f9d1c06af00 0x7f9d1c06d3c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9d24009ab0 tx=0x7f9d24008040 comp rx=0 tx=0).stop 2023-10-16T12:59:17.012 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.010+0000 7f9d35af6700 1 -- 172.21.15.124:0/1805846536 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d3015dec0 msgr2=0x7f9d3014f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:17.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.010+0000 7f9d35af6700 1 --2- 172.21.15.124:0/1805846536 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d3015dec0 0x7f9d3014f660 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800d370 tx=0x7f9d28004ad0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.010+0000 7f9d35af6700 1 -- 172.21.15.124:0/1805846536 shutdown_connections 2023-10-16T12:59:17.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.010+0000 7f9d35af6700 1 --2- 172.21.15.124:0/1805846536 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f9d1c06af00 0x7f9d1c06d3c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.010+0000 7f9d35af6700 1 --2- 172.21.15.124:0/1805846536 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d3015dec0 0x7f9d3014f660 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.013 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.010+0000 7f9d35af6700 1 --2- 172.21.15.124:0/1805846536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d3006dcc0 0x7f9d300b0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.010+0000 7f9d35af6700 1 --2- 172.21.15.124:0/1805846536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d3015a250 0x7f9d300c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.010+0000 7f9d35af6700 1 -- 172.21.15.124:0/1805846536 >> 172.21.15.124:0/1805846536 conn(0x7f9d300ccbe0 msgr2=0x7f9d3006d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:17.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.011+0000 7f9d35af6700 1 -- 172.21.15.124:0/1805846536 shutdown_connections 2023-10-16T12:59:17.014 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.011+0000 7f9d35af6700 1 -- 172.21.15.124:0/1805846536 wait complete. 2023-10-16T12:59:17.024 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T12:59:17.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.143+0000 7fbc82427700 1 Processor -- start 2023-10-16T12:59:17.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.143+0000 7fbc82427700 1 -- start start 2023-10-16T12:59:17.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.144+0000 7fbc82427700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbc7c06a820 0x7fbc7c0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:17.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.144+0000 7fbc82427700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc7c0ca7d0 0x7fbc7c071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:17.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.144+0000 7fbc82427700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc7c0cfeb0 con 0x7fbc7c15e7f0 2023-10-16T12:59:17.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.144+0000 7fbc82427700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc7c0ce410 con 0x7fbc7c06a820 2023-10-16T12:59:17.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.144+0000 7fbc82427700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c15ec50 con 0x7fbc7c0ca7d0 2023-10-16T12:59:17.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.144+0000 7fbc7bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbc7c06a820 0x7fbc7c0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:17.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.144+0000 7fbc809c4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc7c0ca7d0 0x7fbc7c071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:17.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.144+0000 7fbc7bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbc7c06a820 0x7fbc7c0cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:34222/0 (socket says 172.21.15.124:34222) 2023-10-16T12:59:17.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.144+0000 7fbc809c4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc7c0ca7d0 0x7fbc7c071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:40136/0 (socket says 172.21.15.124:40136) 2023-10-16T12:59:17.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.144+0000 7fbc7bfff700 1 -- 172.21.15.124:0/2564788187 learned_addr learned my addr 172.21.15.124:0/2564788187 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:17.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.144+0000 7fbc73fff700 1 --1- 172.21.15.124:0/2564788187 >> v1:172.21.15.192:6789/0 conn(0x7fbc7c15e7f0 0x7fbc7c06ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.124:54724/0 (socket says 172.21.15.124:54724) 2023-10-16T12:59:17.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.145+0000 7fbc809c4700 1 -- 172.21.15.124:0/2564788187 >> v2:172.21.15.192:3300/0 conn(0x7fbc7c06a820 msgr2=0x7fbc7c0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:17.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.145+0000 7fbc809c4700 1 --2- 172.21.15.124:0/2564788187 >> v2:172.21.15.192:3300/0 conn(0x7fbc7c06a820 0x7fbc7c0cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.145+0000 7fbc809c4700 1 -- 172.21.15.124:0/2564788187 >> v1:172.21.15.192:6789/0 conn(0x7fbc7c15e7f0 legacy=0x7fbc7c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:17.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.145+0000 7fbc809c4700 1 -- 172.21.15.124:0/2564788187 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c0af9d0 con 0x7fbc7c0ca7d0 2023-10-16T12:59:17.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.145+0000 7fbc7bfff700 1 --2- 172.21.15.124:0/2564788187 >> v2:172.21.15.192:3300/0 conn(0x7fbc7c06a820 0x7fbc7c0cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:59:17.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.145+0000 7fbc809c4700 1 --2- 172.21.15.124:0/2564788187 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc7c0ca7d0 0x7fbc7c071ea0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009d90 tx=0x7fbc7400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a5c62cca5453c04 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:17.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.145+0000 7fbc7b7fe700 1 -- 172.21.15.124:0/2564788187 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7400e070 con 0x7fbc7c0ca7d0 2023-10-16T12:59:17.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.145+0000 7fbc7b7fe700 1 -- 172.21.15.124:0/2564788187 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7400bb20 con 0x7fbc7c0ca7d0 2023-10-16T12:59:17.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.145+0000 7fbc7b7fe700 1 -- 172.21.15.124:0/2564788187 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74012430 con 0x7fbc7c0ca7d0 2023-10-16T12:59:17.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.145+0000 7fbc82427700 1 -- 172.21.15.124:0/2564788187 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc7c0ca7d0 msgr2=0x7fbc7c071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:17.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.145+0000 7fbc82427700 1 --2- 172.21.15.124:0/2564788187 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc7c0ca7d0 0x7fbc7c071ea0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009d90 tx=0x7fbc7400b330 comp rx=0 tx=0).stop 2023-10-16T12:59:17.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.145+0000 7fbc82427700 1 -- 172.21.15.124:0/2564788187 shutdown_connections 2023-10-16T12:59:17.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.146+0000 7fbc82427700 1 --2- 172.21.15.124:0/2564788187 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc7c0ca7d0 0x7fbc7c071ea0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.146+0000 7fbc82427700 1 --2- 172.21.15.124:0/2564788187 >> v2:172.21.15.192:3300/0 conn(0x7fbc7c06a820 0x7fbc7c0cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.146+0000 7fbc82427700 1 -- 172.21.15.124:0/2564788187 >> 172.21.15.124:0/2564788187 conn(0x7fbc7c0d0180 msgr2=0x7fbc7c0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:17.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.146+0000 7fbc82427700 1 -- 172.21.15.124:0/2564788187 shutdown_connections 2023-10-16T12:59:17.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.146+0000 7fbc82427700 1 -- 172.21.15.124:0/2564788187 wait complete. 2023-10-16T12:59:17.155 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.147+0000 7fbc82427700 1 Processor -- start 2023-10-16T12:59:17.155 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.147+0000 7fbc82427700 1 -- start start 2023-10-16T12:59:17.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.147+0000 7fbc82427700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc7c06a820 0x7fbc7c0c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:17.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.147+0000 7fbc82427700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc7c0ca7d0 0x7fbc7c06e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:17.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.147+0000 7fbc82427700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc7c15e7f0 0x7fbc7c157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:17.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.147+0000 7fbc82427700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c06e720 con 0x7fbc7c0ca7d0 2023-10-16T12:59:17.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.147+0000 7fbc82427700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c0c84b0 con 0x7fbc7c15e7f0 2023-10-16T12:59:17.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.147+0000 7fbc82427700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c0c8790 con 0x7fbc7c06a820 2023-10-16T12:59:17.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.148+0000 7fbc73fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc7c0ca7d0 0x7fbc7c06e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:17.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.148+0000 7fbc73fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc7c0ca7d0 0x7fbc7c06e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54064/0 (socket says 172.21.15.124:54064) 2023-10-16T12:59:17.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.148+0000 7fbc73fff700 1 -- 172.21.15.124:0/3940145970 learned_addr learned my addr 172.21.15.124:0/3940145970 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:17.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.148+0000 7fbc809c4700 1 --2- 172.21.15.124:0/3940145970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc7c15e7f0 0x7fbc7c157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:17.158 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.148+0000 7fbc7bfff700 1 --2- 172.21.15.124:0/3940145970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc7c06a820 0x7fbc7c0c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:17.158 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.148+0000 7fbc73fff700 1 -- 172.21.15.124:0/3940145970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc7c06a820 msgr2=0x7fbc7c0c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:17.158 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.148+0000 7fbc73fff700 1 --2- 172.21.15.124:0/3940145970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc7c06a820 0x7fbc7c0c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.158 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.148+0000 7fbc73fff700 1 -- 172.21.15.124:0/3940145970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc7c15e7f0 msgr2=0x7fbc7c157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:17.158 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.148+0000 7fbc73fff700 1 --2- 172.21.15.124:0/3940145970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc7c15e7f0 0x7fbc7c157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.159 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.148+0000 7fbc73fff700 1 -- 172.21.15.124:0/3940145970 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c009550 con 0x7fbc7c0ca7d0 2023-10-16T12:59:17.159 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.148+0000 7fbc809c4700 1 --2- 172.21.15.124:0/3940145970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc7c15e7f0 0x7fbc7c157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:17.159 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.148+0000 7fbc73fff700 1 --2- 172.21.15.124:0/3940145970 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc7c0ca7d0 0x7fbc7c06e1e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400c500 tx=0x7fbc6400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:17.159 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.148+0000 7fbc797fa700 1 -- 172.21.15.124:0/3940145970 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc64005cb0 con 0x7fbc7c0ca7d0 2023-10-16T12:59:17.159 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.148+0000 7fbc797fa700 1 -- 172.21.15.124:0/3940145970 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc64005e10 con 0x7fbc7c0ca7d0 2023-10-16T12:59:17.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.148+0000 7fbc797fa700 1 -- 172.21.15.124:0/3940145970 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc640072d0 con 0x7fbc7c0ca7d0 2023-10-16T12:59:17.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.148+0000 7fbc82427700 1 -- 172.21.15.124:0/3940145970 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc74009a70 con 0x7fbc7c0ca7d0 2023-10-16T12:59:17.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.148+0000 7fbc82427700 1 -- 172.21.15.124:0/3940145970 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc7c0c8d50 con 0x7fbc7c0ca7d0 2023-10-16T12:59:17.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.149+0000 7fbc82427700 1 -- 172.21.15.124:0/3940145970 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7c04ebb0 con 0x7fbc7c0ca7d0 2023-10-16T12:59:17.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.150+0000 7fbc797fa700 1 -- 172.21.15.124:0/3940145970 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbc64007430 con 0x7fbc7c0ca7d0 2023-10-16T12:59:17.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.150+0000 7fbc797fa700 1 --2- 172.21.15.124:0/3940145970 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbc5c06af00 0x7fbc5c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:17.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.150+0000 7fbc797fa700 1 -- 172.21.15.124:0/3940145970 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbc64088c80 con 0x7fbc7c0ca7d0 2023-10-16T12:59:17.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.150+0000 7fbc7bfff700 1 --2- 172.21.15.124:0/3940145970 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbc5c06af00 0x7fbc5c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:17.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.150+0000 7fbc7bfff700 1 --2- 172.21.15.124:0/3940145970 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbc5c06af00 0x7fbc5c06d3c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009cf0 tx=0x7fbc6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:17.162 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.154+0000 7fbc797fa700 1 -- 172.21.15.124:0/3940145970 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbc64053af0 con 0x7fbc7c0ca7d0 2023-10-16T12:59:17.387 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.386+0000 7fbc82427700 1 -- 172.21.15.124:0/3940145970 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc7c06b490 con 0x7fbc7c0ca7d0 2023-10-16T12:59:17.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.386+0000 7fbc797fa700 1 -- 172.21.15.124:0/3940145970 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4918 (secure 0 0 0) 0x7fbc64017020 con 0x7fbc7c0ca7d0 2023-10-16T12:59:17.388 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:17.388 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1489119886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6833","nonce":1489119886},{"type":"v1","addr":"172.21.15.192:6835","nonce":1489119886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/2221949787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":2221949787},{"type":"v1","addr":"172.21.15.124:6836","nonce":2221949787}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1247092782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":1247092782},{"type":"v1","addr":"172.21.15.124:6837","nonce":1247092782}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T12:58:51.047667+0000","modified":"2023-10-16T12:59:08.133656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6834/621867052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":621867052},{"type":"v1","addr":"172.21.15.192:6834","nonce":621867052}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T12:59:17.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.388+0000 7fbc82427700 1 -- 172.21.15.124:0/3940145970 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbc5c06af00 msgr2=0x7fbc5c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:17.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.388+0000 7fbc82427700 1 --2- 172.21.15.124:0/3940145970 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbc5c06af00 0x7fbc5c06d3c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009cf0 tx=0x7fbc6c008040 comp rx=0 tx=0).stop 2023-10-16T12:59:17.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.388+0000 7fbc82427700 1 -- 172.21.15.124:0/3940145970 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc7c0ca7d0 msgr2=0x7fbc7c06e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:17.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.388+0000 7fbc82427700 1 --2- 172.21.15.124:0/3940145970 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc7c0ca7d0 0x7fbc7c06e1e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400c500 tx=0x7fbc6400c8c0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.388+0000 7fbc82427700 1 -- 172.21.15.124:0/3940145970 shutdown_connections 2023-10-16T12:59:17.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.388+0000 7fbc82427700 1 --2- 172.21.15.124:0/3940145970 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbc5c06af00 0x7fbc5c06d3c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.388+0000 7fbc82427700 1 --2- 172.21.15.124:0/3940145970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc7c15e7f0 0x7fbc7c157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.388+0000 7fbc82427700 1 --2- 172.21.15.124:0/3940145970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc7c06a820 0x7fbc7c0c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.388+0000 7fbc82427700 1 --2- 172.21.15.124:0/3940145970 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc7c0ca7d0 0x7fbc7c06e1e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.388+0000 7fbc82427700 1 -- 172.21.15.124:0/3940145970 >> 172.21.15.124:0/3940145970 conn(0x7fbc7c0d0180 msgr2=0x7fbc7c0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:17.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.388+0000 7fbc82427700 1 -- 172.21.15.124:0/3940145970 shutdown_connections 2023-10-16T12:59:17.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.388+0000 7fbc82427700 1 -- 172.21.15.124:0/3940145970 wait complete. 2023-10-16T12:59:17.393 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 9 2023-10-16T12:59:17.402 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:59:17.523 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.521+0000 7fe1321da700 1 Processor -- start 2023-10-16T12:59:17.523 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.521+0000 7fe1321da700 1 -- start start 2023-10-16T12:59:17.525 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.522+0000 7fe1321da700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe12c15dbf0 0x7fe12c0af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:17.526 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.522+0000 7fe1321da700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe12c0af030 0x7fe12c161560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:17.526 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.522+0000 7fe1321da700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe12c0caee0 con 0x7fe12c15d810 2023-10-16T12:59:17.526 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.522+0000 7fe1321da700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe12c0cf990 con 0x7fe12c0af030 2023-10-16T12:59:17.526 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.522+0000 7fe1321da700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c0cfc30 con 0x7fe12c15dbf0 2023-10-16T12:59:17.526 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.522+0000 7fe12bfff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe12c0af030 0x7fe12c161560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:17.527 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.522+0000 7fe12bfff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe12c0af030 0x7fe12c161560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54074/0 (socket says 172.21.15.124:54074) 2023-10-16T12:59:17.527 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.522+0000 7fe12bfff700 1 -- 172.21.15.124:0/2119711658 learned_addr learned my addr 172.21.15.124:0/2119711658 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:17.527 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.522+0000 7fe12bfff700 1 -- 172.21.15.124:0/2119711658 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe12c15dbf0 msgr2=0x7fe12c0af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:17.527 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.522+0000 7fe12affd700 1 --2- 172.21.15.124:0/2119711658 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe12c15dbf0 0x7fe12c0af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:17.527 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.522+0000 7fe12bfff700 1 --2- 172.21.15.124:0/2119711658 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe12c15dbf0 0x7fe12c0af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.528 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.522+0000 7fe12bfff700 1 -- 172.21.15.124:0/2119711658 >> v1:172.21.15.192:6789/0 conn(0x7fe12c15d810 legacy=0x7fe12c0ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:17.528 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.522+0000 7fe12bfff700 1 -- 172.21.15.124:0/2119711658 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12c0cff10 con 0x7fe12c0af030 2023-10-16T12:59:17.528 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.523+0000 7fe12bfff700 1 --2- 172.21.15.124:0/2119711658 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe12c0af030 0x7fe12c161560 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe124009e50 tx=0x7fe12400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd956a6c42be616 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:17.529 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.523+0000 7fe12a7fc700 1 -- 172.21.15.124:0/2119711658 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12400e070 con 0x7fe12c0af030 2023-10-16T12:59:17.529 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.523+0000 7fe12a7fc700 1 -- 172.21.15.124:0/2119711658 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe124003a20 con 0x7fe12c0af030 2023-10-16T12:59:17.529 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.523+0000 7fe12a7fc700 1 -- 172.21.15.124:0/2119711658 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe124003dd0 con 0x7fe12c0af030 2023-10-16T12:59:17.529 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.523+0000 7fe1321da700 1 -- 172.21.15.124:0/2119711658 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe12c0af030 msgr2=0x7fe12c161560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:17.529 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.523+0000 7fe1321da700 1 --2- 172.21.15.124:0/2119711658 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe12c0af030 0x7fe12c161560 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe124009e50 tx=0x7fe12400b330 comp rx=0 tx=0).stop 2023-10-16T12:59:17.530 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.523+0000 7fe1321da700 1 -- 172.21.15.124:0/2119711658 shutdown_connections 2023-10-16T12:59:17.530 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.523+0000 7fe1321da700 1 --2- 172.21.15.124:0/2119711658 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe12c0af030 0x7fe12c161560 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.530 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.523+0000 7fe1321da700 1 --2- 172.21.15.124:0/2119711658 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe12c15dbf0 0x7fe12c0af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.530 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.523+0000 7fe1321da700 1 -- 172.21.15.124:0/2119711658 >> 172.21.15.124:0/2119711658 conn(0x7fe12c0d0180 msgr2=0x7fe12c0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:17.530 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.523+0000 7fe1321da700 1 -- 172.21.15.124:0/2119711658 shutdown_connections 2023-10-16T12:59:17.531 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.523+0000 7fe1321da700 1 -- 172.21.15.124:0/2119711658 wait complete. 2023-10-16T12:59:17.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.524+0000 7fe1321da700 1 Processor -- start 2023-10-16T12:59:17.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.525+0000 7fe1321da700 1 -- start start 2023-10-16T12:59:17.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.525+0000 7fe1321da700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe12c0af030 0x7fe12c0c9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:17.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.525+0000 7fe1321da700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe12c15d810 0x7fe12c147460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:17.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.525+0000 7fe1321da700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe12c15dbf0 0x7fe12c0c7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:17.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.525+0000 7fe1321da700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c0c8860 con 0x7fe12c15dbf0 2023-10-16T12:59:17.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.525+0000 7fe1321da700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c0ca140 con 0x7fe12c0af030 2023-10-16T12:59:17.535 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.525+0000 7fe1321da700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c1479a0 con 0x7fe12c15d810 2023-10-16T12:59:17.535 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.525+0000 7fe12bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe12c15dbf0 0x7fe12c0c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:17.535 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.525+0000 7fe12bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe12c15dbf0 0x7fe12c0c7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54080/0 (socket says 172.21.15.124:54080) 2023-10-16T12:59:17.535 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.525+0000 7fe12bfff700 1 -- 172.21.15.124:0/2754339425 learned_addr learned my addr 172.21.15.124:0/2754339425 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:17.535 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.526+0000 7fe12affd700 1 --2- 172.21.15.124:0/2754339425 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe12c15d810 0x7fe12c147460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:17.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.526+0000 7fe12b7fe700 1 --2- 172.21.15.124:0/2754339425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe12c0af030 0x7fe12c0c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:17.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.526+0000 7fe12bfff700 1 -- 172.21.15.124:0/2754339425 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe12c15d810 msgr2=0x7fe12c147460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:17.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.526+0000 7fe12bfff700 1 --2- 172.21.15.124:0/2754339425 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe12c15d810 0x7fe12c147460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.526+0000 7fe12bfff700 1 -- 172.21.15.124:0/2754339425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe12c0af030 msgr2=0x7fe12c0c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:17.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.526+0000 7fe12bfff700 1 --2- 172.21.15.124:0/2754339425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe12c0af030 0x7fe12c0c9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.526+0000 7fe12bfff700 1 -- 172.21.15.124:0/2754339425 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe124009b30 con 0x7fe12c15dbf0 2023-10-16T12:59:17.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.526+0000 7fe12affd700 1 --2- 172.21.15.124:0/2754339425 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe12c15d810 0x7fe12c147460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:17.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.526+0000 7fe12bfff700 1 --2- 172.21.15.124:0/2754339425 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe12c15dbf0 0x7fe12c0c7330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe124004000 tx=0x7fe124004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:17.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.526+0000 7fe113fff700 1 -- 172.21.15.124:0/2754339425 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe124004440 con 0x7fe12c15dbf0 2023-10-16T12:59:17.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.526+0000 7fe113fff700 1 -- 172.21.15.124:0/2754339425 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1240045c0 con 0x7fe12c15dbf0 2023-10-16T12:59:17.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.526+0000 7fe113fff700 1 -- 172.21.15.124:0/2754339425 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe124004970 con 0x7fe12c15dbf0 2023-10-16T12:59:17.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.526+0000 7fe1321da700 1 -- 172.21.15.124:0/2754339425 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe12c0c9e60 con 0x7fe12c15dbf0 2023-10-16T12:59:17.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.526+0000 7fe1321da700 1 -- 172.21.15.124:0/2754339425 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe12c0c41e0 con 0x7fe12c15dbf0 2023-10-16T12:59:17.539 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.527+0000 7fe1321da700 1 -- 172.21.15.124:0/2754339425 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe12c04ebb0 con 0x7fe12c15dbf0 2023-10-16T12:59:17.539 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.527+0000 7fe113fff700 1 -- 172.21.15.124:0/2754339425 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe124012430 con 0x7fe12c15dbf0 2023-10-16T12:59:17.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.528+0000 7fe113fff700 1 --2- 172.21.15.124:0/2754339425 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe11806af00 0x7fe11806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:17.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.528+0000 7fe113fff700 1 -- 172.21.15.124:0/2754339425 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe12408ace0 con 0x7fe12c15dbf0 2023-10-16T12:59:17.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.528+0000 7fe12b7fe700 1 --2- 172.21.15.124:0/2754339425 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe11806af00 0x7fe11806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:17.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.528+0000 7fe12b7fe700 1 --2- 172.21.15.124:0/2754339425 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe11806af00 0x7fe11806d3c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe120007fd0 tx=0x7fe120007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:17.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.532+0000 7fe113fff700 1 -- 172.21.15.124:0/2754339425 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe1240595c0 con 0x7fe12c15dbf0 2023-10-16T12:59:17.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.723+0000 7fe1321da700 1 -- 172.21.15.124:0/2754339425 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe12c06eed0 con 0x7fe12c15dbf0 2023-10-16T12:59:17.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.724+0000 7fe113fff700 1 -- 172.21.15.124:0/2754339425 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fe124017090 con 0x7fe12c15dbf0 2023-10-16T12:59:17.726 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:17.726 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":24,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:58:56.089767+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:59:17.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.726+0000 7fe1321da700 1 -- 172.21.15.124:0/2754339425 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe11806af00 msgr2=0x7fe11806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:17.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.726+0000 7fe1321da700 1 --2- 172.21.15.124:0/2754339425 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe11806af00 0x7fe11806d3c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe120007fd0 tx=0x7fe120007ec0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.726+0000 7fe1321da700 1 -- 172.21.15.124:0/2754339425 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe12c15dbf0 msgr2=0x7fe12c0c7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:17.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.726+0000 7fe1321da700 1 --2- 172.21.15.124:0/2754339425 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe12c15dbf0 0x7fe12c0c7330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe124004000 tx=0x7fe124004ad0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.726+0000 7fe1321da700 1 -- 172.21.15.124:0/2754339425 shutdown_connections 2023-10-16T12:59:17.729 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.726+0000 7fe1321da700 1 --2- 172.21.15.124:0/2754339425 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe11806af00 0x7fe11806d3c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.729 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.726+0000 7fe1321da700 1 --2- 172.21.15.124:0/2754339425 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe12c15dbf0 0x7fe12c0c7330 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.729 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.726+0000 7fe1321da700 1 --2- 172.21.15.124:0/2754339425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe12c0af030 0x7fe12c0c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.729 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.726+0000 7fe1321da700 1 --2- 172.21.15.124:0/2754339425 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe12c15d810 0x7fe12c147460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.729 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.726+0000 7fe1321da700 1 -- 172.21.15.124:0/2754339425 >> 172.21.15.124:0/2754339425 conn(0x7fe12c0d0180 msgr2=0x7fe12c06a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:17.730 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.726+0000 7fe1321da700 1 -- 172.21.15.124:0/2754339425 shutdown_connections 2023-10-16T12:59:17.730 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.726+0000 7fe1321da700 1 -- 172.21.15.124:0/2754339425 wait complete. 2023-10-16T12:59:17.740 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T12:58:38.667813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T12:58:49.562073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T12:58:50.011419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T12:58:53.692890+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T12:59:17.740 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T12:59:17.863 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.862+0000 7fdd24b68700 1 Processor -- start 2023-10-16T12:59:17.864 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.862+0000 7fdd24b68700 1 -- start start 2023-10-16T12:59:17.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.863+0000 7fdd24b68700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fdd2006a820 0x7fdd2015dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:17.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.863+0000 7fdd24b68700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd20161360 con 0x7fdd200cdd30 2023-10-16T12:59:17.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.863+0000 7fdd24b68700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd2006b750 con 0x7fdd2006b370 2023-10-16T12:59:17.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.863+0000 7fdd24b68700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd2006dcc0 con 0x7fdd2006a820 2023-10-16T12:59:17.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.863+0000 7fdd1dd9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fdd2006a820 0x7fdd2015dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:17.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.863+0000 7fdd1ed9d700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fdd200cdd30 0x7fdd201617f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42756/0 (socket says 172.21.15.124:42756) 2023-10-16T12:59:17.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.863+0000 7fdd1ed9d700 1 -- 172.21.15.124:0/263858984 learned_addr learned my addr 172.21.15.124:0/263858984 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:17.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.863+0000 7fdd1dd9b700 1 -- 172.21.15.124:0/263858984 >> v1:172.21.15.192:6789/0 conn(0x7fdd2006b370 legacy=0x7fdd2006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:17.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.863+0000 7fdd1dd9b700 1 -- 172.21.15.124:0/263858984 >> v1:172.21.15.124:6789/0 conn(0x7fdd200cdd30 legacy=0x7fdd201617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:17.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.863+0000 7fdd1dd9b700 1 -- 172.21.15.124:0/263858984 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2015e300 con 0x7fdd2006a820 2023-10-16T12:59:17.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.863+0000 7fdd1d59a700 1 -- 172.21.15.124:0/263858984 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623955104 0 0) 0x7fdd20161360 con 0x7fdd200cdd30 2023-10-16T12:59:17.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.863+0000 7fdd1dd9b700 1 --2- 172.21.15.124:0/263858984 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd2006a820 0x7fdd2015dcb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009840 tx=0x7fdd14009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e46a00a6450033e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:17.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.863+0000 7fdd1d59a700 1 -- 172.21.15.124:0/263858984 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd14004230 con 0x7fdd2006a820 2023-10-16T12:59:17.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.863+0000 7fdd1d59a700 1 -- 172.21.15.124:0/263858984 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd14004390 con 0x7fdd2006a820 2023-10-16T12:59:17.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.863+0000 7fdd1d59a700 1 -- 172.21.15.124:0/263858984 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd140036a0 con 0x7fdd2006a820 2023-10-16T12:59:17.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.864+0000 7fdd24b68700 1 -- 172.21.15.124:0/263858984 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd2006a820 msgr2=0x7fdd2015dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:17.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.864+0000 7fdd24b68700 1 --2- 172.21.15.124:0/263858984 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd2006a820 0x7fdd2015dcb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009840 tx=0x7fdd14009b50 comp rx=0 tx=0).stop 2023-10-16T12:59:17.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.864+0000 7fdd24b68700 1 -- 172.21.15.124:0/263858984 shutdown_connections 2023-10-16T12:59:17.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.864+0000 7fdd24b68700 1 --2- 172.21.15.124:0/263858984 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd2006a820 0x7fdd2015dcb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.864+0000 7fdd24b68700 1 -- 172.21.15.124:0/263858984 >> 172.21.15.124:0/263858984 conn(0x7fdd200ccbe0 msgr2=0x7fdd200ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:17.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.864+0000 7fdd24b68700 1 -- 172.21.15.124:0/263858984 shutdown_connections 2023-10-16T12:59:17.870 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.864+0000 7fdd24b68700 1 -- 172.21.15.124:0/263858984 wait complete. 2023-10-16T12:59:17.872 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.865+0000 7fdd24b68700 1 Processor -- start 2023-10-16T12:59:17.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.865+0000 7fdd24b68700 1 -- start start 2023-10-16T12:59:17.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.866+0000 7fdd24b68700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd2006a820 0x7fdd20156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:17.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.866+0000 7fdd24b68700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd2006b370 0x7fdd200c6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:17.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.866+0000 7fdd24b68700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd200cdd30 0x7fdd2006de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:17.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.866+0000 7fdd24b68700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd200c4d70 con 0x7fdd2006b370 2023-10-16T12:59:17.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.866+0000 7fdd24b68700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd200c5190 con 0x7fdd2006a820 2023-10-16T12:59:17.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.866+0000 7fdd24b68700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd200c40f0 con 0x7fdd200cdd30 2023-10-16T12:59:17.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.866+0000 7fdd1dd9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd2006b370 0x7fdd200c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:17.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.866+0000 7fdd1dd9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd2006b370 0x7fdd200c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54092/0 (socket says 172.21.15.124:54092) 2023-10-16T12:59:17.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.866+0000 7fdd1dd9b700 1 -- 172.21.15.124:0/87831237 learned_addr learned my addr 172.21.15.124:0/87831237 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:17.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.866+0000 7fdd1e59c700 1 --2- 172.21.15.124:0/87831237 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd2006a820 0x7fdd20156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:17.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.866+0000 7fdd1ed9d700 1 --2- 172.21.15.124:0/87831237 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd200cdd30 0x7fdd2006de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:17.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.866+0000 7fdd1dd9b700 1 -- 172.21.15.124:0/87831237 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd200cdd30 msgr2=0x7fdd2006de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:17.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.866+0000 7fdd1dd9b700 1 --2- 172.21.15.124:0/87831237 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd200cdd30 0x7fdd2006de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.866+0000 7fdd1dd9b700 1 -- 172.21.15.124:0/87831237 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd2006a820 msgr2=0x7fdd20156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:17.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.866+0000 7fdd1dd9b700 1 --2- 172.21.15.124:0/87831237 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd2006a820 0x7fdd20156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:17.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.866+0000 7fdd1dd9b700 1 -- 172.21.15.124:0/87831237 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd140094a0 con 0x7fdd2006b370 2023-10-16T12:59:17.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.866+0000 7fdd1e59c700 1 --2- 172.21.15.124:0/87831237 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd2006a820 0x7fdd20156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:17.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.867+0000 7fdd1dd9b700 1 --2- 172.21.15.124:0/87831237 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd2006b370 0x7fdd200c6150 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdd140090b0 tx=0x7fdd140047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:17.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.867+0000 7fdd0effd700 1 -- 172.21.15.124:0/87831237 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd14011830 con 0x7fdd2006b370 2023-10-16T12:59:17.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.867+0000 7fdd0effd700 1 -- 172.21.15.124:0/87831237 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd14011990 con 0x7fdd2006b370 2023-10-16T12:59:17.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.867+0000 7fdd24b68700 1 -- 172.21.15.124:0/87831237 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd200c43d0 con 0x7fdd2006b370 2023-10-16T12:59:17.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.867+0000 7fdd0effd700 1 -- 172.21.15.124:0/87831237 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd14011d40 con 0x7fdd2006b370 2023-10-16T12:59:17.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.867+0000 7fdd24b68700 1 -- 172.21.15.124:0/87831237 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd200c4990 con 0x7fdd2006b370 2023-10-16T12:59:17.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.868+0000 7fdd24b68700 1 -- 172.21.15.124:0/87831237 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd200c4b20 con 0x7fdd2006b370 2023-10-16T12:59:17.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.868+0000 7fdd0effd700 1 -- 172.21.15.124:0/87831237 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdd1401b440 con 0x7fdd2006b370 2023-10-16T12:59:17.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.869+0000 7fdd0effd700 1 --2- 172.21.15.124:0/87831237 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fdd0006af00 0x7fdd0006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:17.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.869+0000 7fdd1e59c700 1 --2- 172.21.15.124:0/87831237 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fdd0006af00 0x7fdd0006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:17.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.869+0000 7fdd0effd700 1 -- 172.21.15.124:0/87831237 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdd1408b120 con 0x7fdd2006b370 2023-10-16T12:59:17.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.869+0000 7fdd1e59c700 1 --2- 172.21.15.124:0/87831237 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fdd0006af00 0x7fdd0006d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdd20067530 tx=0x7fdd10008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:17.879 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:17.873+0000 7fdd0effd700 1 -- 172.21.15.124:0/87831237 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdd14055f70 con 0x7fdd2006b370 2023-10-16T12:59:18.062 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.060+0000 7fdd24b68700 1 -- 172.21.15.124:0/87831237 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdd20072d10 con 0x7fdd2006b370 2023-10-16T12:59:18.062 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.061+0000 7fdd0effd700 1 -- 172.21.15.124:0/87831237 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdd14059590 con 0x7fdd2006b370 2023-10-16T12:59:18.063 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-16T12:59:18.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.063+0000 7fdd24b68700 1 -- 172.21.15.124:0/87831237 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fdd0006af00 msgr2=0x7fdd0006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:18.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.063+0000 7fdd24b68700 1 --2- 172.21.15.124:0/87831237 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fdd0006af00 0x7fdd0006d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdd20067530 tx=0x7fdd10008040 comp rx=0 tx=0).stop 2023-10-16T12:59:18.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.063+0000 7fdd24b68700 1 -- 172.21.15.124:0/87831237 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd2006b370 msgr2=0x7fdd200c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:18.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.063+0000 7fdd24b68700 1 --2- 172.21.15.124:0/87831237 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd2006b370 0x7fdd200c6150 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdd140090b0 tx=0x7fdd140047c0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.063+0000 7fdd24b68700 1 -- 172.21.15.124:0/87831237 shutdown_connections 2023-10-16T12:59:18.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.063+0000 7fdd24b68700 1 --2- 172.21.15.124:0/87831237 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fdd0006af00 0x7fdd0006d3c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.063+0000 7fdd24b68700 1 --2- 172.21.15.124:0/87831237 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd200cdd30 0x7fdd2006de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.063+0000 7fdd24b68700 1 --2- 172.21.15.124:0/87831237 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd2006a820 0x7fdd20156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.063+0000 7fdd24b68700 1 --2- 172.21.15.124:0/87831237 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdd2006b370 0x7fdd200c6150 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.066 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.063+0000 7fdd24b68700 1 -- 172.21.15.124:0/87831237 >> 172.21.15.124:0/87831237 conn(0x7fdd200ccbe0 msgr2=0x7fdd200afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:18.067 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.063+0000 7fdd24b68700 1 -- 172.21.15.124:0/87831237 shutdown_connections 2023-10-16T12:59:18.067 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.063+0000 7fdd24b68700 1 -- 172.21.15.124:0/87831237 wait complete. 2023-10-16T12:59:18.076 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T12:59:18.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.197+0000 7f39095ef700 1 Processor -- start 2023-10-16T12:59:18.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.197+0000 7f39095ef700 1 -- start start 2023-10-16T12:59:18.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.198+0000 7f39095ef700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f39040b9060 0x7f39040ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:18.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.198+0000 7f39095ef700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f390406b7e0 0x7f390406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:18.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.198+0000 7f39095ef700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39040ce5e0 con 0x7f390415d760 2023-10-16T12:59:18.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.198+0000 7f39095ef700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f390406c1b0 con 0x7f39040b9060 2023-10-16T12:59:18.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.198+0000 7f39095ef700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39040cf420 con 0x7f390406b7e0 2023-10-16T12:59:18.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.198+0000 7f39027fc700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f39040b9060 0x7f39040ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:18.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.198+0000 7f39027fc700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f39040b9060 0x7f39040ce0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54100/0 (socket says 172.21.15.124:54100) 2023-10-16T12:59:18.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.198+0000 7f39027fc700 1 -- 172.21.15.124:0/2522173449 learned_addr learned my addr 172.21.15.124:0/2522173449 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:18.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.198+0000 7f39037fe700 1 --2- 172.21.15.124:0/2522173449 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f390406b7e0 0x7f390406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:18.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.198+0000 7f39027fc700 1 -- 172.21.15.124:0/2522173449 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f390406b7e0 msgr2=0x7f390406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:18.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.198+0000 7f39027fc700 1 --2- 172.21.15.124:0/2522173449 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f390406b7e0 0x7f390406bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.198+0000 7f39027fc700 1 -- 172.21.15.124:0/2522173449 >> v1:172.21.15.192:6789/0 conn(0x7f390415d760 legacy=0x7f39040cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:18.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.198+0000 7f39027fc700 1 -- 172.21.15.124:0/2522173449 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39040b94c0 con 0x7f39040b9060 2023-10-16T12:59:18.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.199+0000 7f39027fc700 1 --2- 172.21.15.124:0/2522173449 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39040b9060 0x7f39040ce0a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f38f40098f0 tx=0x7f38f4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9211bfbdce42084c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:18.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.199+0000 7f3901ffb700 1 -- 172.21.15.124:0/2522173449 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f400b8a0 con 0x7f39040b9060 2023-10-16T12:59:18.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.199+0000 7f3901ffb700 1 -- 172.21.15.124:0/2522173449 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f400ba00 con 0x7f39040b9060 2023-10-16T12:59:18.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.199+0000 7f3901ffb700 1 -- 172.21.15.124:0/2522173449 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f400bd90 con 0x7f39040b9060 2023-10-16T12:59:18.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.199+0000 7f39095ef700 1 -- 172.21.15.124:0/2522173449 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39040b9060 msgr2=0x7f39040ce0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:18.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.199+0000 7f39095ef700 1 --2- 172.21.15.124:0/2522173449 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39040b9060 0x7f39040ce0a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f38f40098f0 tx=0x7f38f4009c00 comp rx=0 tx=0).stop 2023-10-16T12:59:18.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.199+0000 7f39095ef700 1 -- 172.21.15.124:0/2522173449 shutdown_connections 2023-10-16T12:59:18.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.199+0000 7f39095ef700 1 --2- 172.21.15.124:0/2522173449 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f390406b7e0 0x7f390406bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.199+0000 7f39095ef700 1 --2- 172.21.15.124:0/2522173449 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39040b9060 0x7f39040ce0a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.199+0000 7f39095ef700 1 -- 172.21.15.124:0/2522173449 >> 172.21.15.124:0/2522173449 conn(0x7f3904072340 msgr2=0x7f3904072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:18.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.199+0000 7f39095ef700 1 -- 172.21.15.124:0/2522173449 shutdown_connections 2023-10-16T12:59:18.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.199+0000 7f39095ef700 1 -- 172.21.15.124:0/2522173449 wait complete. 2023-10-16T12:59:18.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.201+0000 7f39095ef700 1 Processor -- start 2023-10-16T12:59:18.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.201+0000 7f39095ef700 1 -- start start 2023-10-16T12:59:18.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.201+0000 7f39095ef700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f390406b7e0 0x7f39040b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:18.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.201+0000 7f39095ef700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39040b9060 0x7f39041f6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:18.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.201+0000 7f39095ef700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f390415d760 0x7f39041525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:18.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.201+0000 7f39095ef700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39040b4bd0 con 0x7f390415d760 2023-10-16T12:59:18.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.201+0000 7f39095ef700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39040b35f0 con 0x7f390406b7e0 2023-10-16T12:59:18.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.201+0000 7f39095ef700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39040b38d0 con 0x7f39040b9060 2023-10-16T12:59:18.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.202+0000 7f39037fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f390415d760 0x7f39041525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:18.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.202+0000 7f3902ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f390406b7e0 0x7f39040b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:18.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.202+0000 7f39037fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f390415d760 0x7f39041525b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54108/0 (socket says 172.21.15.124:54108) 2023-10-16T12:59:18.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.202+0000 7f39037fe700 1 -- 172.21.15.124:0/588766907 learned_addr learned my addr 172.21.15.124:0/588766907 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:18.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.202+0000 7f39027fc700 1 --2- 172.21.15.124:0/588766907 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39040b9060 0x7f39041f6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:18.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.202+0000 7f39037fe700 1 -- 172.21.15.124:0/588766907 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39040b9060 msgr2=0x7f39041f6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:18.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.202+0000 7f39037fe700 1 --2- 172.21.15.124:0/588766907 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39040b9060 0x7f39041f6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.202+0000 7f39037fe700 1 -- 172.21.15.124:0/588766907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f390406b7e0 msgr2=0x7f39040b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:18.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.202+0000 7f39037fe700 1 --2- 172.21.15.124:0/588766907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f390406b7e0 0x7f39040b4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.202+0000 7f39037fe700 1 -- 172.21.15.124:0/588766907 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f4009550 con 0x7f390415d760 2023-10-16T12:59:18.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.202+0000 7f39037fe700 1 --2- 172.21.15.124:0/588766907 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f390415d760 0x7f39041525b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f38fc007e40 tx=0x7f38fc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:18.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.202+0000 7f38eb7fe700 1 -- 172.21.15.124:0/588766907 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc00ed30 con 0x7f390415d760 2023-10-16T12:59:18.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.202+0000 7f38eb7fe700 1 -- 172.21.15.124:0/588766907 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38fc014420 con 0x7f390415d760 2023-10-16T12:59:18.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.202+0000 7f39095ef700 1 -- 172.21.15.124:0/588766907 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39040b3bb0 con 0x7f390415d760 2023-10-16T12:59:18.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.202+0000 7f38eb7fe700 1 -- 172.21.15.124:0/588766907 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc0147d0 con 0x7f390415d760 2023-10-16T12:59:18.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.202+0000 7f39095ef700 1 -- 172.21.15.124:0/588766907 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39040b4170 con 0x7f390415d760 2023-10-16T12:59:18.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.203+0000 7f39095ef700 1 -- 172.21.15.124:0/588766907 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f390404ebb0 con 0x7f390415d760 2023-10-16T12:59:18.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.204+0000 7f38eb7fe700 1 -- 172.21.15.124:0/588766907 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f38fc014930 con 0x7f390415d760 2023-10-16T12:59:18.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.204+0000 7f38eb7fe700 1 --2- 172.21.15.124:0/588766907 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f38f006af00 0x7f38f006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:18.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.204+0000 7f38eb7fe700 1 -- 172.21.15.124:0/588766907 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f38fc089f70 con 0x7f390415d760 2023-10-16T12:59:18.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.204+0000 7f3902ffd700 1 --2- 172.21.15.124:0/588766907 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f38f006af00 0x7f38f006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:18.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.204+0000 7f3902ffd700 1 --2- 172.21.15.124:0/588766907 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f38f006af00 0x7f38f006d3c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f390406bf70 tx=0x7f38f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:18.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.208+0000 7f38eb7fe700 1 -- 172.21.15.124:0/588766907 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f38fc0bcca0 con 0x7f390415d760 2023-10-16T12:59:18.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.398+0000 7f39095ef700 1 -- 172.21.15.124:0/588766907 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f390415df50 con 0x7f390415d760 2023-10-16T12:59:18.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.398+0000 7f38eb7fe700 1 -- 172.21.15.124:0/588766907 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f38fc054d30 con 0x7f390415d760 2023-10-16T12:59:18.400 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:18.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.400+0000 7f39095ef700 1 -- 172.21.15.124:0/588766907 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f38f006af00 msgr2=0x7f38f006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:18.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.400+0000 7f39095ef700 1 --2- 172.21.15.124:0/588766907 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f38f006af00 0x7f38f006d3c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f390406bf70 tx=0x7f38f8009040 comp rx=0 tx=0).stop 2023-10-16T12:59:18.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.400+0000 7f39095ef700 1 -- 172.21.15.124:0/588766907 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f390415d760 msgr2=0x7f39041525b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:18.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.400+0000 7f39095ef700 1 --2- 172.21.15.124:0/588766907 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f390415d760 0x7f39041525b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f38fc007e40 tx=0x7f38fc00e3c0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.400+0000 7f39095ef700 1 -- 172.21.15.124:0/588766907 shutdown_connections 2023-10-16T12:59:18.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.400+0000 7f39095ef700 1 --2- 172.21.15.124:0/588766907 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f38f006af00 0x7f38f006d3c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.400+0000 7f39095ef700 1 --2- 172.21.15.124:0/588766907 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f390415d760 0x7f39041525b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.400+0000 7f39095ef700 1 --2- 172.21.15.124:0/588766907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f390406b7e0 0x7f39040b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.400+0000 7f39095ef700 1 --2- 172.21.15.124:0/588766907 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39040b9060 0x7f39041f6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.401+0000 7f39095ef700 1 -- 172.21.15.124:0/588766907 >> 172.21.15.124:0/588766907 conn(0x7f3904072340 msgr2=0x7f39040d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:18.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.401+0000 7f39095ef700 1 -- 172.21.15.124:0/588766907 shutdown_connections 2023-10-16T12:59:18.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.401+0000 7f39095ef700 1 -- 172.21.15.124:0/588766907 wait complete. 2023-10-16T12:59:18.414 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T12:59:18.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.536+0000 7f540d5e8700 1 Processor -- start 2023-10-16T12:59:18.538 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.536+0000 7f540d5e8700 1 -- start start 2023-10-16T12:59:18.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.537+0000 7f540d5e8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f540806a820 0x7f540806ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:18.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.537+0000 7f540d5e8700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f540815fd40 0x7f5408166240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:18.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.537+0000 7f540d5e8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54080cad30 con 0x7f54080717b0 2023-10-16T12:59:18.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.537+0000 7f540d5e8700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54080ca7b0 con 0x7f540815fd40 2023-10-16T12:59:18.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.537+0000 7f540d5e8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54080cb1c0 con 0x7f540806a820 2023-10-16T12:59:18.541 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.537+0000 7f54077fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f540815fd40 0x7f5408166240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:18.542 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.537+0000 7f54077fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f540815fd40 0x7f5408166240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54112/0 (socket says 172.21.15.124:54112) 2023-10-16T12:59:18.542 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.537+0000 7f54077fe700 1 -- 172.21.15.124:0/3291181266 learned_addr learned my addr 172.21.15.124:0/3291181266 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:18.542 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.537+0000 7f5406ffd700 1 --2- 172.21.15.124:0/3291181266 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f540806a820 0x7f540806ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:18.542 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.537+0000 7f54077fe700 1 -- 172.21.15.124:0/3291181266 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f540806a820 msgr2=0x7f540806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:18.542 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.537+0000 7f54077fe700 1 --2- 172.21.15.124:0/3291181266 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f540806a820 0x7f540806ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.537+0000 7f54077fe700 1 -- 172.21.15.124:0/3291181266 >> v1:172.21.15.192:6789/0 conn(0x7f54080717b0 legacy=0x7f5408071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:18.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.538+0000 7f54077fe700 1 -- 172.21.15.124:0/3291181266 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540806df70 con 0x7f540815fd40 2023-10-16T12:59:18.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.538+0000 7f54077fe700 1 --2- 172.21.15.124:0/3291181266 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f540815fd40 0x7f5408166240 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5400009e50 tx=0x7f540000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa08dc1faf367b35 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:18.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.538+0000 7f5405ffb700 1 -- 172.21.15.124:0/3291181266 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540000e070 con 0x7f540815fd40 2023-10-16T12:59:18.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.538+0000 7f5405ffb700 1 -- 172.21.15.124:0/3291181266 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540000b9c0 con 0x7f540815fd40 2023-10-16T12:59:18.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.538+0000 7f5405ffb700 1 -- 172.21.15.124:0/3291181266 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540000bd70 con 0x7f540815fd40 2023-10-16T12:59:18.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.538+0000 7f540d5e8700 1 -- 172.21.15.124:0/3291181266 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f540815fd40 msgr2=0x7f5408166240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:18.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.538+0000 7f540d5e8700 1 --2- 172.21.15.124:0/3291181266 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f540815fd40 0x7f5408166240 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5400009e50 tx=0x7f540000b330 comp rx=0 tx=0).stop 2023-10-16T12:59:18.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.538+0000 7f540d5e8700 1 -- 172.21.15.124:0/3291181266 shutdown_connections 2023-10-16T12:59:18.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.538+0000 7f540d5e8700 1 --2- 172.21.15.124:0/3291181266 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f540815fd40 0x7f5408166240 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.538+0000 7f540d5e8700 1 --2- 172.21.15.124:0/3291181266 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f540806a820 0x7f540806ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.538+0000 7f540d5e8700 1 -- 172.21.15.124:0/3291181266 >> 172.21.15.124:0/3291181266 conn(0x7f54080ccbe0 msgr2=0x7f54080ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:18.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.538+0000 7f540d5e8700 1 -- 172.21.15.124:0/3291181266 shutdown_connections 2023-10-16T12:59:18.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.538+0000 7f540d5e8700 1 -- 172.21.15.124:0/3291181266 wait complete. 2023-10-16T12:59:18.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.540+0000 7f540d5e8700 1 Processor -- start 2023-10-16T12:59:18.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.540+0000 7f540d5e8700 1 -- start start 2023-10-16T12:59:18.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.540+0000 7f540d5e8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f540806a820 0x7f5408158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:18.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.540+0000 7f540d5e8700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54080717b0 0x7f54080ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:18.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.540+0000 7f540d5e8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f540815fd40 0x7f54080adf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:18.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.540+0000 7f540d5e8700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54080b41c0 con 0x7f54080717b0 2023-10-16T12:59:18.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.540+0000 7f540d5e8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54080ad380 con 0x7f540806a820 2023-10-16T12:59:18.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.540+0000 7f540d5e8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54080ad660 con 0x7f540815fd40 2023-10-16T12:59:18.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.541+0000 7f54067fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54080717b0 0x7f54080ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:18.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.541+0000 7f54067fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54080717b0 0x7f54080ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54118/0 (socket says 172.21.15.124:54118) 2023-10-16T12:59:18.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.541+0000 7f54067fc700 1 -- 172.21.15.124:0/3358895337 learned_addr learned my addr 172.21.15.124:0/3358895337 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:18.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.541+0000 7f5406ffd700 1 --2- 172.21.15.124:0/3358895337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f540806a820 0x7f5408158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:18.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.541+0000 7f54077fe700 1 --2- 172.21.15.124:0/3358895337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f540815fd40 0x7f54080adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:18.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.541+0000 7f54067fc700 1 -- 172.21.15.124:0/3358895337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f540815fd40 msgr2=0x7f54080adf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:18.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.541+0000 7f54067fc700 1 --2- 172.21.15.124:0/3358895337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f540815fd40 0x7f54080adf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.541+0000 7f54067fc700 1 -- 172.21.15.124:0/3358895337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f540806a820 msgr2=0x7f5408158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:18.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.541+0000 7f54067fc700 1 --2- 172.21.15.124:0/3358895337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f540806a820 0x7f5408158550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.541+0000 7f54067fc700 1 -- 172.21.15.124:0/3358895337 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5400009b30 con 0x7f54080717b0 2023-10-16T12:59:18.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.541+0000 7f54067fc700 1 --2- 172.21.15.124:0/3358895337 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54080717b0 0x7f54080ac8c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f53f800c4e0 tx=0x7f53f800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:18.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.541+0000 7f53ef7fe700 1 -- 172.21.15.124:0/3358895337 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f80052d0 con 0x7f54080717b0 2023-10-16T12:59:18.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.541+0000 7f53ef7fe700 1 -- 172.21.15.124:0/3358895337 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f8005430 con 0x7f54080717b0 2023-10-16T12:59:18.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.541+0000 7f540d5e8700 1 -- 172.21.15.124:0/3358895337 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54080ad940 con 0x7f54080717b0 2023-10-16T12:59:18.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.541+0000 7f53ef7fe700 1 -- 172.21.15.124:0/3358895337 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f80038c0 con 0x7f54080717b0 2023-10-16T12:59:18.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.541+0000 7f540d5e8700 1 -- 172.21.15.124:0/3358895337 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5408158a90 con 0x7f54080717b0 2023-10-16T12:59:18.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.542+0000 7f540d5e8700 1 -- 172.21.15.124:0/3358895337 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540804ebb0 con 0x7f54080717b0 2023-10-16T12:59:18.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.543+0000 7f53ef7fe700 1 -- 172.21.15.124:0/3358895337 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f53f8003a20 con 0x7f54080717b0 2023-10-16T12:59:18.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.543+0000 7f53ef7fe700 1 --2- 172.21.15.124:0/3358895337 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f53f406af00 0x7f53f406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:18.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.543+0000 7f53ef7fe700 1 -- 172.21.15.124:0/3358895337 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f53f8088c50 con 0x7f54080717b0 2023-10-16T12:59:18.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.543+0000 7f5406ffd700 1 --2- 172.21.15.124:0/3358895337 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f53f406af00 0x7f53f406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:18.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.543+0000 7f5406ffd700 1 --2- 172.21.15.124:0/3358895337 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f53f406af00 0x7f53f406d3c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5408070130 tx=0x7f53fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:18.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.547+0000 7f53ef7fe700 1 -- 172.21.15.124:0/3358895337 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f53f808e020 con 0x7f54080717b0 2023-10-16T12:59:18.740 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.739+0000 7f540d5e8700 1 -- 172.21.15.124:0/3358895337 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f54080cc7e0 con 0x7f54080717b0 2023-10-16T12:59:18.741 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.739+0000 7f53ef7fe700 1 -- 172.21.15.124:0/3358895337 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f53f80170a0 con 0x7f54080717b0 2023-10-16T12:59:18.741 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2023-10-16T12:59:18.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.741+0000 7f540d5e8700 1 -- 172.21.15.124:0/3358895337 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f53f406af00 msgr2=0x7f53f406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:18.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.741+0000 7f540d5e8700 1 --2- 172.21.15.124:0/3358895337 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f53f406af00 0x7f53f406d3c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5408070130 tx=0x7f53fc008040 comp rx=0 tx=0).stop 2023-10-16T12:59:18.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.741+0000 7f540d5e8700 1 -- 172.21.15.124:0/3358895337 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54080717b0 msgr2=0x7f54080ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:18.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.741+0000 7f540d5e8700 1 --2- 172.21.15.124:0/3358895337 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54080717b0 0x7f54080ac8c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f53f800c4e0 tx=0x7f53f800c7f0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.741+0000 7f540d5e8700 1 -- 172.21.15.124:0/3358895337 shutdown_connections 2023-10-16T12:59:18.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.741+0000 7f540d5e8700 1 --2- 172.21.15.124:0/3358895337 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f53f406af00 0x7f53f406d3c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.741+0000 7f540d5e8700 1 --2- 172.21.15.124:0/3358895337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f540815fd40 0x7f54080adf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.741+0000 7f540d5e8700 1 --2- 172.21.15.124:0/3358895337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f540806a820 0x7f5408158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.741+0000 7f540d5e8700 1 --2- 172.21.15.124:0/3358895337 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f54080717b0 0x7f54080ac8c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.741+0000 7f540d5e8700 1 -- 172.21.15.124:0/3358895337 >> 172.21.15.124:0/3358895337 conn(0x7f54080ccbe0 msgr2=0x7f54080c96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:18.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.741+0000 7f540d5e8700 1 -- 172.21.15.124:0/3358895337 shutdown_connections 2023-10-16T12:59:18.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.741+0000 7f540d5e8700 1 -- 172.21.15.124:0/3358895337 wait complete. 2023-10-16T12:59:18.755 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T12:59:18.879 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.877+0000 7fb971d2a700 1 Processor -- start 2023-10-16T12:59:18.879 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.877+0000 7fb971d2a700 1 -- start start 2023-10-16T12:59:18.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.878+0000 7fb971d2a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb96c15dba0 0x7fb96c0ca710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:18.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.878+0000 7fb971d2a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb96c06dcd0 0x7fb96c06e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:18.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.878+0000 7fb971d2a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb96c0ce480 con 0x7fb96c15d7c0 2023-10-16T12:59:18.883 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.878+0000 7fb971d2a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb96c0cf820 con 0x7fb96c15dba0 2023-10-16T12:59:18.883 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.878+0000 7fb971d2a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c0cadf0 con 0x7fb96c06dcd0 2023-10-16T12:59:18.883 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.878+0000 7fb96affd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb96c15dba0 0x7fb96c0ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:18.883 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.878+0000 7fb96bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb96c06dcd0 0x7fb96c06e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:18.883 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.878+0000 7fb96affd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb96c15dba0 0x7fb96c0ca710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:34294/0 (socket says 172.21.15.124:34294) 2023-10-16T12:59:18.884 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.878+0000 7fb96affd700 1 -- 172.21.15.124:0/3700196536 learned_addr learned my addr 172.21.15.124:0/3700196536 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:18.884 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.879+0000 7fb96bfff700 1 -- 172.21.15.124:0/3700196536 >> v2:172.21.15.192:3300/0 conn(0x7fb96c15dba0 msgr2=0x7fb96c0ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:18.884 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.879+0000 7fb96bfff700 1 --2- 172.21.15.124:0/3700196536 >> v2:172.21.15.192:3300/0 conn(0x7fb96c15dba0 0x7fb96c0ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.884 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.879+0000 7fb96bfff700 1 -- 172.21.15.124:0/3700196536 >> v1:172.21.15.192:6789/0 conn(0x7fb96c15d7c0 legacy=0x7fb96c0ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:18.884 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.879+0000 7fb96bfff700 1 -- 172.21.15.124:0/3700196536 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c0cde30 con 0x7fb96c06dcd0 2023-10-16T12:59:18.885 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.879+0000 7fb96affd700 1 --2- 172.21.15.124:0/3700196536 >> v2:172.21.15.192:3300/0 conn(0x7fb96c15dba0 0x7fb96c0ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:59:18.885 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.879+0000 7fb96bfff700 1 --2- 172.21.15.124:0/3700196536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb96c06dcd0 0x7fb96c06e140 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb964009840 tx=0x7fb964009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58a394035407f508 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:18.885 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.879+0000 7fb96a7fc700 1 -- 172.21.15.124:0/3700196536 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964011830 con 0x7fb96c06dcd0 2023-10-16T12:59:18.885 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.879+0000 7fb96a7fc700 1 -- 172.21.15.124:0/3700196536 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb964011990 con 0x7fb96c06dcd0 2023-10-16T12:59:18.886 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.879+0000 7fb96a7fc700 1 -- 172.21.15.124:0/3700196536 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964011d20 con 0x7fb96c06dcd0 2023-10-16T12:59:18.886 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.880+0000 7fb971d2a700 1 -- 172.21.15.124:0/3700196536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb96c06dcd0 msgr2=0x7fb96c06e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:18.886 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.880+0000 7fb971d2a700 1 --2- 172.21.15.124:0/3700196536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb96c06dcd0 0x7fb96c06e140 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb964009840 tx=0x7fb964009b50 comp rx=0 tx=0).stop 2023-10-16T12:59:18.886 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.880+0000 7fb971d2a700 1 -- 172.21.15.124:0/3700196536 shutdown_connections 2023-10-16T12:59:18.886 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.880+0000 7fb971d2a700 1 --2- 172.21.15.124:0/3700196536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb96c06dcd0 0x7fb96c06e140 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.887 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.880+0000 7fb971d2a700 1 --2- 172.21.15.124:0/3700196536 >> v2:172.21.15.192:3300/0 conn(0x7fb96c15dba0 0x7fb96c0ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.887 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.880+0000 7fb971d2a700 1 -- 172.21.15.124:0/3700196536 >> 172.21.15.124:0/3700196536 conn(0x7fb96c0ccbd0 msgr2=0x7fb96c0ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:18.887 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.880+0000 7fb971d2a700 1 -- 172.21.15.124:0/3700196536 shutdown_connections 2023-10-16T12:59:18.887 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.880+0000 7fb971d2a700 1 -- 172.21.15.124:0/3700196536 wait complete. 2023-10-16T12:59:18.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.881+0000 7fb971d2a700 1 Processor -- start 2023-10-16T12:59:18.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.881+0000 7fb971d2a700 1 -- start start 2023-10-16T12:59:18.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.882+0000 7fb971d2a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb96c06dcd0 0x7fb96c0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:18.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.882+0000 7fb971d2a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb96c15d7c0 0x7fb96c0c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:18.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.882+0000 7fb971d2a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb96c15dba0 0x7fb96c159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:18.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.882+0000 7fb971d2a700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c0c76d0 con 0x7fb96c06dcd0 2023-10-16T12:59:18.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.882+0000 7fb971d2a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c15a0f0 con 0x7fb96c15dba0 2023-10-16T12:59:18.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.882+0000 7fb971d2a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c099a40 con 0x7fb96c15d7c0 2023-10-16T12:59:18.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.882+0000 7fb96b7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb96c06dcd0 0x7fb96c0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:18.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.882+0000 7fb96b7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb96c06dcd0 0x7fb96c0ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54132/0 (socket says 172.21.15.124:54132) 2023-10-16T12:59:18.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.882+0000 7fb96b7fe700 1 -- 172.21.15.124:0/3226400699 learned_addr learned my addr 172.21.15.124:0/3226400699 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:18.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.882+0000 7fb96bfff700 1 --2- 172.21.15.124:0/3226400699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb96c15dba0 0x7fb96c159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:18.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.882+0000 7fb96affd700 1 --2- 172.21.15.124:0/3226400699 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb96c15d7c0 0x7fb96c0c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:18.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.882+0000 7fb96b7fe700 1 -- 172.21.15.124:0/3226400699 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb96c15d7c0 msgr2=0x7fb96c0c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:18.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.882+0000 7fb96b7fe700 1 --2- 172.21.15.124:0/3226400699 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb96c15d7c0 0x7fb96c0c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.882+0000 7fb96b7fe700 1 -- 172.21.15.124:0/3226400699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb96c15dba0 msgr2=0x7fb96c159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:18.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.882+0000 7fb96b7fe700 1 --2- 172.21.15.124:0/3226400699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb96c15dba0 0x7fb96c159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:18.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.882+0000 7fb96b7fe700 1 -- 172.21.15.124:0/3226400699 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95c009b30 con 0x7fb96c06dcd0 2023-10-16T12:59:18.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.882+0000 7fb96affd700 1 --2- 172.21.15.124:0/3226400699 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb96c15d7c0 0x7fb96c0c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:18.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.882+0000 7fb96b7fe700 1 --2- 172.21.15.124:0/3226400699 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb96c06dcd0 0x7fb96c0ca490 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb96000c4e0 tx=0x7fb96000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:18.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.883+0000 7fb953fff700 1 -- 172.21.15.124:0/3226400699 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9600052d0 con 0x7fb96c06dcd0 2023-10-16T12:59:18.896 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.883+0000 7fb953fff700 1 -- 172.21.15.124:0/3226400699 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb960005430 con 0x7fb96c06dcd0 2023-10-16T12:59:18.896 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.883+0000 7fb953fff700 1 -- 172.21.15.124:0/3226400699 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9600038c0 con 0x7fb96c06dcd0 2023-10-16T12:59:18.896 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.883+0000 7fb971d2a700 1 -- 172.21.15.124:0/3226400699 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9640094a0 con 0x7fb96c06dcd0 2023-10-16T12:59:18.896 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.883+0000 7fb971d2a700 1 -- 172.21.15.124:0/3226400699 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96c0c7950 con 0x7fb96c06dcd0 2023-10-16T12:59:18.896 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.884+0000 7fb971d2a700 1 -- 172.21.15.124:0/3226400699 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb96c04ebb0 con 0x7fb96c06dcd0 2023-10-16T12:59:18.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.884+0000 7fb953fff700 1 -- 172.21.15.124:0/3226400699 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb960003a20 con 0x7fb96c06dcd0 2023-10-16T12:59:18.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.884+0000 7fb953fff700 1 --2- 172.21.15.124:0/3226400699 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb95806af00 0x7fb95806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:18.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.885+0000 7fb953fff700 1 -- 172.21.15.124:0/3226400699 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb960088d20 con 0x7fb96c06dcd0 2023-10-16T12:59:18.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.885+0000 7fb96affd700 1 --2- 172.21.15.124:0/3226400699 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb95806af00 0x7fb95806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:18.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.885+0000 7fb96affd700 1 --2- 172.21.15.124:0/3226400699 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb95806af00 0x7fb95806d3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0b5ca0 tx=0x7fb95c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:18.898 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:18.889+0000 7fb953fff700 1 -- 172.21.15.124:0/3226400699 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb960053ae0 con 0x7fb96c06dcd0 2023-10-16T12:59:19.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.077+0000 7fb971d2a700 1 -- 172.21.15.124:0/3226400699 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb96c0b60d0 con 0x7fb96c06dcd0 2023-10-16T12:59:19.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.077+0000 7fb953fff700 1 -- 172.21.15.124:0/3226400699 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb9600170a0 con 0x7fb96c06dcd0 2023-10-16T12:59:19.079 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:19.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.079+0000 7fb971d2a700 1 -- 172.21.15.124:0/3226400699 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb95806af00 msgr2=0x7fb95806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:19.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.079+0000 7fb971d2a700 1 --2- 172.21.15.124:0/3226400699 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb95806af00 0x7fb95806d3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0b5ca0 tx=0x7fb95c00b040 comp rx=0 tx=0).stop 2023-10-16T12:59:19.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.079+0000 7fb971d2a700 1 -- 172.21.15.124:0/3226400699 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb96c06dcd0 msgr2=0x7fb96c0ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:19.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.079+0000 7fb971d2a700 1 --2- 172.21.15.124:0/3226400699 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb96c06dcd0 0x7fb96c0ca490 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb96000c4e0 tx=0x7fb96000c7f0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.079+0000 7fb971d2a700 1 -- 172.21.15.124:0/3226400699 shutdown_connections 2023-10-16T12:59:19.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.079+0000 7fb971d2a700 1 --2- 172.21.15.124:0/3226400699 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb95806af00 0x7fb95806d3c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.079+0000 7fb971d2a700 1 --2- 172.21.15.124:0/3226400699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb96c15dba0 0x7fb96c159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.079+0000 7fb971d2a700 1 --2- 172.21.15.124:0/3226400699 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb96c06dcd0 0x7fb96c0ca490 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.079+0000 7fb971d2a700 1 --2- 172.21.15.124:0/3226400699 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb96c15d7c0 0x7fb96c0c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.079+0000 7fb971d2a700 1 -- 172.21.15.124:0/3226400699 >> 172.21.15.124:0/3226400699 conn(0x7fb96c0ccbd0 msgr2=0x7fb96c0aea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:19.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.079+0000 7fb971d2a700 1 -- 172.21.15.124:0/3226400699 shutdown_connections 2023-10-16T12:59:19.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.079+0000 7fb971d2a700 1 -- 172.21.15.124:0/3226400699 wait complete. 2023-10-16T12:59:19.093 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T12:59:19.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.212+0000 7f4e3dae3700 1 Processor -- start 2023-10-16T12:59:19.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.212+0000 7f4e3dae3700 1 -- start start 2023-10-16T12:59:19.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.212+0000 7f4e3dae3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4e38152470 0x7f4e380cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:19.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.212+0000 7f4e3dae3700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4e380cb8d0 0x7f4e380b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:19.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.212+0000 7f4e3dae3700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e38070d70 con 0x7f4e380b3240 2023-10-16T12:59:19.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.212+0000 7f4e3dae3700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e380b36d0 con 0x7f4e380cb8d0 2023-10-16T12:59:19.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.212+0000 7f4e3dae3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e38071200 con 0x7f4e38152470 2023-10-16T12:59:19.218 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.213+0000 7f4e37fff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f4e380b3240 0x7f4e380b60f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42810/0 (socket says 172.21.15.124:42810) 2023-10-16T12:59:19.218 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.213+0000 7f4e37fff700 1 -- 172.21.15.124:0/3044832666 learned_addr learned my addr 172.21.15.124:0/3044832666 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:19.218 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.213+0000 7f4e36ffd700 1 --2- 172.21.15.124:0/3044832666 >> v2:172.21.15.124:3300/0 conn(0x7f4e380cb8d0 0x7f4e380b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:19.218 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.213+0000 7f4e367fc700 1 -- 172.21.15.124:0/3044832666 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261996573 0 0) 0x7f4e38070d70 con 0x7f4e380b3240 2023-10-16T12:59:19.219 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.213+0000 7f4e377fe700 1 --2- 172.21.15.124:0/3044832666 >> v2:172.21.15.192:3300/0 conn(0x7f4e38152470 0x7f4e380cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:19.219 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.213+0000 7f4e367fc700 1 -- 172.21.15.124:0/3044832666 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e240035b0 con 0x7f4e380b3240 2023-10-16T12:59:19.219 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.213+0000 7f4e36ffd700 1 -- 172.21.15.124:0/3044832666 >> v2:172.21.15.192:3300/0 conn(0x7f4e38152470 msgr2=0x7f4e380cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:19.219 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.213+0000 7f4e36ffd700 1 --2- 172.21.15.124:0/3044832666 >> v2:172.21.15.192:3300/0 conn(0x7f4e38152470 0x7f4e380cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.213+0000 7f4e36ffd700 1 -- 172.21.15.124:0/3044832666 >> v1:172.21.15.124:6789/0 conn(0x7f4e380b3240 legacy=0x7f4e380b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:19.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.213+0000 7f4e36ffd700 1 -- 172.21.15.124:0/3044832666 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e380cbd80 con 0x7f4e380cb8d0 2023-10-16T12:59:19.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.213+0000 7f4e36ffd700 1 --2- 172.21.15.124:0/3044832666 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4e380cb8d0 0x7f4e380b2d00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4e38071460 tx=0x7f4e28009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b422bae8d7b20851 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:19.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.213+0000 7f4e367fc700 1 -- 172.21.15.124:0/3044832666 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28011830 con 0x7f4e380cb8d0 2023-10-16T12:59:19.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.213+0000 7f4e367fc700 1 -- 172.21.15.124:0/3044832666 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e28011990 con 0x7f4e380cb8d0 2023-10-16T12:59:19.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.213+0000 7f4e367fc700 1 -- 172.21.15.124:0/3044832666 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28011d20 con 0x7f4e380cb8d0 2023-10-16T12:59:19.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.214+0000 7f4e3dae3700 1 -- 172.21.15.124:0/3044832666 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4e380cb8d0 msgr2=0x7f4e380b2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:19.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.214+0000 7f4e3dae3700 1 --2- 172.21.15.124:0/3044832666 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4e380cb8d0 0x7f4e380b2d00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4e38071460 tx=0x7f4e28009b20 comp rx=0 tx=0).stop 2023-10-16T12:59:19.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.214+0000 7f4e3dae3700 1 -- 172.21.15.124:0/3044832666 shutdown_connections 2023-10-16T12:59:19.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.214+0000 7f4e3dae3700 1 --2- 172.21.15.124:0/3044832666 >> v2:172.21.15.192:3300/0 conn(0x7f4e38152470 0x7f4e380cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.214+0000 7f4e3dae3700 1 --2- 172.21.15.124:0/3044832666 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4e380cb8d0 0x7f4e380b2d00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.214+0000 7f4e3dae3700 1 -- 172.21.15.124:0/3044832666 >> 172.21.15.124:0/3044832666 conn(0x7f4e380cdd00 msgr2=0x7f4e380ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:19.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.214+0000 7f4e3dae3700 1 -- 172.21.15.124:0/3044832666 shutdown_connections 2023-10-16T12:59:19.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.214+0000 7f4e3dae3700 1 -- 172.21.15.124:0/3044832666 wait complete. 2023-10-16T12:59:19.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.215+0000 7f4e3dae3700 1 Processor -- start 2023-10-16T12:59:19.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.216+0000 7f4e3dae3700 1 -- start start 2023-10-16T12:59:19.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.216+0000 7f4e3dae3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e380b3240 0x7f4e38150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:19.226 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.216+0000 7f4e3dae3700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4e380cb8d0 0x7f4e380c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:19.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.216+0000 7f4e3dae3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e38152470 0x7f4e380c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:19.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.216+0000 7f4e3dae3700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e38151330 con 0x7f4e380cb8d0 2023-10-16T12:59:19.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.216+0000 7f4e3dae3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e38156420 con 0x7f4e38152470 2023-10-16T12:59:19.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.216+0000 7f4e3dae3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e38156700 con 0x7f4e380b3240 2023-10-16T12:59:19.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.217+0000 7f4e36ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4e380cb8d0 0x7f4e380c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:19.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.217+0000 7f4e36ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4e380cb8d0 0x7f4e380c8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54148/0 (socket says 172.21.15.124:54148) 2023-10-16T12:59:19.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.217+0000 7f4e36ffd700 1 -- 172.21.15.124:0/2767703045 learned_addr learned my addr 172.21.15.124:0/2767703045 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:19.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.217+0000 7f4e377fe700 1 --2- 172.21.15.124:0/2767703045 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e380b3240 0x7f4e38150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:19.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.217+0000 7f4e37fff700 1 --2- 172.21.15.124:0/2767703045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e38152470 0x7f4e380c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:19.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.217+0000 7f4e36ffd700 1 -- 172.21.15.124:0/2767703045 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e380b3240 msgr2=0x7f4e38150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:19.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.217+0000 7f4e36ffd700 1 --2- 172.21.15.124:0/2767703045 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e380b3240 0x7f4e38150df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.217+0000 7f4e36ffd700 1 -- 172.21.15.124:0/2767703045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e38152470 msgr2=0x7f4e380c63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:19.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.217+0000 7f4e36ffd700 1 --2- 172.21.15.124:0/2767703045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e38152470 0x7f4e380c63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.217+0000 7f4e36ffd700 1 -- 172.21.15.124:0/2767703045 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e280094a0 con 0x7f4e380cb8d0 2023-10-16T12:59:19.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.217+0000 7f4e36ffd700 1 --2- 172.21.15.124:0/2767703045 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4e380cb8d0 0x7f4e380c8d40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4e28009b60 tx=0x7f4e28004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:19.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.217+0000 7f4e2ffff700 1 -- 172.21.15.124:0/2767703045 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e280038a0 con 0x7f4e380cb8d0 2023-10-16T12:59:19.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.217+0000 7f4e2ffff700 1 -- 172.21.15.124:0/2767703045 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2801f070 con 0x7f4e380cb8d0 2023-10-16T12:59:19.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.217+0000 7f4e3dae3700 1 -- 172.21.15.124:0/2767703045 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e381569e0 con 0x7f4e380cb8d0 2023-10-16T12:59:19.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.217+0000 7f4e2ffff700 1 -- 172.21.15.124:0/2767703045 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28003c20 con 0x7f4e380cb8d0 2023-10-16T12:59:19.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.217+0000 7f4e3dae3700 1 -- 172.21.15.124:0/2767703045 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e38156fa0 con 0x7f4e380cb8d0 2023-10-16T12:59:19.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.218+0000 7f4e3dae3700 1 -- 172.21.15.124:0/2767703045 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3804ebb0 con 0x7f4e380cb8d0 2023-10-16T12:59:19.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.219+0000 7f4e2ffff700 1 -- 172.21.15.124:0/2767703045 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4e2801a430 con 0x7f4e380cb8d0 2023-10-16T12:59:19.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.219+0000 7f4e2ffff700 1 --2- 172.21.15.124:0/2767703045 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f4e1806af00 0x7f4e1806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:19.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.219+0000 7f4e377fe700 1 --2- 172.21.15.124:0/2767703045 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f4e1806af00 0x7f4e1806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:19.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.219+0000 7f4e2ffff700 1 -- 172.21.15.124:0/2767703045 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4e28021070 con 0x7f4e380cb8d0 2023-10-16T12:59:19.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.219+0000 7f4e377fe700 1 --2- 172.21.15.124:0/2767703045 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f4e1806af00 0x7f4e1806d3c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4e20009930 tx=0x7f4e20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:19.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.224+0000 7f4e2ffff700 1 -- 172.21.15.124:0/2767703045 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4e28055fe0 con 0x7f4e380cb8d0 2023-10-16T12:59:19.458 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.457+0000 7f4e3dae3700 1 -- 172.21.15.124:0/2767703045 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e38151c90 con 0x7f4e380cb8d0 2023-10-16T12:59:19.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.457+0000 7f4e2ffff700 1 -- 172.21.15.124:0/2767703045 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4918 (secure 0 0 0) 0x7f4e28059600 con 0x7f4e380cb8d0 2023-10-16T12:59:19.459 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:19.460 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1489119886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6833","nonce":1489119886},{"type":"v1","addr":"172.21.15.192:6835","nonce":1489119886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/2221949787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":2221949787},{"type":"v1","addr":"172.21.15.124:6836","nonce":2221949787}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1247092782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":1247092782},{"type":"v1","addr":"172.21.15.124:6837","nonce":1247092782}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T12:58:51.047667+0000","modified":"2023-10-16T12:59:08.133656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6834/621867052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":621867052},{"type":"v1","addr":"172.21.15.192:6834","nonce":621867052}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T12:59:19.461 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.460+0000 7f4e3dae3700 1 -- 172.21.15.124:0/2767703045 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f4e1806af00 msgr2=0x7f4e1806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:19.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.460+0000 7f4e3dae3700 1 --2- 172.21.15.124:0/2767703045 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f4e1806af00 0x7f4e1806d3c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4e20009930 tx=0x7f4e20008040 comp rx=0 tx=0).stop 2023-10-16T12:59:19.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.460+0000 7f4e3dae3700 1 -- 172.21.15.124:0/2767703045 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4e380cb8d0 msgr2=0x7f4e380c8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:19.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.460+0000 7f4e3dae3700 1 --2- 172.21.15.124:0/2767703045 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4e380cb8d0 0x7f4e380c8d40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4e28009b60 tx=0x7f4e28004750 comp rx=0 tx=0).stop 2023-10-16T12:59:19.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.460+0000 7f4e3dae3700 1 -- 172.21.15.124:0/2767703045 shutdown_connections 2023-10-16T12:59:19.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.460+0000 7f4e3dae3700 1 --2- 172.21.15.124:0/2767703045 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f4e1806af00 0x7f4e1806d3c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.460+0000 7f4e3dae3700 1 --2- 172.21.15.124:0/2767703045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e38152470 0x7f4e380c63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.460+0000 7f4e3dae3700 1 --2- 172.21.15.124:0/2767703045 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e380b3240 0x7f4e38150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.460+0000 7f4e3dae3700 1 --2- 172.21.15.124:0/2767703045 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4e380cb8d0 0x7f4e380c8d40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.464 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.460+0000 7f4e3dae3700 1 -- 172.21.15.124:0/2767703045 >> 172.21.15.124:0/2767703045 conn(0x7f4e380cdd00 msgr2=0x7f4e3815ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:19.464 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.460+0000 7f4e3dae3700 1 -- 172.21.15.124:0/2767703045 shutdown_connections 2023-10-16T12:59:19.464 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.460+0000 7f4e3dae3700 1 -- 172.21.15.124:0/2767703045 wait complete. 2023-10-16T12:59:19.464 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 9 2023-10-16T12:59:19.474 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:59:19.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.592+0000 7f6375ec7700 1 Processor -- start 2023-10-16T12:59:19.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.592+0000 7f6375ec7700 1 -- start start 2023-10-16T12:59:19.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.593+0000 7f6375ec7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63700cf7d0 0x7f637015e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:19.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.593+0000 7f6375ec7700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63700cfeb0 con 0x7f63700ca7d0 2023-10-16T12:59:19.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.593+0000 7f6375ec7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63700cfc30 con 0x7f637006a820 2023-10-16T12:59:19.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.593+0000 7f6375ec7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63700ce410 con 0x7f63700cf7d0 2023-10-16T12:59:19.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.593+0000 7f636ffff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f63700ca7d0 0x7f6370071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42826/0 (socket says 172.21.15.124:42826) 2023-10-16T12:59:19.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.593+0000 7f636ffff700 1 -- 172.21.15.124:0/683855118 learned_addr learned my addr 172.21.15.124:0/683855118 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:19.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.593+0000 7f636effd700 1 --2- 172.21.15.124:0/683855118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63700cf7d0 0x7f637015e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:19.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.593+0000 7f636e7fc700 1 -- 172.21.15.124:0/683855118 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269481762 0 0) 0x7f63700cfeb0 con 0x7f63700ca7d0 2023-10-16T12:59:19.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.593+0000 7f636e7fc700 1 -- 172.21.15.124:0/683855118 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63580035b0 con 0x7f63700ca7d0 2023-10-16T12:59:19.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.593+0000 7f636e7fc700 1 -- 172.21.15.124:0/683855118 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4279086739 0 0) 0x7f63580035b0 con 0x7f63700ca7d0 2023-10-16T12:59:19.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.593+0000 7f636e7fc700 1 -- 172.21.15.124:0/683855118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63700cf7d0 msgr2=0x7f637015e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:19.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.593+0000 7f636e7fc700 1 --2- 172.21.15.124:0/683855118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63700cf7d0 0x7f637015e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.593+0000 7f636e7fc700 1 -- 172.21.15.124:0/683855118 >> v1:172.21.15.192:6789/0 conn(0x7f637006a820 legacy=0x7f637006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:19.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.594+0000 7f636e7fc700 1 -- 172.21.15.124:0/683855118 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63700af9d0 con 0x7f63700ca7d0 2023-10-16T12:59:19.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.594+0000 7f636e7fc700 1 -- 172.21.15.124:0/683855118 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f6368001a40 con 0x7f63700ca7d0 2023-10-16T12:59:19.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.594+0000 7f636e7fc700 1 -- 172.21.15.124:0/683855118 >> v1:172.21.15.124:6789/0 conn(0x7f63700ca7d0 legacy=0x7f6370071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:19.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.594+0000 7f636e7fc700 1 --2- 172.21.15.124:0/683855118 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6358003a30 0x7f6358003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:19.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.594+0000 7f636e7fc700 1 --2- 172.21.15.124:0/683855118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63700cf7d0 0x7f6358004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:19.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.594+0000 7f636e7fc700 1 --2- 172.21.15.124:0/683855118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6358004d90 0x7f6358005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:19.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.594+0000 7f636e7fc700 1 -- 172.21.15.124:0/683855118 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63700ce410 con 0x7f6358003a30 2023-10-16T12:59:19.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.594+0000 7f636e7fc700 1 -- 172.21.15.124:0/683855118 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635800bb40 con 0x7f6358004d90 2023-10-16T12:59:19.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.594+0000 7f636e7fc700 1 -- 172.21.15.124:0/683855118 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f635800bd00 con 0x7f63700cf7d0 2023-10-16T12:59:19.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.594+0000 7f636f7fe700 1 --2- 172.21.15.124:0/683855118 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6358003a30 0x7f6358003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:19.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.594+0000 7f636effd700 1 --2- 172.21.15.124:0/683855118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63700cf7d0 0x7f6358004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:19.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.594+0000 7f636ffff700 1 --2- 172.21.15.124:0/683855118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6358004d90 0x7f6358005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:19.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.594+0000 7f636f7fe700 1 -- 172.21.15.124:0/683855118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63700cf7d0 msgr2=0x7f6358004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:19.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.594+0000 7f636f7fe700 1 --2- 172.21.15.124:0/683855118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63700cf7d0 0x7f6358004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.594+0000 7f636f7fe700 1 -- 172.21.15.124:0/683855118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6358004d90 msgr2=0x7f6358005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:19.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.594+0000 7f636f7fe700 1 --2- 172.21.15.124:0/683855118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6358004d90 0x7f6358005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.594+0000 7f636f7fe700 1 -- 172.21.15.124:0/683855118 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63580035b0 con 0x7f6358003a30 2023-10-16T12:59:19.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.594+0000 7f636f7fe700 1 --2- 172.21.15.124:0/683855118 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6358003a30 0x7f6358003e50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f63640017c0 tx=0x7f6358005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57dfd674f1c3c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:19.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.594+0000 7f636e7fc700 1 -- 172.21.15.124:0/683855118 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63640052d0 con 0x7f6358003a30 2023-10-16T12:59:19.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.594+0000 7f636e7fc700 1 -- 172.21.15.124:0/683855118 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6364005430 con 0x7f6358003a30 2023-10-16T12:59:19.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.594+0000 7f636e7fc700 1 -- 172.21.15.124:0/683855118 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63640038c0 con 0x7f6358003a30 2023-10-16T12:59:19.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.595+0000 7f6375ec7700 1 -- 172.21.15.124:0/683855118 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6358003a30 msgr2=0x7f6358003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:19.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.595+0000 7f6375ec7700 1 --2- 172.21.15.124:0/683855118 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6358003a30 0x7f6358003e50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f63640017c0 tx=0x7f6358005880 comp rx=0 tx=0).stop 2023-10-16T12:59:19.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.595+0000 7f636ffff700 1 -- 172.21.15.124:0/683855118 reap_dead start 2023-10-16T12:59:19.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.595+0000 7f6375ec7700 1 -- 172.21.15.124:0/683855118 shutdown_connections 2023-10-16T12:59:19.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.595+0000 7f6375ec7700 1 -- 172.21.15.124:0/683855118 >> 172.21.15.124:0/683855118 conn(0x7f63700d0180 msgr2=0x7f63700d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:19.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.595+0000 7f6375ec7700 1 -- 172.21.15.124:0/683855118 shutdown_connections 2023-10-16T12:59:19.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.595+0000 7f6375ec7700 1 -- 172.21.15.124:0/683855118 wait complete. 2023-10-16T12:59:19.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.596+0000 7f6375ec7700 1 Processor -- start 2023-10-16T12:59:19.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.596+0000 7f6375ec7700 1 -- start start 2023-10-16T12:59:19.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.597+0000 7f6375ec7700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6358003a30 0x7f63700aec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:19.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.597+0000 7f6375ec7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6370155220 0x7f63700acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:19.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.597+0000 7f6375ec7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63700ad330 0x7f637006e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:19.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.597+0000 7f6375ec7700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6370157f50 con 0x7f6358003a30 2023-10-16T12:59:19.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.597+0000 7f6375ec7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63700ae790 con 0x7f6370155220 2023-10-16T12:59:19.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.597+0000 7f6375ec7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63700af160 con 0x7f63700ad330 2023-10-16T12:59:19.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.597+0000 7f636f7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6358003a30 0x7f63700aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:19.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.597+0000 7f636f7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6358003a30 0x7f63700aec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54166/0 (socket says 172.21.15.124:54166) 2023-10-16T12:59:19.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.597+0000 7f636f7fe700 1 -- 172.21.15.124:0/1082968496 learned_addr learned my addr 172.21.15.124:0/1082968496 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:19.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.597+0000 7f636effd700 1 --2- 172.21.15.124:0/1082968496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6370155220 0x7f63700acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:19.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.597+0000 7f636ffff700 1 --2- 172.21.15.124:0/1082968496 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63700ad330 0x7f637006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:19.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.597+0000 7f636f7fe700 1 -- 172.21.15.124:0/1082968496 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63700ad330 msgr2=0x7f637006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:19.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.597+0000 7f636f7fe700 1 --2- 172.21.15.124:0/1082968496 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63700ad330 0x7f637006e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.597+0000 7f636f7fe700 1 -- 172.21.15.124:0/1082968496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6370155220 msgr2=0x7f63700acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:19.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.597+0000 7f636f7fe700 1 --2- 172.21.15.124:0/1082968496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6370155220 0x7f63700acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.597+0000 7f636f7fe700 1 -- 172.21.15.124:0/1082968496 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63700adc40 con 0x7f6358003a30 2023-10-16T12:59:19.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.598+0000 7f636f7fe700 1 --2- 172.21.15.124:0/1082968496 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6358003a30 0x7f63700aec20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6364001db0 tx=0x7f6364001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:19.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.598+0000 7f6357fff700 1 -- 172.21.15.124:0/1082968496 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6364026660 con 0x7f6358003a30 2023-10-16T12:59:19.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.598+0000 7f6357fff700 1 -- 172.21.15.124:0/1082968496 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6364003e90 con 0x7f6358003a30 2023-10-16T12:59:19.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.598+0000 7f6357fff700 1 -- 172.21.15.124:0/1082968496 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6364026a00 con 0x7f6358003a30 2023-10-16T12:59:19.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.598+0000 7f6375ec7700 1 -- 172.21.15.124:0/1082968496 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63701559a0 con 0x7f6358003a30 2023-10-16T12:59:19.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.598+0000 7f6375ec7700 1 -- 172.21.15.124:0/1082968496 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63700ae140 con 0x7f6358003a30 2023-10-16T12:59:19.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.599+0000 7f6375ec7700 1 -- 172.21.15.124:0/1082968496 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63700aea70 con 0x7f6358003a30 2023-10-16T12:59:19.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.599+0000 7f6357fff700 1 -- 172.21.15.124:0/1082968496 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6364019070 con 0x7f6358003a30 2023-10-16T12:59:19.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.599+0000 7f6357fff700 1 --2- 172.21.15.124:0/1082968496 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f635c06af00 0x7f635c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:19.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.600+0000 7f6357fff700 1 -- 172.21.15.124:0/1082968496 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f636408a690 con 0x7f6358003a30 2023-10-16T12:59:19.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.600+0000 7f636effd700 1 --2- 172.21.15.124:0/1082968496 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f635c06af00 0x7f635c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:19.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.600+0000 7f636effd700 1 --2- 172.21.15.124:0/1082968496 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f635c06af00 0x7f635c06d3c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6370157270 tx=0x7f6360008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:19.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.604+0000 7f6357fff700 1 -- 172.21.15.124:0/1082968496 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6364055600 con 0x7f6358003a30 2023-10-16T12:59:19.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.798+0000 7f6375ec7700 1 -- 172.21.15.124:0/1082968496 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63700ad710 con 0x7f6358003a30 2023-10-16T12:59:19.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.799+0000 7f6357fff700 1 -- 172.21.15.124:0/1082968496 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f6364058c20 con 0x7f6358003a30 2023-10-16T12:59:19.802 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:19.802 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":24,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:58:56.089767+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:59:19.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.802+0000 7f6375ec7700 1 -- 172.21.15.124:0/1082968496 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f635c06af00 msgr2=0x7f635c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:19.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.802+0000 7f6375ec7700 1 --2- 172.21.15.124:0/1082968496 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f635c06af00 0x7f635c06d3c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6370157270 tx=0x7f6360008040 comp rx=0 tx=0).stop 2023-10-16T12:59:19.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.802+0000 7f6375ec7700 1 -- 172.21.15.124:0/1082968496 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6358003a30 msgr2=0x7f63700aec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:19.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.802+0000 7f6375ec7700 1 --2- 172.21.15.124:0/1082968496 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6358003a30 0x7f63700aec20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6364001db0 tx=0x7f6364001120 comp rx=0 tx=0).stop 2023-10-16T12:59:19.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.802+0000 7f6375ec7700 1 -- 172.21.15.124:0/1082968496 shutdown_connections 2023-10-16T12:59:19.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.802+0000 7f6375ec7700 1 --2- 172.21.15.124:0/1082968496 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f635c06af00 0x7f635c06d3c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.802+0000 7f6375ec7700 1 --2- 172.21.15.124:0/1082968496 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63700ad330 0x7f637006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.802+0000 7f6375ec7700 1 --2- 172.21.15.124:0/1082968496 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6358003a30 0x7f63700aec20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.802+0000 7f6375ec7700 1 --2- 172.21.15.124:0/1082968496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6370155220 0x7f63700acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.802+0000 7f6375ec7700 1 -- 172.21.15.124:0/1082968496 >> 172.21.15.124:0/1082968496 conn(0x7f63700d0180 msgr2=0x7f6370071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:19.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.802+0000 7f6375ec7700 1 -- 172.21.15.124:0/1082968496 shutdown_connections 2023-10-16T12:59:19.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.802+0000 7f6375ec7700 1 -- 172.21.15.124:0/1082968496 wait complete. 2023-10-16T12:59:19.816 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T12:59:19.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.934+0000 7f7184dbf700 1 Processor -- start 2023-10-16T12:59:19.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.934+0000 7f7184dbf700 1 -- start start 2023-10-16T12:59:19.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.935+0000 7f7184dbf700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7180152470 0x7f71800cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:19.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.935+0000 7f7184dbf700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f71800b3410 0x7f71800b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:19.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.935+0000 7f7184dbf700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7180070d70 con 0x7f71800cb8d0 2023-10-16T12:59:19.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.935+0000 7f7184dbf700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7180071200 con 0x7f71800b3410 2023-10-16T12:59:19.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.935+0000 7f7184dbf700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71800cbd80 con 0x7f7180152470 2023-10-16T12:59:19.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.935+0000 7f717ed9d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f71800b3410 0x7f71800b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:19.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.935+0000 7f717dd9b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f71800cb8d0 0x7f71800b2d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42842/0 (socket says 172.21.15.124:42842) 2023-10-16T12:59:19.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.935+0000 7f717dd9b700 1 -- 172.21.15.124:0/3642291734 learned_addr learned my addr 172.21.15.124:0/3642291734 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:19.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.935+0000 7f717e59c700 1 --2- 172.21.15.124:0/3642291734 >> v2:172.21.15.192:3300/0 conn(0x7f7180152470 0x7f71800cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:19.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.935+0000 7f717ed9d700 1 -- 172.21.15.124:0/3642291734 >> v2:172.21.15.192:3300/0 conn(0x7f7180152470 msgr2=0x7f71800cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:19.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.935+0000 7f717ed9d700 1 --2- 172.21.15.124:0/3642291734 >> v2:172.21.15.192:3300/0 conn(0x7f7180152470 0x7f71800cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.935+0000 7f717ed9d700 1 -- 172.21.15.124:0/3642291734 >> v1:172.21.15.124:6789/0 conn(0x7f71800cb8d0 legacy=0x7f71800b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:19.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.935+0000 7f717ed9d700 1 -- 172.21.15.124:0/3642291734 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7180070440 con 0x7f71800b3410 2023-10-16T12:59:19.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.935+0000 7f717d59a700 1 -- 172.21.15.124:0/3642291734 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3342630216 0 0) 0x7f7180070d70 con 0x7f71800cb8d0 2023-10-16T12:59:19.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.935+0000 7f717e59c700 1 --2- 172.21.15.124:0/3642291734 >> v2:172.21.15.192:3300/0 conn(0x7f7180152470 0x7f71800cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:19.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.935+0000 7f717ed9d700 1 --2- 172.21.15.124:0/3642291734 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71800b3410 0x7f71800b60f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7180071460 tx=0x7f717800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c797a291ca08cfc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:19.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.935+0000 7f717d59a700 1 -- 172.21.15.124:0/3642291734 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717800e070 con 0x7f71800b3410 2023-10-16T12:59:19.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.935+0000 7f717d59a700 1 -- 172.21.15.124:0/3642291734 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717800bbd0 con 0x7f71800b3410 2023-10-16T12:59:19.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.936+0000 7f717d59a700 1 -- 172.21.15.124:0/3642291734 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7178012430 con 0x7f71800b3410 2023-10-16T12:59:19.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.936+0000 7f7184dbf700 1 -- 172.21.15.124:0/3642291734 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71800b3410 msgr2=0x7f71800b60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:19.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.936+0000 7f7184dbf700 1 --2- 172.21.15.124:0/3642291734 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71800b3410 0x7f71800b60f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7180071460 tx=0x7f717800b330 comp rx=0 tx=0).stop 2023-10-16T12:59:19.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.936+0000 7f7184dbf700 1 -- 172.21.15.124:0/3642291734 shutdown_connections 2023-10-16T12:59:19.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.936+0000 7f7184dbf700 1 --2- 172.21.15.124:0/3642291734 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71800b3410 0x7f71800b60f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.936+0000 7f7184dbf700 1 --2- 172.21.15.124:0/3642291734 >> v2:172.21.15.192:3300/0 conn(0x7f7180152470 0x7f71800cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.936+0000 7f7184dbf700 1 -- 172.21.15.124:0/3642291734 >> 172.21.15.124:0/3642291734 conn(0x7f71800cdd00 msgr2=0x7f71800ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:19.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.936+0000 7f7184dbf700 1 -- 172.21.15.124:0/3642291734 shutdown_connections 2023-10-16T12:59:19.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.936+0000 7f7184dbf700 1 -- 172.21.15.124:0/3642291734 wait complete. 2023-10-16T12:59:19.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.937+0000 7f7184dbf700 1 Processor -- start 2023-10-16T12:59:19.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.938+0000 7f7184dbf700 1 -- start start 2023-10-16T12:59:19.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.938+0000 7f7184dbf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71800b3410 0x7f71800b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:19.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.938+0000 7f7184dbf700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71800cb8d0 0x7f71800b3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:19.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.938+0000 7f7184dbf700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7180152470 0x7f71800b2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:19.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.938+0000 7f7184dbf700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71800b65d0 con 0x7f71800cb8d0 2023-10-16T12:59:19.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.938+0000 7f7184dbf700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71801536e0 con 0x7f7180152470 2023-10-16T12:59:19.953 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.938+0000 7f7184dbf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7180152ad0 con 0x7f71800b3410 2023-10-16T12:59:19.953 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.938+0000 7f717dd9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71800cb8d0 0x7f71800b3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:19.953 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.938+0000 7f717dd9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71800cb8d0 0x7f71800b3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54180/0 (socket says 172.21.15.124:54180) 2023-10-16T12:59:19.953 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.938+0000 7f717dd9b700 1 -- 172.21.15.124:0/1329081399 learned_addr learned my addr 172.21.15.124:0/1329081399 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:19.953 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.939+0000 7f717ed9d700 1 --2- 172.21.15.124:0/1329081399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7180152470 0x7f71800b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:19.954 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.939+0000 7f717e59c700 1 --2- 172.21.15.124:0/1329081399 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71800b3410 0x7f71800b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:19.954 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.939+0000 7f717dd9b700 1 -- 172.21.15.124:0/1329081399 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71800b3410 msgr2=0x7f71800b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:19.954 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.939+0000 7f717dd9b700 1 --2- 172.21.15.124:0/1329081399 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71800b3410 0x7f71800b6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.954 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.939+0000 7f717dd9b700 1 -- 172.21.15.124:0/1329081399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7180152470 msgr2=0x7f71800b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:19.954 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.939+0000 7f717dd9b700 1 --2- 172.21.15.124:0/1329081399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7180152470 0x7f71800b2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:19.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.939+0000 7f717dd9b700 1 -- 172.21.15.124:0/1329081399 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7178009a70 con 0x7f71800cb8d0 2023-10-16T12:59:19.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.939+0000 7f717e59c700 1 --2- 172.21.15.124:0/1329081399 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71800b3410 0x7f71800b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:19.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.939+0000 7f717dd9b700 1 --2- 172.21.15.124:0/1329081399 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71800cb8d0 0x7f71800b3fc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f71740011e0 tx=0x7f717400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:19.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.939+0000 7f716effd700 1 -- 172.21.15.124:0/1329081399 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7174004c80 con 0x7f71800cb8d0 2023-10-16T12:59:19.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.939+0000 7f716effd700 1 -- 172.21.15.124:0/1329081399 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7174004e00 con 0x7f71800cb8d0 2023-10-16T12:59:19.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.939+0000 7f7184dbf700 1 -- 172.21.15.124:0/1329081399 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7180152db0 con 0x7f71800cb8d0 2023-10-16T12:59:19.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.939+0000 7f716effd700 1 -- 172.21.15.124:0/1329081399 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7174007310 con 0x7f71800cb8d0 2023-10-16T12:59:19.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.939+0000 7f7184dbf700 1 -- 172.21.15.124:0/1329081399 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7180153370 con 0x7f71800cb8d0 2023-10-16T12:59:19.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.940+0000 7f7184dbf700 1 -- 172.21.15.124:0/1329081399 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f718004ebb0 con 0x7f71800cb8d0 2023-10-16T12:59:19.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.940+0000 7f716effd700 1 -- 172.21.15.124:0/1329081399 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7174007470 con 0x7f71800cb8d0 2023-10-16T12:59:19.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.941+0000 7f716effd700 1 --2- 172.21.15.124:0/1329081399 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f716006af00 0x7f716006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:19.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.941+0000 7f716effd700 1 -- 172.21.15.124:0/1329081399 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f71740896d0 con 0x7f71800cb8d0 2023-10-16T12:59:19.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.941+0000 7f717e59c700 1 --2- 172.21.15.124:0/1329081399 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f716006af00 0x7f716006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:19.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.941+0000 7f717e59c700 1 --2- 172.21.15.124:0/1329081399 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f716006af00 0x7f716006d3c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7170009a00 tx=0x7f7170008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:19.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:19.945+0000 7f716effd700 1 -- 172.21.15.124:0/1329081399 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7174054400 con 0x7f71800cb8d0 2023-10-16T12:59:20.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.175+0000 7f7184dbf700 1 -- 172.21.15.124:0/1329081399 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7180153820 con 0x7f71800cb8d0 2023-10-16T12:59:20.177 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:59:20.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.176+0000 7f716effd700 1 -- 172.21.15.124:0/1329081399 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4918 (secure 0 0 0) 0x7f7174057a20 con 0x7f71800cb8d0 2023-10-16T12:59:20.178 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:20.179 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1489119886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6833","nonce":1489119886},{"type":"v1","addr":"172.21.15.192:6835","nonce":1489119886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/2221949787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":2221949787},{"type":"v1","addr":"172.21.15.124:6836","nonce":2221949787}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1247092782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":1247092782},{"type":"v1","addr":"172.21.15.124:6837","nonce":1247092782}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T12:58:51.047667+0000","modified":"2023-10-16T12:59:08.133656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6834/621867052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":621867052},{"type":"v1","addr":"172.21.15.192:6834","nonce":621867052}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T12:59:20.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.178+0000 7f7184dbf700 1 -- 172.21.15.124:0/1329081399 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f716006af00 msgr2=0x7f716006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:20.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.178+0000 7f7184dbf700 1 --2- 172.21.15.124:0/1329081399 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f716006af00 0x7f716006d3c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7170009a00 tx=0x7f7170008040 comp rx=0 tx=0).stop 2023-10-16T12:59:20.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.178+0000 7f7184dbf700 1 -- 172.21.15.124:0/1329081399 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71800cb8d0 msgr2=0x7f71800b3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:20.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.178+0000 7f7184dbf700 1 --2- 172.21.15.124:0/1329081399 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71800cb8d0 0x7f71800b3fc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f71740011e0 tx=0x7f717400cae0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.178+0000 7f7184dbf700 1 -- 172.21.15.124:0/1329081399 shutdown_connections 2023-10-16T12:59:20.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.178+0000 7f7184dbf700 1 --2- 172.21.15.124:0/1329081399 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f716006af00 0x7f716006d3c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.178+0000 7f7184dbf700 1 --2- 172.21.15.124:0/1329081399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7180152470 0x7f71800b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.178+0000 7f7184dbf700 1 --2- 172.21.15.124:0/1329081399 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71800b3410 0x7f71800b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.178+0000 7f7184dbf700 1 --2- 172.21.15.124:0/1329081399 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71800cb8d0 0x7f71800b3fc0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.178+0000 7f7184dbf700 1 -- 172.21.15.124:0/1329081399 >> 172.21.15.124:0/1329081399 conn(0x7f71800cdd00 msgr2=0x7f71800ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:20.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.178+0000 7f7184dbf700 1 -- 172.21.15.124:0/1329081399 shutdown_connections 2023-10-16T12:59:20.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.178+0000 7f7184dbf700 1 -- 172.21.15.124:0/1329081399 wait complete. 2023-10-16T12:59:20.183 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:59:20.184 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 9 2023-10-16T12:59:20.596 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T12:58:51.047667+0000', 'modified': '2023-10-16T12:59:08.133656+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.192:6834/621867052', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6832', 'nonce': 621867052}, {'type': 'v1', 'addr': '172.21.15.192:6834', 'nonce': 621867052}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T12:59:20.596 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T12:59:20.596 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-16T12:59:20.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.717+0000 7fc0601bb700 1 Processor -- start 2023-10-16T12:59:20.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.717+0000 7fc0601bb700 1 -- start start 2023-10-16T12:59:20.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.718+0000 7fc0601bb700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc05815d810 0x7fc0580af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:20.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.718+0000 7fc0601bb700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc05815dbf0 0x7fc0580ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:20.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.718+0000 7fc0601bb700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0580cfc30 con 0x7fc0580af030 2023-10-16T12:59:20.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.718+0000 7fc0601bb700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0580cf990 con 0x7fc05815d810 2023-10-16T12:59:20.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.718+0000 7fc0601bb700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0580cff10 con 0x7fc05815dbf0 2023-10-16T12:59:20.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.718+0000 7fc05df57700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc05815d810 0x7fc0580af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:20.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.718+0000 7fc05e758700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fc0580af030 0x7fc058161560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42860/0 (socket says 172.21.15.124:42860) 2023-10-16T12:59:20.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.718+0000 7fc05e758700 1 -- 172.21.15.124:0/2501252577 learned_addr learned my addr 172.21.15.124:0/2501252577 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:20.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.718+0000 7fc05d756700 1 --2- 172.21.15.124:0/2501252577 >> v2:172.21.15.192:3300/0 conn(0x7fc05815dbf0 0x7fc0580ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:20.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.719+0000 7fc05df57700 1 -- 172.21.15.124:0/2501252577 >> v2:172.21.15.192:3300/0 conn(0x7fc05815dbf0 msgr2=0x7fc0580ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:20.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.719+0000 7fc05df57700 1 --2- 172.21.15.124:0/2501252577 >> v2:172.21.15.192:3300/0 conn(0x7fc05815dbf0 0x7fc0580ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.719+0000 7fc05df57700 1 -- 172.21.15.124:0/2501252577 >> v1:172.21.15.124:6789/0 conn(0x7fc0580af030 legacy=0x7fc058161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:20.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.719+0000 7fc05df57700 1 -- 172.21.15.124:0/2501252577 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc058072290 con 0x7fc05815d810 2023-10-16T12:59:20.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.719+0000 7fc05cf55700 1 -- 172.21.15.124:0/2501252577 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997284774 0 0) 0x7fc0580cfc30 con 0x7fc0580af030 2023-10-16T12:59:20.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.719+0000 7fc05df57700 1 --2- 172.21.15.124:0/2501252577 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc05815d810 0x7fc0580af580 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc05806f750 tx=0x7fc048009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7536d919f2f4cffe server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:20.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.719+0000 7fc05cf55700 1 -- 172.21.15.124:0/2501252577 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048011830 con 0x7fc05815d810 2023-10-16T12:59:20.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.719+0000 7fc05cf55700 1 -- 172.21.15.124:0/2501252577 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc048011990 con 0x7fc05815d810 2023-10-16T12:59:20.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.719+0000 7fc05cf55700 1 -- 172.21.15.124:0/2501252577 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048011d20 con 0x7fc05815d810 2023-10-16T12:59:20.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.719+0000 7fc0601bb700 1 -- 172.21.15.124:0/2501252577 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc05815d810 msgr2=0x7fc0580af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:20.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.719+0000 7fc0601bb700 1 --2- 172.21.15.124:0/2501252577 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc05815d810 0x7fc0580af580 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc05806f750 tx=0x7fc048009b20 comp rx=0 tx=0).stop 2023-10-16T12:59:20.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.719+0000 7fc0601bb700 1 -- 172.21.15.124:0/2501252577 shutdown_connections 2023-10-16T12:59:20.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.719+0000 7fc0601bb700 1 --2- 172.21.15.124:0/2501252577 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc05815d810 0x7fc0580af580 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.725 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.719+0000 7fc0601bb700 1 --2- 172.21.15.124:0/2501252577 >> v2:172.21.15.192:3300/0 conn(0x7fc05815dbf0 0x7fc0580ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.719+0000 7fc0601bb700 1 -- 172.21.15.124:0/2501252577 >> 172.21.15.124:0/2501252577 conn(0x7fc0580d0180 msgr2=0x7fc0580d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:20.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.720+0000 7fc0601bb700 1 -- 172.21.15.124:0/2501252577 shutdown_connections 2023-10-16T12:59:20.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.720+0000 7fc0601bb700 1 -- 172.21.15.124:0/2501252577 wait complete. 2023-10-16T12:59:20.737 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.721+0000 7fc0601bb700 1 Processor -- start 2023-10-16T12:59:20.738 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.721+0000 7fc0601bb700 1 -- start start 2023-10-16T12:59:20.738 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.721+0000 7fc0601bb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0580af030 0x7fc0581f23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:20.739 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.721+0000 7fc0601bb700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc05815d810 0x7fc0580b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:20.739 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.721+0000 7fc0601bb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc05815dbf0 0x7fc0580b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:20.739 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.721+0000 7fc0601bb700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0581f6e80 con 0x7fc05815d810 2023-10-16T12:59:20.740 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.721+0000 7fc0601bb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0581f2d50 con 0x7fc05815dbf0 2023-10-16T12:59:20.740 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.721+0000 7fc0601bb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0581f3030 con 0x7fc0580af030 2023-10-16T12:59:20.740 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.722+0000 7fc05d756700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc05815d810 0x7fc0580b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:20.740 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.722+0000 7fc05d756700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc05815d810 0x7fc0580b0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54196/0 (socket says 172.21.15.124:54196) 2023-10-16T12:59:20.741 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.722+0000 7fc05d756700 1 -- 172.21.15.124:0/3560354950 learned_addr learned my addr 172.21.15.124:0/3560354950 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:20.741 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.722+0000 7fc05e758700 1 --2- 172.21.15.124:0/3560354950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc05815dbf0 0x7fc0580b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:20.741 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.722+0000 7fc05df57700 1 --2- 172.21.15.124:0/3560354950 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0580af030 0x7fc0581f23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:20.741 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.722+0000 7fc05d756700 1 -- 172.21.15.124:0/3560354950 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0580af030 msgr2=0x7fc0581f23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:20.741 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.722+0000 7fc05d756700 1 --2- 172.21.15.124:0/3560354950 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0580af030 0x7fc0581f23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.722+0000 7fc05d756700 1 -- 172.21.15.124:0/3560354950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc05815dbf0 msgr2=0x7fc0580b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:20.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.722+0000 7fc05d756700 1 --2- 172.21.15.124:0/3560354950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc05815dbf0 0x7fc0580b0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.722+0000 7fc05d756700 1 -- 172.21.15.124:0/3560354950 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0480094a0 con 0x7fc05815d810 2023-10-16T12:59:20.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.722+0000 7fc05d756700 1 --2- 172.21.15.124:0/3560354950 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc05815d810 0x7fc0580b0560 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc05400c7f0 tx=0x7fc05400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:20.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.722+0000 7fc04e7fc700 1 -- 172.21.15.124:0/3560354950 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc054004220 con 0x7fc05815d810 2023-10-16T12:59:20.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.722+0000 7fc04e7fc700 1 -- 172.21.15.124:0/3560354950 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc054004380 con 0x7fc05815d810 2023-10-16T12:59:20.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.722+0000 7fc0601bb700 1 -- 172.21.15.124:0/3560354950 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0581f3310 con 0x7fc05815d810 2023-10-16T12:59:20.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.722+0000 7fc04e7fc700 1 -- 172.21.15.124:0/3560354950 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0540036c0 con 0x7fc05815d810 2023-10-16T12:59:20.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.722+0000 7fc0601bb700 1 -- 172.21.15.124:0/3560354950 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0581f2b00 con 0x7fc05815d810 2023-10-16T12:59:20.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.724+0000 7fc04e7fc700 1 -- 172.21.15.124:0/3560354950 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc054003820 con 0x7fc05815d810 2023-10-16T12:59:20.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.724+0000 7fc04e7fc700 1 --2- 172.21.15.124:0/3560354950 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fc03c06af00 0x7fc03c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:20.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.724+0000 7fc04e7fc700 1 -- 172.21.15.124:0/3560354950 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc054089380 con 0x7fc05815d810 2023-10-16T12:59:20.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.724+0000 7fc05df57700 1 --2- 172.21.15.124:0/3560354950 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fc03c06af00 0x7fc03c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:20.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.725+0000 7fc05df57700 1 --2- 172.21.15.124:0/3560354950 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fc03c06af00 0x7fc03c06d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc0480090b0 tx=0x7fc048008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:20.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.726+0000 7fc06c3a5b80 1 Processor -- start 2023-10-16T12:59:20.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.726+0000 7fc06c3a5b80 1 -- start start 2023-10-16T12:59:20.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.727+0000 7fc06c3a5b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feffb2f220 0x55feffb36a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:20.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.727+0000 7fc06c3a5b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb34630 0x55feffb36fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:20.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.727+0000 7fc06c3a5b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55feffb0a010 0x55feffb0a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:20.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.727+0000 7fc06c3a5b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feffa80c20 con 0x55feffb34630 2023-10-16T12:59:20.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.727+0000 7fc06c3a5b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feffa65c10 con 0x55feffb2f220 2023-10-16T12:59:20.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.727+0000 7fc06c3a5b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55feffa63530 con 0x55feffb0a010 2023-10-16T12:59:20.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.727+0000 7fc05d756700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb34630 0x55feffb36fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:20.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.727+0000 7fc05d756700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb34630 0x55feffb36fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54202/0 (socket says 172.21.15.124:54202) 2023-10-16T12:59:20.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.727+0000 7fc05d756700 1 -- 172.21.15.124:0/534120226 learned_addr learned my addr 172.21.15.124:0/534120226 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:20.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.727+0000 7fc05e758700 1 --2- 172.21.15.124:0/534120226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55feffb0a010 0x55feffb0a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:20.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.727+0000 7fc05df57700 1 --2- 172.21.15.124:0/534120226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feffb2f220 0x55feffb36a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:20.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.727+0000 7fc05d756700 1 -- 172.21.15.124:0/534120226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55feffb0a010 msgr2=0x55feffb0a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:20.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.727+0000 7fc05d756700 1 --2- 172.21.15.124:0/534120226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55feffb0a010 0x55feffb0a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.727+0000 7fc05d756700 1 -- 172.21.15.124:0/534120226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feffb2f220 msgr2=0x55feffb36a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:20.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.727+0000 7fc05d756700 1 --2- 172.21.15.124:0/534120226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feffb2f220 0x55feffb36a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.727+0000 7fc05d756700 1 -- 172.21.15.124:0/534120226 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55feffa1c3a0 con 0x55feffb34630 2023-10-16T12:59:20.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.727+0000 7fc05d756700 1 --2- 172.21.15.124:0/534120226 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb34630 0x55feffb36fb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc05405fbd0 tx=0x7fc05400af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446796dcc825be00 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:20.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.728+0000 7fc03b7fe700 1 -- 172.21.15.124:0/534120226 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05405a070 con 0x55feffb34630 2023-10-16T12:59:20.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.728+0000 7fc03b7fe700 1 -- 172.21.15.124:0/534120226 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05405bf50 con 0x55feffb34630 2023-10-16T12:59:20.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.728+0000 7fc03b7fe700 1 -- 172.21.15.124:0/534120226 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc054060100 con 0x55feffb34630 2023-10-16T12:59:20.749 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.728+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/534120226 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb34630 msgr2=0x55feffb36fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:20.749 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.728+0000 7fc06c3a5b80 1 --2- 172.21.15.124:0/534120226 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb34630 0x55feffb36fb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc05405fbd0 tx=0x7fc05400af90 comp rx=0 tx=0).stop 2023-10-16T12:59:20.749 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.728+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/534120226 shutdown_connections 2023-10-16T12:59:20.749 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.728+0000 7fc06c3a5b80 1 --2- 172.21.15.124:0/534120226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55feffb0a010 0x55feffb0a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.749 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.728+0000 7fc06c3a5b80 1 --2- 172.21.15.124:0/534120226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feffb2f220 0x55feffb36a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.728+0000 7fc06c3a5b80 1 --2- 172.21.15.124:0/534120226 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb34630 0x55feffb36fb0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.728+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/534120226 >> 172.21.15.124:0/534120226 conn(0x55feffa39d80 msgr2=0x55feffb54ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:20.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.728+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/534120226 shutdown_connections 2023-10-16T12:59:20.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.728+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/534120226 wait complete. 2023-10-16T12:59:20.750 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.729+0000 7fc06c3a5b80 1 -- start start 2023-10-16T12:59:20.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.729+0000 7fc06c3a5b80 1 Processor -- start 2023-10-16T12:59:20.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.730+0000 7fc06c3a5b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb0a010 0x55feffb2fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:20.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.730+0000 7fc06c3a5b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55feffb2f220 0x55feffb2e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:20.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.730+0000 7fc06c3a5b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feffb34630 0x55feffb51a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:20.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.730+0000 7fc06c3a5b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feffa5ee20 con 0x55feffb0a010 2023-10-16T12:59:20.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.730+0000 7fc06c3a5b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feff9fb6c0 con 0x55feffb34630 2023-10-16T12:59:20.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.730+0000 7fc06c3a5b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55feff9fb360 con 0x55feffb2f220 2023-10-16T12:59:20.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.730+0000 7fc06c3a5b80 10 client.0 _ll_register_callbacks cb 0x55feff8587b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T12:59:20.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.730+0000 7fc05df57700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb0a010 0x55feffb2fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:20.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.730+0000 7fc05df57700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb0a010 0x55feffb2fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54210/0 (socket says 172.21.15.124:54210) 2023-10-16T12:59:20.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.730+0000 7fc05df57700 1 -- 172.21.15.124:0/3655035739 learned_addr learned my addr 172.21.15.124:0/3655035739 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:20.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.730+0000 7fc05e758700 1 --2- 172.21.15.124:0/3655035739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feffb34630 0x55feffb51a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:20.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.730+0000 7fc05d756700 1 --2- 172.21.15.124:0/3655035739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55feffb2f220 0x55feffb2e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:20.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.730+0000 7fc05df57700 1 -- 172.21.15.124:0/3655035739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55feffb2f220 msgr2=0x55feffb2e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:20.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.730+0000 7fc05df57700 1 --2- 172.21.15.124:0/3655035739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55feffb2f220 0x55feffb2e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.730+0000 7fc05df57700 1 -- 172.21.15.124:0/3655035739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feffb34630 msgr2=0x55feffb51a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:20.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.730+0000 7fc05df57700 1 --2- 172.21.15.124:0/3655035739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feffb34630 0x55feffb51a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.730+0000 7fc05df57700 1 -- 172.21.15.124:0/3655035739 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0581f2b00 con 0x55feffb0a010 2023-10-16T12:59:20.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.730+0000 7fc05e758700 1 --2- 172.21.15.124:0/3655035739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feffb34630 0x55feffb51a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:20.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.730+0000 7fc05d756700 1 --2- 172.21.15.124:0/3655035739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55feffb2f220 0x55feffb2e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:20.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.730+0000 7fc05df57700 1 --2- 172.21.15.124:0/3655035739 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb0a010 0x55feffb2fff0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc0580b2d70 tx=0x7fc0480047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e4193960d97a58 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:20.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.730+0000 7fc038ff9700 10 client.0 ms_handle_connect on v2:172.21.15.124:3300/0 2023-10-16T12:59:20.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.730+0000 7fc038ff9700 1 -- 172.21.15.124:0/3655035739 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048020070 con 0x55feffb0a010 2023-10-16T12:59:20.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.730+0000 7fc038ff9700 1 -- 172.21.15.124:0/3655035739 <== mon.0 v2:172.21.15.124:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc048003d50 con 0x55feffb0a010 2023-10-16T12:59:20.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.730+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/3655035739 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55feffaff5b0 con 0x55feffb0a010 2023-10-16T12:59:20.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.731+0000 7fc038ff9700 1 -- 172.21.15.124:0/3655035739 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc048003f10 con 0x55feffb0a010 2023-10-16T12:59:20.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.731+0000 7fc06c3a5b80 10 client.4824 fetch_fsmap learned FSMap version 9 2023-10-16T12:59:20.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.731+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/3655035739 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55feff889d90 con 0x55feffb0a010 2023-10-16T12:59:20.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.731+0000 7fc038ff9700 1 -- 172.21.15.124:0/3655035739 <== mon.0 v2:172.21.15.124:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55feffaff5b0 con 0x55feffb0a010 2023-10-16T12:59:20.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.731+0000 7fc038ff9700 1 -- 172.21.15.124:0/3655035739 <== mon.0 v2:172.21.15.124:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fc04801a420 con 0x55feffb0a010 2023-10-16T12:59:20.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.731+0000 7fc06c3a5b80 10 client.4824 fetch_fsmap finished waiting for FSMap version 9 2023-10-16T12:59:20.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.731+0000 7fc06c3a5b80 10 client.4824 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-16T12:59:20.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.731+0000 7fc06c3a5b80 20 client.4824 populate_metadata read hostname 'smithi124' 2023-10-16T12:59:20.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.731+0000 7fc06c3a5b80 1 --2- 172.21.15.124:0/3655035739 >> [v2:172.21.15.192:6832/621867052,v1:172.21.15.192:6834/621867052] conn(0x55feffb380b0 0x55feffb38490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:20.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.731+0000 7fc06c3a5b80 4 client.4824 mds_command: new command op to 4291 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T12:59:20.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.731+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/3655035739 --> [v2:172.21.15.192:6832/621867052,v1:172.21.15.192:6834/621867052] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55feffa57e00 con 0x55feffb380b0 2023-10-16T12:59:20.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.731+0000 7fc05d756700 1 --2- 172.21.15.124:0/3655035739 >> [v2:172.21.15.192:6832/621867052,v1:172.21.15.192:6834/621867052] conn(0x55feffb380b0 0x55feffb38490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:20.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.732+0000 7fc038ff9700 10 client.4824 ms_handle_connect on v2:172.21.15.192:6832/621867052 2023-10-16T12:59:20.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.732+0000 7fc05d756700 1 --2- 172.21.15.124:0/3655035739 >> [v2:172.21.15.192:6832/621867052,v1:172.21.15.192:6834/621867052] conn(0x55feffb380b0 0x55feffb38490 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1e9ba33c7dbd6d7 server_cookie=cd2cc022354452c6 in_seq=0 out_seq=0 2023-10-16T12:59:20.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.732+0000 7fc038ff9700 1 -- 172.21.15.124:0/3655035739 <== mds.0 v2:172.21.15.192:6832/621867052 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55feffa57e00 con 0x55feffb380b0 2023-10-16T12:59:20.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.732+0000 7fc038ff9700 10 client.4824 handle_command_reply: tid=0 2023-10-16T12:59:20.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.732+0000 7fc06c3a5b80 1 client.4824 shutdown 2023-10-16T12:59:20.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.732+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/3655035739 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb0a010 msgr2=0x55feffb2fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:20.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.732+0000 7fc06c3a5b80 1 --2- 172.21.15.124:0/3655035739 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb0a010 0x55feffb2fff0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc0580b2d70 tx=0x7fc0480047c0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.732+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/3655035739 shutdown_connections 2023-10-16T12:59:20.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.732+0000 7fc06c3a5b80 1 --2- 172.21.15.124:0/3655035739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feffb34630 0x55feffb51a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.732+0000 7fc06c3a5b80 1 --2- 172.21.15.124:0/3655035739 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb0a010 0x55feffb2fff0 secure :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc0580b2d70 tx=0x7fc0480047c0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.732+0000 7fc06c3a5b80 1 --2- 172.21.15.124:0/3655035739 >> [v2:172.21.15.192:6832/621867052,v1:172.21.15.192:6834/621867052] conn(0x55feffb380b0 0x55feffb38490 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.732+0000 7fc06c3a5b80 1 --2- 172.21.15.124:0/3655035739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55feffb2f220 0x55feffb2e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.732+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/3655035739 >> 172.21.15.124:0/3655035739 conn(0x55feffa39d80 msgr2=0x55feffb4b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:20.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.732+0000 7fc038ff9700 0 client.4824 ms_handle_reset on v2:172.21.15.192:6832/621867052 2023-10-16T12:59:20.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.732+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/3655035739 shutdown_connections 2023-10-16T12:59:20.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.732+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/3655035739 wait complete. 2023-10-16T12:59:20.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.733+0000 7fc06c3a5b80 20 client.4824 trim_cache size 0 max 16384 2023-10-16T12:59:20.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.750+0000 7fc06c3a5b80 1 Processor -- start 2023-10-16T12:59:20.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.750+0000 7fc06c3a5b80 1 -- start start 2023-10-16T12:59:20.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.751+0000 7fc06c3a5b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feffb2f220 0x55feffb60300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:20.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.751+0000 7fc06c3a5b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55feffb34630 0x55feffb60840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:20.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.751+0000 7fc06c3a5b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb00b00 0x55feffb00f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:20.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.751+0000 7fc06c3a5b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feff8df8d0 con 0x55feffb00b00 2023-10-16T12:59:20.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.751+0000 7fc06c3a5b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feffb03630 con 0x55feffb2f220 2023-10-16T12:59:20.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.751+0000 7fc06c3a5b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55feffb32330 con 0x55feffb34630 2023-10-16T12:59:20.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.752+0000 7fc05e758700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb00b00 0x55feffb00f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:20.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.752+0000 7fc05e758700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb00b00 0x55feffb00f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54220/0 (socket says 172.21.15.124:54220) 2023-10-16T12:59:20.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.752+0000 7fc05e758700 1 -- 172.21.15.124:0/4010160587 learned_addr learned my addr 172.21.15.124:0/4010160587 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:20.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.752+0000 7fc05d756700 1 --2- 172.21.15.124:0/4010160587 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55feffb34630 0x55feffb60840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:20.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.752+0000 7fc05e758700 1 -- 172.21.15.124:0/4010160587 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55feffb34630 msgr2=0x55feffb60840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:20.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.752+0000 7fc05e758700 1 --2- 172.21.15.124:0/4010160587 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55feffb34630 0x55feffb60840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.752+0000 7fc05e758700 1 -- 172.21.15.124:0/4010160587 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feffb2f220 msgr2=0x55feffb60300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:20.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.752+0000 7fc05e758700 1 --2- 172.21.15.124:0/4010160587 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feffb2f220 0x55feffb60300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.752+0000 7fc05e758700 1 -- 172.21.15.124:0/4010160587 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55feff872c10 con 0x55feffb00b00 2023-10-16T12:59:20.772 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.752+0000 7fc05e758700 1 --2- 172.21.15.124:0/4010160587 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb00b00 0x55feffb00f40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc0580af4e0 tx=0x7fc050009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5c0a4cc9e11523 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:20.772 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.752+0000 7fc03bfff700 1 -- 172.21.15.124:0/4010160587 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0500155c0 con 0x55feffb00b00 2023-10-16T12:59:20.772 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.752+0000 7fc03bfff700 1 -- 172.21.15.124:0/4010160587 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc050015720 con 0x55feffb00b00 2023-10-16T12:59:20.772 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.752+0000 7fc03bfff700 1 -- 172.21.15.124:0/4010160587 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc050015ab0 con 0x55feffb00b00 2023-10-16T12:59:20.772 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.753+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/4010160587 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb00b00 msgr2=0x55feffb00f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:20.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.753+0000 7fc06c3a5b80 1 --2- 172.21.15.124:0/4010160587 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb00b00 0x55feffb00f40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc0580af4e0 tx=0x7fc050009040 comp rx=0 tx=0).stop 2023-10-16T12:59:20.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.753+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/4010160587 shutdown_connections 2023-10-16T12:59:20.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.753+0000 7fc06c3a5b80 1 --2- 172.21.15.124:0/4010160587 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb00b00 0x55feffb00f40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.753+0000 7fc06c3a5b80 1 --2- 172.21.15.124:0/4010160587 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feffb2f220 0x55feffb60300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.753+0000 7fc06c3a5b80 1 --2- 172.21.15.124:0/4010160587 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55feffb34630 0x55feffb60840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.753+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/4010160587 >> 172.21.15.124:0/4010160587 conn(0x55feffa39d80 msgr2=0x55feffb72760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:20.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.753+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/4010160587 shutdown_connections 2023-10-16T12:59:20.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.753+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/4010160587 wait complete. 2023-10-16T12:59:20.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.753+0000 7fc06c3a5b80 1 -- start start 2023-10-16T12:59:20.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.753+0000 7fc06c3a5b80 1 Processor -- start 2023-10-16T12:59:20.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.754+0000 7fc06c3a5b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feffb00b00 0x55feffbb3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:20.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.754+0000 7fc06c3a5b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb2f220 0x55feffb602e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:20.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.754+0000 7fc06c3a5b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55feffb34630 0x55feffb60820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:20.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.754+0000 7fc06c3a5b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feffb4d6d0 con 0x55feffb2f220 2023-10-16T12:59:20.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.754+0000 7fc06c3a5b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55feffb07310 con 0x55feffb00b00 2023-10-16T12:59:20.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.754+0000 7fc06c3a5b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55feffb010e0 con 0x55feffb34630 2023-10-16T12:59:20.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.754+0000 7fc06c3a5b80 10 client.0 _ll_register_callbacks cb 0x7fc048011830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T12:59:20.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.754+0000 7fc05d756700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb2f220 0x55feffb602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:20.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.754+0000 7fc05d756700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb2f220 0x55feffb602e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54224/0 (socket says 172.21.15.124:54224) 2023-10-16T12:59:20.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.754+0000 7fc05d756700 1 -- 172.21.15.124:0/273036673 learned_addr learned my addr 172.21.15.124:0/273036673 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:20.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.754+0000 7fc05df57700 1 --2- 172.21.15.124:0/273036673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feffb00b00 0x55feffbb3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:20.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.754+0000 7fc05e758700 1 --2- 172.21.15.124:0/273036673 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55feffb34630 0x55feffb60820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:20.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.755+0000 7fc05d756700 1 -- 172.21.15.124:0/273036673 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55feffb34630 msgr2=0x55feffb60820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:20.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.755+0000 7fc05d756700 1 --2- 172.21.15.124:0/273036673 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55feffb34630 0x55feffb60820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.755+0000 7fc05d756700 1 -- 172.21.15.124:0/273036673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feffb00b00 msgr2=0x55feffbb3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:20.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.755+0000 7fc05d756700 1 --2- 172.21.15.124:0/273036673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feffb00b00 0x55feffbb3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.755+0000 7fc05d756700 1 -- 172.21.15.124:0/273036673 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc050001fd0 con 0x55feffb2f220 2023-10-16T12:59:20.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.755+0000 7fc05d756700 1 --2- 172.21.15.124:0/273036673 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb2f220 0x55feffb602e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc054054300 tx=0x7fc054000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7a64fed1120c67 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:20.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.755+0000 7fc038ff9700 10 client.0 ms_handle_connect on v2:172.21.15.124:3300/0 2023-10-16T12:59:20.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.755+0000 7fc038ff9700 1 -- 172.21.15.124:0/273036673 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05405a070 con 0x55feffb2f220 2023-10-16T12:59:20.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.755+0000 7fc038ff9700 1 -- 172.21.15.124:0/273036673 <== mon.0 v2:172.21.15.124:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc0540561a0 con 0x55feffb2f220 2023-10-16T12:59:20.779 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.755+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/273036673 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc05405bf50 con 0x55feffb2f220 2023-10-16T12:59:20.779 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.755+0000 7fc038ff9700 1 -- 172.21.15.124:0/273036673 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0540872e0 con 0x55feffb2f220 2023-10-16T12:59:20.779 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.755+0000 7fc06c3a5b80 10 client.4830 fetch_fsmap learned FSMap version 9 2023-10-16T12:59:20.779 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.755+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/273036673 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55feff8b0200 con 0x55feffb2f220 2023-10-16T12:59:20.779 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.755+0000 7fc038ff9700 1 -- 172.21.15.124:0/273036673 <== mon.0 v2:172.21.15.124:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05405bf50 con 0x55feffb2f220 2023-10-16T12:59:20.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.755+0000 7fc038ff9700 1 -- 172.21.15.124:0/273036673 <== mon.0 v2:172.21.15.124:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fc054089070 con 0x55feffb2f220 2023-10-16T12:59:20.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.755+0000 7fc06c3a5b80 10 client.4830 fetch_fsmap finished waiting for FSMap version 9 2023-10-16T12:59:20.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.755+0000 7fc06c3a5b80 10 client.4830 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-16T12:59:20.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.755+0000 7fc06c3a5b80 20 client.4830 populate_metadata read hostname 'smithi124' 2023-10-16T12:59:20.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.755+0000 7fc06c3a5b80 1 --2- 172.21.15.124:0/273036673 >> [v2:172.21.15.192:6832/621867052,v1:172.21.15.192:6834/621867052] conn(0x55feffbb9300 0x55feffbb96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:20.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.755+0000 7fc06c3a5b80 4 client.4830 mds_command: new command op to 4291 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T12:59:20.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.755+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/273036673 --> [v2:172.21.15.192:6832/621867052,v1:172.21.15.192:6834/621867052] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55feffa57b20 con 0x55feffbb9300 2023-10-16T12:59:20.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.755+0000 7fc05df57700 1 --2- 172.21.15.124:0/273036673 >> [v2:172.21.15.192:6832/621867052,v1:172.21.15.192:6834/621867052] conn(0x55feffbb9300 0x55feffbb96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:20.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.756+0000 7fc038ff9700 10 client.4830 ms_handle_connect on v2:172.21.15.192:6832/621867052 2023-10-16T12:59:20.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.756+0000 7fc05df57700 1 --2- 172.21.15.124:0/273036673 >> [v2:172.21.15.192:6832/621867052,v1:172.21.15.192:6834/621867052] conn(0x55feffbb9300 0x55feffbb96e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8543ede9c863963c server_cookie=7edbec27b56c85ef in_seq=0 out_seq=0 2023-10-16T12:59:20.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.756+0000 7fc038ff9700 1 -- 172.21.15.124:0/273036673 <== mds.0 v2:172.21.15.192:6832/621867052 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55feffa57b20 con 0x55feffbb9300 2023-10-16T12:59:20.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.756+0000 7fc038ff9700 10 client.4830 handle_command_reply: tid=0 2023-10-16T12:59:20.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.756+0000 7fc06c3a5b80 1 client.4830 shutdown 2023-10-16T12:59:20.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.756+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/273036673 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb2f220 msgr2=0x55feffb602e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:20.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.756+0000 7fc06c3a5b80 1 --2- 172.21.15.124:0/273036673 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb2f220 0x55feffb602e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc054054300 tx=0x7fc054000bc0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.756+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/273036673 shutdown_connections 2023-10-16T12:59:20.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.756+0000 7fc06c3a5b80 1 --2- 172.21.15.124:0/273036673 >> [v2:172.21.15.192:6832/621867052,v1:172.21.15.192:6834/621867052] conn(0x55feffbb9300 0x55feffbb96e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.756+0000 7fc06c3a5b80 1 --2- 172.21.15.124:0/273036673 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55feffb34630 0x55feffb60820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.756+0000 7fc06c3a5b80 1 --2- 172.21.15.124:0/273036673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feffb00b00 0x55feffbb3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.756+0000 7fc038ff9700 0 client.4830 ms_handle_reset on v2:172.21.15.192:6832/621867052 2023-10-16T12:59:20.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.756+0000 7fc06c3a5b80 1 --2- 172.21.15.124:0/273036673 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x55feffb2f220 0x55feffb602e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.756+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/273036673 >> 172.21.15.124:0/273036673 conn(0x55feffa39d80 msgr2=0x55feffb50b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:20.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.756+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/273036673 shutdown_connections 2023-10-16T12:59:20.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.756+0000 7fc06c3a5b80 1 -- 172.21.15.124:0/273036673 wait complete. 2023-10-16T12:59:20.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.756+0000 7fc06c3a5b80 20 client.4830 trim_cache size 0 max 16384 2023-10-16T12:59:20.785 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2023-10-16T12:59:20.785 INFO:teuthology.orchestra.run.smithi124.stdout: "cluster_fsid": "4cfd077b-2400-4ae1-a7e8-14265fee7113", 2023-10-16T12:59:20.785 INFO:teuthology.orchestra.run.smithi124.stdout: "whoami": 0, 2023-10-16T12:59:20.785 INFO:teuthology.orchestra.run.smithi124.stdout: "id": 4291, 2023-10-16T12:59:20.785 INFO:teuthology.orchestra.run.smithi124.stdout: "want_state": "up:active", 2023-10-16T12:59:20.786 INFO:teuthology.orchestra.run.smithi124.stdout: "state": "up:active", 2023-10-16T12:59:20.786 INFO:teuthology.orchestra.run.smithi124.stdout: "fs_name": "cephfs", 2023-10-16T12:59:20.786 INFO:teuthology.orchestra.run.smithi124.stdout: "rank_uptime": 29.100332553000001, 2023-10-16T12:59:20.786 INFO:teuthology.orchestra.run.smithi124.stdout: "mdsmap_epoch": 9, 2023-10-16T12:59:20.787 INFO:teuthology.orchestra.run.smithi124.stdout: "osdmap_epoch": 24, 2023-10-16T12:59:20.787 INFO:teuthology.orchestra.run.smithi124.stdout: "osdmap_epoch_barrier": 24, 2023-10-16T12:59:20.787 INFO:teuthology.orchestra.run.smithi124.stdout: "uptime": 35.916305219000002 2023-10-16T12:59:20.787 INFO:teuthology.orchestra.run.smithi124.stdout:} 2023-10-16T12:59:20.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.757+0000 7fc0601bb700 1 -- 172.21.15.124:0/3560354950 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fc03c06af00 msgr2=0x7fc03c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:20.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.757+0000 7fc0601bb700 1 --2- 172.21.15.124:0/3560354950 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fc03c06af00 0x7fc03c06d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc0480090b0 tx=0x7fc048008030 comp rx=0 tx=0).stop 2023-10-16T12:59:20.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.757+0000 7fc0601bb700 1 -- 172.21.15.124:0/3560354950 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc05815d810 msgr2=0x7fc0580b0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:20.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.757+0000 7fc0601bb700 1 --2- 172.21.15.124:0/3560354950 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc05815d810 0x7fc0580b0560 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc05400c7f0 tx=0x7fc05400cb00 comp rx=0 tx=0).stop 2023-10-16T12:59:20.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.757+0000 7fc0601bb700 1 -- 172.21.15.124:0/3560354950 shutdown_connections 2023-10-16T12:59:20.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.757+0000 7fc0601bb700 1 --2- 172.21.15.124:0/3560354950 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fc03c06af00 0x7fc03c06d3c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.757+0000 7fc0601bb700 1 --2- 172.21.15.124:0/3560354950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc05815dbf0 0x7fc0580b0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.757+0000 7fc0601bb700 1 --2- 172.21.15.124:0/3560354950 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0580af030 0x7fc0581f23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.757+0000 7fc0601bb700 1 --2- 172.21.15.124:0/3560354950 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc05815d810 0x7fc0580b0560 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:20.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.757+0000 7fc0601bb700 1 -- 172.21.15.124:0/3560354950 >> 172.21.15.124:0/3560354950 conn(0x7fc0580d0180 msgr2=0x7fc0580ca7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:20.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.757+0000 7fc0601bb700 1 -- 172.21.15.124:0/3560354950 shutdown_connections 2023-10-16T12:59:20.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:20.757+0000 7fc0601bb700 1 -- 172.21.15.124:0/3560354950 wait complete. 2023-10-16T12:59:20.792 INFO:teuthology.run_tasks:Running task kclient... 2023-10-16T12:59:20.805 INFO:tasks.kclient:Mounting kernel clients... 2023-10-16T12:59:20.805 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-16T12:59:20.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:20.806 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list 2023-10-16T12:59:20.824 INFO:teuthology.orchestra.run.smithi124.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-16T12:59:20.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:20.825 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T12:59:20.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:20.905 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link delete ceph-brx 2023-10-16T12:59:21.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:21.002 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list 2023-10-16T12:59:21.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:21.020 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link delete ceph-brx 2023-10-16T12:59:21.088 INFO:teuthology.orchestra.run.smithi124.stderr:Cannot find device "ceph-brx" 2023-10-16T12:59:21.088 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:59:21.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:21.090 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-10-16T12:59:21.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:21.111 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2023-10-16T12:59:21.185 INFO:teuthology.orchestra.run.smithi192.stderr:Cannot find device "ceph-brx" 2023-10-16T12:59:21.186 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:59:21.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:21.187 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-10-16T12:59:21.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:21.247 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2023-10-16T12:59:21.317 INFO:teuthology.orchestra.run.smithi192.stderr:Cannot find device "ceph-brx" 2023-10-16T12:59:21.318 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:59:21.319 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-16T12:59:21.320 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T12:59:21.320 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T12:59:21.320 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T12:59:21.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.440+0000 7f2513c7a700 1 Processor -- start 2023-10-16T12:59:21.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.441+0000 7f2513c7a700 1 -- start start 2023-10-16T12:59:21.445 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.441+0000 7f2513c7a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f250c0b0c30 0x7f250c0b1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:21.445 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.442+0000 7f2513c7a700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250c0c9d40 con 0x7f250c15b600 2023-10-16T12:59:21.445 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.442+0000 7f2513c7a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250c0b1550 con 0x7f250c0b1860 2023-10-16T12:59:21.445 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.442+0000 7f2513c7a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250c0cd6d0 con 0x7f250c0b0c30 2023-10-16T12:59:21.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.442+0000 7f2512217700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f250c15b600 0x7f250c0ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42902/0 (socket says 172.21.15.124:42902) 2023-10-16T12:59:21.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.442+0000 7f2512217700 1 -- 172.21.15.124:0/1078163185 learned_addr learned my addr 172.21.15.124:0/1078163185 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:21.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.442+0000 7f2511a16700 1 --2- 172.21.15.124:0/1078163185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f250c0b0c30 0x7f250c0b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:21.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.442+0000 7f2510a14700 1 -- 172.21.15.124:0/1078163185 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372955057 0 0) 0x7f250c0c9d40 con 0x7f250c15b600 2023-10-16T12:59:21.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.442+0000 7f2510a14700 1 -- 172.21.15.124:0/1078163185 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24f80035b0 con 0x7f250c15b600 2023-10-16T12:59:21.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.442+0000 7f2510a14700 1 -- 172.21.15.124:0/1078163185 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174424054 0 0) 0x7f250c0b1550 con 0x7f250c0b1860 2023-10-16T12:59:21.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.442+0000 7f2510a14700 1 -- 172.21.15.124:0/1078163185 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f250c0c9d40 con 0x7f250c0b1860 2023-10-16T12:59:21.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.442+0000 7f2511a16700 1 -- 172.21.15.124:0/1078163185 >> v1:172.21.15.192:6789/0 conn(0x7f250c0b1860 legacy=0x7f250c0ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:21.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.442+0000 7f2511a16700 1 -- 172.21.15.124:0/1078163185 >> v1:172.21.15.124:6789/0 conn(0x7f250c15b600 legacy=0x7f250c0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:21.448 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.442+0000 7f2511a16700 1 -- 172.21.15.124:0/1078163185 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250c0cd9a0 con 0x7f250c0b0c30 2023-10-16T12:59:21.448 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.442+0000 7f2511a16700 1 --2- 172.21.15.124:0/1078163185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f250c0b0c30 0x7f250c0b1010 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2508009870 tx=0x7f2508009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78ca93f49446a652 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:21.448 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.442+0000 7f2510a14700 1 -- 172.21.15.124:0/1078163185 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2508011830 con 0x7f250c0b0c30 2023-10-16T12:59:21.448 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.442+0000 7f2510a14700 1 -- 172.21.15.124:0/1078163185 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2508011990 con 0x7f250c0b0c30 2023-10-16T12:59:21.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.442+0000 7f2510a14700 1 -- 172.21.15.124:0/1078163185 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2508011d20 con 0x7f250c0b0c30 2023-10-16T12:59:21.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.443+0000 7f2513c7a700 1 -- 172.21.15.124:0/1078163185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f250c0b0c30 msgr2=0x7f250c0b1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:21.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.443+0000 7f2513c7a700 1 --2- 172.21.15.124:0/1078163185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f250c0b0c30 0x7f250c0b1010 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2508009870 tx=0x7f2508009b80 comp rx=0 tx=0).stop 2023-10-16T12:59:21.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.443+0000 7f2513c7a700 1 -- 172.21.15.124:0/1078163185 shutdown_connections 2023-10-16T12:59:21.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.443+0000 7f2513c7a700 1 --2- 172.21.15.124:0/1078163185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f250c0b0c30 0x7f250c0b1010 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:21.450 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.443+0000 7f2513c7a700 1 -- 172.21.15.124:0/1078163185 >> 172.21.15.124:0/1078163185 conn(0x7f250c06c850 msgr2=0x7f250c06cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:21.450 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.443+0000 7f2513c7a700 1 -- 172.21.15.124:0/1078163185 shutdown_connections 2023-10-16T12:59:21.450 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.443+0000 7f2513c7a700 1 -- 172.21.15.124:0/1078163185 wait complete. 2023-10-16T12:59:21.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.444+0000 7f2513c7a700 1 Processor -- start 2023-10-16T12:59:21.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.444+0000 7f2513c7a700 1 -- start start 2023-10-16T12:59:21.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.445+0000 7f2513c7a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f250c0b0c30 0x7f250c158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:21.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.445+0000 7f2513c7a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f250c0b1860 0x7f250c0af880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:21.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.445+0000 7f2513c7a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f250c15b600 0x7f250c1e3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:21.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.445+0000 7f2513c7a700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250c0b0300 con 0x7f250c15b600 2023-10-16T12:59:21.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.445+0000 7f2513c7a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250c157e60 con 0x7f250c0b1860 2023-10-16T12:59:21.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.445+0000 7f2513c7a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250c158140 con 0x7f250c0b0c30 2023-10-16T12:59:21.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.445+0000 7f2512217700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f250c15b600 0x7f250c1e3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:21.455 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.445+0000 7f2512217700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f250c15b600 0x7f250c1e3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54240/0 (socket says 172.21.15.124:54240) 2023-10-16T12:59:21.455 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.445+0000 7f2512217700 1 -- 172.21.15.124:0/53993957 learned_addr learned my addr 172.21.15.124:0/53993957 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:21.455 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.445+0000 7f2511215700 1 --2- 172.21.15.124:0/53993957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f250c0b1860 0x7f250c0af880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:21.455 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.445+0000 7f2511a16700 1 --2- 172.21.15.124:0/53993957 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f250c0b0c30 0x7f250c158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:21.455 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.445+0000 7f2512217700 1 -- 172.21.15.124:0/53993957 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f250c0b0c30 msgr2=0x7f250c158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:21.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.445+0000 7f2512217700 1 --2- 172.21.15.124:0/53993957 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f250c0b0c30 0x7f250c158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:21.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.445+0000 7f2512217700 1 -- 172.21.15.124:0/53993957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f250c0b1860 msgr2=0x7f250c0af880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:21.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.445+0000 7f2512217700 1 --2- 172.21.15.124:0/53993957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f250c0b1860 0x7f250c0af880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:21.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.445+0000 7f2512217700 1 -- 172.21.15.124:0/53993957 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25080094a0 con 0x7f250c15b600 2023-10-16T12:59:21.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.445+0000 7f2511215700 1 --2- 172.21.15.124:0/53993957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f250c0b1860 0x7f250c0af880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:21.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.445+0000 7f2511a16700 1 --2- 172.21.15.124:0/53993957 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f250c0b0c30 0x7f250c158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:21.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.445+0000 7f2512217700 1 --2- 172.21.15.124:0/53993957 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f250c15b600 0x7f250c1e3850 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f250400cb10 tx=0x7f250400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:21.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.446+0000 7f25027fc700 1 -- 172.21.15.124:0/53993957 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250400ab00 con 0x7f250c15b600 2023-10-16T12:59:21.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.446+0000 7f25027fc700 1 -- 172.21.15.124:0/53993957 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250400ac60 con 0x7f250c15b600 2023-10-16T12:59:21.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.446+0000 7f2513c7a700 1 -- 172.21.15.124:0/53993957 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f250c158420 con 0x7f250c15b600 2023-10-16T12:59:21.458 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.446+0000 7f25027fc700 1 -- 172.21.15.124:0/53993957 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2504012400 con 0x7f250c15b600 2023-10-16T12:59:21.458 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.446+0000 7f2513c7a700 1 -- 172.21.15.124:0/53993957 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f250c0b08d0 con 0x7f250c15b600 2023-10-16T12:59:21.458 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.447+0000 7f2513c7a700 1 -- 172.21.15.124:0/53993957 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f250c04f400 con 0x7f250c15b600 2023-10-16T12:59:21.458 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.447+0000 7f25027fc700 1 -- 172.21.15.124:0/53993957 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f250401b3b0 con 0x7f250c15b600 2023-10-16T12:59:21.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.447+0000 7f25027fc700 1 --2- 172.21.15.124:0/53993957 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f24f006af00 0x7f24f006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:21.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.448+0000 7f25027fc700 1 -- 172.21.15.124:0/53993957 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2504089560 con 0x7f250c15b600 2023-10-16T12:59:21.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.448+0000 7f2511a16700 1 --2- 172.21.15.124:0/53993957 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f24f006af00 0x7f24f006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:21.459 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.448+0000 7f2511a16700 1 --2- 172.21.15.124:0/53993957 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f24f006af00 0x7f24f006d3c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2508000c00 tx=0x7f250801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:21.460 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.452+0000 7f25027fc700 1 -- 172.21.15.124:0/53993957 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2504054330 con 0x7f250c15b600 2023-10-16T12:59:21.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.684+0000 7f2513c7a700 1 -- 172.21.15.124:0/53993957 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f250c158940 con 0x7f250c15b600 2023-10-16T12:59:21.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.684+0000 7f25027fc700 1 -- 172.21.15.124:0/53993957 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f250c158940 con 0x7f250c15b600 2023-10-16T12:59:21.687 INFO:teuthology.orchestra.run.smithi124.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-16T12:59:21.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.687+0000 7f2513c7a700 1 -- 172.21.15.124:0/53993957 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f24f006af00 msgr2=0x7f24f006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:21.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.687+0000 7f2513c7a700 1 --2- 172.21.15.124:0/53993957 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f24f006af00 0x7f24f006d3c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2508000c00 tx=0x7f250801c040 comp rx=0 tx=0).stop 2023-10-16T12:59:21.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.687+0000 7f2513c7a700 1 -- 172.21.15.124:0/53993957 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f250c15b600 msgr2=0x7f250c1e3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:21.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.687+0000 7f2513c7a700 1 --2- 172.21.15.124:0/53993957 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f250c15b600 0x7f250c1e3850 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f250400cb10 tx=0x7f250400ced0 comp rx=0 tx=0).stop 2023-10-16T12:59:21.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.687+0000 7f2513c7a700 1 -- 172.21.15.124:0/53993957 shutdown_connections 2023-10-16T12:59:21.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.687+0000 7f2513c7a700 1 --2- 172.21.15.124:0/53993957 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f24f006af00 0x7f24f006d3c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:21.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.687+0000 7f2513c7a700 1 --2- 172.21.15.124:0/53993957 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f250c15b600 0x7f250c1e3850 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:21.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.687+0000 7f2513c7a700 1 --2- 172.21.15.124:0/53993957 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f250c0b0c30 0x7f250c158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:21.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.687+0000 7f2513c7a700 1 --2- 172.21.15.124:0/53993957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f250c0b1860 0x7f250c0af880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:21.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.687+0000 7f2513c7a700 1 -- 172.21.15.124:0/53993957 >> 172.21.15.124:0/53993957 conn(0x7f250c06c850 msgr2=0x7f250c0ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:21.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.687+0000 7f2513c7a700 1 -- 172.21.15.124:0/53993957 shutdown_connections 2023-10-16T12:59:21.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:21.687+0000 7f2513c7a700 1 -- 172.21.15.124:0/53993957 wait complete. 2023-10-16T12:59:21.700 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T12:59:21.700 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T12:59:21.701 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi124.front.sepia.ceph.com 2023-10-16T12:59:21.701 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-16T12:59:21.701 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T12:59:21.701 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T12:59:21.702 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T12:59:21.702 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T12:59:21.702 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T12:59:21.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:21.703 DEBUG:teuthology.orchestra.run.smithi124:> ip addr 2023-10-16T12:59:21.720 INFO:teuthology.orchestra.run.smithi124.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T12:59:21.720 INFO:teuthology.orchestra.run.smithi124.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T12:59:21.720 INFO:teuthology.orchestra.run.smithi124.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T12:59:21.720 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:21.721 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 ::1/128 scope host 2023-10-16T12:59:21.721 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:21.721 INFO:teuthology.orchestra.run.smithi124.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T12:59:21.721 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:d8:a1:a6 brd ff:ff:ff:ff:ff:ff 2023-10-16T12:59:21.721 INFO:teuthology.orchestra.run.smithi124.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T12:59:21.722 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:d8:a1:a7 brd ff:ff:ff:ff:ff:ff 2023-10-16T12:59:21.722 INFO:teuthology.orchestra.run.smithi124.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T12:59:21.722 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:8f:d5:c4 brd ff:ff:ff:ff:ff:ff 2023-10-16T12:59:21.722 INFO:teuthology.orchestra.run.smithi124.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T12:59:21.722 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:8f:d5:c5 brd ff:ff:ff:ff:ff:ff 2023-10-16T12:59:21.723 INFO:teuthology.orchestra.run.smithi124.stdout: inet 172.21.15.124/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T12:59:21.723 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft 42398sec preferred_lft 42398sec 2023-10-16T12:59:21.723 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::1cab:2850:a634:5e4f/64 scope link noprefixroute 2023-10-16T12:59:21.723 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:21.724 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-16T12:59:21.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:21.724 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-16T12:59:21.725 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-16T12:59:21.725 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link add name ceph-brx type bridge 2023-10-16T12:59:21.725 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip addr flush dev ceph-brx 2023-10-16T12:59:21.725 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set ceph-brx up 2023-10-16T12:59:21.726 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-16T12:59:21.726 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-16T12:59:21.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:21.835 DEBUG:teuthology.orchestra.run.smithi124:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T12:59:21.861 INFO:teuthology.orchestra.run.smithi124.stdout:1 2023-10-16T12:59:21.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:21.862 DEBUG:teuthology.orchestra.run.smithi124:> route 2023-10-16T12:59:21.921 INFO:teuthology.orchestra.run.smithi124.stdout:Kernel IP routing table 2023-10-16T12:59:21.921 INFO:teuthology.orchestra.run.smithi124.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T12:59:21.922 INFO:teuthology.orchestra.run.smithi124.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T12:59:21.922 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T12:59:21.922 INFO:teuthology.orchestra.run.smithi124.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T12:59:21.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:21.923 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-16T12:59:21.923 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-16T12:59:21.923 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T12:59:21.924 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T12:59:21.924 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T12:59:21.924 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-16T12:59:22.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:22.027 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list 2023-10-16T12:59:22.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:22.045 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list-id 2023-10-16T12:59:22.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:22.101 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-16T12:59:22.102 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-16T12:59:22.102 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T12:59:22.102 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-16T12:59:22.103 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-16T12:59:22.195 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-16T12:59:22.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:22.196 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-16T12:59:22.196 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-16T12:59:22.196 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-16T12:59:22.197 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-16T12:59:22.197 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-16T12:59:22.197 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-16T12:59:22.197 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-16T12:59:22.198 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-16T12:59:22.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:22.399 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-16T12:59:22.400 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-16T12:59:22.400 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set brx.0 up 2023-10-16T12:59:22.400 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set dev brx.0 master ceph-brx 2023-10-16T12:59:22.401 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-16T12:59:22.513 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T12:59:22.513 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-16T12:59:22.536 INFO:teuthology.orchestra.run.smithi124.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-16T12:59:22.536 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T12:59:22.537 DEBUG:teuthology.orchestra.run.smithi124:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-16T12:59:22.592 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-16T12:59:22.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:22.593 DEBUG:teuthology.orchestra.run.smithi124:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T12:59:22.678 INFO:teuthology.orchestra.run.smithi124.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T12:59:22.678 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T12:59:22.807 INFO:teuthology.orchestra.run.smithi124.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T12:59:22.807 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T12:59:22.807 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: resolved to: "172.21.15.124:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-16T12:59:22.808 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: trying mount with new device syntax: 0@4cfd077b-2400-4ae1-a7e8-14265fee7113.cephfs=/ 2023-10-16T12:59:22.808 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.124:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-16T12:59:22.808 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T12:59:22.808 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T12:59:22.808 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T12:59:22.838 INFO:teuthology.orchestra.run.smithi124.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T12:59:22.839 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T12:59:22.839 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: resolved to: "172.21.15.124:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-16T12:59:22.839 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: trying mount with new device syntax: 0@4cfd077b-2400-4ae1-a7e8-14265fee7113.cephfs=/ 2023-10-16T12:59:22.839 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.124:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-16T12:59:22.839 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T12:59:22.840 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T12:59:22.840 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T12:59:22.840 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: resolved to: "172.21.15.124:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-16T12:59:22.840 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.124:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-16T12:59:22.840 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=4cfd077b-2400-4ae1-a7e8-14265fee7113" will pass to kernel 2023-10-16T12:59:22.842 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T12:59:22.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:22.843 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-16T12:59:22.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:22.877 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T12:59:22.950 INFO:teuthology.orchestra.run.smithi124.stdout:client4574 2023-10-16T12:59:22.951 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:59:22.951 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:59:23.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:23.008 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T12:59:23.080 INFO:teuthology.orchestra.run.smithi124.stdout:client4574 2023-10-16T12:59:23.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:23.081 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T12:59:23.154 INFO:teuthology.orchestra.run.smithi124.stdout:client4574 2023-10-16T12:59:23.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:23.155 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/4cfd077b-2400-4ae1-a7e8-14265fee7113.client4574/status') 2023-10-16T12:59:23.234 INFO:teuthology.orchestra.run.smithi124.stdout:instance: client.4574 (3)172.21.15.124:0/1590257781 2023-10-16T12:59:23.234 INFO:teuthology.orchestra.run.smithi124.stdout:blocklisted: false 2023-10-16T12:59:23.235 INFO:teuthology.orchestra.run.smithi124.stderr:0+1 records in 2023-10-16T12:59:23.235 INFO:teuthology.orchestra.run.smithi124.stderr:0+1 records out 2023-10-16T12:59:23.236 INFO:teuthology.orchestra.run.smithi124.stderr:71 bytes copied, 2.1424e-05 s, 3.3 MB/s 2023-10-16T12:59:23.236 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-16T12:59:23.236 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T12:59:23.237 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-16T12:59:23.237 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T12:59:23.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.395+0000 7f868fed6700 1 Processor -- start 2023-10-16T12:59:23.397 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.396+0000 7f868fed6700 1 -- start start 2023-10-16T12:59:23.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.396+0000 7f868fed6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f868815a240 0x7f868815de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:23.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.396+0000 7f868fed6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86880b1bd0 0x7f86880b2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:23.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.396+0000 7f868fed6700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86880b2560 con 0x7f868815e390 2023-10-16T12:59:23.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.396+0000 7f868fed6700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f868815edf0 con 0x7f868815a240 2023-10-16T12:59:23.401 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.396+0000 7f868fed6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868815e830 con 0x7f86880b1bd0 2023-10-16T12:59:23.401 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.397+0000 7f868e473700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86880b1bd0 0x7f86880b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:23.401 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.397+0000 7f868dc72700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f868815a240 0x7f868815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:23.401 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.397+0000 7f868dc72700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f868815a240 0x7f868815de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:34414/0 (socket says 172.21.15.124:34414) 2023-10-16T12:59:23.401 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.397+0000 7f868d471700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f868815e390 0x7f86880724a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.124:54916/0 (socket says 172.21.15.124:54916) 2023-10-16T12:59:23.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.397+0000 7f868e473700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86880b1bd0 0x7f86880b2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:40328/0 (socket says 172.21.15.124:40328) 2023-10-16T12:59:23.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.397+0000 7f868dc72700 1 -- 172.21.15.124:0/604830828 learned_addr learned my addr 172.21.15.124:0/604830828 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:23.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.397+0000 7f868e473700 1 -- 172.21.15.124:0/604830828 >> v2:172.21.15.192:3300/0 conn(0x7f868815a240 msgr2=0x7f868815de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:23.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.397+0000 7f868e473700 1 --2- 172.21.15.124:0/604830828 >> v2:172.21.15.192:3300/0 conn(0x7f868815a240 0x7f868815de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:23.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.397+0000 7f868e473700 1 -- 172.21.15.124:0/604830828 >> v1:172.21.15.192:6789/0 conn(0x7f868815e390 legacy=0x7f86880724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:23.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.397+0000 7f868e473700 1 -- 172.21.15.124:0/604830828 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868815eb10 con 0x7f86880b1bd0 2023-10-16T12:59:23.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.397+0000 7f868dc72700 1 --2- 172.21.15.124:0/604830828 >> v2:172.21.15.192:3300/0 conn(0x7f868815a240 0x7f868815de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:59:23.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.397+0000 7f868e473700 1 --2- 172.21.15.124:0/604830828 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86880b1bd0 0x7f86880b2020 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8680009d90 tx=0x7f868000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6af209d2c4ff444a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:23.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.397+0000 7f868cc70700 1 -- 172.21.15.124:0/604830828 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868000e070 con 0x7f86880b1bd0 2023-10-16T12:59:23.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.398+0000 7f868cc70700 1 -- 172.21.15.124:0/604830828 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868000bb20 con 0x7f86880b1bd0 2023-10-16T12:59:23.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.398+0000 7f868cc70700 1 -- 172.21.15.124:0/604830828 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680012430 con 0x7f86880b1bd0 2023-10-16T12:59:23.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.398+0000 7f868fed6700 1 -- 172.21.15.124:0/604830828 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86880b1bd0 msgr2=0x7f86880b2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:23.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.398+0000 7f868fed6700 1 --2- 172.21.15.124:0/604830828 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86880b1bd0 0x7f86880b2020 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8680009d90 tx=0x7f868000b330 comp rx=0 tx=0).stop 2023-10-16T12:59:23.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.398+0000 7f868fed6700 1 -- 172.21.15.124:0/604830828 shutdown_connections 2023-10-16T12:59:23.405 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.398+0000 7f868fed6700 1 --2- 172.21.15.124:0/604830828 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86880b1bd0 0x7f86880b2020 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:23.405 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.398+0000 7f868fed6700 1 --2- 172.21.15.124:0/604830828 >> v2:172.21.15.192:3300/0 conn(0x7f868815a240 0x7f868815de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:23.405 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.398+0000 7f868fed6700 1 -- 172.21.15.124:0/604830828 >> 172.21.15.124:0/604830828 conn(0x7f868806bd50 msgr2=0x7f868806c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:23.405 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.398+0000 7f868fed6700 1 -- 172.21.15.124:0/604830828 shutdown_connections 2023-10-16T12:59:23.405 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.398+0000 7f868fed6700 1 -- 172.21.15.124:0/604830828 wait complete. 2023-10-16T12:59:23.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.399+0000 7f868fed6700 1 Processor -- start 2023-10-16T12:59:23.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.399+0000 7f868fed6700 1 -- start start 2023-10-16T12:59:23.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.400+0000 7f868fed6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86880b1bd0 0x7f86881f0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:23.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.400+0000 7f868fed6700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f868815a240 0x7f86880c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:23.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.400+0000 7f868fed6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f868815e390 0x7f86881eccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:23.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.400+0000 7f868fed6700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86880c7f40 con 0x7f868815a240 2023-10-16T12:59:23.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.400+0000 7f868fed6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86881f0bd0 con 0x7f86880b1bd0 2023-10-16T12:59:23.410 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.400+0000 7f868fed6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86880c72c0 con 0x7f868815e390 2023-10-16T12:59:23.410 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.400+0000 7f868d471700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f868815a240 0x7f86880c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:23.410 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.400+0000 7f868d471700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f868815a240 0x7f86880c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54258/0 (socket says 172.21.15.124:54258) 2023-10-16T12:59:23.410 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.400+0000 7f868d471700 1 -- 172.21.15.124:0/4099167052 learned_addr learned my addr 172.21.15.124:0/4099167052 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:23.410 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.400+0000 7f868dc72700 1 --2- 172.21.15.124:0/4099167052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86880b1bd0 0x7f86881f0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:23.411 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.400+0000 7f868e473700 1 --2- 172.21.15.124:0/4099167052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f868815e390 0x7f86881eccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:23.411 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.401+0000 7f868d471700 1 -- 172.21.15.124:0/4099167052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f868815e390 msgr2=0x7f86881eccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:23.411 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.401+0000 7f868d471700 1 --2- 172.21.15.124:0/4099167052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f868815e390 0x7f86881eccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:23.411 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.401+0000 7f868d471700 1 -- 172.21.15.124:0/4099167052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86880b1bd0 msgr2=0x7f86881f0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:23.411 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.401+0000 7f868d471700 1 --2- 172.21.15.124:0/4099167052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86880b1bd0 0x7f86881f0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:23.412 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.401+0000 7f868d471700 1 -- 172.21.15.124:0/4099167052 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8684009550 con 0x7f868815a240 2023-10-16T12:59:23.412 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.401+0000 7f868d471700 1 --2- 172.21.15.124:0/4099167052 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f868815a240 0x7f86880c9010 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f867c00c520 tx=0x7f867c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:23.412 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.401+0000 7f867a7fc700 1 -- 172.21.15.124:0/4099167052 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c005cb0 con 0x7f868815a240 2023-10-16T12:59:23.412 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.401+0000 7f868fed6700 1 -- 172.21.15.124:0/4099167052 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8680009a70 con 0x7f868815a240 2023-10-16T12:59:23.412 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.401+0000 7f867a7fc700 1 -- 172.21.15.124:0/4099167052 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c005e10 con 0x7f868815a240 2023-10-16T12:59:23.413 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.401+0000 7f867a7fc700 1 -- 172.21.15.124:0/4099167052 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c0072d0 con 0x7f868815a240 2023-10-16T12:59:23.413 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.401+0000 7f868fed6700 1 -- 172.21.15.124:0/4099167052 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86880c7880 con 0x7f868815a240 2023-10-16T12:59:23.413 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.402+0000 7f868fed6700 1 -- 172.21.15.124:0/4099167052 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86880c8080 con 0x7f868815a240 2023-10-16T12:59:23.413 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.402+0000 7f867a7fc700 1 -- 172.21.15.124:0/4099167052 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f867c007430 con 0x7f868815a240 2023-10-16T12:59:23.413 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.403+0000 7f867a7fc700 1 --2- 172.21.15.124:0/4099167052 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f866c06af00 0x7f866c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:23.414 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.403+0000 7f867a7fc700 1 -- 172.21.15.124:0/4099167052 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f867c088980 con 0x7f868815a240 2023-10-16T12:59:23.414 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.403+0000 7f868dc72700 1 --2- 172.21.15.124:0/4099167052 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f866c06af00 0x7f866c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:23.414 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.403+0000 7f868dc72700 1 --2- 172.21.15.124:0/4099167052 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f866c06af00 0x7f866c06d3c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8684006d30 tx=0x7f86840092c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:23.415 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.407+0000 7f867a7fc700 1 -- 172.21.15.124:0/4099167052 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f86880c8080 con 0x7f868815a240 2023-10-16T12:59:23.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.643+0000 7f868fed6700 1 -- 172.21.15.124:0/4099167052 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f86880b2560 con 0x7f868815a240 2023-10-16T12:59:23.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.643+0000 7f867a7fc700 1 -- 172.21.15.124:0/4099167052 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f867c017070 con 0x7f868815a240 2023-10-16T12:59:23.646 INFO:teuthology.orchestra.run.smithi124.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-16T12:59:23.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.645+0000 7f868fed6700 1 -- 172.21.15.124:0/4099167052 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f866c06af00 msgr2=0x7f866c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:23.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.645+0000 7f868fed6700 1 --2- 172.21.15.124:0/4099167052 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f866c06af00 0x7f866c06d3c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8684006d30 tx=0x7f86840092c0 comp rx=0 tx=0).stop 2023-10-16T12:59:23.648 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.645+0000 7f868fed6700 1 -- 172.21.15.124:0/4099167052 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f868815a240 msgr2=0x7f86880c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:23.648 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.645+0000 7f868fed6700 1 --2- 172.21.15.124:0/4099167052 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f868815a240 0x7f86880c9010 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f867c00c520 tx=0x7f867c00c830 comp rx=0 tx=0).stop 2023-10-16T12:59:23.648 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.645+0000 7f868fed6700 1 -- 172.21.15.124:0/4099167052 shutdown_connections 2023-10-16T12:59:23.648 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.645+0000 7f868fed6700 1 --2- 172.21.15.124:0/4099167052 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f866c06af00 0x7f866c06d3c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:23.648 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.645+0000 7f868fed6700 1 --2- 172.21.15.124:0/4099167052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f868815e390 0x7f86881eccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:23.649 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.645+0000 7f868fed6700 1 --2- 172.21.15.124:0/4099167052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86880b1bd0 0x7f86881f0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:23.649 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.645+0000 7f868fed6700 1 --2- 172.21.15.124:0/4099167052 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f868815a240 0x7f86880c9010 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:23.649 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.645+0000 7f868fed6700 1 -- 172.21.15.124:0/4099167052 >> 172.21.15.124:0/4099167052 conn(0x7f868806bd50 msgr2=0x7f868806c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:23.649 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.646+0000 7f868fed6700 1 -- 172.21.15.124:0/4099167052 shutdown_connections 2023-10-16T12:59:23.649 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:23.646+0000 7f868fed6700 1 -- 172.21.15.124:0/4099167052 wait complete. 2023-10-16T12:59:23.659 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T12:59:23.659 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T12:59:23.660 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi124.front.sepia.ceph.com 2023-10-16T12:59:23.660 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-16T12:59:23.660 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-16T12:59:23.660 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T12:59:23.661 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T12:59:23.661 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T12:59:23.661 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-16T12:59:23.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:23.662 DEBUG:teuthology.orchestra.run.smithi124:> ip addr 2023-10-16T12:59:23.679 INFO:teuthology.orchestra.run.smithi124.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T12:59:23.679 INFO:teuthology.orchestra.run.smithi124.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T12:59:23.679 INFO:teuthology.orchestra.run.smithi124.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T12:59:23.680 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:23.680 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 ::1/128 scope host 2023-10-16T12:59:23.680 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:23.680 INFO:teuthology.orchestra.run.smithi124.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T12:59:23.681 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:d8:a1:a6 brd ff:ff:ff:ff:ff:ff 2023-10-16T12:59:23.681 INFO:teuthology.orchestra.run.smithi124.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T12:59:23.681 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:d8:a1:a7 brd ff:ff:ff:ff:ff:ff 2023-10-16T12:59:23.681 INFO:teuthology.orchestra.run.smithi124.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T12:59:23.681 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:8f:d5:c4 brd ff:ff:ff:ff:ff:ff 2023-10-16T12:59:23.682 INFO:teuthology.orchestra.run.smithi124.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T12:59:23.682 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:8f:d5:c5 brd ff:ff:ff:ff:ff:ff 2023-10-16T12:59:23.682 INFO:teuthology.orchestra.run.smithi124.stdout: inet 172.21.15.124/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T12:59:23.682 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft 42396sec preferred_lft 42396sec 2023-10-16T12:59:23.682 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::1cab:2850:a634:5e4f/64 scope link noprefixroute 2023-10-16T12:59:23.683 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:23.683 INFO:teuthology.orchestra.run.smithi124.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T12:59:23.683 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 76:ac:d4:62:c0:51 brd ff:ff:ff:ff:ff:ff 2023-10-16T12:59:23.683 INFO:teuthology.orchestra.run.smithi124.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T12:59:23.683 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:23.684 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::2c14:adff:fe0c:d2d6/64 scope link tentative 2023-10-16T12:59:23.684 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:23.684 INFO:teuthology.orchestra.run.smithi124.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T12:59:23.684 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 76:ac:d4:62:c0:51 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T12:59:23.684 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::74ac:d4ff:fe62:c051/64 scope link tentative 2023-10-16T12:59:23.685 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:23.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:23.685 DEBUG:teuthology.orchestra.run.smithi124:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T12:59:23.745 INFO:teuthology.orchestra.run.smithi124.stdout:1 2023-10-16T12:59:23.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:23.746 DEBUG:teuthology.orchestra.run.smithi124:> route 2023-10-16T12:59:23.805 INFO:teuthology.orchestra.run.smithi124.stdout:Kernel IP routing table 2023-10-16T12:59:23.806 INFO:teuthology.orchestra.run.smithi124.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T12:59:23.806 INFO:teuthology.orchestra.run.smithi124.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T12:59:23.806 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T12:59:23.806 INFO:teuthology.orchestra.run.smithi124.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T12:59:23.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:23.807 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-16T12:59:23.808 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-16T12:59:23.808 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T12:59:23.808 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T12:59:23.808 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T12:59:23.809 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-16T12:59:23.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:23.910 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list 2023-10-16T12:59:23.926 INFO:teuthology.orchestra.run.smithi124.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T12:59:23.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:23.927 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list-id 2023-10-16T12:59:23.983 INFO:teuthology.orchestra.run.smithi124.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-16T12:59:23.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:23.984 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-16T12:59:23.984 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-16T12:59:23.984 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T12:59:23.985 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-16T12:59:23.985 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-16T12:59:24.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:24.077 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-16T12:59:24.119 INFO:teuthology.orchestra.run.smithi124.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T12:59:24.120 INFO:teuthology.orchestra.run.smithi124.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T12:59:24.120 INFO:teuthology.orchestra.run.smithi124.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T12:59:24.120 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:24.120 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 ::1/128 scope host 2023-10-16T12:59:24.120 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:24.121 INFO:teuthology.orchestra.run.smithi124.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T12:59:24.121 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 9e:03:9d:3e:ee:e7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-16T12:59:24.121 INFO:teuthology.orchestra.run.smithi124.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-16T12:59:24.121 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:24.122 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::9c03:9dff:fe3e:eee7/64 scope link tentative 2023-10-16T12:59:24.122 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:24.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:24.144 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-16T12:59:24.221 INFO:teuthology.orchestra.run.smithi124.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T12:59:24.221 INFO:teuthology.orchestra.run.smithi124.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T12:59:24.222 INFO:teuthology.orchestra.run.smithi124.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T12:59:24.222 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:24.222 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 ::1/128 scope host 2023-10-16T12:59:24.222 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:24.222 INFO:teuthology.orchestra.run.smithi124.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T12:59:24.223 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 9e:03:9d:3e:ee:e7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-16T12:59:24.223 INFO:teuthology.orchestra.run.smithi124.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-16T12:59:24.223 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:24.223 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::9c03:9dff:fe3e:eee7/64 scope link tentative 2023-10-16T12:59:24.223 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:24.234 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-16T12:59:24.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:24.235 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-16T12:59:24.235 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-16T12:59:24.236 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-16T12:59:24.236 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-16T12:59:24.236 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-16T12:59:24.237 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-16T12:59:24.237 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-16T12:59:24.237 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-16T12:59:24.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:24.479 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-16T12:59:24.480 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-16T12:59:24.480 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set brx.1 up 2023-10-16T12:59:24.480 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set dev brx.1 master ceph-brx 2023-10-16T12:59:24.480 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-16T12:59:24.595 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T12:59:24.596 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-16T12:59:24.616 INFO:teuthology.orchestra.run.smithi124.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-16T12:59:24.616 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T12:59:24.617 DEBUG:teuthology.orchestra.run.smithi124:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-16T12:59:24.673 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-16T12:59:24.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:24.674 DEBUG:teuthology.orchestra.run.smithi124:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T12:59:24.759 INFO:teuthology.orchestra.run.smithi124.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T12:59:24.759 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T12:59:24.785 INFO:teuthology.orchestra.run.smithi124.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T12:59:24.785 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T12:59:24.786 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: resolved to: "172.21.15.124:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-16T12:59:24.786 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: trying mount with new device syntax: 2@4cfd077b-2400-4ae1-a7e8-14265fee7113.cephfs=/ 2023-10-16T12:59:24.786 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.124:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-16T12:59:24.786 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T12:59:24.787 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T12:59:24.787 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T12:59:24.856 INFO:teuthology.orchestra.run.smithi124.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T12:59:24.856 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T12:59:24.856 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: resolved to: "172.21.15.124:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-16T12:59:24.857 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: trying mount with new device syntax: 2@4cfd077b-2400-4ae1-a7e8-14265fee7113.cephfs=/ 2023-10-16T12:59:24.857 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.124:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-16T12:59:24.857 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T12:59:24.857 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T12:59:24.857 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T12:59:24.858 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: resolved to: "172.21.15.124:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-16T12:59:24.858 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.124:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-16T12:59:24.858 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=4cfd077b-2400-4ae1-a7e8-14265fee7113" will pass to kernel 2023-10-16T12:59:24.859 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T12:59:24.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:24.860 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-16T12:59:24.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:24.887 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T12:59:24.960 INFO:teuthology.orchestra.run.smithi124.stdout:client4842 2023-10-16T12:59:24.960 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:59:24.961 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:59:25.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:25.018 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T12:59:25.091 INFO:teuthology.orchestra.run.smithi124.stdout:client4842 2023-10-16T12:59:25.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:25.092 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T12:59:25.163 INFO:teuthology.orchestra.run.smithi124.stdout:client4842 2023-10-16T12:59:25.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:25.164 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/4cfd077b-2400-4ae1-a7e8-14265fee7113.client4842/status') 2023-10-16T12:59:25.244 INFO:teuthology.orchestra.run.smithi124.stdout:instance: client.4842 (3)192.168.0.2:0/1030191162 2023-10-16T12:59:25.244 INFO:teuthology.orchestra.run.smithi124.stdout:blocklisted: false 2023-10-16T12:59:25.245 INFO:teuthology.orchestra.run.smithi124.stderr:0+1 records in 2023-10-16T12:59:25.246 INFO:teuthology.orchestra.run.smithi124.stderr:0+1 records out 2023-10-16T12:59:25.246 INFO:teuthology.orchestra.run.smithi124.stderr:69 bytes copied, 2.1297e-05 s, 3.2 MB/s 2023-10-16T12:59:25.246 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-16T12:59:25.246 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T12:59:25.247 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-16T12:59:25.247 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T12:59:25.405 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.404+0000 7f96f3291700 1 Processor -- start 2023-10-16T12:59:25.406 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.404+0000 7f96f3291700 1 -- start start 2023-10-16T12:59:25.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.405+0000 7f96f3291700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f96ec0712e0 0x7f96ec0716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:25.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.405+0000 7f96f3291700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f96ec0cbea0 0x7f96ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:25.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.405+0000 7f96f3291700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96ec0ca420 con 0x7f96ec06cf10 2023-10-16T12:59:25.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.405+0000 7f96f3291700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96ec071c00 con 0x7f96ec0cbea0 2023-10-16T12:59:25.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.405+0000 7f96f3291700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96ec06d9b0 con 0x7f96ec0712e0 2023-10-16T12:59:25.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.405+0000 7f96f182e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f96ec0cbea0 0x7f96ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:25.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.405+0000 7f96f182e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f96ec0cbea0 0x7f96ec06d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54270/0 (socket says 172.21.15.124:54270) 2023-10-16T12:59:25.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.405+0000 7f96f182e700 1 -- 172.21.15.124:0/1830147497 learned_addr learned my addr 172.21.15.124:0/1830147497 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:25.410 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.405+0000 7f96f102d700 1 --2- 172.21.15.124:0/1830147497 >> v2:172.21.15.192:3300/0 conn(0x7f96ec0712e0 0x7f96ec0716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:25.410 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.405+0000 7f96f182e700 1 -- 172.21.15.124:0/1830147497 >> v2:172.21.15.192:3300/0 conn(0x7f96ec0712e0 msgr2=0x7f96ec0716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:25.410 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.405+0000 7f96f182e700 1 --2- 172.21.15.124:0/1830147497 >> v2:172.21.15.192:3300/0 conn(0x7f96ec0712e0 0x7f96ec0716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:25.410 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.405+0000 7f96f182e700 1 -- 172.21.15.124:0/1830147497 >> v1:172.21.15.192:6789/0 conn(0x7f96ec06cf10 legacy=0x7f96ec06a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:25.411 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.405+0000 7f96f182e700 1 -- 172.21.15.124:0/1830147497 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ec0ca690 con 0x7f96ec0cbea0 2023-10-16T12:59:25.411 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.405+0000 7f96f102d700 1 --2- 172.21.15.124:0/1830147497 >> v2:172.21.15.192:3300/0 conn(0x7f96ec0712e0 0x7f96ec0716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:25.411 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.405+0000 7f96f182e700 1 --2- 172.21.15.124:0/1830147497 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96ec0cbea0 0x7f96ec06d3c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f96ec06c370 tx=0x7f96e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d376bcbde2eb3252 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:25.411 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.405+0000 7f96e3fff700 1 -- 172.21.15.124:0/1830147497 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e400e070 con 0x7f96ec0cbea0 2023-10-16T12:59:25.411 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.405+0000 7f96e3fff700 1 -- 172.21.15.124:0/1830147497 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e400b9c0 con 0x7f96ec0cbea0 2023-10-16T12:59:25.412 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.405+0000 7f96e3fff700 1 -- 172.21.15.124:0/1830147497 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e400bd70 con 0x7f96ec0cbea0 2023-10-16T12:59:25.412 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.406+0000 7f96f3291700 1 -- 172.21.15.124:0/1830147497 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96ec0cbea0 msgr2=0x7f96ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:25.412 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.406+0000 7f96f3291700 1 --2- 172.21.15.124:0/1830147497 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96ec0cbea0 0x7f96ec06d3c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f96ec06c370 tx=0x7f96e400b330 comp rx=0 tx=0).stop 2023-10-16T12:59:25.412 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.406+0000 7f96f3291700 1 -- 172.21.15.124:0/1830147497 shutdown_connections 2023-10-16T12:59:25.412 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.406+0000 7f96f3291700 1 --2- 172.21.15.124:0/1830147497 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96ec0cbea0 0x7f96ec06d3c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:25.413 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.406+0000 7f96f3291700 1 --2- 172.21.15.124:0/1830147497 >> v2:172.21.15.192:3300/0 conn(0x7f96ec0712e0 0x7f96ec0716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:25.413 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.406+0000 7f96f3291700 1 -- 172.21.15.124:0/1830147497 >> 172.21.15.124:0/1830147497 conn(0x7f96ec0cfcd0 msgr2=0x7f96ec0d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:25.413 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.406+0000 7f96f3291700 1 -- 172.21.15.124:0/1830147497 shutdown_connections 2023-10-16T12:59:25.413 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.406+0000 7f96f3291700 1 -- 172.21.15.124:0/1830147497 wait complete. 2023-10-16T12:59:25.416 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.407+0000 7f96f3291700 1 Processor -- start 2023-10-16T12:59:25.416 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.407+0000 7f96f3291700 1 -- start start 2023-10-16T12:59:25.416 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.408+0000 7f96f3291700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96ec06cf10 0x7f96ec0b3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:25.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.408+0000 7f96f3291700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96ec0712e0 0x7f96ec0c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:25.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.408+0000 7f96f3291700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96ec0cbea0 0x7f96ec0cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:25.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.408+0000 7f96f3291700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec0c8240 con 0x7f96ec0712e0 2023-10-16T12:59:25.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.408+0000 7f96f3291700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec0c8520 con 0x7f96ec06cf10 2023-10-16T12:59:25.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.408+0000 7f96f3291700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec153ac0 con 0x7f96ec0cbea0 2023-10-16T12:59:25.418 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.408+0000 7f96f082c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96ec0712e0 0x7f96ec0c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:25.418 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.408+0000 7f96f082c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96ec0712e0 0x7f96ec0c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54274/0 (socket says 172.21.15.124:54274) 2023-10-16T12:59:25.418 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.408+0000 7f96f082c700 1 -- 172.21.15.124:0/3867701329 learned_addr learned my addr 172.21.15.124:0/3867701329 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:25.418 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.408+0000 7f96f102d700 1 --2- 172.21.15.124:0/3867701329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96ec06cf10 0x7f96ec0b3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:25.418 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.408+0000 7f96f082c700 1 -- 172.21.15.124:0/3867701329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96ec0cbea0 msgr2=0x7f96ec0cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:25.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.408+0000 7f96f082c700 1 --2- 172.21.15.124:0/3867701329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96ec0cbea0 0x7f96ec0cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:25.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.408+0000 7f96f082c700 1 -- 172.21.15.124:0/3867701329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96ec06cf10 msgr2=0x7f96ec0b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:25.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.408+0000 7f96f082c700 1 --2- 172.21.15.124:0/3867701329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96ec06cf10 0x7f96ec0b3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:25.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.408+0000 7f96f082c700 1 -- 172.21.15.124:0/3867701329 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e4009b30 con 0x7f96ec0712e0 2023-10-16T12:59:25.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.408+0000 7f96f082c700 1 --2- 172.21.15.124:0/3867701329 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96ec0712e0 0x7f96ec0c57d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00c450 tx=0x7f96dc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:25.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.409+0000 7f96e1ffb700 1 -- 172.21.15.124:0/3867701329 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc0052d0 con 0x7f96ec0712e0 2023-10-16T12:59:25.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.409+0000 7f96e1ffb700 1 -- 172.21.15.124:0/3867701329 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96dc005430 con 0x7f96ec0712e0 2023-10-16T12:59:25.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.409+0000 7f96f3291700 1 -- 172.21.15.124:0/3867701329 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96ec153da0 con 0x7f96ec0712e0 2023-10-16T12:59:25.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.409+0000 7f96e1ffb700 1 -- 172.21.15.124:0/3867701329 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc0038c0 con 0x7f96ec0712e0 2023-10-16T12:59:25.421 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.409+0000 7f96f3291700 1 -- 172.21.15.124:0/3867701329 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96ec0c5d10 con 0x7f96ec0712e0 2023-10-16T12:59:25.421 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.410+0000 7f96f3291700 1 -- 172.21.15.124:0/3867701329 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96ec153920 con 0x7f96ec0712e0 2023-10-16T12:59:25.421 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.410+0000 7f96e1ffb700 1 -- 172.21.15.124:0/3867701329 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f96dc003a20 con 0x7f96ec0712e0 2023-10-16T12:59:25.421 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.410+0000 7f96e1ffb700 1 --2- 172.21.15.124:0/3867701329 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f96d006af00 0x7f96d006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:25.421 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.411+0000 7f96e1ffb700 1 -- 172.21.15.124:0/3867701329 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f96dc088b40 con 0x7f96ec0712e0 2023-10-16T12:59:25.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.411+0000 7f96f102d700 1 --2- 172.21.15.124:0/3867701329 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f96d006af00 0x7f96d006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:25.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.411+0000 7f96f102d700 1 --2- 172.21.15.124:0/3867701329 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f96d006af00 0x7f96d006d3c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f96e800a9b0 tx=0x7f96e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:25.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.415+0000 7f96e1ffb700 1 -- 172.21.15.124:0/3867701329 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f96ec153920 con 0x7f96ec0712e0 2023-10-16T12:59:25.648 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.646+0000 7f96f3291700 1 -- 172.21.15.124:0/3867701329 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f96ec1542c0 con 0x7f96ec0712e0 2023-10-16T12:59:25.649 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.647+0000 7f96e1ffb700 1 -- 172.21.15.124:0/3867701329 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f96ec1542c0 con 0x7f96ec0712e0 2023-10-16T12:59:25.649 INFO:teuthology.orchestra.run.smithi124.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-16T12:59:25.651 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.649+0000 7f96f3291700 1 -- 172.21.15.124:0/3867701329 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f96d006af00 msgr2=0x7f96d006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:25.651 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.649+0000 7f96f3291700 1 --2- 172.21.15.124:0/3867701329 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f96d006af00 0x7f96d006d3c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f96e800a9b0 tx=0x7f96e8008040 comp rx=0 tx=0).stop 2023-10-16T12:59:25.652 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.649+0000 7f96f3291700 1 -- 172.21.15.124:0/3867701329 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96ec0712e0 msgr2=0x7f96ec0c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:25.652 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.649+0000 7f96f3291700 1 --2- 172.21.15.124:0/3867701329 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96ec0712e0 0x7f96ec0c57d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00c450 tx=0x7f96dc00c810 comp rx=0 tx=0).stop 2023-10-16T12:59:25.652 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.649+0000 7f96f3291700 1 -- 172.21.15.124:0/3867701329 shutdown_connections 2023-10-16T12:59:25.652 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.649+0000 7f96f3291700 1 --2- 172.21.15.124:0/3867701329 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f96d006af00 0x7f96d006d3c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:25.652 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.649+0000 7f96f3291700 1 --2- 172.21.15.124:0/3867701329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96ec0cbea0 0x7f96ec0cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:25.653 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.649+0000 7f96f3291700 1 --2- 172.21.15.124:0/3867701329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96ec06cf10 0x7f96ec0b3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:25.653 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.649+0000 7f96f3291700 1 --2- 172.21.15.124:0/3867701329 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96ec0712e0 0x7f96ec0c57d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:25.653 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.649+0000 7f96f3291700 1 -- 172.21.15.124:0/3867701329 >> 172.21.15.124:0/3867701329 conn(0x7f96ec0cfcd0 msgr2=0x7f96ec158f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:25.653 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.649+0000 7f96f3291700 1 -- 172.21.15.124:0/3867701329 shutdown_connections 2023-10-16T12:59:25.653 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:25.649+0000 7f96f3291700 1 -- 172.21.15.124:0/3867701329 wait complete. 2023-10-16T12:59:25.663 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T12:59:25.663 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T12:59:25.663 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-10-16T12:59:25.664 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-16T12:59:25.664 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-16T12:59:25.664 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T12:59:25.664 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T12:59:25.665 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T12:59:25.665 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-16T12:59:25.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:25.665 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-10-16T12:59:25.686 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T12:59:25.687 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T12:59:25.687 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T12:59:25.687 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:25.688 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-10-16T12:59:25.688 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:25.688 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T12:59:25.688 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-10-16T12:59:25.688 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T12:59:25.689 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-10-16T12:59:25.689 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T12:59:25.689 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-10-16T12:59:25.689 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T12:59:25.689 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-10-16T12:59:25.690 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T12:59:25.690 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42397sec preferred_lft 42397sec 2023-10-16T12:59:25.690 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::c4a6:1b97:a23d:849a/64 scope link noprefixroute 2023-10-16T12:59:25.690 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:25.690 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-16T12:59:25.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:25.691 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-16T12:59:25.691 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-16T12:59:25.692 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add name ceph-brx type bridge 2023-10-16T12:59:25.692 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip addr flush dev ceph-brx 2023-10-16T12:59:25.692 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set ceph-brx up 2023-10-16T12:59:25.693 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-16T12:59:25.693 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-16T12:59:25.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:25.871 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T12:59:25.898 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-10-16T12:59:25.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:25.900 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-10-16T12:59:25.982 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-10-16T12:59:25.982 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T12:59:25.983 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T12:59:25.983 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T12:59:25.983 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T12:59:25.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:25.984 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-16T12:59:25.984 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-16T12:59:25.984 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T12:59:25.985 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T12:59:25.985 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T12:59:25.985 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-16T12:59:26.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:26.228 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-10-16T12:59:26.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:26.245 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list-id 2023-10-16T12:59:26.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:26.301 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-16T12:59:26.301 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-16T12:59:26.302 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T12:59:26.302 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-16T12:59:26.302 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-16T12:59:26.394 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-16T12:59:26.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:26.396 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-16T12:59:26.397 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-16T12:59:26.397 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-16T12:59:26.397 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-16T12:59:26.397 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-16T12:59:26.398 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-16T12:59:26.398 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-16T12:59:26.398 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-16T12:59:26.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:26.610 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-16T12:59:26.611 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-16T12:59:26.611 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2023-10-16T12:59:26.611 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set dev brx.0 master ceph-brx 2023-10-16T12:59:26.611 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-16T12:59:26.712 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T12:59:26.713 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-16T12:59:26.732 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-16T12:59:26.732 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T12:59:26.733 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-16T12:59:26.788 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-16T12:59:26.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:26.789 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T12:59:26.880 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T12:59:26.881 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T12:59:27.001 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T12:59:27.001 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T12:59:27.001 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.124:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-16T12:59:27.001 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@4cfd077b-2400-4ae1-a7e8-14265fee7113.cephfs=/ 2023-10-16T12:59:27.002 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.124:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-16T12:59:27.002 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T12:59:27.002 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T12:59:27.002 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T12:59:27.035 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T12:59:27.035 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T12:59:27.035 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.124:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-16T12:59:27.035 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@4cfd077b-2400-4ae1-a7e8-14265fee7113.cephfs=/ 2023-10-16T12:59:27.036 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.124:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-16T12:59:27.036 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T12:59:27.036 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T12:59:27.036 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T12:59:27.036 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.124:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-16T12:59:27.037 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.124:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-16T12:59:27.037 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=4cfd077b-2400-4ae1-a7e8-14265fee7113" will pass to kernel 2023-10-16T12:59:27.039 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T12:59:27.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:27.039 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-16T12:59:27.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:27.072 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T12:59:27.143 INFO:teuthology.orchestra.run.smithi192.stdout:client4851 2023-10-16T12:59:27.144 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:59:27.144 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:59:27.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:27.201 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T12:59:27.271 INFO:teuthology.orchestra.run.smithi192.stdout:client4851 2023-10-16T12:59:27.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:27.272 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T12:59:27.344 INFO:teuthology.orchestra.run.smithi192.stdout:client4851 2023-10-16T12:59:27.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:27.345 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/4cfd077b-2400-4ae1-a7e8-14265fee7113.client4851/status') 2023-10-16T12:59:27.423 INFO:teuthology.orchestra.run.smithi192.stdout:instance: client.4851 (3)172.21.15.192:0/2718141389 2023-10-16T12:59:27.424 INFO:teuthology.orchestra.run.smithi192.stdout:blocklisted: false 2023-10-16T12:59:27.425 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2023-10-16T12:59:27.425 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2023-10-16T12:59:27.425 INFO:teuthology.orchestra.run.smithi192.stderr:71 bytes copied, 2.1676e-05 s, 3.3 MB/s 2023-10-16T12:59:27.425 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-16T12:59:27.426 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T12:59:27.426 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-16T12:59:27.426 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T12:59:27.561 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.559+0000 7f476ec42700 1 Processor -- start 2023-10-16T12:59:27.561 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.559+0000 7f476ec42700 1 -- start start 2023-10-16T12:59:27.564 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.560+0000 7f476ec42700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4768161780 0x7f476815e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:27.564 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.560+0000 7f476ec42700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f47680cdc90 0x7f4768161b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:27.565 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.560+0000 7f476ec42700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f476815ecf0 con 0x7f476806a820 2023-10-16T12:59:27.565 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.560+0000 7f476ec42700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f476815e320 con 0x7f4768161780 2023-10-16T12:59:27.565 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.560+0000 7f476ec42700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47680c3a20 con 0x7f47680cdc90 2023-10-16T12:59:27.566 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.560+0000 7f476c9de700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4768161780 0x7f476815e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:27.566 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.560+0000 7f476d1df700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f476806a820 0x7f47680716d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42952/0 (socket says 172.21.15.124:42952) 2023-10-16T12:59:27.566 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.560+0000 7f476d1df700 1 -- 172.21.15.124:0/794528745 learned_addr learned my addr 172.21.15.124:0/794528745 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:27.566 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.560+0000 7f4767fff700 1 --2- 172.21.15.124:0/794528745 >> v2:172.21.15.192:3300/0 conn(0x7f47680cdc90 0x7f4768161b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:27.566 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.560+0000 7f476c9de700 1 -- 172.21.15.124:0/794528745 >> v2:172.21.15.192:3300/0 conn(0x7f47680cdc90 msgr2=0x7f4768161b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:27.567 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.560+0000 7f476c9de700 1 --2- 172.21.15.124:0/794528745 >> v2:172.21.15.192:3300/0 conn(0x7f47680cdc90 0x7f4768161b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:27.567 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.560+0000 7f476c9de700 1 -- 172.21.15.124:0/794528745 >> v1:172.21.15.124:6789/0 conn(0x7f476806a820 legacy=0x7f47680716d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:27.567 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.560+0000 7f476c9de700 1 -- 172.21.15.124:0/794528745 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476815dcf0 con 0x7f4768161780 2023-10-16T12:59:27.567 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.560+0000 7f47677fe700 1 -- 172.21.15.124:0/794528745 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704315203 0 0) 0x7f4760001490 con 0x7f476806a820 2023-10-16T12:59:27.567 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.561+0000 7f476c9de700 1 --2- 172.21.15.124:0/794528745 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4768161780 0x7f476815e7b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f47680715b0 tx=0x7f475c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9834b7e9f95c4f4f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:27.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.561+0000 7f47677fe700 1 -- 172.21.15.124:0/794528745 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c011830 con 0x7f4768161780 2023-10-16T12:59:27.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.561+0000 7f47677fe700 1 -- 172.21.15.124:0/794528745 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c011990 con 0x7f4768161780 2023-10-16T12:59:27.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.561+0000 7f47677fe700 1 -- 172.21.15.124:0/794528745 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c011d20 con 0x7f4768161780 2023-10-16T12:59:27.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.561+0000 7f476ec42700 1 -- 172.21.15.124:0/794528745 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4768161780 msgr2=0x7f476815e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:27.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.561+0000 7f476ec42700 1 --2- 172.21.15.124:0/794528745 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4768161780 0x7f476815e7b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f47680715b0 tx=0x7f475c009b20 comp rx=0 tx=0).stop 2023-10-16T12:59:27.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.561+0000 7f476ec42700 1 -- 172.21.15.124:0/794528745 shutdown_connections 2023-10-16T12:59:27.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.561+0000 7f476ec42700 1 --2- 172.21.15.124:0/794528745 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4768161780 0x7f476815e7b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:27.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.561+0000 7f476ec42700 1 --2- 172.21.15.124:0/794528745 >> v2:172.21.15.192:3300/0 conn(0x7f47680cdc90 0x7f4768161b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:27.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.561+0000 7f476ec42700 1 -- 172.21.15.124:0/794528745 >> 172.21.15.124:0/794528745 conn(0x7f476806bd50 msgr2=0x7f476806c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:27.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.561+0000 7f476ec42700 1 -- 172.21.15.124:0/794528745 shutdown_connections 2023-10-16T12:59:27.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.561+0000 7f476ec42700 1 -- 172.21.15.124:0/794528745 wait complete. 2023-10-16T12:59:27.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.562+0000 7f476ec42700 1 Processor -- start 2023-10-16T12:59:27.571 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.563+0000 7f476ec42700 1 -- start start 2023-10-16T12:59:27.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.563+0000 7f476ec42700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f476806a820 0x7f47681501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:27.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.563+0000 7f476ec42700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47680cdc90 0x7f4768157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:27.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.563+0000 7f476ec42700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4768161780 0x7f476814f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:27.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.563+0000 7f476ec42700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47680afc00 con 0x7f476806a820 2023-10-16T12:59:27.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.563+0000 7f476ec42700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4768150ae0 con 0x7f4768161780 2023-10-16T12:59:27.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.563+0000 7f476ec42700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4768155ec0 con 0x7f47680cdc90 2023-10-16T12:59:27.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.564+0000 7f476c9de700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f476806a820 0x7f47681501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:27.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.564+0000 7f476c9de700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f476806a820 0x7f47681501e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54288/0 (socket says 172.21.15.124:54288) 2023-10-16T12:59:27.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.564+0000 7f476c9de700 1 -- 172.21.15.124:0/3919820085 learned_addr learned my addr 172.21.15.124:0/3919820085 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:27.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.564+0000 7f4767fff700 1 --2- 172.21.15.124:0/3919820085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47680cdc90 0x7f4768157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:27.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.564+0000 7f476d1df700 1 --2- 172.21.15.124:0/3919820085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4768161780 0x7f476814f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:27.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.564+0000 7f476c9de700 1 -- 172.21.15.124:0/3919820085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47680cdc90 msgr2=0x7f4768157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:27.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.564+0000 7f476c9de700 1 --2- 172.21.15.124:0/3919820085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47680cdc90 0x7f4768157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:27.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.564+0000 7f476c9de700 1 -- 172.21.15.124:0/3919820085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4768161780 msgr2=0x7f476814f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:27.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.564+0000 7f476c9de700 1 --2- 172.21.15.124:0/3919820085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4768161780 0x7f476814f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:27.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.564+0000 7f476c9de700 1 -- 172.21.15.124:0/3919820085 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c0094a0 con 0x7f476806a820 2023-10-16T12:59:27.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.564+0000 7f476c9de700 1 --2- 172.21.15.124:0/3919820085 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f476806a820 0x7f47681501e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f475c014040 tx=0x7f475c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:27.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.564+0000 7f47657fa700 1 -- 172.21.15.124:0/3919820085 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c0036a0 con 0x7f476806a820 2023-10-16T12:59:27.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.564+0000 7f47657fa700 1 -- 172.21.15.124:0/3919820085 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c01e070 con 0x7f476806a820 2023-10-16T12:59:27.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.564+0000 7f476ec42700 1 -- 172.21.15.124:0/3919820085 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47681561a0 con 0x7f476806a820 2023-10-16T12:59:27.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.564+0000 7f47657fa700 1 -- 172.21.15.124:0/3919820085 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c003a60 con 0x7f476806a820 2023-10-16T12:59:27.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.564+0000 7f476ec42700 1 -- 172.21.15.124:0/3919820085 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4768156760 con 0x7f476806a820 2023-10-16T12:59:27.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.565+0000 7f476ec42700 1 -- 172.21.15.124:0/3919820085 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f476804ebb0 con 0x7f476806a820 2023-10-16T12:59:27.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.566+0000 7f47657fa700 1 -- 172.21.15.124:0/3919820085 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f475c003bc0 con 0x7f476806a820 2023-10-16T12:59:27.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.566+0000 7f47657fa700 1 --2- 172.21.15.124:0/3919820085 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f474c06af00 0x7f474c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:27.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.566+0000 7f47657fa700 1 -- 172.21.15.124:0/3919820085 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f475c08a790 con 0x7f476806a820 2023-10-16T12:59:27.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.566+0000 7f4767fff700 1 --2- 172.21.15.124:0/3919820085 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f474c06af00 0x7f474c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:27.580 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.566+0000 7f4767fff700 1 --2- 172.21.15.124:0/3919820085 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f474c06af00 0x7f474c06d3c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f476806b2a0 tx=0x7f4754008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:27.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.570+0000 7f47657fa700 1 -- 172.21.15.124:0/3919820085 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f475c0555e0 con 0x7f476806a820 2023-10-16T12:59:27.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.813+0000 7f476ec42700 1 -- 172.21.15.124:0/3919820085 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f47680cc940 con 0x7f476806a820 2023-10-16T12:59:27.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.813+0000 7f47657fa700 1 -- 172.21.15.124:0/3919820085 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f475c020070 con 0x7f476806a820 2023-10-16T12:59:27.815 INFO:teuthology.orchestra.run.smithi124.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-16T12:59:27.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.815+0000 7f476ec42700 1 -- 172.21.15.124:0/3919820085 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f474c06af00 msgr2=0x7f474c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:27.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.815+0000 7f476ec42700 1 --2- 172.21.15.124:0/3919820085 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f474c06af00 0x7f474c06d3c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f476806b2a0 tx=0x7f4754008040 comp rx=0 tx=0).stop 2023-10-16T12:59:27.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.815+0000 7f476ec42700 1 -- 172.21.15.124:0/3919820085 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f476806a820 msgr2=0x7f47681501e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:27.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.815+0000 7f476ec42700 1 --2- 172.21.15.124:0/3919820085 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f476806a820 0x7f47681501e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f475c014040 tx=0x7f475c004750 comp rx=0 tx=0).stop 2023-10-16T12:59:27.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.815+0000 7f476ec42700 1 -- 172.21.15.124:0/3919820085 shutdown_connections 2023-10-16T12:59:27.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.815+0000 7f476ec42700 1 --2- 172.21.15.124:0/3919820085 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f474c06af00 0x7f474c06d3c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:27.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.815+0000 7f476ec42700 1 --2- 172.21.15.124:0/3919820085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4768161780 0x7f476814f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:27.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.815+0000 7f476ec42700 1 --2- 172.21.15.124:0/3919820085 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f476806a820 0x7f47681501e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:27.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.815+0000 7f476ec42700 1 --2- 172.21.15.124:0/3919820085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47680cdc90 0x7f4768157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:27.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.815+0000 7f476ec42700 1 -- 172.21.15.124:0/3919820085 >> 172.21.15.124:0/3919820085 conn(0x7f476806bd50 msgr2=0x7f4768153690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:27.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.815+0000 7f476ec42700 1 -- 172.21.15.124:0/3919820085 shutdown_connections 2023-10-16T12:59:27.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:27.815+0000 7f476ec42700 1 -- 172.21.15.124:0/3919820085 wait complete. 2023-10-16T12:59:27.829 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T12:59:27.829 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T12:59:27.829 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-10-16T12:59:27.830 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-16T12:59:27.830 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-16T12:59:27.830 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T12:59:27.831 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T12:59:27.831 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T12:59:27.831 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-16T12:59:27.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:27.832 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-10-16T12:59:27.849 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T12:59:27.849 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T12:59:27.849 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T12:59:27.850 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:27.850 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-10-16T12:59:27.850 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:27.850 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T12:59:27.850 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-10-16T12:59:27.851 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T12:59:27.851 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-10-16T12:59:27.851 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T12:59:27.851 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-10-16T12:59:27.851 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T12:59:27.852 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-10-16T12:59:27.852 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T12:59:27.852 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42395sec preferred_lft 42395sec 2023-10-16T12:59:27.852 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::c4a6:1b97:a23d:849a/64 scope link noprefixroute 2023-10-16T12:59:27.852 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:27.853 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T12:59:27.853 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 3a:35:ea:2d:a9:9e brd ff:ff:ff:ff:ff:ff 2023-10-16T12:59:27.853 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T12:59:27.853 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:27.853 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::6cc2:7fff:fe07:d2a1/64 scope link 2023-10-16T12:59:27.854 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:27.854 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T12:59:27.854 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 3a:35:ea:2d:a9:9e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T12:59:27.854 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::3835:eaff:fe2d:a99e/64 scope link 2023-10-16T12:59:27.854 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:27.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:27.855 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T12:59:27.914 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-10-16T12:59:27.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:27.916 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-10-16T12:59:27.974 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-10-16T12:59:27.974 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T12:59:27.974 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T12:59:27.975 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T12:59:27.975 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T12:59:27.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:27.976 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-16T12:59:27.976 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-16T12:59:27.976 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T12:59:27.977 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T12:59:27.977 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T12:59:27.977 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-16T12:59:28.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:28.079 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-10-16T12:59:28.095 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-16T12:59:28.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:28.096 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list-id 2023-10-16T12:59:28.152 INFO:teuthology.orchestra.run.smithi192.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-16T12:59:28.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:28.153 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-16T12:59:28.153 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-16T12:59:28.153 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T12:59:28.154 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-16T12:59:28.154 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-16T12:59:28.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:28.245 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-16T12:59:28.283 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T12:59:28.283 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T12:59:28.284 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T12:59:28.284 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:28.284 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-10-16T12:59:28.284 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:28.284 INFO:teuthology.orchestra.run.smithi192.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T12:59:28.285 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether fa:04:57:bb:2a:40 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-16T12:59:28.285 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-16T12:59:28.285 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:28.285 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::f804:57ff:febb:2a40/64 scope link 2023-10-16T12:59:28.285 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:28.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:28.296 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-16T12:59:28.377 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T12:59:28.378 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T12:59:28.378 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T12:59:28.378 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:28.378 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-10-16T12:59:28.379 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:28.379 INFO:teuthology.orchestra.run.smithi192.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T12:59:28.379 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether fa:04:57:bb:2a:40 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-16T12:59:28.379 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-16T12:59:28.380 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:28.380 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::f804:57ff:febb:2a40/64 scope link 2023-10-16T12:59:28.380 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-16T12:59:28.389 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-16T12:59:28.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:28.390 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-16T12:59:28.391 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-16T12:59:28.391 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-16T12:59:28.391 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-16T12:59:28.392 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-16T12:59:28.392 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-16T12:59:28.392 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-16T12:59:28.393 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-16T12:59:28.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:28.619 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-16T12:59:28.620 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-16T12:59:28.620 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.1 up 2023-10-16T12:59:28.620 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set dev brx.1 master ceph-brx 2023-10-16T12:59:28.621 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-16T12:59:28.737 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T12:59:28.738 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-16T12:59:28.759 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-16T12:59:28.759 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T12:59:28.760 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-16T12:59:28.815 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-16T12:59:28.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:28.816 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T12:59:28.900 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T12:59:28.901 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T12:59:28.925 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T12:59:28.925 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T12:59:28.925 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.124:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-16T12:59:28.925 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 3@4cfd077b-2400-4ae1-a7e8-14265fee7113.cephfs=/ 2023-10-16T12:59:28.926 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.124:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-16T12:59:28.926 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T12:59:28.926 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T12:59:28.926 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T12:59:28.999 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T12:59:28.999 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T12:59:29.000 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.124:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-16T12:59:29.000 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 3@4cfd077b-2400-4ae1-a7e8-14265fee7113.cephfs=/ 2023-10-16T12:59:29.000 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.124:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-16T12:59:29.000 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T12:59:29.001 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T12:59:29.001 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T12:59:29.001 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.124:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-16T12:59:29.001 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.124:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-16T12:59:29.001 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=4cfd077b-2400-4ae1-a7e8-14265fee7113" will pass to kernel 2023-10-16T12:59:29.003 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T12:59:29.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:29.003 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-16T12:59:29.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:29.030 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T12:59:29.102 INFO:teuthology.orchestra.run.smithi192.stdout:client4863 2023-10-16T12:59:29.103 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:59:29.103 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:59:29.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:29.160 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T12:59:29.232 INFO:teuthology.orchestra.run.smithi192.stdout:client4863 2023-10-16T12:59:29.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:29.232 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T12:59:29.304 INFO:teuthology.orchestra.run.smithi192.stdout:client4863 2023-10-16T12:59:29.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:29.305 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/4cfd077b-2400-4ae1-a7e8-14265fee7113.client4863/status') 2023-10-16T12:59:29.384 INFO:teuthology.orchestra.run.smithi192.stdout:instance: client.4863 (3)172.21.15.192:0/991367066 2023-10-16T12:59:29.384 INFO:teuthology.orchestra.run.smithi192.stdout:blocklisted: false 2023-10-16T12:59:29.385 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2023-10-16T12:59:29.385 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2023-10-16T12:59:29.386 INFO:teuthology.orchestra.run.smithi192.stderr:70 bytes copied, 2.3604e-05 s, 3.0 MB/s 2023-10-16T12:59:29.386 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-16T12:59:29.402 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:59:29.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.537+0000 7fc64003b700 1 Processor -- start 2023-10-16T12:59:29.540 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.537+0000 7fc64003b700 1 -- start start 2023-10-16T12:59:29.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.538+0000 7fc64003b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc63815b250 0x7fc63806e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:29.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.538+0000 7fc64003b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6380cd0f0 0x7fc6380cd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:29.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.538+0000 7fc64003b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc63806a820 0x7fc63806ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:29.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.538+0000 7fc64003b700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6380cb020 con 0x7fc63806a820 2023-10-16T12:59:29.543 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.538+0000 7fc64003b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6380cda90 con 0x7fc63815b250 2023-10-16T12:59:29.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.538+0000 7fc64003b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380ca710 con 0x7fc6380cd0f0 2023-10-16T12:59:29.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.538+0000 7fc63e5d8700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc63806a820 0x7fc63806ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:29.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.538+0000 7fc63e5d8700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc63806a820 0x7fc63806ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54298/0 (socket says 172.21.15.124:54298) 2023-10-16T12:59:29.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.538+0000 7fc63e5d8700 1 -- 172.21.15.124:0/2618568812 learned_addr learned my addr 172.21.15.124:0/2618568812 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:29.544 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.538+0000 7fc63d5d6700 1 --2- 172.21.15.124:0/2618568812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6380cd0f0 0x7fc6380cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:29.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.538+0000 7fc63ddd7700 1 --2- 172.21.15.124:0/2618568812 >> v2:172.21.15.192:3300/0 conn(0x7fc63815b250 0x7fc63806e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:29.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.538+0000 7fc63e5d8700 1 -- 172.21.15.124:0/2618568812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6380cd0f0 msgr2=0x7fc6380cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:29.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.538+0000 7fc63e5d8700 1 --2- 172.21.15.124:0/2618568812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6380cd0f0 0x7fc6380cd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:29.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.539+0000 7fc63e5d8700 1 -- 172.21.15.124:0/2618568812 >> v2:172.21.15.192:3300/0 conn(0x7fc63815b250 msgr2=0x7fc63806e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:29.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.539+0000 7fc63e5d8700 1 --2- 172.21.15.124:0/2618568812 >> v2:172.21.15.192:3300/0 conn(0x7fc63815b250 0x7fc63806e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:29.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.539+0000 7fc63e5d8700 1 -- 172.21.15.124:0/2618568812 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6380724c0 con 0x7fc63806a820 2023-10-16T12:59:29.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.539+0000 7fc63e5d8700 1 --2- 172.21.15.124:0/2618568812 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc63806a820 0x7fc63806ac60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc6380b2a40 tx=0x7fc63000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0122b1c31528be3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:29.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.539+0000 7fc63cdd5700 1 -- 172.21.15.124:0/2618568812 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63000e070 con 0x7fc63806a820 2023-10-16T12:59:29.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.539+0000 7fc63cdd5700 1 -- 172.21.15.124:0/2618568812 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63000b8d0 con 0x7fc63806a820 2023-10-16T12:59:29.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.539+0000 7fc63cdd5700 1 -- 172.21.15.124:0/2618568812 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63000bc80 con 0x7fc63806a820 2023-10-16T12:59:29.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.539+0000 7fc64003b700 1 -- 172.21.15.124:0/2618568812 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc63806a820 msgr2=0x7fc63806ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:29.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.539+0000 7fc64003b700 1 --2- 172.21.15.124:0/2618568812 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc63806a820 0x7fc63806ac60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc6380b2a40 tx=0x7fc63000b330 comp rx=0 tx=0).stop 2023-10-16T12:59:29.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.539+0000 7fc64003b700 1 -- 172.21.15.124:0/2618568812 shutdown_connections 2023-10-16T12:59:29.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.539+0000 7fc64003b700 1 --2- 172.21.15.124:0/2618568812 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc63806a820 0x7fc63806ac60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:29.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.539+0000 7fc64003b700 1 --2- 172.21.15.124:0/2618568812 >> v2:172.21.15.192:3300/0 conn(0x7fc63815b250 0x7fc63806e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:29.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.539+0000 7fc64003b700 1 --2- 172.21.15.124:0/2618568812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6380cd0f0 0x7fc6380cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:29.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.539+0000 7fc64003b700 1 -- 172.21.15.124:0/2618568812 >> 172.21.15.124:0/2618568812 conn(0x7fc63806bd50 msgr2=0x7fc63806c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:29.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.540+0000 7fc64003b700 1 -- 172.21.15.124:0/2618568812 shutdown_connections 2023-10-16T12:59:29.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.540+0000 7fc64003b700 1 -- 172.21.15.124:0/2618568812 wait complete. 2023-10-16T12:59:29.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.541+0000 7fc64003b700 1 Processor -- start 2023-10-16T12:59:29.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.541+0000 7fc64003b700 1 -- start start 2023-10-16T12:59:29.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.541+0000 7fc64003b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc63806a820 0x7fc6380cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:29.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.541+0000 7fc64003b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc6380cd0f0 0x7fc6381526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:29.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.541+0000 7fc64003b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc63815b250 0x7fc6380c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:29.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.541+0000 7fc64003b700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380cec10 con 0x7fc6380cd0f0 2023-10-16T12:59:29.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.541+0000 7fc64003b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380c6800 con 0x7fc63815b250 2023-10-16T12:59:29.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.541+0000 7fc64003b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380cf5e0 con 0x7fc63806a820 2023-10-16T12:59:29.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.542+0000 7fc63d5d6700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc6380cd0f0 0x7fc6381526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:29.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.542+0000 7fc63ddd7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc63806a820 0x7fc6380cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:29.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.542+0000 7fc63ddd7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc63806a820 0x7fc6380cf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:40378/0 (socket says 172.21.15.124:40378) 2023-10-16T12:59:29.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.542+0000 7fc63e5d8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc63815b250 0x7fc6380c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:29.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.542+0000 7fc63ddd7700 1 -- 172.21.15.124:0/3322255046 learned_addr learned my addr 172.21.15.124:0/3322255046 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:29.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.542+0000 7fc63d5d6700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc6380cd0f0 0x7fc6381526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54302/0 (socket says 172.21.15.124:54302) 2023-10-16T12:59:29.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.542+0000 7fc63d5d6700 1 -- 172.21.15.124:0/3322255046 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc63806a820 msgr2=0x7fc6380cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:29.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.542+0000 7fc63d5d6700 1 --2- 172.21.15.124:0/3322255046 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc63806a820 0x7fc6380cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:29.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.542+0000 7fc63d5d6700 1 -- 172.21.15.124:0/3322255046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc63815b250 msgr2=0x7fc6380c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:29.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.542+0000 7fc63d5d6700 1 --2- 172.21.15.124:0/3322255046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc63815b250 0x7fc6380c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:29.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.542+0000 7fc63d5d6700 1 -- 172.21.15.124:0/3322255046 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc630009b30 con 0x7fc6380cd0f0 2023-10-16T12:59:29.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.542+0000 7fc63e5d8700 1 --2- 172.21.15.124:0/3322255046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc63815b250 0x7fc6380c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:59:29.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.542+0000 7fc63d5d6700 1 --2- 172.21.15.124:0/3322255046 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc6380cd0f0 0x7fc6381526a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc63400e900 tx=0x7fc63400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:29.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.542+0000 7fc62a7fc700 1 -- 172.21.15.124:0/3322255046 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc634013680 con 0x7fc6380cd0f0 2023-10-16T12:59:29.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.542+0000 7fc62a7fc700 1 -- 172.21.15.124:0/3322255046 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6340137e0 con 0x7fc6380cd0f0 2023-10-16T12:59:29.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.542+0000 7fc64003b700 1 -- 172.21.15.124:0/3322255046 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6380ce000 con 0x7fc6380cd0f0 2023-10-16T12:59:29.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.542+0000 7fc62a7fc700 1 -- 172.21.15.124:0/3322255046 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc634013b50 con 0x7fc6380cd0f0 2023-10-16T12:59:29.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.542+0000 7fc64003b700 1 -- 172.21.15.124:0/3322255046 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6380ce5c0 con 0x7fc6380cd0f0 2023-10-16T12:59:29.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.543+0000 7fc64003b700 1 -- 172.21.15.124:0/3322255046 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc63806e880 con 0x7fc6380cd0f0 2023-10-16T12:59:29.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.544+0000 7fc62a7fc700 1 -- 172.21.15.124:0/3322255046 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc634013cb0 con 0x7fc6380cd0f0 2023-10-16T12:59:29.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.544+0000 7fc62a7fc700 1 --2- 172.21.15.124:0/3322255046 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fc61c06af00 0x7fc61c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:29.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.544+0000 7fc62a7fc700 1 -- 172.21.15.124:0/3322255046 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc634089a80 con 0x7fc6380cd0f0 2023-10-16T12:59:29.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.544+0000 7fc63ddd7700 1 --2- 172.21.15.124:0/3322255046 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fc61c06af00 0x7fc61c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:29.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.545+0000 7fc63ddd7700 1 --2- 172.21.15.124:0/3322255046 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fc61c06af00 0x7fc61c06d3c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc62c009b60 tx=0x7fc62c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:29.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.549+0000 7fc62a7fc700 1 -- 172.21.15.124:0/3322255046 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc6340548d0 con 0x7fc6380cd0f0 2023-10-16T12:59:29.742 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.739+0000 7fc64003b700 1 -- 172.21.15.124:0/3322255046 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6380ceef0 con 0x7fc6380cd0f0 2023-10-16T12:59:29.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.740+0000 7fc62a7fc700 1 -- 172.21.15.124:0/3322255046 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fc634017020 con 0x7fc6380cd0f0 2023-10-16T12:59:29.743 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:29.743 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":24,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:58:56.089767+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:59:29.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.742+0000 7fc64003b700 1 -- 172.21.15.124:0/3322255046 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fc61c06af00 msgr2=0x7fc61c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:29.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.742+0000 7fc64003b700 1 --2- 172.21.15.124:0/3322255046 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fc61c06af00 0x7fc61c06d3c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc62c009b60 tx=0x7fc62c009210 comp rx=0 tx=0).stop 2023-10-16T12:59:29.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.742+0000 7fc64003b700 1 -- 172.21.15.124:0/3322255046 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc6380cd0f0 msgr2=0x7fc6381526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:29.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.742+0000 7fc64003b700 1 --2- 172.21.15.124:0/3322255046 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc6380cd0f0 0x7fc6381526a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc63400e900 tx=0x7fc63400ec10 comp rx=0 tx=0).stop 2023-10-16T12:59:29.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.742+0000 7fc64003b700 1 -- 172.21.15.124:0/3322255046 shutdown_connections 2023-10-16T12:59:29.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.742+0000 7fc64003b700 1 --2- 172.21.15.124:0/3322255046 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fc61c06af00 0x7fc61c06d3c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:29.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.742+0000 7fc64003b700 1 --2- 172.21.15.124:0/3322255046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc63815b250 0x7fc6380c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:29.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.742+0000 7fc64003b700 1 --2- 172.21.15.124:0/3322255046 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc63806a820 0x7fc6380cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:29.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.742+0000 7fc64003b700 1 --2- 172.21.15.124:0/3322255046 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc6380cd0f0 0x7fc6381526a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:29.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.742+0000 7fc64003b700 1 -- 172.21.15.124:0/3322255046 >> 172.21.15.124:0/3322255046 conn(0x7fc63806bd50 msgr2=0x7fc63806ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:29.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.742+0000 7fc64003b700 1 -- 172.21.15.124:0/3322255046 shutdown_connections 2023-10-16T12:59:29.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.742+0000 7fc64003b700 1 -- 172.21.15.124:0/3322255046 wait complete. 2023-10-16T12:59:29.757 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T12:58:38.667813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T12:58:49.562073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T12:58:50.011419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T12:58:53.692890+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T12:59:29.758 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T12:59:29.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.879+0000 7f764e0bb700 1 Processor -- start 2023-10-16T12:59:29.882 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.879+0000 7f764e0bb700 1 -- start start 2023-10-16T12:59:29.884 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.880+0000 7f764e0bb700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f764815dec0 0x7f764806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:29.884 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.880+0000 7f764e0bb700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f764815e350 0x7f764806daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:29.884 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.880+0000 7f764e0bb700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76480cba90 con 0x7f764815a250 2023-10-16T12:59:29.884 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.880+0000 7f764e0bb700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76480cb510 con 0x7f764815dec0 2023-10-16T12:59:29.885 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.880+0000 7f764e0bb700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7648071ec0 con 0x7f764815e350 2023-10-16T12:59:29.885 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.880+0000 7f7646ffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f764815dec0 0x7f764806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:29.885 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.880+0000 7f7646ffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f764815dec0 0x7f764806d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54308/0 (socket says 172.21.15.124:54308) 2023-10-16T12:59:29.885 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.880+0000 7f7646ffd700 1 -- 172.21.15.124:0/2814760204 learned_addr learned my addr 172.21.15.124:0/2814760204 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:29.885 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.880+0000 7f7647fff700 1 --2- 172.21.15.124:0/2814760204 >> v2:172.21.15.192:3300/0 conn(0x7f764815e350 0x7f764806daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:29.886 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.880+0000 7f7646ffd700 1 -- 172.21.15.124:0/2814760204 >> v2:172.21.15.192:3300/0 conn(0x7f764815e350 msgr2=0x7f764806daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:29.886 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.880+0000 7f7646ffd700 1 --2- 172.21.15.124:0/2814760204 >> v2:172.21.15.192:3300/0 conn(0x7f764815e350 0x7f764806daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:29.886 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.880+0000 7f7646ffd700 1 -- 172.21.15.124:0/2814760204 >> v1:172.21.15.192:6789/0 conn(0x7f764815a250 legacy=0x7f76480717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:29.886 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.880+0000 7f7646ffd700 1 -- 172.21.15.124:0/2814760204 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764815ee40 con 0x7f764815dec0 2023-10-16T12:59:29.886 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.880+0000 7f7646ffd700 1 --2- 172.21.15.124:0/2814760204 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f764815dec0 0x7f764806d5b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7648067ac0 tx=0x7f763c00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4566804385d089 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:29.887 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.880+0000 7f76467fc700 1 -- 172.21.15.124:0/2814760204 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c00dcf0 con 0x7f764815dec0 2023-10-16T12:59:29.887 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.880+0000 7f76467fc700 1 -- 172.21.15.124:0/2814760204 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c00de50 con 0x7f764815dec0 2023-10-16T12:59:29.887 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.880+0000 7f76467fc700 1 -- 172.21.15.124:0/2814760204 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c004250 con 0x7f764815dec0 2023-10-16T12:59:29.887 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.881+0000 7f764e0bb700 1 -- 172.21.15.124:0/2814760204 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f764815dec0 msgr2=0x7f764806d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:29.887 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.881+0000 7f764e0bb700 1 --2- 172.21.15.124:0/2814760204 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f764815dec0 0x7f764806d5b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7648067ac0 tx=0x7f763c00be70 comp rx=0 tx=0).stop 2023-10-16T12:59:29.888 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.881+0000 7f764e0bb700 1 -- 172.21.15.124:0/2814760204 shutdown_connections 2023-10-16T12:59:29.888 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.881+0000 7f764e0bb700 1 --2- 172.21.15.124:0/2814760204 >> v2:172.21.15.192:3300/0 conn(0x7f764815e350 0x7f764806daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:29.888 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.881+0000 7f764e0bb700 1 --2- 172.21.15.124:0/2814760204 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f764815dec0 0x7f764806d5b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:29.888 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.881+0000 7f764e0bb700 1 -- 172.21.15.124:0/2814760204 >> 172.21.15.124:0/2814760204 conn(0x7f76480ccbe0 msgr2=0x7f76480ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:29.888 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.881+0000 7f764e0bb700 1 -- 172.21.15.124:0/2814760204 shutdown_connections 2023-10-16T12:59:29.888 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.881+0000 7f764e0bb700 1 -- 172.21.15.124:0/2814760204 wait complete. 2023-10-16T12:59:29.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.882+0000 7f764e0bb700 1 Processor -- start 2023-10-16T12:59:29.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.882+0000 7f764e0bb700 1 -- start start 2023-10-16T12:59:29.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.883+0000 7f764e0bb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f764815a250 0x7f7648154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:29.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.883+0000 7f764e0bb700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f764815dec0 0x7f76480c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:29.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.883+0000 7f764e0bb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f764815e350 0x7f76480b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:29.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.883+0000 7f764e0bb700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76480b3550 con 0x7f764815dec0 2023-10-16T12:59:29.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.883+0000 7f764e0bb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76480c9e90 con 0x7f764815a250 2023-10-16T12:59:29.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.883+0000 7f764e0bb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76480b2ed0 con 0x7f764815e350 2023-10-16T12:59:29.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.883+0000 7f7646ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f764815dec0 0x7f76480c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:29.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.883+0000 7f7646ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f764815dec0 0x7f76480c9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54314/0 (socket says 172.21.15.124:54314) 2023-10-16T12:59:29.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.883+0000 7f7646ffd700 1 -- 172.21.15.124:0/1193872489 learned_addr learned my addr 172.21.15.124:0/1193872489 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:29.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.883+0000 7f76477fe700 1 --2- 172.21.15.124:0/1193872489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f764815a250 0x7f7648154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:29.893 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.883+0000 7f7647fff700 1 --2- 172.21.15.124:0/1193872489 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f764815e350 0x7f76480b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:29.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.883+0000 7f7646ffd700 1 -- 172.21.15.124:0/1193872489 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f764815e350 msgr2=0x7f76480b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:29.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.883+0000 7f7646ffd700 1 --2- 172.21.15.124:0/1193872489 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f764815e350 0x7f76480b3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:29.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.883+0000 7f7646ffd700 1 -- 172.21.15.124:0/1193872489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f764815a250 msgr2=0x7f7648154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:29.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.883+0000 7f7646ffd700 1 --2- 172.21.15.124:0/1193872489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f764815a250 0x7f7648154740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:29.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.883+0000 7f7646ffd700 1 -- 172.21.15.124:0/1193872489 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c00b7f0 con 0x7f764815dec0 2023-10-16T12:59:29.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.883+0000 7f76477fe700 1 --2- 172.21.15.124:0/1193872489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f764815a250 0x7f7648154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:29.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.884+0000 7f7646ffd700 1 --2- 172.21.15.124:0/1193872489 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f764815dec0 0x7f76480c9240 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f763c000c00 tx=0x7f763c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:29.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.884+0000 7f762ffff700 1 -- 172.21.15.124:0/1193872489 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c020070 con 0x7f764815dec0 2023-10-16T12:59:29.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.884+0000 7f762ffff700 1 -- 172.21.15.124:0/1193872489 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c004030 con 0x7f764815dec0 2023-10-16T12:59:29.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.884+0000 7f764e0bb700 1 -- 172.21.15.124:0/1193872489 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76480c9bb0 con 0x7f764815dec0 2023-10-16T12:59:29.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.884+0000 7f762ffff700 1 -- 172.21.15.124:0/1193872489 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c010470 con 0x7f764815dec0 2023-10-16T12:59:29.896 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.884+0000 7f764e0bb700 1 -- 172.21.15.124:0/1193872489 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76480c9780 con 0x7f764815dec0 2023-10-16T12:59:29.896 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.885+0000 7f764e0bb700 1 -- 172.21.15.124:0/1193872489 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76480b3690 con 0x7f764815dec0 2023-10-16T12:59:29.896 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.885+0000 7f762ffff700 1 -- 172.21.15.124:0/1193872489 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f763c02e480 con 0x7f764815dec0 2023-10-16T12:59:29.896 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.885+0000 7f762ffff700 1 --2- 172.21.15.124:0/1193872489 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f763406af50 0x7f763406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:29.896 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.885+0000 7f762ffff700 1 -- 172.21.15.124:0/1193872489 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f763c08cfb0 con 0x7f764815dec0 2023-10-16T12:59:29.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.886+0000 7f76477fe700 1 --2- 172.21.15.124:0/1193872489 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f763406af50 0x7f763406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:29.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.886+0000 7f76477fe700 1 --2- 172.21.15.124:0/1193872489 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f763406af50 0x7f763406d410 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7638003fc0 tx=0x7f7638009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:29.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:29.890+0000 7f762ffff700 1 -- 172.21.15.124:0/1193872489 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f76480b3690 con 0x7f764815dec0 2023-10-16T12:59:30.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.076+0000 7f764e0bb700 1 -- 172.21.15.124:0/1193872489 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f76480b3690 con 0x7f764815dec0 2023-10-16T12:59:30.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.077+0000 7f762ffff700 1 -- 172.21.15.124:0/1193872489 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f76480b3690 con 0x7f764815dec0 2023-10-16T12:59:30.080 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-16T12:59:30.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.079+0000 7f764e0bb700 1 -- 172.21.15.124:0/1193872489 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f763406af50 msgr2=0x7f763406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:30.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.079+0000 7f764e0bb700 1 --2- 172.21.15.124:0/1193872489 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f763406af50 0x7f763406d410 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7638003fc0 tx=0x7f7638009040 comp rx=0 tx=0).stop 2023-10-16T12:59:30.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.079+0000 7f764e0bb700 1 -- 172.21.15.124:0/1193872489 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f764815dec0 msgr2=0x7f76480c9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:30.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.079+0000 7f764e0bb700 1 --2- 172.21.15.124:0/1193872489 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f764815dec0 0x7f76480c9240 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f763c000c00 tx=0x7f763c004750 comp rx=0 tx=0).stop 2023-10-16T12:59:30.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.079+0000 7f764e0bb700 1 -- 172.21.15.124:0/1193872489 shutdown_connections 2023-10-16T12:59:30.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.079+0000 7f764e0bb700 1 --2- 172.21.15.124:0/1193872489 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f763406af50 0x7f763406d410 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.079+0000 7f764e0bb700 1 --2- 172.21.15.124:0/1193872489 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f764815e350 0x7f76480b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.079+0000 7f764e0bb700 1 --2- 172.21.15.124:0/1193872489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f764815a250 0x7f7648154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.079+0000 7f764e0bb700 1 --2- 172.21.15.124:0/1193872489 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f764815dec0 0x7f76480c9240 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.079+0000 7f764e0bb700 1 -- 172.21.15.124:0/1193872489 >> 172.21.15.124:0/1193872489 conn(0x7f76480ccbe0 msgr2=0x7f764806d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:30.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.079+0000 7f764e0bb700 1 -- 172.21.15.124:0/1193872489 shutdown_connections 2023-10-16T12:59:30.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.079+0000 7f764e0bb700 1 -- 172.21.15.124:0/1193872489 wait complete. 2023-10-16T12:59:30.094 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T12:59:30.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.214+0000 7f6619fc0700 1 Processor -- start 2023-10-16T12:59:30.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.214+0000 7f6619fc0700 1 -- start start 2023-10-16T12:59:30.219 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.214+0000 7f6619fc0700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f66140b33f0 0x7f661406f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:30.219 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.214+0000 7f6619fc0700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f66140cd770 0x7f66140b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:30.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.214+0000 7f6619fc0700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6614070620 con 0x7f661415b4e0 2023-10-16T12:59:30.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.214+0000 7f6619fc0700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6614070900 con 0x7f66140b33f0 2023-10-16T12:59:30.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.214+0000 7f6619fc0700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6614070be0 con 0x7f66140cd770 2023-10-16T12:59:30.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.215+0000 7f6612ffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f66140b33f0 0x7f661406f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:30.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.215+0000 7f66137fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f661415b4e0 0x7f66140b2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:42990/0 (socket says 172.21.15.124:42990) 2023-10-16T12:59:30.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.215+0000 7f66137fe700 1 -- 172.21.15.124:0/898216048 learned_addr learned my addr 172.21.15.124:0/898216048 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:30.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.215+0000 7f6612ffd700 1 -- 172.21.15.124:0/898216048 >> v2:172.21.15.192:3300/0 conn(0x7f66140cd770 msgr2=0x7f66140b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:30.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.215+0000 7f6612ffd700 1 --2- 172.21.15.124:0/898216048 >> v2:172.21.15.192:3300/0 conn(0x7f66140cd770 0x7f66140b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.215+0000 7f6612ffd700 1 -- 172.21.15.124:0/898216048 >> v1:172.21.15.124:6789/0 conn(0x7f661415b4e0 legacy=0x7f66140b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:30.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.215+0000 7f66127fc700 1 -- 172.21.15.124:0/898216048 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988686988 0 0) 0x7f6614070620 con 0x7f661415b4e0 2023-10-16T12:59:30.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.215+0000 7f6612ffd700 1 -- 172.21.15.124:0/898216048 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6614070ec0 con 0x7f66140b33f0 2023-10-16T12:59:30.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.215+0000 7f6612ffd700 1 --2- 172.21.15.124:0/898216048 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f66140b33f0 0x7f661406f280 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6604009840 tx=0x7f6604009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ac962e1cc052a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:30.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.215+0000 7f66127fc700 1 -- 172.21.15.124:0/898216048 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6604011830 con 0x7f66140b33f0 2023-10-16T12:59:30.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.215+0000 7f66127fc700 1 -- 172.21.15.124:0/898216048 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6604011990 con 0x7f66140b33f0 2023-10-16T12:59:30.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.215+0000 7f66127fc700 1 -- 172.21.15.124:0/898216048 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6604011d20 con 0x7f66140b33f0 2023-10-16T12:59:30.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.216+0000 7f6619fc0700 1 -- 172.21.15.124:0/898216048 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f66140b33f0 msgr2=0x7f661406f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:30.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.216+0000 7f6619fc0700 1 --2- 172.21.15.124:0/898216048 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f66140b33f0 0x7f661406f280 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6604009840 tx=0x7f6604009b50 comp rx=0 tx=0).stop 2023-10-16T12:59:30.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.216+0000 7f6619fc0700 1 -- 172.21.15.124:0/898216048 shutdown_connections 2023-10-16T12:59:30.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.216+0000 7f6619fc0700 1 --2- 172.21.15.124:0/898216048 >> v2:172.21.15.192:3300/0 conn(0x7f66140cd770 0x7f66140b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.216+0000 7f6619fc0700 1 --2- 172.21.15.124:0/898216048 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f66140b33f0 0x7f661406f280 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.223 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.216+0000 7f6619fc0700 1 -- 172.21.15.124:0/898216048 >> 172.21.15.124:0/898216048 conn(0x7f66140cdce0 msgr2=0x7f66140ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:30.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.216+0000 7f6619fc0700 1 -- 172.21.15.124:0/898216048 shutdown_connections 2023-10-16T12:59:30.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.216+0000 7f6619fc0700 1 -- 172.21.15.124:0/898216048 wait complete. 2023-10-16T12:59:30.224 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.217+0000 7f6619fc0700 1 Processor -- start 2023-10-16T12:59:30.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.217+0000 7f6619fc0700 1 -- start start 2023-10-16T12:59:30.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.218+0000 7f6619fc0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66140b33f0 0x7f6614158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:30.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.218+0000 7f6619fc0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66140cd770 0x7f66140c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:30.227 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.218+0000 7f6619fc0700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f661415b4e0 0x7f66140c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:30.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.218+0000 7f6619fc0700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66141e0680 con 0x7f661415b4e0 2023-10-16T12:59:30.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.218+0000 7f6619fc0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6614158740 con 0x7f66140b33f0 2023-10-16T12:59:30.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.218+0000 7f6619fc0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66140c71b0 con 0x7f66140cd770 2023-10-16T12:59:30.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.218+0000 7f6613fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f661415b4e0 0x7f66140c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:30.228 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.218+0000 7f6613fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f661415b4e0 0x7f66140c5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54332/0 (socket says 172.21.15.124:54332) 2023-10-16T12:59:30.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.218+0000 7f6613fff700 1 -- 172.21.15.124:0/1227851320 learned_addr learned my addr 172.21.15.124:0/1227851320 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:30.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.218+0000 7f66137fe700 1 --2- 172.21.15.124:0/1227851320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66140b33f0 0x7f6614158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:30.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.218+0000 7f6612ffd700 1 --2- 172.21.15.124:0/1227851320 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66140cd770 0x7f66140c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:30.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.218+0000 7f6613fff700 1 -- 172.21.15.124:0/1227851320 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66140cd770 msgr2=0x7f66140c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:30.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.218+0000 7f6613fff700 1 --2- 172.21.15.124:0/1227851320 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66140cd770 0x7f66140c6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.229 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.218+0000 7f6613fff700 1 -- 172.21.15.124:0/1227851320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66140b33f0 msgr2=0x7f6614158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:30.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.218+0000 7f6613fff700 1 --2- 172.21.15.124:0/1227851320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66140b33f0 0x7f6614158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.218+0000 7f6613fff700 1 -- 172.21.15.124:0/1227851320 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66040094a0 con 0x7f661415b4e0 2023-10-16T12:59:30.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.218+0000 7f6612ffd700 1 --2- 172.21.15.124:0/1227851320 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66140cd770 0x7f66140c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:30.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.218+0000 7f6613fff700 1 --2- 172.21.15.124:0/1227851320 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f661415b4e0 0x7f66140c5de0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f660c00ba10 tx=0x7f660c00bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:30.230 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.219+0000 7f660bfff700 1 -- 172.21.15.124:0/1227851320 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c00c9b0 con 0x7f661415b4e0 2023-10-16T12:59:30.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.219+0000 7f660bfff700 1 -- 172.21.15.124:0/1227851320 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660c00cb50 con 0x7f661415b4e0 2023-10-16T12:59:30.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.219+0000 7f6619fc0700 1 -- 172.21.15.124:0/1227851320 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66141e0890 con 0x7f661415b4e0 2023-10-16T12:59:30.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.219+0000 7f660bfff700 1 -- 172.21.15.124:0/1227851320 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c014440 con 0x7f661415b4e0 2023-10-16T12:59:30.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.219+0000 7f6619fc0700 1 -- 172.21.15.124:0/1227851320 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66141e0e50 con 0x7f661415b4e0 2023-10-16T12:59:30.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.220+0000 7f6619fc0700 1 -- 172.21.15.124:0/1227851320 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f661404ebb0 con 0x7f661415b4e0 2023-10-16T12:59:30.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.220+0000 7f660bfff700 1 -- 172.21.15.124:0/1227851320 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f660c0145a0 con 0x7f661415b4e0 2023-10-16T12:59:30.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.221+0000 7f660bfff700 1 --2- 172.21.15.124:0/1227851320 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f65f406af00 0x7f65f406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:30.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.221+0000 7f66137fe700 1 --2- 172.21.15.124:0/1227851320 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f65f406af00 0x7f65f406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:30.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.221+0000 7f660bfff700 1 -- 172.21.15.124:0/1227851320 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f660c006e40 con 0x7f661415b4e0 2023-10-16T12:59:30.232 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.221+0000 7f66137fe700 1 --2- 172.21.15.124:0/1227851320 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f65f406af00 0x7f65f406d3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f65fc000f60 tx=0x7f65fc007c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:30.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.225+0000 7f660bfff700 1 -- 172.21.15.124:0/1227851320 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f660c0542c0 con 0x7f661415b4e0 2023-10-16T12:59:30.416 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.413+0000 7f6619fc0700 1 -- 172.21.15.124:0/1227851320 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f66140d0bf0 con 0x7f661415b4e0 2023-10-16T12:59:30.416 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.414+0000 7f660bfff700 1 -- 172.21.15.124:0/1227851320 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f660c0578e0 con 0x7f661415b4e0 2023-10-16T12:59:30.417 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:30.418 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.416+0000 7f6619fc0700 1 -- 172.21.15.124:0/1227851320 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f65f406af00 msgr2=0x7f65f406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:30.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.416+0000 7f6619fc0700 1 --2- 172.21.15.124:0/1227851320 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f65f406af00 0x7f65f406d3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f65fc000f60 tx=0x7f65fc007c90 comp rx=0 tx=0).stop 2023-10-16T12:59:30.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.416+0000 7f6619fc0700 1 -- 172.21.15.124:0/1227851320 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f661415b4e0 msgr2=0x7f66140c5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:30.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.416+0000 7f6619fc0700 1 --2- 172.21.15.124:0/1227851320 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f661415b4e0 0x7f66140c5de0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f660c00ba10 tx=0x7f660c00bdd0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.416+0000 7f6619fc0700 1 -- 172.21.15.124:0/1227851320 shutdown_connections 2023-10-16T12:59:30.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.416+0000 7f6619fc0700 1 --2- 172.21.15.124:0/1227851320 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f65f406af00 0x7f65f406d3c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.416+0000 7f6619fc0700 1 --2- 172.21.15.124:0/1227851320 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f661415b4e0 0x7f66140c5de0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.416+0000 7f6619fc0700 1 --2- 172.21.15.124:0/1227851320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66140b33f0 0x7f6614158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.416+0000 7f6619fc0700 1 --2- 172.21.15.124:0/1227851320 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66140cd770 0x7f66140c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.416+0000 7f6619fc0700 1 -- 172.21.15.124:0/1227851320 >> 172.21.15.124:0/1227851320 conn(0x7f66140cdce0 msgr2=0x7f66140ca880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:30.421 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.416+0000 7f6619fc0700 1 -- 172.21.15.124:0/1227851320 shutdown_connections 2023-10-16T12:59:30.421 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.416+0000 7f6619fc0700 1 -- 172.21.15.124:0/1227851320 wait complete. 2023-10-16T12:59:30.430 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T12:59:30.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.552+0000 7f9cbffdd700 1 Processor -- start 2023-10-16T12:59:30.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.552+0000 7f9cbffdd700 1 -- start start 2023-10-16T12:59:30.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.553+0000 7f9cbffdd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9cb815b4e0 0x7f9cb806f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:30.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.553+0000 7f9cbffdd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9cb80cd770 0x7f9cb80b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:30.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.553+0000 7f9cbffdd700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb80b3670 con 0x7f9cb80b3220 2023-10-16T12:59:30.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.553+0000 7f9cbffdd700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb8070620 con 0x7f9cb80cd770 2023-10-16T12:59:30.559 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.553+0000 7f9cbffdd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb8070900 con 0x7f9cb815b4e0 2023-10-16T12:59:30.559 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.553+0000 7f9cbd578700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9cb80cd770 0x7f9cb80b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:30.559 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.553+0000 7f9cbe57a700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f9cb80b3220 0x7f9cb80cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43008/0 (socket says 172.21.15.124:43008) 2023-10-16T12:59:30.559 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.553+0000 7f9cbe57a700 1 -- 172.21.15.124:0/931172060 learned_addr learned my addr 172.21.15.124:0/931172060 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:30.559 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.553+0000 7f9cbdd79700 1 --2- 172.21.15.124:0/931172060 >> v2:172.21.15.192:3300/0 conn(0x7f9cb815b4e0 0x7f9cb806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:30.560 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.553+0000 7f9cbd578700 1 -- 172.21.15.124:0/931172060 >> v2:172.21.15.192:3300/0 conn(0x7f9cb815b4e0 msgr2=0x7f9cb806f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:30.560 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.553+0000 7f9cbd578700 1 --2- 172.21.15.124:0/931172060 >> v2:172.21.15.192:3300/0 conn(0x7f9cb815b4e0 0x7f9cb806f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.560 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.553+0000 7f9cbd578700 1 -- 172.21.15.124:0/931172060 >> v1:172.21.15.124:6789/0 conn(0x7f9cb80b3220 legacy=0x7f9cb80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:30.560 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.553+0000 7f9cbd578700 1 -- 172.21.15.124:0/931172060 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb8070be0 con 0x7f9cb80cd770 2023-10-16T12:59:30.560 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.553+0000 7f9cbcd77700 1 -- 172.21.15.124:0/931172060 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 228353423 0 0) 0x7f9cb0001490 con 0x7f9cb80b3220 2023-10-16T12:59:30.561 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.553+0000 7f9cbd578700 1 --2- 172.21.15.124:0/931172060 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9cb80cd770 0x7f9cb80b2ce0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80c4d60 tx=0x7f9ca8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b5076681216132 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:30.561 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.553+0000 7f9cbcd77700 1 -- 172.21.15.124:0/931172060 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8011830 con 0x7f9cb80cd770 2023-10-16T12:59:30.561 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.554+0000 7f9cbcd77700 1 -- 172.21.15.124:0/931172060 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca8011990 con 0x7f9cb80cd770 2023-10-16T12:59:30.561 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.554+0000 7f9cbcd77700 1 -- 172.21.15.124:0/931172060 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8011d20 con 0x7f9cb80cd770 2023-10-16T12:59:30.562 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.554+0000 7f9cbffdd700 1 -- 172.21.15.124:0/931172060 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9cb80cd770 msgr2=0x7f9cb80b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:30.562 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.554+0000 7f9cbffdd700 1 --2- 172.21.15.124:0/931172060 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9cb80cd770 0x7f9cb80b2ce0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80c4d60 tx=0x7f9ca8009b20 comp rx=0 tx=0).stop 2023-10-16T12:59:30.562 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.554+0000 7f9cbffdd700 1 -- 172.21.15.124:0/931172060 shutdown_connections 2023-10-16T12:59:30.562 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.554+0000 7f9cbffdd700 1 --2- 172.21.15.124:0/931172060 >> v2:172.21.15.192:3300/0 conn(0x7f9cb815b4e0 0x7f9cb806f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.562 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.554+0000 7f9cbffdd700 1 --2- 172.21.15.124:0/931172060 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9cb80cd770 0x7f9cb80b2ce0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.565 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.554+0000 7f9cbffdd700 1 -- 172.21.15.124:0/931172060 >> 172.21.15.124:0/931172060 conn(0x7f9cb80cdce0 msgr2=0x7f9cb80ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:30.565 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.554+0000 7f9cbffdd700 1 -- 172.21.15.124:0/931172060 shutdown_connections 2023-10-16T12:59:30.565 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.554+0000 7f9cbffdd700 1 -- 172.21.15.124:0/931172060 wait complete. 2023-10-16T12:59:30.566 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.555+0000 7f9cbffdd700 1 Processor -- start 2023-10-16T12:59:30.566 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.555+0000 7f9cbffdd700 1 -- start start 2023-10-16T12:59:30.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.556+0000 7f9cbffdd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cb80b3220 0x7f9cb80c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:30.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.556+0000 7f9cbffdd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cb80cd770 0x7f9cb80ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:30.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.556+0000 7f9cbffdd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9cb815b4e0 0x7f9cb81e4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:30.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.556+0000 7f9cbffdd700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb80ca130 con 0x7f9cb815b4e0 2023-10-16T12:59:30.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.556+0000 7f9cbffdd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb80c9520 con 0x7f9cb80cd770 2023-10-16T12:59:30.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.556+0000 7f9cbffdd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb80c9800 con 0x7f9cb80b3220 2023-10-16T12:59:30.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.556+0000 7f9cbe57a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9cb815b4e0 0x7f9cb81e4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:30.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.556+0000 7f9cbe57a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9cb815b4e0 0x7f9cb81e4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54346/0 (socket says 172.21.15.124:54346) 2023-10-16T12:59:30.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.556+0000 7f9cbe57a700 1 -- 172.21.15.124:0/174446500 learned_addr learned my addr 172.21.15.124:0/174446500 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:30.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.556+0000 7f9cbdd79700 1 --2- 172.21.15.124:0/174446500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cb80b3220 0x7f9cb80c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:30.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.556+0000 7f9cbd578700 1 --2- 172.21.15.124:0/174446500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cb80cd770 0x7f9cb80ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:30.571 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.556+0000 7f9cbe57a700 1 -- 172.21.15.124:0/174446500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cb80b3220 msgr2=0x7f9cb80c44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:30.571 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.556+0000 7f9cbe57a700 1 --2- 172.21.15.124:0/174446500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cb80b3220 0x7f9cb80c44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.571 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.556+0000 7f9cbe57a700 1 -- 172.21.15.124:0/174446500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cb80cd770 msgr2=0x7f9cb80ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:30.571 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.556+0000 7f9cbe57a700 1 --2- 172.21.15.124:0/174446500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cb80cd770 0x7f9cb80ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.571 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.556+0000 7f9cbe57a700 1 -- 172.21.15.124:0/174446500 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca80094a0 con 0x7f9cb815b4e0 2023-10-16T12:59:30.572 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.557+0000 7f9cbe57a700 1 --2- 172.21.15.124:0/174446500 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9cb815b4e0 0x7f9cb81e4a40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000cca0 tx=0x7f9cb000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:30.572 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.557+0000 7f9cae7fc700 1 -- 172.21.15.124:0/174446500 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb000ab10 con 0x7f9cb815b4e0 2023-10-16T12:59:30.572 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.557+0000 7f9cae7fc700 1 -- 172.21.15.124:0/174446500 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb000ac90 con 0x7f9cb815b4e0 2023-10-16T12:59:30.572 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.557+0000 7f9cae7fc700 1 -- 172.21.15.124:0/174446500 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb00070d0 con 0x7f9cb815b4e0 2023-10-16T12:59:30.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.557+0000 7f9cbffdd700 1 -- 172.21.15.124:0/174446500 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb80c9ae0 con 0x7f9cb815b4e0 2023-10-16T12:59:30.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.557+0000 7f9cbffdd700 1 -- 172.21.15.124:0/174446500 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb8154f00 con 0x7f9cb815b4e0 2023-10-16T12:59:30.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.558+0000 7f9cbffdd700 1 -- 172.21.15.124:0/174446500 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb804ebb0 con 0x7f9cb815b4e0 2023-10-16T12:59:30.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.558+0000 7f9cae7fc700 1 -- 172.21.15.124:0/174446500 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9cb0007250 con 0x7f9cb815b4e0 2023-10-16T12:59:30.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.559+0000 7f9cae7fc700 1 --2- 172.21.15.124:0/174446500 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f9c9c06af00 0x7f9c9c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:30.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.559+0000 7f9cae7fc700 1 -- 172.21.15.124:0/174446500 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9cb0089200 con 0x7f9cb815b4e0 2023-10-16T12:59:30.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.559+0000 7f9cbdd79700 1 --2- 172.21.15.124:0/174446500 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f9c9c06af00 0x7f9c9c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:30.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.559+0000 7f9cbdd79700 1 --2- 172.21.15.124:0/174446500 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f9c9c06af00 0x7f9c9c06d3c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009b40 tx=0x7f9cb4009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:30.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.563+0000 7f9cae7fc700 1 -- 172.21.15.124:0/174446500 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9cb0053fc0 con 0x7f9cb815b4e0 2023-10-16T12:59:30.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.758+0000 7f9cbffdd700 1 -- 172.21.15.124:0/174446500 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9cb80b3670 con 0x7f9cb815b4e0 2023-10-16T12:59:30.762 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.759+0000 7f9cae7fc700 1 -- 172.21.15.124:0/174446500 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9cb80b3670 con 0x7f9cb815b4e0 2023-10-16T12:59:30.762 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2023-10-16T12:59:30.763 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.761+0000 7f9cbffdd700 1 -- 172.21.15.124:0/174446500 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f9c9c06af00 msgr2=0x7f9c9c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:30.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.761+0000 7f9cbffdd700 1 --2- 172.21.15.124:0/174446500 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f9c9c06af00 0x7f9c9c06d3c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009b40 tx=0x7f9cb4009210 comp rx=0 tx=0).stop 2023-10-16T12:59:30.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.761+0000 7f9cbffdd700 1 -- 172.21.15.124:0/174446500 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9cb815b4e0 msgr2=0x7f9cb81e4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:30.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.761+0000 7f9cbffdd700 1 --2- 172.21.15.124:0/174446500 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9cb815b4e0 0x7f9cb81e4a40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000cca0 tx=0x7f9cb000a060 comp rx=0 tx=0).stop 2023-10-16T12:59:30.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.761+0000 7f9cbffdd700 1 -- 172.21.15.124:0/174446500 shutdown_connections 2023-10-16T12:59:30.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.761+0000 7f9cbffdd700 1 --2- 172.21.15.124:0/174446500 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f9c9c06af00 0x7f9c9c06d3c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.761+0000 7f9cbffdd700 1 --2- 172.21.15.124:0/174446500 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9cb815b4e0 0x7f9cb81e4a40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.761+0000 7f9cbffdd700 1 --2- 172.21.15.124:0/174446500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cb80b3220 0x7f9cb80c44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.761+0000 7f9cbffdd700 1 --2- 172.21.15.124:0/174446500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cb80cd770 0x7f9cb80ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.761+0000 7f9cbffdd700 1 -- 172.21.15.124:0/174446500 >> 172.21.15.124:0/174446500 conn(0x7f9cb80cdce0 msgr2=0x7f9cb80c4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:30.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.761+0000 7f9cbffdd700 1 -- 172.21.15.124:0/174446500 shutdown_connections 2023-10-16T12:59:30.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.761+0000 7f9cbffdd700 1 -- 172.21.15.124:0/174446500 wait complete. 2023-10-16T12:59:30.775 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T12:59:30.899 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.896+0000 7f45d6854700 1 Processor -- start 2023-10-16T12:59:30.899 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.896+0000 7f45d6854700 1 -- start start 2023-10-16T12:59:30.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.897+0000 7f45d6854700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45d0157d10 0x7f45d015b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:30.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.897+0000 7f45d6854700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f45d00b0b50 0x7f45d00b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:30.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.897+0000 7f45d6854700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d015a9a0 con 0x7f45d00ce0e0 2023-10-16T12:59:30.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.897+0000 7f45d6854700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d00b15a0 con 0x7f45d00b0b50 2023-10-16T12:59:30.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.897+0000 7f45d6854700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d00b1880 con 0x7f45d0157d10 2023-10-16T12:59:30.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.898+0000 7f45cf7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f45d00b0b50 0x7f45d00b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:30.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.898+0000 7f45cffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45d0157d10 0x7f45d015b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:30.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.898+0000 7f45cf7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f45d00b0b50 0x7f45d00b0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:34516/0 (socket says 172.21.15.124:34516) 2023-10-16T12:59:30.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.898+0000 7f45cffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45d0157d10 0x7f45d015b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:40430/0 (socket says 172.21.15.124:40430) 2023-10-16T12:59:30.903 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.898+0000 7f45cf7fe700 1 -- 172.21.15.124:0/2081283804 learned_addr learned my addr 172.21.15.124:0/2081283804 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:30.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.898+0000 7f45d4df1700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f45d00ce0e0 0x7f45d015df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.124:55018/0 (socket says 172.21.15.124:55018) 2023-10-16T12:59:30.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.898+0000 7f45cf7fe700 1 -- 172.21.15.124:0/2081283804 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45d0157d10 msgr2=0x7f45d015b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:30.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.898+0000 7f45cf7fe700 1 --2- 172.21.15.124:0/2081283804 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45d0157d10 0x7f45d015b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.898+0000 7f45cf7fe700 1 -- 172.21.15.124:0/2081283804 >> v1:172.21.15.192:6789/0 conn(0x7f45d00ce0e0 legacy=0x7f45d015df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:30.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.898+0000 7f45ceffd700 1 -- 172.21.15.124:0/2081283804 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270213423 0 0) 0x7f45d015a9a0 con 0x7f45d00ce0e0 2023-10-16T12:59:30.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.898+0000 7f45cf7fe700 1 -- 172.21.15.124:0/2081283804 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d015abf0 con 0x7f45d00b0b50 2023-10-16T12:59:30.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.898+0000 7f45cf7fe700 1 --2- 172.21.15.124:0/2081283804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45d00b0b50 0x7f45d00b0f90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f45c00098f0 tx=0x7f45c0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=250fb9c1c29d31f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:30.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.898+0000 7f45ceffd700 1 -- 172.21.15.124:0/2081283804 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c0011830 con 0x7f45d00b0b50 2023-10-16T12:59:30.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.898+0000 7f45ceffd700 1 -- 172.21.15.124:0/2081283804 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c0011990 con 0x7f45d00b0b50 2023-10-16T12:59:30.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.898+0000 7f45ceffd700 1 -- 172.21.15.124:0/2081283804 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c0011d20 con 0x7f45d00b0b50 2023-10-16T12:59:30.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.899+0000 7f45d6854700 1 -- 172.21.15.124:0/2081283804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45d00b0b50 msgr2=0x7f45d00b0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:30.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.899+0000 7f45d6854700 1 --2- 172.21.15.124:0/2081283804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45d00b0b50 0x7f45d00b0f90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f45c00098f0 tx=0x7f45c0009c00 comp rx=0 tx=0).stop 2023-10-16T12:59:30.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.899+0000 7f45d6854700 1 -- 172.21.15.124:0/2081283804 shutdown_connections 2023-10-16T12:59:30.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.899+0000 7f45d6854700 1 --2- 172.21.15.124:0/2081283804 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45d0157d10 0x7f45d015b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.899+0000 7f45d6854700 1 --2- 172.21.15.124:0/2081283804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45d00b0b50 0x7f45d00b0f90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.899+0000 7f45d6854700 1 -- 172.21.15.124:0/2081283804 >> 172.21.15.124:0/2081283804 conn(0x7f45d00cbb50 msgr2=0x7f45d00cbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:30.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.899+0000 7f45d6854700 1 -- 172.21.15.124:0/2081283804 shutdown_connections 2023-10-16T12:59:30.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.899+0000 7f45d6854700 1 -- 172.21.15.124:0/2081283804 wait complete. 2023-10-16T12:59:30.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.900+0000 7f45d6854700 1 Processor -- start 2023-10-16T12:59:30.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.900+0000 7f45d6854700 1 -- start start 2023-10-16T12:59:30.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.901+0000 7f45d6854700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45d00b0b50 0x7f45d00ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:30.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.901+0000 7f45d6854700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45d00ce0e0 0x7f45d00afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:30.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.901+0000 7f45d6854700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45d0157d10 0x7f45d0146400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:30.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.901+0000 7f45d6854700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d014a040 con 0x7f45d0157d10 2023-10-16T12:59:30.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.901+0000 7f45d6854700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d01494c0 con 0x7f45d00b0b50 2023-10-16T12:59:30.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.901+0000 7f45d6854700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d01497a0 con 0x7f45d00ce0e0 2023-10-16T12:59:30.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.901+0000 7f45d4df1700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45d0157d10 0x7f45d0146400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:30.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.901+0000 7f45d4df1700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45d0157d10 0x7f45d0146400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54360/0 (socket says 172.21.15.124:54360) 2023-10-16T12:59:30.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.901+0000 7f45d4df1700 1 -- 172.21.15.124:0/2220301432 learned_addr learned my addr 172.21.15.124:0/2220301432 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:30.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.901+0000 7f45cf7fe700 1 --2- 172.21.15.124:0/2220301432 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45d00ce0e0 0x7f45d00afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:30.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.901+0000 7f45cffff700 1 --2- 172.21.15.124:0/2220301432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45d00b0b50 0x7f45d00ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:30.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.902+0000 7f45d4df1700 1 -- 172.21.15.124:0/2220301432 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45d00ce0e0 msgr2=0x7f45d00afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:30.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.902+0000 7f45d4df1700 1 --2- 172.21.15.124:0/2220301432 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45d00ce0e0 0x7f45d00afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.902+0000 7f45d4df1700 1 -- 172.21.15.124:0/2220301432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45d00b0b50 msgr2=0x7f45d00ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:30.913 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.902+0000 7f45d4df1700 1 --2- 172.21.15.124:0/2220301432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45d00b0b50 0x7f45d00ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:30.913 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.902+0000 7f45d4df1700 1 -- 172.21.15.124:0/2220301432 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c0009550 con 0x7f45d0157d10 2023-10-16T12:59:30.913 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.902+0000 7f45d4df1700 1 --2- 172.21.15.124:0/2220301432 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45d0157d10 0x7f45d0146400 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f45c8002230 tx=0x7f45c800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:30.913 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.902+0000 7f45ccff9700 1 -- 172.21.15.124:0/2220301432 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c800aac0 con 0x7f45d0157d10 2023-10-16T12:59:30.913 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.902+0000 7f45ccff9700 1 -- 172.21.15.124:0/2220301432 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c800ac40 con 0x7f45d0157d10 2023-10-16T12:59:30.914 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.902+0000 7f45d6854700 1 -- 172.21.15.124:0/2220301432 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d0149a80 con 0x7f45d0157d10 2023-10-16T12:59:30.914 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.902+0000 7f45ccff9700 1 -- 172.21.15.124:0/2220301432 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c80070d0 con 0x7f45d0157d10 2023-10-16T12:59:30.914 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.902+0000 7f45d6854700 1 -- 172.21.15.124:0/2220301432 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d00c9db0 con 0x7f45d0157d10 2023-10-16T12:59:30.914 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.903+0000 7f45d6854700 1 -- 172.21.15.124:0/2220301432 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d004ebb0 con 0x7f45d0157d10 2023-10-16T12:59:30.915 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.903+0000 7f45ccff9700 1 -- 172.21.15.124:0/2220301432 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f45c8007250 con 0x7f45d0157d10 2023-10-16T12:59:30.915 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.904+0000 7f45ccff9700 1 --2- 172.21.15.124:0/2220301432 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f45bc06af00 0x7f45bc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:30.915 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.904+0000 7f45ccff9700 1 -- 172.21.15.124:0/2220301432 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f45c8089690 con 0x7f45d0157d10 2023-10-16T12:59:30.916 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.904+0000 7f45cffff700 1 --2- 172.21.15.124:0/2220301432 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f45bc06af00 0x7f45bc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:30.916 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.904+0000 7f45cffff700 1 --2- 172.21.15.124:0/2220301432 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f45bc06af00 0x7f45bc06d3c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f45c4009be0 tx=0x7f45c4009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:30.917 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:30.908+0000 7f45ccff9700 1 -- 172.21.15.124:0/2220301432 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f45c8054440 con 0x7f45d0157d10 2023-10-16T12:59:31.101 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.099+0000 7f45d6854700 1 -- 172.21.15.124:0/2220301432 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f45d006d500 con 0x7f45d0157d10 2023-10-16T12:59:31.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.099+0000 7f45ccff9700 1 -- 172.21.15.124:0/2220301432 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f45c8057a60 con 0x7f45d0157d10 2023-10-16T12:59:31.102 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:31.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.101+0000 7f45d6854700 1 -- 172.21.15.124:0/2220301432 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f45bc06af00 msgr2=0x7f45bc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:31.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.101+0000 7f45d6854700 1 --2- 172.21.15.124:0/2220301432 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f45bc06af00 0x7f45bc06d3c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f45c4009be0 tx=0x7f45c4009210 comp rx=0 tx=0).stop 2023-10-16T12:59:31.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.101+0000 7f45d6854700 1 -- 172.21.15.124:0/2220301432 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45d0157d10 msgr2=0x7f45d0146400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:31.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.101+0000 7f45d6854700 1 --2- 172.21.15.124:0/2220301432 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45d0157d10 0x7f45d0146400 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f45c8002230 tx=0x7f45c800cf50 comp rx=0 tx=0).stop 2023-10-16T12:59:31.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.101+0000 7f45d6854700 1 -- 172.21.15.124:0/2220301432 shutdown_connections 2023-10-16T12:59:31.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.101+0000 7f45d6854700 1 --2- 172.21.15.124:0/2220301432 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f45bc06af00 0x7f45bc06d3c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.101+0000 7f45d6854700 1 --2- 172.21.15.124:0/2220301432 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f45d0157d10 0x7f45d0146400 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.101+0000 7f45d6854700 1 --2- 172.21.15.124:0/2220301432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45d00b0b50 0x7f45d00ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.101+0000 7f45d6854700 1 --2- 172.21.15.124:0/2220301432 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45d00ce0e0 0x7f45d00afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.101+0000 7f45d6854700 1 -- 172.21.15.124:0/2220301432 >> 172.21.15.124:0/2220301432 conn(0x7f45d00cbb50 msgr2=0x7f45d00c23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:31.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.101+0000 7f45d6854700 1 -- 172.21.15.124:0/2220301432 shutdown_connections 2023-10-16T12:59:31.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.101+0000 7f45d6854700 1 -- 172.21.15.124:0/2220301432 wait complete. 2023-10-16T12:59:31.116 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:59:31.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.233+0000 7f21c75f2700 1 Processor -- start 2023-10-16T12:59:31.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.233+0000 7f21c75f2700 1 -- start start 2023-10-16T12:59:31.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.234+0000 7f21c75f2700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f21c00cd4b0 0x7f21c006e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:31.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.234+0000 7f21c75f2700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c0161260 con 0x7f21c006bf80 2023-10-16T12:59:31.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.234+0000 7f21c75f2700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c0161b00 con 0x7f21c015dc70 2023-10-16T12:59:31.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.234+0000 7f21c75f2700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c006e7d0 con 0x7f21c00cd4b0 2023-10-16T12:59:31.239 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.234+0000 7f21c538e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f21c00cd4b0 0x7f21c006e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:31.240 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.234+0000 7f21c538e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f21c00cd4b0 0x7f21c006e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54364/0 (socket says 172.21.15.124:54364) 2023-10-16T12:59:31.240 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.234+0000 7f21c4b8d700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f21c006bf80 0x7f21c00cd890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43032/0 (socket says 172.21.15.124:43032) 2023-10-16T12:59:31.240 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.234+0000 7f21c538e700 1 -- 172.21.15.124:0/2629876040 learned_addr learned my addr 172.21.15.124:0/2629876040 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:31.240 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.234+0000 7f21c538e700 1 -- 172.21.15.124:0/2629876040 >> v1:172.21.15.192:6789/0 conn(0x7f21c015dc70 legacy=0x7f21c015e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:31.240 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.234+0000 7f21b7fff700 1 -- 172.21.15.124:0/2629876040 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1443091331 0 0) 0x7f21c0161260 con 0x7f21c006bf80 2023-10-16T12:59:31.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.234+0000 7f21c538e700 1 -- 172.21.15.124:0/2629876040 >> v1:172.21.15.124:6789/0 conn(0x7f21c006bf80 legacy=0x7f21c00cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:31.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.234+0000 7f21c538e700 1 -- 172.21.15.124:0/2629876040 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c0158120 con 0x7f21c00cd4b0 2023-10-16T12:59:31.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.235+0000 7f21c538e700 1 --2- 172.21.15.124:0/2629876040 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f21c00cd4b0 0x7f21c006e290 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f21b00098f0 tx=0x7f21b0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f295da8cce4481f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:31.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.235+0000 7f21b7fff700 1 -- 172.21.15.124:0/2629876040 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b000b8a0 con 0x7f21c00cd4b0 2023-10-16T12:59:31.241 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.235+0000 7f21b7fff700 1 -- 172.21.15.124:0/2629876040 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b000ba00 con 0x7f21c00cd4b0 2023-10-16T12:59:31.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.235+0000 7f21b7fff700 1 -- 172.21.15.124:0/2629876040 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b000bd90 con 0x7f21c00cd4b0 2023-10-16T12:59:31.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.235+0000 7f21c75f2700 1 -- 172.21.15.124:0/2629876040 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f21c00cd4b0 msgr2=0x7f21c006e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:31.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.235+0000 7f21c75f2700 1 --2- 172.21.15.124:0/2629876040 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f21c00cd4b0 0x7f21c006e290 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f21b00098f0 tx=0x7f21b0009c00 comp rx=0 tx=0).stop 2023-10-16T12:59:31.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.235+0000 7f21c75f2700 1 -- 172.21.15.124:0/2629876040 shutdown_connections 2023-10-16T12:59:31.242 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.235+0000 7f21c75f2700 1 --2- 172.21.15.124:0/2629876040 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f21c00cd4b0 0x7f21c006e290 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.235+0000 7f21c75f2700 1 -- 172.21.15.124:0/2629876040 >> 172.21.15.124:0/2629876040 conn(0x7f21c00cfcd0 msgr2=0x7f21c00d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:31.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.235+0000 7f21c75f2700 1 -- 172.21.15.124:0/2629876040 shutdown_connections 2023-10-16T12:59:31.243 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.235+0000 7f21c75f2700 1 -- 172.21.15.124:0/2629876040 wait complete. 2023-10-16T12:59:31.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.237+0000 7f21c75f2700 1 Processor -- start 2023-10-16T12:59:31.246 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.237+0000 7f21c75f2700 1 -- start start 2023-10-16T12:59:31.247 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.238+0000 7f21c75f2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c006bf80 0x7f21c00c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:31.247 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.238+0000 7f21c75f2700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f21c00cd4b0 0x7f21c0142a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:31.247 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.238+0000 7f21c75f2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21c015dc70 0x7f21c00c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:31.247 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.238+0000 7f21c75f2700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c00c4460 con 0x7f21c00cd4b0 2023-10-16T12:59:31.247 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.238+0000 7f21c75f2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c01612b0 con 0x7f21c006bf80 2023-10-16T12:59:31.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.238+0000 7f21c75f2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c00c9a80 con 0x7f21c015dc70 2023-10-16T12:59:31.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.238+0000 7f21c4b8d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f21c00cd4b0 0x7f21c0142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:31.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.238+0000 7f21c4b8d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f21c00cd4b0 0x7f21c0142a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54370/0 (socket says 172.21.15.124:54370) 2023-10-16T12:59:31.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.238+0000 7f21c4b8d700 1 -- 172.21.15.124:0/4254476220 learned_addr learned my addr 172.21.15.124:0/4254476220 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:31.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.238+0000 7f21c4b8d700 1 -- 172.21.15.124:0/4254476220 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21c015dc70 msgr2=0x7f21c00c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:31.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.238+0000 7f21c4b8d700 1 --2- 172.21.15.124:0/4254476220 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21c015dc70 0x7f21c00c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.238+0000 7f21c4b8d700 1 -- 172.21.15.124:0/4254476220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c006bf80 msgr2=0x7f21c00c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:31.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.238+0000 7f21c4b8d700 1 --2- 172.21.15.124:0/4254476220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c006bf80 0x7f21c00c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.238+0000 7f21c4b8d700 1 -- 172.21.15.124:0/4254476220 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b0009550 con 0x7f21c00cd4b0 2023-10-16T12:59:31.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.238+0000 7f21c4b8d700 1 --2- 172.21.15.124:0/4254476220 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f21c00cd4b0 0x7f21c0142a40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00c520 tx=0x7f21bc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:31.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.239+0000 7f21b5ffb700 1 -- 172.21.15.124:0/4254476220 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc004c80 con 0x7f21c00cd4b0 2023-10-16T12:59:31.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.239+0000 7f21b5ffb700 1 -- 172.21.15.124:0/4254476220 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc004e00 con 0x7f21c00cd4b0 2023-10-16T12:59:31.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.239+0000 7f21c75f2700 1 -- 172.21.15.124:0/4254476220 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c00c4670 con 0x7f21c00cd4b0 2023-10-16T12:59:31.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.239+0000 7f21b5ffb700 1 -- 172.21.15.124:0/4254476220 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc007310 con 0x7f21c00cd4b0 2023-10-16T12:59:31.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.239+0000 7f21c75f2700 1 -- 172.21.15.124:0/4254476220 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c00c4c30 con 0x7f21c00cd4b0 2023-10-16T12:59:31.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.240+0000 7f21c75f2700 1 -- 172.21.15.124:0/4254476220 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c004ebb0 con 0x7f21c00cd4b0 2023-10-16T12:59:31.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.240+0000 7f21b5ffb700 1 -- 172.21.15.124:0/4254476220 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f21bc007470 con 0x7f21c00cd4b0 2023-10-16T12:59:31.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.240+0000 7f21b5ffb700 1 --2- 172.21.15.124:0/4254476220 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f21a406af30 0x7f21a406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:31.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.241+0000 7f21b5ffb700 1 -- 172.21.15.124:0/4254476220 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f21bc089640 con 0x7f21c00cd4b0 2023-10-16T12:59:31.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.241+0000 7f21c538e700 1 --2- 172.21.15.124:0/4254476220 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f21a406af30 0x7f21a406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:31.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.241+0000 7f21c538e700 1 --2- 172.21.15.124:0/4254476220 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f21a406af30 0x7f21a406d3f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f21b0009130 tx=0x7f21b0010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:31.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.245+0000 7f21b5ffb700 1 -- 172.21.15.124:0/4254476220 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f21bc054400 con 0x7f21c00cd4b0 2023-10-16T12:59:31.437 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.435+0000 7f21c75f2700 1 -- 172.21.15.124:0/4254476220 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21c0161470 con 0x7f21c00cd4b0 2023-10-16T12:59:31.438 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.436+0000 7f21b5ffb700 1 -- 172.21.15.124:0/4254476220 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f21bc057a20 con 0x7f21c00cd4b0 2023-10-16T12:59:31.439 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:31.439 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":24,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:58:56.089767+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:59:31.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.439+0000 7f21c75f2700 1 -- 172.21.15.124:0/4254476220 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f21a406af30 msgr2=0x7f21a406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:31.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.439+0000 7f21c75f2700 1 --2- 172.21.15.124:0/4254476220 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f21a406af30 0x7f21a406d3f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f21b0009130 tx=0x7f21b0010000 comp rx=0 tx=0).stop 2023-10-16T12:59:31.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.439+0000 7f21c75f2700 1 -- 172.21.15.124:0/4254476220 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f21c00cd4b0 msgr2=0x7f21c0142a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:31.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.439+0000 7f21c75f2700 1 --2- 172.21.15.124:0/4254476220 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f21c00cd4b0 0x7f21c0142a40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00c520 tx=0x7f21bc00c8e0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.442 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.439+0000 7f21c75f2700 1 -- 172.21.15.124:0/4254476220 shutdown_connections 2023-10-16T12:59:31.443 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.439+0000 7f21c75f2700 1 --2- 172.21.15.124:0/4254476220 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f21a406af30 0x7f21a406d3f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.443 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.439+0000 7f21c75f2700 1 --2- 172.21.15.124:0/4254476220 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21c015dc70 0x7f21c00c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.443 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.439+0000 7f21c75f2700 1 --2- 172.21.15.124:0/4254476220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c006bf80 0x7f21c00c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.443 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.439+0000 7f21c75f2700 1 --2- 172.21.15.124:0/4254476220 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f21c00cd4b0 0x7f21c0142a40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.444 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.439+0000 7f21c75f2700 1 -- 172.21.15.124:0/4254476220 >> 172.21.15.124:0/4254476220 conn(0x7f21c00cfcd0 msgr2=0x7f21c0071180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:31.444 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.439+0000 7f21c75f2700 1 -- 172.21.15.124:0/4254476220 shutdown_connections 2023-10-16T12:59:31.444 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.439+0000 7f21c75f2700 1 -- 172.21.15.124:0/4254476220 wait complete. 2023-10-16T12:59:31.455 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T12:58:38.667813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T12:58:49.562073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T12:58:50.011419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T12:58:53.692890+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T12:59:31.455 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T12:59:31.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.576+0000 7ff8cf2a6700 1 Processor -- start 2023-10-16T12:59:31.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.577+0000 7ff8cf2a6700 1 -- start start 2023-10-16T12:59:31.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.577+0000 7ff8cf2a6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff8c815d660 0x7ff8c80cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:31.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.577+0000 7ff8cf2a6700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8c8072b70 con 0x7ff8c8161c50 2023-10-16T12:59:31.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.577+0000 7ff8cf2a6700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8c806fb60 con 0x7ff8c80cd800 2023-10-16T12:59:31.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.577+0000 7ff8cf2a6700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c8162210 con 0x7ff8c815d660 2023-10-16T12:59:31.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.578+0000 7ff8cd843700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7ff8c8161c50 0x7ff8c806f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43048/0 (socket says 172.21.15.124:43048) 2023-10-16T12:59:31.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.578+0000 7ff8cd843700 1 -- 172.21.15.124:0/2853318825 learned_addr learned my addr 172.21.15.124:0/2853318825 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:31.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.578+0000 7ff8cd042700 1 --2- 172.21.15.124:0/2853318825 >> v2:172.21.15.192:3300/0 conn(0x7ff8c815d660 0x7ff8c80cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:31.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.578+0000 7ff8bffff700 1 -- 172.21.15.124:0/2853318825 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181777592 0 0) 0x7ff8c8072b70 con 0x7ff8c8161c50 2023-10-16T12:59:31.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.578+0000 7ff8bffff700 1 -- 172.21.15.124:0/2853318825 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8b40035b0 con 0x7ff8c8161c50 2023-10-16T12:59:31.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.578+0000 7ff8bffff700 1 -- 172.21.15.124:0/2853318825 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2963882074 0 0) 0x7ff8b40035b0 con 0x7ff8c8161c50 2023-10-16T12:59:31.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.578+0000 7ff8bffff700 1 -- 172.21.15.124:0/2853318825 >> v2:172.21.15.192:3300/0 conn(0x7ff8c815d660 msgr2=0x7ff8c80cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:31.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.578+0000 7ff8bffff700 1 --2- 172.21.15.124:0/2853318825 >> v2:172.21.15.192:3300/0 conn(0x7ff8c815d660 0x7ff8c80cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.578+0000 7ff8bffff700 1 -- 172.21.15.124:0/2853318825 >> v1:172.21.15.192:6789/0 conn(0x7ff8c80cd800 legacy=0x7ff8c806ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:31.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.578+0000 7ff8bffff700 1 -- 172.21.15.124:0/2853318825 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c806a9c0 con 0x7ff8c8161c50 2023-10-16T12:59:31.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.578+0000 7ff8bffff700 1 -- 172.21.15.124:0/2853318825 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7ff8c0001a40 con 0x7ff8c8161c50 2023-10-16T12:59:31.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.578+0000 7ff8bffff700 1 -- 172.21.15.124:0/2853318825 >> v1:172.21.15.124:6789/0 conn(0x7ff8c8161c50 legacy=0x7ff8c806f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:31.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.578+0000 7ff8bffff700 1 --2- 172.21.15.124:0/2853318825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8b4003a00 0x7ff8b4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:31.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.578+0000 7ff8bffff700 1 --2- 172.21.15.124:0/2853318825 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8b4004850 0x7ff8b4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:31.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.578+0000 7ff8bffff700 1 --2- 172.21.15.124:0/2853318825 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8b4005210 0x7ff8b400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:31.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.578+0000 7ff8bffff700 1 -- 172.21.15.124:0/2853318825 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c8162210 con 0x7ff8b4004850 2023-10-16T12:59:31.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.578+0000 7ff8bffff700 1 -- 172.21.15.124:0/2853318825 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b400c0b0 con 0x7ff8b4003a00 2023-10-16T12:59:31.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.578+0000 7ff8bffff700 1 -- 172.21.15.124:0/2853318825 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b400c270 con 0x7ff8b4005210 2023-10-16T12:59:31.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.578+0000 7ff8cc841700 1 --2- 172.21.15.124:0/2853318825 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8b4004850 0x7ff8b4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:31.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.578+0000 7ff8cd042700 1 --2- 172.21.15.124:0/2853318825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8b4003a00 0x7ff8b4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:31.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.578+0000 7ff8cd843700 1 --2- 172.21.15.124:0/2853318825 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8b4005210 0x7ff8b400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:31.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.579+0000 7ff8cc841700 1 -- 172.21.15.124:0/2853318825 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8b4005210 msgr2=0x7ff8b400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:31.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.579+0000 7ff8cc841700 1 --2- 172.21.15.124:0/2853318825 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8b4005210 0x7ff8b400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.579+0000 7ff8cc841700 1 -- 172.21.15.124:0/2853318825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8b4003a00 msgr2=0x7ff8b4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:31.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.579+0000 7ff8cc841700 1 --2- 172.21.15.124:0/2853318825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8b4003a00 0x7ff8b4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.579+0000 7ff8cd843700 1 -- 172.21.15.124:0/2853318825 reap_dead start 2023-10-16T12:59:31.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.579+0000 7ff8cc841700 1 -- 172.21.15.124:0/2853318825 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b40035b0 con 0x7ff8b4004850 2023-10-16T12:59:31.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.579+0000 7ff8cc841700 1 --2- 172.21.15.124:0/2853318825 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8b4004850 0x7ff8b4004cd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80cdcb0 tx=0x7ff8b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed926a5998c25032 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:31.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.579+0000 7ff8bffff700 1 -- 172.21.15.124:0/2853318825 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b80052d0 con 0x7ff8b4004850 2023-10-16T12:59:31.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.579+0000 7ff8bffff700 1 -- 172.21.15.124:0/2853318825 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b8005450 con 0x7ff8b4004850 2023-10-16T12:59:31.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.579+0000 7ff8bffff700 1 -- 172.21.15.124:0/2853318825 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b80038c0 con 0x7ff8b4004850 2023-10-16T12:59:31.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.579+0000 7ff8cf2a6700 1 -- 172.21.15.124:0/2853318825 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8b4004850 msgr2=0x7ff8b4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:31.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.579+0000 7ff8cf2a6700 1 --2- 172.21.15.124:0/2853318825 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8b4004850 0x7ff8b4004cd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80cdcb0 tx=0x7ff8b4005880 comp rx=0 tx=0).stop 2023-10-16T12:59:31.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.579+0000 7ff8cf2a6700 1 -- 172.21.15.124:0/2853318825 shutdown_connections 2023-10-16T12:59:31.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.579+0000 7ff8cf2a6700 1 --2- 172.21.15.124:0/2853318825 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8b4004850 0x7ff8b4004cd0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.579+0000 7ff8cf2a6700 1 -- 172.21.15.124:0/2853318825 >> 172.21.15.124:0/2853318825 conn(0x7ff8c80ccce0 msgr2=0x7ff8c80cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:31.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.580+0000 7ff8cf2a6700 1 -- 172.21.15.124:0/2853318825 shutdown_connections 2023-10-16T12:59:31.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.580+0000 7ff8cf2a6700 1 -- 172.21.15.124:0/2853318825 wait complete. 2023-10-16T12:59:31.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.581+0000 7ff8cf2a6700 1 Processor -- start 2023-10-16T12:59:31.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.581+0000 7ff8cf2a6700 1 -- start start 2023-10-16T12:59:31.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.581+0000 7ff8cf2a6700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8b4004850 0x7ff8c80c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:31.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.581+0000 7ff8cf2a6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8c80b5060 0x7ff8c8157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:31.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.581+0000 7ff8cf2a6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8c80b55b0 0x7ff8c80b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:31.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.581+0000 7ff8cf2a6700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c80b5fa0 con 0x7ff8b4004850 2023-10-16T12:59:31.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.581+0000 7ff8cf2a6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c80b4e40 con 0x7ff8c80b5060 2023-10-16T12:59:31.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.581+0000 7ff8cf2a6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c80c6a30 con 0x7ff8c80b55b0 2023-10-16T12:59:31.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.582+0000 7ff8cd042700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8b4004850 0x7ff8c80c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:31.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.582+0000 7ff8cd042700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8b4004850 0x7ff8c80c5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54388/0 (socket says 172.21.15.124:54388) 2023-10-16T12:59:31.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.582+0000 7ff8cd042700 1 -- 172.21.15.124:0/2128042728 learned_addr learned my addr 172.21.15.124:0/2128042728 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:31.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.582+0000 7ff8cc841700 1 --2- 172.21.15.124:0/2128042728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8c80b5060 0x7ff8c8157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:31.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.582+0000 7ff8cd843700 1 --2- 172.21.15.124:0/2128042728 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8c80b55b0 0x7ff8c80b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:31.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.582+0000 7ff8cd042700 1 -- 172.21.15.124:0/2128042728 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8c80b55b0 msgr2=0x7ff8c80b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:31.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.582+0000 7ff8cd042700 1 --2- 172.21.15.124:0/2128042728 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8c80b55b0 0x7ff8c80b5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.582+0000 7ff8cd042700 1 -- 172.21.15.124:0/2128042728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8c80b5060 msgr2=0x7ff8c8157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:31.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.582+0000 7ff8cd042700 1 --2- 172.21.15.124:0/2128042728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8c80b5060 0x7ff8c8157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.582+0000 7ff8cd042700 1 -- 172.21.15.124:0/2128042728 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c80c6470 con 0x7ff8b4004850 2023-10-16T12:59:31.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.582+0000 7ff8cd042700 1 --2- 172.21.15.124:0/2128042728 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8b4004850 0x7ff8c80c5d70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40119d0 tx=0x7ff8c4011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:31.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.582+0000 7ff8bdffb700 1 -- 172.21.15.124:0/2128042728 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4004030 con 0x7ff8b4004850 2023-10-16T12:59:31.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.582+0000 7ff8bdffb700 1 -- 172.21.15.124:0/2128042728 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c4004190 con 0x7ff8b4004850 2023-10-16T12:59:31.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.582+0000 7ff8bdffb700 1 -- 172.21.15.124:0/2128042728 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4004520 con 0x7ff8b4004850 2023-10-16T12:59:31.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.582+0000 7ff8cf2a6700 1 -- 172.21.15.124:0/2128042728 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c80c6750 con 0x7ff8b4004850 2023-10-16T12:59:31.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.582+0000 7ff8cf2a6700 1 -- 172.21.15.124:0/2128042728 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c80c7740 con 0x7ff8b4004850 2023-10-16T12:59:31.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.583+0000 7ff8cf2a6700 1 -- 172.21.15.124:0/2128042728 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c804ebb0 con 0x7ff8b4004850 2023-10-16T12:59:31.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.584+0000 7ff8bdffb700 1 -- 172.21.15.124:0/2128042728 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff8c40036a0 con 0x7ff8b4004850 2023-10-16T12:59:31.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.584+0000 7ff8bdffb700 1 --2- 172.21.15.124:0/2128042728 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff8ac06af00 0x7ff8ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:31.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.584+0000 7ff8bdffb700 1 -- 172.21.15.124:0/2128042728 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff8c4089b90 con 0x7ff8b4004850 2023-10-16T12:59:31.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.584+0000 7ff8cc841700 1 --2- 172.21.15.124:0/2128042728 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff8ac06af00 0x7ff8ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:31.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.585+0000 7ff8cc841700 1 --2- 172.21.15.124:0/2128042728 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff8ac06af00 0x7ff8ac06d3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8005040 tx=0x7ff8b8009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:31.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.589+0000 7ff8bdffb700 1 -- 172.21.15.124:0/2128042728 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff8c40549e0 con 0x7ff8b4004850 2023-10-16T12:59:31.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.777+0000 7ff8cf2a6700 1 -- 172.21.15.124:0/2128042728 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff8c80cb120 con 0x7ff8b4004850 2023-10-16T12:59:31.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.777+0000 7ff8bdffb700 1 -- 172.21.15.124:0/2128042728 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff8c40230a0 con 0x7ff8b4004850 2023-10-16T12:59:31.781 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-16T12:59:31.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.779+0000 7ff8cf2a6700 1 -- 172.21.15.124:0/2128042728 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff8ac06af00 msgr2=0x7ff8ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:31.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.779+0000 7ff8cf2a6700 1 --2- 172.21.15.124:0/2128042728 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff8ac06af00 0x7ff8ac06d3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8005040 tx=0x7ff8b8009030 comp rx=0 tx=0).stop 2023-10-16T12:59:31.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.779+0000 7ff8cf2a6700 1 -- 172.21.15.124:0/2128042728 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8b4004850 msgr2=0x7ff8c80c5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:31.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.779+0000 7ff8cf2a6700 1 --2- 172.21.15.124:0/2128042728 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8b4004850 0x7ff8c80c5d70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40119d0 tx=0x7ff8c4011ce0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.779+0000 7ff8cf2a6700 1 -- 172.21.15.124:0/2128042728 shutdown_connections 2023-10-16T12:59:31.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.779+0000 7ff8cf2a6700 1 --2- 172.21.15.124:0/2128042728 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff8ac06af00 0x7ff8ac06d3c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.779+0000 7ff8cf2a6700 1 --2- 172.21.15.124:0/2128042728 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8c80b55b0 0x7ff8c80b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.779+0000 7ff8cf2a6700 1 --2- 172.21.15.124:0/2128042728 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8b4004850 0x7ff8c80c5d70 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.779+0000 7ff8cf2a6700 1 --2- 172.21.15.124:0/2128042728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8c80b5060 0x7ff8c8157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.779+0000 7ff8cf2a6700 1 -- 172.21.15.124:0/2128042728 >> 172.21.15.124:0/2128042728 conn(0x7ff8c80ccce0 msgr2=0x7ff8c80719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:31.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.780+0000 7ff8cf2a6700 1 -- 172.21.15.124:0/2128042728 shutdown_connections 2023-10-16T12:59:31.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.780+0000 7ff8cf2a6700 1 -- 172.21.15.124:0/2128042728 wait complete. 2023-10-16T12:59:31.794 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T12:59:31.920 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.917+0000 7fae6e5e6700 1 Processor -- start 2023-10-16T12:59:31.920 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.917+0000 7fae6e5e6700 1 -- start start 2023-10-16T12:59:31.923 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.918+0000 7fae6e5e6700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fae6806a820 0x7fae6815dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:31.923 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.918+0000 7fae6e5e6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae680cdd30 0x7fae680ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:31.923 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.918+0000 7fae6e5e6700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae68161360 con 0x7fae6806b370 2023-10-16T12:59:31.923 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.918+0000 7fae6e5e6700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae680ce720 con 0x7fae6806a820 2023-10-16T12:59:31.923 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.918+0000 7fae6e5e6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6806b750 con 0x7fae680cdd30 2023-10-16T12:59:31.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.918+0000 7fae677fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fae6806a820 0x7fae6815dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:31.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.918+0000 7fae677fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fae6806a820 0x7fae6815dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54398/0 (socket says 172.21.15.124:54398) 2023-10-16T12:59:31.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.918+0000 7fae677fe700 1 -- 172.21.15.124:0/613216864 learned_addr learned my addr 172.21.15.124:0/613216864 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:31.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.918+0000 7fae6cb83700 1 --2- 172.21.15.124:0/613216864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae680cdd30 0x7fae680ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:31.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.919+0000 7fae677fe700 1 -- 172.21.15.124:0/613216864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae680cdd30 msgr2=0x7fae680ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:31.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.919+0000 7fae677fe700 1 --2- 172.21.15.124:0/613216864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae680cdd30 0x7fae680ce1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.919+0000 7fae677fe700 1 -- 172.21.15.124:0/613216864 >> v1:172.21.15.192:6789/0 conn(0x7fae6806b370 legacy=0x7fae6806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:31.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.919+0000 7fae677fe700 1 -- 172.21.15.124:0/613216864 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6806dcc0 con 0x7fae6806a820 2023-10-16T12:59:31.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.919+0000 7fae677fe700 1 --2- 172.21.15.124:0/613216864 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fae6806a820 0x7fae6815dcb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fae580098f0 tx=0x7fae58009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=163140209e0d834f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:31.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.919+0000 7fae66ffd700 1 -- 172.21.15.124:0/613216864 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae58004230 con 0x7fae6806a820 2023-10-16T12:59:31.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.919+0000 7fae66ffd700 1 -- 172.21.15.124:0/613216864 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae58004390 con 0x7fae6806a820 2023-10-16T12:59:31.926 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.919+0000 7fae66ffd700 1 -- 172.21.15.124:0/613216864 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae580036a0 con 0x7fae6806a820 2023-10-16T12:59:31.926 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.919+0000 7fae6e5e6700 1 -- 172.21.15.124:0/613216864 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fae6806a820 msgr2=0x7fae6815dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:31.926 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.919+0000 7fae6e5e6700 1 --2- 172.21.15.124:0/613216864 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fae6806a820 0x7fae6815dcb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fae580098f0 tx=0x7fae58009c00 comp rx=0 tx=0).stop 2023-10-16T12:59:31.926 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.919+0000 7fae6e5e6700 1 -- 172.21.15.124:0/613216864 shutdown_connections 2023-10-16T12:59:31.926 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.919+0000 7fae6e5e6700 1 --2- 172.21.15.124:0/613216864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae680cdd30 0x7fae680ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.927 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.919+0000 7fae6e5e6700 1 --2- 172.21.15.124:0/613216864 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fae6806a820 0x7fae6815dcb0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.927 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.919+0000 7fae6e5e6700 1 -- 172.21.15.124:0/613216864 >> 172.21.15.124:0/613216864 conn(0x7fae680ccbe0 msgr2=0x7fae680ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:31.927 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.920+0000 7fae6e5e6700 1 -- 172.21.15.124:0/613216864 shutdown_connections 2023-10-16T12:59:31.927 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.920+0000 7fae6e5e6700 1 -- 172.21.15.124:0/613216864 wait complete. 2023-10-16T12:59:31.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.921+0000 7fae6e5e6700 1 Processor -- start 2023-10-16T12:59:31.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.921+0000 7fae6e5e6700 1 -- start start 2023-10-16T12:59:31.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.922+0000 7fae6e5e6700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fae6806a820 0x7fae68155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:31.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.922+0000 7fae6e5e6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae6806b370 0x7fae680c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:31.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.922+0000 7fae6e5e6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae680cdd30 0x7fae681f6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:31.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.922+0000 7fae6e5e6700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae680b3db0 con 0x7fae6806a820 2023-10-16T12:59:31.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.922+0000 7fae6e5e6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae680c6800 con 0x7fae680cdd30 2023-10-16T12:59:31.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.922+0000 7fae6e5e6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae681f7230 con 0x7fae6806b370 2023-10-16T12:59:31.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.922+0000 7fae67fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fae6806a820 0x7fae68155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:31.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.922+0000 7fae67fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fae6806a820 0x7fae68155200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54402/0 (socket says 172.21.15.124:54402) 2023-10-16T12:59:31.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.922+0000 7fae67fff700 1 -- 172.21.15.124:0/3359772397 learned_addr learned my addr 172.21.15.124:0/3359772397 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:31.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.922+0000 7fae677fe700 1 --2- 172.21.15.124:0/3359772397 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae6806b370 0x7fae680c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:31.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.922+0000 7fae6cb83700 1 --2- 172.21.15.124:0/3359772397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae680cdd30 0x7fae681f6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:31.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.922+0000 7fae67fff700 1 -- 172.21.15.124:0/3359772397 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae6806b370 msgr2=0x7fae680c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:31.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.922+0000 7fae67fff700 1 --2- 172.21.15.124:0/3359772397 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae6806b370 0x7fae680c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.922+0000 7fae67fff700 1 -- 172.21.15.124:0/3359772397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae680cdd30 msgr2=0x7fae681f6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:31.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.922+0000 7fae67fff700 1 --2- 172.21.15.124:0/3359772397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae680cdd30 0x7fae681f6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:31.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.922+0000 7fae67fff700 1 -- 172.21.15.124:0/3359772397 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae58009550 con 0x7fae6806a820 2023-10-16T12:59:31.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.922+0000 7fae67fff700 1 --2- 172.21.15.124:0/3359772397 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fae6806a820 0x7fae68155200 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fae5000c4d0 tx=0x7fae5000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:31.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.922+0000 7fae64ff9700 1 -- 172.21.15.124:0/3359772397 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae50011790 con 0x7fae6806a820 2023-10-16T12:59:31.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.922+0000 7fae64ff9700 1 -- 172.21.15.124:0/3359772397 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae500118f0 con 0x7fae6806a820 2023-10-16T12:59:31.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.922+0000 7fae6e5e6700 1 -- 172.21.15.124:0/3359772397 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae680b5e20 con 0x7fae6806a820 2023-10-16T12:59:31.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.922+0000 7fae64ff9700 1 -- 172.21.15.124:0/3359772397 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae50011ca0 con 0x7fae6806a820 2023-10-16T12:59:31.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.922+0000 7fae6e5e6700 1 -- 172.21.15.124:0/3359772397 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae681f6860 con 0x7fae6806a820 2023-10-16T12:59:31.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.923+0000 7fae6e5e6700 1 -- 172.21.15.124:0/3359772397 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae68072d10 con 0x7fae6806a820 2023-10-16T12:59:31.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.924+0000 7fae64ff9700 1 -- 172.21.15.124:0/3359772397 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fae5001c460 con 0x7fae6806a820 2023-10-16T12:59:31.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.924+0000 7fae64ff9700 1 --2- 172.21.15.124:0/3359772397 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fae4806af30 0x7fae4806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:31.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.924+0000 7fae64ff9700 1 -- 172.21.15.124:0/3359772397 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fae500895c0 con 0x7fae6806a820 2023-10-16T12:59:31.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.924+0000 7fae677fe700 1 --2- 172.21.15.124:0/3359772397 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fae4806af30 0x7fae4806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:31.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.925+0000 7fae677fe700 1 --2- 172.21.15.124:0/3359772397 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fae4806af30 0x7fae4806d3f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fae580098f0 tx=0x7fae58008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:31.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:31.929+0000 7fae64ff9700 1 -- 172.21.15.124:0/3359772397 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fae50054380 con 0x7fae6806a820 2023-10-16T12:59:32.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.119+0000 7fae6e5e6700 1 -- 172.21.15.124:0/3359772397 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fae6804ebb0 con 0x7fae6806a820 2023-10-16T12:59:32.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.119+0000 7fae64ff9700 1 -- 172.21.15.124:0/3359772397 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fae500579a0 con 0x7fae6806a820 2023-10-16T12:59:32.122 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:32.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.121+0000 7fae6e5e6700 1 -- 172.21.15.124:0/3359772397 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fae4806af30 msgr2=0x7fae4806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:32.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.121+0000 7fae6e5e6700 1 --2- 172.21.15.124:0/3359772397 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fae4806af30 0x7fae4806d3f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fae580098f0 tx=0x7fae58008030 comp rx=0 tx=0).stop 2023-10-16T12:59:32.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.121+0000 7fae6e5e6700 1 -- 172.21.15.124:0/3359772397 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fae6806a820 msgr2=0x7fae68155200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:32.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.121+0000 7fae6e5e6700 1 --2- 172.21.15.124:0/3359772397 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fae6806a820 0x7fae68155200 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fae5000c4d0 tx=0x7fae5000c7e0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.121+0000 7fae6e5e6700 1 -- 172.21.15.124:0/3359772397 shutdown_connections 2023-10-16T12:59:32.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.121+0000 7fae6e5e6700 1 --2- 172.21.15.124:0/3359772397 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fae4806af30 0x7fae4806d3f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.121+0000 7fae6e5e6700 1 --2- 172.21.15.124:0/3359772397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae680cdd30 0x7fae681f6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.121+0000 7fae6e5e6700 1 --2- 172.21.15.124:0/3359772397 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fae6806a820 0x7fae68155200 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.121+0000 7fae6e5e6700 1 --2- 172.21.15.124:0/3359772397 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae6806b370 0x7fae680c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.121+0000 7fae6e5e6700 1 -- 172.21.15.124:0/3359772397 >> 172.21.15.124:0/3359772397 conn(0x7fae680ccbe0 msgr2=0x7fae680ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:32.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.121+0000 7fae6e5e6700 1 -- 172.21.15.124:0/3359772397 shutdown_connections 2023-10-16T12:59:32.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.121+0000 7fae6e5e6700 1 -- 172.21.15.124:0/3359772397 wait complete. 2023-10-16T12:59:32.136 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T12:59:32.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.257+0000 7f1ffff69700 1 Processor -- start 2023-10-16T12:59:32.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.257+0000 7f1ffff69700 1 -- start start 2023-10-16T12:59:32.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.258+0000 7f1ffff69700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ff815da20 0x7f1ff80caca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:32.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.258+0000 7f1ffff69700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1ff80cb1e0 0x7f1ff80ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:32.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.258+0000 7f1ffff69700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff815de00 con 0x7f1ff8066940 2023-10-16T12:59:32.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.258+0000 7f1ffff69700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff80cc1e0 con 0x7f1ff80cb1e0 2023-10-16T12:59:32.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.258+0000 7f1ffff69700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff80cb660 con 0x7f1ff815da20 2023-10-16T12:59:32.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.258+0000 7f1ffdd05700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ff815da20 0x7f1ff80caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:32.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.258+0000 7f1ffd504700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1ff80cb1e0 0x7f1ff80ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:32.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.258+0000 7f1ffdd05700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ff815da20 0x7f1ff80caca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:40488/0 (socket says 172.21.15.124:40488) 2023-10-16T12:59:32.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.258+0000 7f1ffdd05700 1 -- 172.21.15.124:0/3817646962 learned_addr learned my addr 172.21.15.124:0/3817646962 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:32.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.258+0000 7f1ffdd05700 1 -- 172.21.15.124:0/3817646962 >> v2:172.21.15.192:3300/0 conn(0x7f1ff80cb1e0 msgr2=0x7f1ff80ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:32.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.258+0000 7f1ffdd05700 1 --2- 172.21.15.124:0/3817646962 >> v2:172.21.15.192:3300/0 conn(0x7f1ff80cb1e0 0x7f1ff80ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.258+0000 7f1ffdd05700 1 -- 172.21.15.124:0/3817646962 >> v1:172.21.15.192:6789/0 conn(0x7f1ff8066940 legacy=0x7f1ff815e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:32.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.258+0000 7f1ffdd05700 1 -- 172.21.15.124:0/3817646962 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff80cb940 con 0x7f1ff815da20 2023-10-16T12:59:32.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.258+0000 7f1ffd504700 1 --2- 172.21.15.124:0/3817646962 >> v2:172.21.15.192:3300/0 conn(0x7f1ff80cb1e0 0x7f1ff80ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:59:32.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.259+0000 7f1ffdd05700 1 --2- 172.21.15.124:0/3817646962 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ff815da20 0x7f1ff80caca0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1ff40098f0 tx=0x7f1ff4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97f525badf2e0078 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:32.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.259+0000 7f1ffcd03700 1 -- 172.21.15.124:0/3817646962 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4011830 con 0x7f1ff815da20 2023-10-16T12:59:32.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.259+0000 7f1ffcd03700 1 -- 172.21.15.124:0/3817646962 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff4011990 con 0x7f1ff815da20 2023-10-16T12:59:32.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.259+0000 7f1ffcd03700 1 -- 172.21.15.124:0/3817646962 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4011d20 con 0x7f1ff815da20 2023-10-16T12:59:32.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.259+0000 7f1ffff69700 1 -- 172.21.15.124:0/3817646962 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ff815da20 msgr2=0x7f1ff80caca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:32.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.259+0000 7f1ffff69700 1 --2- 172.21.15.124:0/3817646962 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ff815da20 0x7f1ff80caca0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1ff40098f0 tx=0x7f1ff4009c00 comp rx=0 tx=0).stop 2023-10-16T12:59:32.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.259+0000 7f1ffff69700 1 -- 172.21.15.124:0/3817646962 shutdown_connections 2023-10-16T12:59:32.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.259+0000 7f1ffff69700 1 --2- 172.21.15.124:0/3817646962 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ff815da20 0x7f1ff80caca0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.259+0000 7f1ffff69700 1 --2- 172.21.15.124:0/3817646962 >> v2:172.21.15.192:3300/0 conn(0x7f1ff80cb1e0 0x7f1ff80ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.259+0000 7f1ffff69700 1 -- 172.21.15.124:0/3817646962 >> 172.21.15.124:0/3817646962 conn(0x7f1ff80b13e0 msgr2=0x7f1ff80b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:32.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.259+0000 7f1ffff69700 1 -- 172.21.15.124:0/3817646962 shutdown_connections 2023-10-16T12:59:32.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.259+0000 7f1ffff69700 1 -- 172.21.15.124:0/3817646962 wait complete. 2023-10-16T12:59:32.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.260+0000 7f1ffff69700 1 Processor -- start 2023-10-16T12:59:32.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.261+0000 7f1ffff69700 1 -- start start 2023-10-16T12:59:32.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.261+0000 7f1ffff69700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ff8066940 0x7f1ff80aca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:32.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.261+0000 7f1ffff69700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ff80cb1e0 0x7f1ff80c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:32.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.261+0000 7f1ffff69700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1ff815da20 0x7f1ff80af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:32.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.261+0000 7f1ffff69700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff80acfd0 con 0x7f1ff815da20 2023-10-16T12:59:32.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.261+0000 7f1ffff69700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff80ad1e0 con 0x7f1ff8066940 2023-10-16T12:59:32.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.261+0000 7f1ffff69700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff80ad4c0 con 0x7f1ff80cb1e0 2023-10-16T12:59:32.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.261+0000 7f1ffe506700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1ff815da20 0x7f1ff80af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:32.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.261+0000 7f1ffe506700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1ff815da20 0x7f1ff80af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54418/0 (socket says 172.21.15.124:54418) 2023-10-16T12:59:32.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.261+0000 7f1ffe506700 1 -- 172.21.15.124:0/1415652615 learned_addr learned my addr 172.21.15.124:0/1415652615 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:32.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.262+0000 7f1ffdd05700 1 --2- 172.21.15.124:0/1415652615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ff8066940 0x7f1ff80aca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:32.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.262+0000 7f1ffd504700 1 --2- 172.21.15.124:0/1415652615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ff80cb1e0 0x7f1ff80c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:32.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.262+0000 7f1ffe506700 1 -- 172.21.15.124:0/1415652615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ff80cb1e0 msgr2=0x7f1ff80c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:32.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.262+0000 7f1ffe506700 1 --2- 172.21.15.124:0/1415652615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ff80cb1e0 0x7f1ff80c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.262+0000 7f1ffe506700 1 -- 172.21.15.124:0/1415652615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ff8066940 msgr2=0x7f1ff80aca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:32.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.262+0000 7f1ffe506700 1 --2- 172.21.15.124:0/1415652615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ff8066940 0x7f1ff80aca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.262+0000 7f1ffe506700 1 -- 172.21.15.124:0/1415652615 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe80094a0 con 0x7f1ff815da20 2023-10-16T12:59:32.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.262+0000 7f1ffe506700 1 --2- 172.21.15.124:0/1415652615 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1ff815da20 0x7f1ff80af250 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000cc50 tx=0x7f1ff000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:32.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.262+0000 7f1fee7fc700 1 -- 172.21.15.124:0/1415652615 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff000ad80 con 0x7f1ff815da20 2023-10-16T12:59:32.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.262+0000 7f1fee7fc700 1 -- 172.21.15.124:0/1415652615 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff000ce50 con 0x7f1ff815da20 2023-10-16T12:59:32.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.262+0000 7f1fee7fc700 1 -- 172.21.15.124:0/1415652615 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0003c40 con 0x7f1ff815da20 2023-10-16T12:59:32.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.262+0000 7f1ffff69700 1 -- 172.21.15.124:0/1415652615 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff4009550 con 0x7f1ff815da20 2023-10-16T12:59:32.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.262+0000 7f1ffff69700 1 -- 172.21.15.124:0/1415652615 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff80ada80 con 0x7f1ff815da20 2023-10-16T12:59:32.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.263+0000 7f1ffff69700 1 -- 172.21.15.124:0/1415652615 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff804ebb0 con 0x7f1ff815da20 2023-10-16T12:59:32.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.263+0000 7f1fee7fc700 1 -- 172.21.15.124:0/1415652615 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1ff00050d0 con 0x7f1ff815da20 2023-10-16T12:59:32.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.264+0000 7f1fee7fc700 1 --2- 172.21.15.124:0/1415652615 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1fdc06af00 0x7f1fdc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:32.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.264+0000 7f1fee7fc700 1 -- 172.21.15.124:0/1415652615 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1ff0089950 con 0x7f1ff815da20 2023-10-16T12:59:32.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.264+0000 7f1ffdd05700 1 --2- 172.21.15.124:0/1415652615 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1fdc06af00 0x7f1fdc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:32.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.264+0000 7f1ffdd05700 1 --2- 172.21.15.124:0/1415652615 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1fdc06af00 0x7f1fdc06d3c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4014040 tx=0x7f1ff4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:32.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.268+0000 7f1fee7fc700 1 -- 172.21.15.124:0/1415652615 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1ff00547a0 con 0x7f1ff815da20 2023-10-16T12:59:32.460 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.458+0000 7f1ffff69700 1 -- 172.21.15.124:0/1415652615 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1ff806c140 con 0x7f1ff815da20 2023-10-16T12:59:32.461 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.459+0000 7f1fee7fc700 1 -- 172.21.15.124:0/1415652615 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1ff0057dc0 con 0x7f1ff815da20 2023-10-16T12:59:32.462 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2023-10-16T12:59:32.464 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.461+0000 7f1ffff69700 1 -- 172.21.15.124:0/1415652615 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1fdc06af00 msgr2=0x7f1fdc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:32.464 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.461+0000 7f1ffff69700 1 --2- 172.21.15.124:0/1415652615 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1fdc06af00 0x7f1fdc06d3c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4014040 tx=0x7f1ff4008030 comp rx=0 tx=0).stop 2023-10-16T12:59:32.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.461+0000 7f1ffff69700 1 -- 172.21.15.124:0/1415652615 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1ff815da20 msgr2=0x7f1ff80af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:32.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.461+0000 7f1ffff69700 1 --2- 172.21.15.124:0/1415652615 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1ff815da20 0x7f1ff80af250 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000cc50 tx=0x7f1ff000a340 comp rx=0 tx=0).stop 2023-10-16T12:59:32.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.461+0000 7f1ffff69700 1 -- 172.21.15.124:0/1415652615 shutdown_connections 2023-10-16T12:59:32.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.461+0000 7f1ffff69700 1 --2- 172.21.15.124:0/1415652615 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1fdc06af00 0x7f1fdc06d3c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.461+0000 7f1ffff69700 1 --2- 172.21.15.124:0/1415652615 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1ff815da20 0x7f1ff80af250 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.461+0000 7f1ffff69700 1 --2- 172.21.15.124:0/1415652615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ff8066940 0x7f1ff80aca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.461+0000 7f1ffff69700 1 --2- 172.21.15.124:0/1415652615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ff80cb1e0 0x7f1ff80c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.461+0000 7f1ffff69700 1 -- 172.21.15.124:0/1415652615 >> 172.21.15.124:0/1415652615 conn(0x7f1ff80b13e0 msgr2=0x7f1ff815d010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:32.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.461+0000 7f1ffff69700 1 -- 172.21.15.124:0/1415652615 shutdown_connections 2023-10-16T12:59:32.467 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.461+0000 7f1ffff69700 1 -- 172.21.15.124:0/1415652615 wait complete. 2023-10-16T12:59:32.476 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T12:59:32.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.596+0000 7fb3bb831700 1 Processor -- start 2023-10-16T12:59:32.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.597+0000 7fb3bb831700 1 -- start start 2023-10-16T12:59:32.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.597+0000 7fb3bb831700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb3b406bd30 0x7fb3b40cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:32.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.597+0000 7fb3bb831700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b4159f30 con 0x7fb3b4159b50 2023-10-16T12:59:32.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.597+0000 7fb3bb831700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b40ce6d0 con 0x7fb3b40ce280 2023-10-16T12:59:32.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.597+0000 7fb3bb831700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3b406c1e0 con 0x7fb3b406bd30 2023-10-16T12:59:32.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.597+0000 7fb3b95cd700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fb3b4159b50 0x7fb3b406e310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43092/0 (socket says 172.21.15.124:43092) 2023-10-16T12:59:32.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.597+0000 7fb3b95cd700 1 -- 172.21.15.124:0/3901274774 learned_addr learned my addr 172.21.15.124:0/3901274774 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:32.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3b8dcc700 1 --2- 172.21.15.124:0/3901274774 >> v2:172.21.15.192:3300/0 conn(0x7fb3b406bd30 0x7fb3b40cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:32.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3a7fff700 1 -- 172.21.15.124:0/3901274774 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194595442 0 0) 0x7fb3b4159f30 con 0x7fb3b4159b50 2023-10-16T12:59:32.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3a7fff700 1 -- 172.21.15.124:0/3901274774 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3a00035b0 con 0x7fb3b4159b50 2023-10-16T12:59:32.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3a7fff700 1 -- 172.21.15.124:0/3901274774 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1310086466 0 0) 0x7fb3a00035b0 con 0x7fb3b4159b50 2023-10-16T12:59:32.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3a7fff700 1 -- 172.21.15.124:0/3901274774 >> v2:172.21.15.192:3300/0 conn(0x7fb3b406bd30 msgr2=0x7fb3b40cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:32.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3a7fff700 1 --2- 172.21.15.124:0/3901274774 >> v2:172.21.15.192:3300/0 conn(0x7fb3b406bd30 0x7fb3b40cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3a7fff700 1 -- 172.21.15.124:0/3901274774 >> v1:172.21.15.192:6789/0 conn(0x7fb3b40ce280 legacy=0x7fb3b40ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:32.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3a7fff700 1 -- 172.21.15.124:0/3901274774 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b406ea20 con 0x7fb3b4159b50 2023-10-16T12:59:32.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3a7fff700 1 -- 172.21.15.124:0/3901274774 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7fb3a8001670 con 0x7fb3b4159b50 2023-10-16T12:59:32.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3b8dcc700 1 --2- 172.21.15.124:0/3901274774 >> v2:172.21.15.192:3300/0 conn(0x7fb3b406bd30 0x7fb3b40cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:59:32.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3a7fff700 1 -- 172.21.15.124:0/3901274774 >> v1:172.21.15.124:6789/0 conn(0x7fb3b4159b50 legacy=0x7fb3b406e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:32.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3a7fff700 1 --2- 172.21.15.124:0/3901274774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3a0003a00 0x7fb3a0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:32.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3a7fff700 1 --2- 172.21.15.124:0/3901274774 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb3a0004850 0x7fb3a0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:32.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3a7fff700 1 --2- 172.21.15.124:0/3901274774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3a0005210 0x7fb3a000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:32.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3a7fff700 1 -- 172.21.15.124:0/3901274774 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b406c1e0 con 0x7fb3a0004850 2023-10-16T12:59:32.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3a7fff700 1 -- 172.21.15.124:0/3901274774 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a000c0b0 con 0x7fb3a0003a00 2023-10-16T12:59:32.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3a7fff700 1 -- 172.21.15.124:0/3901274774 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a000c270 con 0x7fb3a0005210 2023-10-16T12:59:32.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3b8dcc700 1 --2- 172.21.15.124:0/3901274774 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb3a0004850 0x7fb3a0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:32.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3b95cd700 1 --2- 172.21.15.124:0/3901274774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3a0003a00 0x7fb3a0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:32.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3b9dce700 1 --2- 172.21.15.124:0/3901274774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3a0005210 0x7fb3a000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:32.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3b8dcc700 1 -- 172.21.15.124:0/3901274774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3a0005210 msgr2=0x7fb3a000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:32.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3b8dcc700 1 --2- 172.21.15.124:0/3901274774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3a0005210 0x7fb3a000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3b8dcc700 1 -- 172.21.15.124:0/3901274774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3a0003a00 msgr2=0x7fb3a0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:32.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3b8dcc700 1 --2- 172.21.15.124:0/3901274774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3a0003a00 0x7fb3a0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.598+0000 7fb3b8dcc700 1 -- 172.21.15.124:0/3901274774 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a00035b0 con 0x7fb3a0004850 2023-10-16T12:59:32.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.599+0000 7fb3b9dce700 1 --2- 172.21.15.124:0/3901274774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3a0005210 0x7fb3a000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:32.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.599+0000 7fb3b9dce700 1 -- 172.21.15.124:0/3901274774 reap_dead start 2023-10-16T12:59:32.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.599+0000 7fb3b8dcc700 1 --2- 172.21.15.124:0/3901274774 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb3a0004850 0x7fb3a0004cd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009d30 tx=0x7fb3a0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d5a998af8c43b98 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:32.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.599+0000 7fb3a7fff700 1 -- 172.21.15.124:0/3901274774 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0009e80 con 0x7fb3a0004850 2023-10-16T12:59:32.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.599+0000 7fb3a7fff700 1 -- 172.21.15.124:0/3901274774 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b000e9a0 con 0x7fb3a0004850 2023-10-16T12:59:32.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.599+0000 7fb3a7fff700 1 -- 172.21.15.124:0/3901274774 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b000ed10 con 0x7fb3a0004850 2023-10-16T12:59:32.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.599+0000 7fb3bb831700 1 -- 172.21.15.124:0/3901274774 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb3a0004850 msgr2=0x7fb3a0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:32.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.599+0000 7fb3bb831700 1 --2- 172.21.15.124:0/3901274774 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb3a0004850 0x7fb3a0004cd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009d30 tx=0x7fb3a0005880 comp rx=0 tx=0).stop 2023-10-16T12:59:32.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.599+0000 7fb3bb831700 1 -- 172.21.15.124:0/3901274774 shutdown_connections 2023-10-16T12:59:32.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.599+0000 7fb3bb831700 1 --2- 172.21.15.124:0/3901274774 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb3a0004850 0x7fb3a0004cd0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.599+0000 7fb3bb831700 1 -- 172.21.15.124:0/3901274774 >> 172.21.15.124:0/3901274774 conn(0x7fb3b40b13e0 msgr2=0x7fb3b40b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:32.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.599+0000 7fb3bb831700 1 -- 172.21.15.124:0/3901274774 shutdown_connections 2023-10-16T12:59:32.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.599+0000 7fb3bb831700 1 -- 172.21.15.124:0/3901274774 wait complete. 2023-10-16T12:59:32.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.601+0000 7fb3bb831700 1 Processor -- start 2023-10-16T12:59:32.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.601+0000 7fb3bb831700 1 -- start start 2023-10-16T12:59:32.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.601+0000 7fb3bb831700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb3a0004850 0x7fb3b414a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:32.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.601+0000 7fb3bb831700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3b40c81b0 0x7fb3b40c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:32.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.601+0000 7fb3bb831700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3b40b49c0 0x7fb3b40b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:32.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.601+0000 7fb3bb831700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b40b53b0 con 0x7fb3a0004850 2023-10-16T12:59:32.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.601+0000 7fb3bb831700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b40c6f00 con 0x7fb3b40c81b0 2023-10-16T12:59:32.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.601+0000 7fb3bb831700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b40b4810 con 0x7fb3b40b49c0 2023-10-16T12:59:32.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.601+0000 7fb3b95cd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb3a0004850 0x7fb3b414a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:32.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.602+0000 7fb3b95cd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb3a0004850 0x7fb3b414a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54436/0 (socket says 172.21.15.124:54436) 2023-10-16T12:59:32.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.602+0000 7fb3b95cd700 1 -- 172.21.15.124:0/1052138749 learned_addr learned my addr 172.21.15.124:0/1052138749 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:32.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.602+0000 7fb3b8dcc700 1 --2- 172.21.15.124:0/1052138749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3b40c81b0 0x7fb3b40c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:32.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.602+0000 7fb3b95cd700 1 -- 172.21.15.124:0/1052138749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3b40b49c0 msgr2=0x7fb3b40b4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:32.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.602+0000 7fb3b95cd700 1 --2- 172.21.15.124:0/1052138749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3b40b49c0 0x7fb3b40b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.602+0000 7fb3b95cd700 1 -- 172.21.15.124:0/1052138749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3b40c81b0 msgr2=0x7fb3b40c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:32.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.602+0000 7fb3b95cd700 1 --2- 172.21.15.124:0/1052138749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3b40c81b0 0x7fb3b40c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.602+0000 7fb3b95cd700 1 -- 172.21.15.124:0/1052138749 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b40c7110 con 0x7fb3a0004850 2023-10-16T12:59:32.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.602+0000 7fb3b95cd700 1 --2- 172.21.15.124:0/1052138749 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb3a0004850 0x7fb3b414a6c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80017a0 tx=0x7fb3a8007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:32.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.602+0000 7fb3a5ffb700 1 -- 172.21.15.124:0/1052138749 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8001500 con 0x7fb3a0004850 2023-10-16T12:59:32.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.602+0000 7fb3a5ffb700 1 -- 172.21.15.124:0/1052138749 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a800f770 con 0x7fb3a0004850 2023-10-16T12:59:32.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.602+0000 7fb3bb831700 1 -- 172.21.15.124:0/1052138749 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b40c73f0 con 0x7fb3a0004850 2023-10-16T12:59:32.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.602+0000 7fb3a5ffb700 1 -- 172.21.15.124:0/1052138749 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a800fb20 con 0x7fb3a0004850 2023-10-16T12:59:32.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.602+0000 7fb3bb831700 1 -- 172.21.15.124:0/1052138749 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b40c79b0 con 0x7fb3a0004850 2023-10-16T12:59:32.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.603+0000 7fb3bb831700 1 -- 172.21.15.124:0/1052138749 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3b404ebb0 con 0x7fb3a0004850 2023-10-16T12:59:32.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.603+0000 7fb3a5ffb700 1 -- 172.21.15.124:0/1052138749 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb3a800fc80 con 0x7fb3a0004850 2023-10-16T12:59:32.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.604+0000 7fb3a5ffb700 1 --2- 172.21.15.124:0/1052138749 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb39806af00 0x7fb39806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:32.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.604+0000 7fb3b8dcc700 1 --2- 172.21.15.124:0/1052138749 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb39806af00 0x7fb39806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:32.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.604+0000 7fb3a5ffb700 1 -- 172.21.15.124:0/1052138749 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb3a8089880 con 0x7fb3a0004850 2023-10-16T12:59:32.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.604+0000 7fb3b8dcc700 1 --2- 172.21.15.124:0/1052138749 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb39806af00 0x7fb39806d3c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb3b00090b0 tx=0x7fb3b001e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:32.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.608+0000 7fb3a5ffb700 1 -- 172.21.15.124:0/1052138749 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb3a80546d0 con 0x7fb3a0004850 2023-10-16T12:59:32.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.799+0000 7fb3bb831700 1 -- 172.21.15.124:0/1052138749 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb3b406cae0 con 0x7fb3a0004850 2023-10-16T12:59:32.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.799+0000 7fb3a5ffb700 1 -- 172.21.15.124:0/1052138749 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb3a8057cf0 con 0x7fb3a0004850 2023-10-16T12:59:32.802 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:32.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.801+0000 7fb3bb831700 1 -- 172.21.15.124:0/1052138749 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb39806af00 msgr2=0x7fb39806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:32.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.801+0000 7fb3bb831700 1 --2- 172.21.15.124:0/1052138749 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb39806af00 0x7fb39806d3c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb3b00090b0 tx=0x7fb3b001e040 comp rx=0 tx=0).stop 2023-10-16T12:59:32.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.801+0000 7fb3bb831700 1 -- 172.21.15.124:0/1052138749 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb3a0004850 msgr2=0x7fb3b414a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:32.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.801+0000 7fb3bb831700 1 --2- 172.21.15.124:0/1052138749 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb3a0004850 0x7fb3b414a6c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80017a0 tx=0x7fb3a8007620 comp rx=0 tx=0).stop 2023-10-16T12:59:32.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.801+0000 7fb3bb831700 1 -- 172.21.15.124:0/1052138749 shutdown_connections 2023-10-16T12:59:32.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.801+0000 7fb3bb831700 1 --2- 172.21.15.124:0/1052138749 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb39806af00 0x7fb39806d3c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.801+0000 7fb3bb831700 1 --2- 172.21.15.124:0/1052138749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3b40b49c0 0x7fb3b40b4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.801+0000 7fb3bb831700 1 --2- 172.21.15.124:0/1052138749 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb3a0004850 0x7fb3b414a6c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.801+0000 7fb3bb831700 1 --2- 172.21.15.124:0/1052138749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3b40c81b0 0x7fb3b40c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.801+0000 7fb3bb831700 1 -- 172.21.15.124:0/1052138749 >> 172.21.15.124:0/1052138749 conn(0x7fb3b40b13e0 msgr2=0x7fb3b40ae960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:32.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.801+0000 7fb3bb831700 1 -- 172.21.15.124:0/1052138749 shutdown_connections 2023-10-16T12:59:32.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.801+0000 7fb3bb831700 1 -- 172.21.15.124:0/1052138749 wait complete. 2023-10-16T12:59:32.816 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:59:32.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.933+0000 7f3d8c894700 1 Processor -- start 2023-10-16T12:59:32.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.933+0000 7f3d8c894700 1 -- start start 2023-10-16T12:59:32.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.934+0000 7f3d8c894700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3d8806a820 0x7f3d880cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:32.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.934+0000 7f3d8c894700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3d880ca7d0 0x7f3d88071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:32.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.934+0000 7f3d8c894700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d880cfeb0 con 0x7f3d8815e7f0 2023-10-16T12:59:32.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.934+0000 7f3d8c894700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d880ce410 con 0x7f3d8806a820 2023-10-16T12:59:32.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.934+0000 7f3d8c894700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d8815ec50 con 0x7f3d880ca7d0 2023-10-16T12:59:32.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.934+0000 7f3d8659c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3d8806a820 0x7f3d880cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:32.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.934+0000 7f3d8659c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3d8806a820 0x7f3d880cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54446/0 (socket says 172.21.15.124:54446) 2023-10-16T12:59:32.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.934+0000 7f3d85d9b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f3d8815e7f0 0x7f3d8806ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43112/0 (socket says 172.21.15.124:43112) 2023-10-16T12:59:32.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.934+0000 7f3d8659c700 1 -- 172.21.15.124:0/408147079 learned_addr learned my addr 172.21.15.124:0/408147079 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:32.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.934+0000 7f3d86d9d700 1 --2- 172.21.15.124:0/408147079 >> v2:172.21.15.192:3300/0 conn(0x7f3d880ca7d0 0x7f3d88071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:32.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.934+0000 7f3d8659c700 1 -- 172.21.15.124:0/408147079 >> v2:172.21.15.192:3300/0 conn(0x7f3d880ca7d0 msgr2=0x7f3d88071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:32.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.934+0000 7f3d8659c700 1 --2- 172.21.15.124:0/408147079 >> v2:172.21.15.192:3300/0 conn(0x7f3d880ca7d0 0x7f3d88071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.934+0000 7f3d8659c700 1 -- 172.21.15.124:0/408147079 >> v1:172.21.15.124:6789/0 conn(0x7f3d8815e7f0 legacy=0x7f3d8806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:32.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.934+0000 7f3d8559a700 1 -- 172.21.15.124:0/408147079 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040594443 0 0) 0x7f3d880cfeb0 con 0x7f3d8815e7f0 2023-10-16T12:59:32.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.934+0000 7f3d8659c700 1 -- 172.21.15.124:0/408147079 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d880af9d0 con 0x7f3d8806a820 2023-10-16T12:59:32.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.934+0000 7f3d86d9d700 1 --2- 172.21.15.124:0/408147079 >> v2:172.21.15.192:3300/0 conn(0x7f3d880ca7d0 0x7f3d88071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:32.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.935+0000 7f3d8659c700 1 --2- 172.21.15.124:0/408147079 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d8806a820 0x7f3d880cf7d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3d880b2cb0 tx=0x7f3d7c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e5665d39b27919 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:32.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.935+0000 7f3d8559a700 1 -- 172.21.15.124:0/408147079 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c00b870 con 0x7f3d8806a820 2023-10-16T12:59:32.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.935+0000 7f3d8559a700 1 -- 172.21.15.124:0/408147079 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7c00b9d0 con 0x7f3d8806a820 2023-10-16T12:59:32.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.935+0000 7f3d8559a700 1 -- 172.21.15.124:0/408147079 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c00bd60 con 0x7f3d8806a820 2023-10-16T12:59:32.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.935+0000 7f3d8c894700 1 -- 172.21.15.124:0/408147079 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d8806a820 msgr2=0x7f3d880cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:32.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.935+0000 7f3d8c894700 1 --2- 172.21.15.124:0/408147079 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d8806a820 0x7f3d880cf7d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3d880b2cb0 tx=0x7f3d7c009bd0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.935+0000 7f3d8c894700 1 -- 172.21.15.124:0/408147079 shutdown_connections 2023-10-16T12:59:32.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.935+0000 7f3d8c894700 1 --2- 172.21.15.124:0/408147079 >> v2:172.21.15.192:3300/0 conn(0x7f3d880ca7d0 0x7f3d88071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.935+0000 7f3d8c894700 1 --2- 172.21.15.124:0/408147079 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d8806a820 0x7f3d880cf7d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.935+0000 7f3d8c894700 1 -- 172.21.15.124:0/408147079 >> 172.21.15.124:0/408147079 conn(0x7f3d880d0180 msgr2=0x7f3d880d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:32.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.935+0000 7f3d8c894700 1 -- 172.21.15.124:0/408147079 shutdown_connections 2023-10-16T12:59:32.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.935+0000 7f3d8c894700 1 -- 172.21.15.124:0/408147079 wait complete. 2023-10-16T12:59:32.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.937+0000 7f3d8c894700 1 Processor -- start 2023-10-16T12:59:32.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.937+0000 7f3d8c894700 1 -- start start 2023-10-16T12:59:32.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.937+0000 7f3d8c894700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d8806a820 0x7f3d88155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:32.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.937+0000 7f3d8c894700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d880ca7d0 0x7f3d88155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:32.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.937+0000 7f3d8c894700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d8815e7f0 0x7f3d880aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:32.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.938+0000 7f3d8c894700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d881f64a0 con 0x7f3d8815e7f0 2023-10-16T12:59:32.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.938+0000 7f3d8c894700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d881f6780 con 0x7f3d880ca7d0 2023-10-16T12:59:32.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.938+0000 7f3d8c894700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d881f6a60 con 0x7f3d8806a820 2023-10-16T12:59:32.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.938+0000 7f3d86d9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d8815e7f0 0x7f3d880aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:32.953 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.938+0000 7f3d86d9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d8815e7f0 0x7f3d880aebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54450/0 (socket says 172.21.15.124:54450) 2023-10-16T12:59:32.953 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.938+0000 7f3d86d9d700 1 -- 172.21.15.124:0/3477948634 learned_addr learned my addr 172.21.15.124:0/3477948634 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:32.953 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.938+0000 7f3d8659c700 1 --2- 172.21.15.124:0/3477948634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d8806a820 0x7f3d88155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:32.954 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.938+0000 7f3d85d9b700 1 --2- 172.21.15.124:0/3477948634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d880ca7d0 0x7f3d88155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:32.954 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.938+0000 7f3d86d9d700 1 -- 172.21.15.124:0/3477948634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d8806a820 msgr2=0x7f3d88155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:32.954 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.938+0000 7f3d86d9d700 1 --2- 172.21.15.124:0/3477948634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d8806a820 0x7f3d88155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.938+0000 7f3d86d9d700 1 -- 172.21.15.124:0/3477948634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d880ca7d0 msgr2=0x7f3d88155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:32.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.938+0000 7f3d86d9d700 1 --2- 172.21.15.124:0/3477948634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d880ca7d0 0x7f3d88155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:32.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.938+0000 7f3d86d9d700 1 -- 172.21.15.124:0/3477948634 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7c009550 con 0x7f3d8815e7f0 2023-10-16T12:59:32.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.938+0000 7f3d85d9b700 1 --2- 172.21.15.124:0/3477948634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d880ca7d0 0x7f3d88155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:32.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.938+0000 7f3d8659c700 1 --2- 172.21.15.124:0/3477948634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d8806a820 0x7f3d88155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:32.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.938+0000 7f3d86d9d700 1 --2- 172.21.15.124:0/3477948634 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d8815e7f0 0x7f3d880aebc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3d80009fa0 tx=0x7f3d8000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:32.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.938+0000 7f3d76ffd700 1 -- 172.21.15.124:0/3477948634 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d80003a70 con 0x7f3d8815e7f0 2023-10-16T12:59:32.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.938+0000 7f3d76ffd700 1 -- 172.21.15.124:0/3477948634 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8000f040 con 0x7f3d8815e7f0 2023-10-16T12:59:32.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.938+0000 7f3d8c894700 1 -- 172.21.15.124:0/3477948634 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d881f6d40 con 0x7f3d8815e7f0 2023-10-16T12:59:32.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.938+0000 7f3d76ffd700 1 -- 172.21.15.124:0/3477948634 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d80003e30 con 0x7f3d8815e7f0 2023-10-16T12:59:32.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.938+0000 7f3d8c894700 1 -- 172.21.15.124:0/3477948634 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d880af100 con 0x7f3d8815e7f0 2023-10-16T12:59:32.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.939+0000 7f3d8c894700 1 -- 172.21.15.124:0/3477948634 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d881f2dd0 con 0x7f3d8815e7f0 2023-10-16T12:59:32.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.940+0000 7f3d76ffd700 1 -- 172.21.15.124:0/3477948634 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3d80004030 con 0x7f3d8815e7f0 2023-10-16T12:59:32.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.940+0000 7f3d76ffd700 1 --2- 172.21.15.124:0/3477948634 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f3d6806af00 0x7f3d6806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:32.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.940+0000 7f3d76ffd700 1 -- 172.21.15.124:0/3477948634 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3d80089a30 con 0x7f3d8815e7f0 2023-10-16T12:59:32.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.940+0000 7f3d8659c700 1 --2- 172.21.15.124:0/3477948634 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f3d6806af00 0x7f3d6806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:32.958 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.940+0000 7f3d8659c700 1 --2- 172.21.15.124:0/3477948634 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f3d6806af00 0x7f3d6806d3c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c000c00 tx=0x7f3d7c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:32.958 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:32.944+0000 7f3d76ffd700 1 -- 172.21.15.124:0/3477948634 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3d80054880 con 0x7f3d8815e7f0 2023-10-16T12:59:33.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.134+0000 7f3d8c894700 1 -- 172.21.15.124:0/3477948634 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d8804ebb0 con 0x7f3d8815e7f0 2023-10-16T12:59:33.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.135+0000 7f3d76ffd700 1 -- 172.21.15.124:0/3477948634 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f3d8001a020 con 0x7f3d8815e7f0 2023-10-16T12:59:33.138 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:33.138 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":24,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:58:56.089767+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:59:33.140 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.137+0000 7f3d8c894700 1 -- 172.21.15.124:0/3477948634 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f3d6806af00 msgr2=0x7f3d6806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:33.140 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.137+0000 7f3d8c894700 1 --2- 172.21.15.124:0/3477948634 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f3d6806af00 0x7f3d6806d3c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c000c00 tx=0x7f3d7c008030 comp rx=0 tx=0).stop 2023-10-16T12:59:33.140 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.137+0000 7f3d8c894700 1 -- 172.21.15.124:0/3477948634 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d8815e7f0 msgr2=0x7f3d880aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:33.141 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.137+0000 7f3d8c894700 1 --2- 172.21.15.124:0/3477948634 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d8815e7f0 0x7f3d880aebc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3d80009fa0 tx=0x7f3d8000d460 comp rx=0 tx=0).stop 2023-10-16T12:59:33.141 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.137+0000 7f3d8c894700 1 -- 172.21.15.124:0/3477948634 shutdown_connections 2023-10-16T12:59:33.141 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.137+0000 7f3d8c894700 1 --2- 172.21.15.124:0/3477948634 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f3d6806af00 0x7f3d6806d3c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:33.141 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.137+0000 7f3d8c894700 1 --2- 172.21.15.124:0/3477948634 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d8815e7f0 0x7f3d880aebc0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:33.141 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.137+0000 7f3d8c894700 1 --2- 172.21.15.124:0/3477948634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d8806a820 0x7f3d88155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:33.142 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.137+0000 7f3d8c894700 1 --2- 172.21.15.124:0/3477948634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d880ca7d0 0x7f3d88155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:33.142 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.137+0000 7f3d8c894700 1 -- 172.21.15.124:0/3477948634 >> 172.21.15.124:0/3477948634 conn(0x7f3d880d0180 msgr2=0x7f3d88071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:33.142 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.137+0000 7f3d8c894700 1 -- 172.21.15.124:0/3477948634 shutdown_connections 2023-10-16T12:59:33.142 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.137+0000 7f3d8c894700 1 -- 172.21.15.124:0/3477948634 wait complete. 2023-10-16T12:59:33.153 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T12:58:38.667813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T12:58:49.562073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T12:58:50.011419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T12:58:53.692890+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T12:59:33.153 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T12:59:33.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.274+0000 7f60006df700 1 Processor -- start 2023-10-16T12:59:33.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.274+0000 7f60006df700 1 -- start start 2023-10-16T12:59:33.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.275+0000 7f60006df700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ff806a820 0x7f5ff806ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:33.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.275+0000 7f60006df700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff80cad30 con 0x7f5ff80717b0 2023-10-16T12:59:33.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.275+0000 7f60006df700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff80cb1c0 con 0x7f5ff815fd40 2023-10-16T12:59:33.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.275+0000 7f60006df700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff80ca7b0 con 0x7f5ff806a820 2023-10-16T12:59:33.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.275+0000 7f5ffdc7a700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f5ff80717b0 0x7f5ff8071c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43124/0 (socket says 172.21.15.124:43124) 2023-10-16T12:59:33.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.275+0000 7f5ffdc7a700 1 -- 172.21.15.124:0/1301466232 learned_addr learned my addr 172.21.15.124:0/1301466232 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:33.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.275+0000 7f5ffe47b700 1 --2- 172.21.15.124:0/1301466232 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ff806a820 0x7f5ff806ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:33.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.275+0000 7f5ffd479700 1 -- 172.21.15.124:0/1301466232 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434037062 0 0) 0x7f5ff80cad30 con 0x7f5ff80717b0 2023-10-16T12:59:33.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.275+0000 7f5ffd479700 1 -- 172.21.15.124:0/1301466232 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fe40035b0 con 0x7f5ff80717b0 2023-10-16T12:59:33.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.276+0000 7f5ffd479700 1 -- 172.21.15.124:0/1301466232 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 209230048 0 0) 0x7f5ff80cb1c0 con 0x7f5ff815fd40 2023-10-16T12:59:33.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.276+0000 7f5ffd479700 1 -- 172.21.15.124:0/1301466232 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ff80cad30 con 0x7f5ff815fd40 2023-10-16T12:59:33.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.276+0000 7f5ffd479700 1 -- 172.21.15.124:0/1301466232 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 704271207 0 0) 0x7f5fe40035b0 con 0x7f5ff80717b0 2023-10-16T12:59:33.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.276+0000 7f5ffe47b700 1 -- 172.21.15.124:0/1301466232 >> v1:172.21.15.192:6789/0 conn(0x7f5ff815fd40 legacy=0x7f5ff8166240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:33.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.276+0000 7f5ffe47b700 1 -- 172.21.15.124:0/1301466232 >> v1:172.21.15.124:6789/0 conn(0x7f5ff80717b0 legacy=0x7f5ff8071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:33.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.276+0000 7f5ffe47b700 1 -- 172.21.15.124:0/1301466232 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff806df70 con 0x7f5ff806a820 2023-10-16T12:59:33.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.276+0000 7f5ffe47b700 1 --2- 172.21.15.124:0/1301466232 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ff806a820 0x7f5ff806ac00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8009870 tx=0x7f5fe8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fcde3edad271f7c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:33.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.276+0000 7f5ffd479700 1 -- 172.21.15.124:0/1301466232 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4001670 con 0x7f5ff806a820 2023-10-16T12:59:33.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.276+0000 7f5ffd479700 1 -- 172.21.15.124:0/1301466232 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe8004030 con 0x7f5ff806a820 2023-10-16T12:59:33.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.276+0000 7f5ffd479700 1 -- 172.21.15.124:0/1301466232 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe80043a0 con 0x7f5ff806a820 2023-10-16T12:59:33.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.276+0000 7f60006df700 1 -- 172.21.15.124:0/1301466232 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ff806a820 msgr2=0x7f5ff806ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:33.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.277+0000 7f60006df700 1 --2- 172.21.15.124:0/1301466232 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ff806a820 0x7f5ff806ac00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8009870 tx=0x7f5fe8009b80 comp rx=0 tx=0).stop 2023-10-16T12:59:33.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.277+0000 7f60006df700 1 -- 172.21.15.124:0/1301466232 shutdown_connections 2023-10-16T12:59:33.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.277+0000 7f60006df700 1 --2- 172.21.15.124:0/1301466232 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ff806a820 0x7f5ff806ac00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:33.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.277+0000 7f60006df700 1 -- 172.21.15.124:0/1301466232 >> 172.21.15.124:0/1301466232 conn(0x7f5ff80ccbe0 msgr2=0x7f5ff80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:33.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.277+0000 7f60006df700 1 -- 172.21.15.124:0/1301466232 shutdown_connections 2023-10-16T12:59:33.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.277+0000 7f60006df700 1 -- 172.21.15.124:0/1301466232 wait complete. 2023-10-16T12:59:33.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.278+0000 7f60006df700 1 Processor -- start 2023-10-16T12:59:33.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.278+0000 7f60006df700 1 -- start start 2023-10-16T12:59:33.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.279+0000 7f60006df700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5ff806a820 0x7f5ff814ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:33.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.279+0000 7f60006df700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ff80717b0 0x7f5ff80a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:33.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.279+0000 7f60006df700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ff815fd40 0x7f5ff80a89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:33.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.279+0000 7f60006df700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff814f2a0 con 0x7f5ff806a820 2023-10-16T12:59:33.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.279+0000 7f60006df700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff80b46a0 con 0x7f5ff80717b0 2023-10-16T12:59:33.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.279+0000 7f60006df700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff80b3a90 con 0x7f5ff815fd40 2023-10-16T12:59:33.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.279+0000 7f5ffe47b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5ff806a820 0x7f5ff814ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:33.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.279+0000 7f5ffe47b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5ff806a820 0x7f5ff814ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54460/0 (socket says 172.21.15.124:54460) 2023-10-16T12:59:33.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.279+0000 7f5ffe47b700 1 -- 172.21.15.124:0/3608186857 learned_addr learned my addr 172.21.15.124:0/3608186857 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:33.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.279+0000 7f5ffdc7a700 1 --2- 172.21.15.124:0/3608186857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ff80717b0 0x7f5ff80a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:33.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.279+0000 7f5ffec7c700 1 --2- 172.21.15.124:0/3608186857 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ff815fd40 0x7f5ff80a89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:33.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.279+0000 7f5ffe47b700 1 -- 172.21.15.124:0/3608186857 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ff815fd40 msgr2=0x7f5ff80a89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:33.296 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.279+0000 7f5ffe47b700 1 --2- 172.21.15.124:0/3608186857 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ff815fd40 0x7f5ff80a89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:33.296 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.279+0000 7f5ffe47b700 1 -- 172.21.15.124:0/3608186857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ff80717b0 msgr2=0x7f5ff80a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:33.296 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.279+0000 7f5ffe47b700 1 --2- 172.21.15.124:0/3608186857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ff80717b0 0x7f5ff80a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:33.296 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.279+0000 7f5ffe47b700 1 -- 172.21.15.124:0/3608186857 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe80094a0 con 0x7f5ff806a820 2023-10-16T12:59:33.297 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.279+0000 7f5ffec7c700 1 --2- 172.21.15.124:0/3608186857 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ff815fd40 0x7f5ff80a89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:33.297 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.279+0000 7f5ffe47b700 1 --2- 172.21.15.124:0/3608186857 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5ff806a820 0x7f5ff814ed60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80097c0 tx=0x7f5fe8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:33.297 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.279+0000 7f5feeffd700 1 -- 172.21.15.124:0/3608186857 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe80045b0 con 0x7f5ff806a820 2023-10-16T12:59:33.297 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.279+0000 7f5feeffd700 1 -- 172.21.15.124:0/3608186857 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe801f070 con 0x7f5ff806a820 2023-10-16T12:59:33.297 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.279+0000 7f60006df700 1 -- 172.21.15.124:0/3608186857 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff80b3d70 con 0x7f5ff806a820 2023-10-16T12:59:33.298 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.279+0000 7f5feeffd700 1 -- 172.21.15.124:0/3608186857 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8011870 con 0x7f5ff806a820 2023-10-16T12:59:33.298 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.279+0000 7f60006df700 1 -- 172.21.15.124:0/3608186857 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff80b4330 con 0x7f5ff806a820 2023-10-16T12:59:33.298 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.280+0000 7f60006df700 1 -- 172.21.15.124:0/3608186857 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff804ebb0 con 0x7f5ff806a820 2023-10-16T12:59:33.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.281+0000 7f5feeffd700 1 -- 172.21.15.124:0/3608186857 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5fe80119d0 con 0x7f5ff806a820 2023-10-16T12:59:33.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.281+0000 7f5feeffd700 1 --2- 172.21.15.124:0/3608186857 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5fdc06af00 0x7f5fdc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:33.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.281+0000 7f5feeffd700 1 -- 172.21.15.124:0/3608186857 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5fe8021070 con 0x7f5ff806a820 2023-10-16T12:59:33.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.281+0000 7f5ffdc7a700 1 --2- 172.21.15.124:0/3608186857 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5fdc06af00 0x7f5fdc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:33.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.281+0000 7f5ffdc7a700 1 --2- 172.21.15.124:0/3608186857 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5fdc06af00 0x7f5fdc06d3c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5ff80cd130 tx=0x7f5ff4001590 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:33.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.285+0000 7f5feeffd700 1 -- 172.21.15.124:0/3608186857 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5fe8056000 con 0x7f5ff806a820 2023-10-16T12:59:33.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.482+0000 7f60006df700 1 -- 172.21.15.124:0/3608186857 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ff80b44c0 con 0x7f5ff806a820 2023-10-16T12:59:33.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.482+0000 7f5feeffd700 1 -- 172.21.15.124:0/3608186857 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5fe802fe80 con 0x7f5ff806a820 2023-10-16T12:59:33.485 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-16T12:59:33.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.484+0000 7f60006df700 1 -- 172.21.15.124:0/3608186857 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5fdc06af00 msgr2=0x7f5fdc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:33.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.484+0000 7f60006df700 1 --2- 172.21.15.124:0/3608186857 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5fdc06af00 0x7f5fdc06d3c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5ff80cd130 tx=0x7f5ff4001590 comp rx=0 tx=0).stop 2023-10-16T12:59:33.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.484+0000 7f60006df700 1 -- 172.21.15.124:0/3608186857 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5ff806a820 msgr2=0x7f5ff814ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:33.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.484+0000 7f60006df700 1 --2- 172.21.15.124:0/3608186857 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5ff806a820 0x7f5ff814ed60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80097c0 tx=0x7f5fe8004750 comp rx=0 tx=0).stop 2023-10-16T12:59:33.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.484+0000 7f60006df700 1 -- 172.21.15.124:0/3608186857 shutdown_connections 2023-10-16T12:59:33.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.484+0000 7f60006df700 1 --2- 172.21.15.124:0/3608186857 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5fdc06af00 0x7f5fdc06d3c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:33.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.484+0000 7f60006df700 1 --2- 172.21.15.124:0/3608186857 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ff815fd40 0x7f5ff80a89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:33.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.484+0000 7f60006df700 1 --2- 172.21.15.124:0/3608186857 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5ff806a820 0x7f5ff814ed60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:33.489 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.484+0000 7f60006df700 1 --2- 172.21.15.124:0/3608186857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ff80717b0 0x7f5ff80a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:33.489 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.484+0000 7f60006df700 1 -- 172.21.15.124:0/3608186857 >> 172.21.15.124:0/3608186857 conn(0x7f5ff80ccbe0 msgr2=0x7f5ff815c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:33.489 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.484+0000 7f60006df700 1 -- 172.21.15.124:0/3608186857 shutdown_connections 2023-10-16T12:59:33.489 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.484+0000 7f60006df700 1 -- 172.21.15.124:0/3608186857 wait complete. 2023-10-16T12:59:33.499 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T12:59:33.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.619+0000 7f0eaf65d700 1 Processor -- start 2023-10-16T12:59:33.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.619+0000 7f0eaf65d700 1 -- start start 2023-10-16T12:59:33.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.620+0000 7f0eaf65d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0ea806bed0 0x7f0ea80ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:33.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.620+0000 7f0eaf65d700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea80cea10 con 0x7f0ea815d6b0 2023-10-16T12:59:33.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.620+0000 7f0eaf65d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea80cecf0 con 0x7f0ea80cfab0 2023-10-16T12:59:33.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.620+0000 7f0eaf65d700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea80cefd0 con 0x7f0ea806bed0 2023-10-16T12:59:33.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.620+0000 7f0eacbf8700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0ea806bed0 0x7f0ea80ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:33.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.620+0000 7f0ead3f9700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f0ea815d6b0 0x7f0ea806b7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43136/0 (socket says 172.21.15.124:43136) 2023-10-16T12:59:33.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.620+0000 7f0ead3f9700 1 -- 172.21.15.124:0/2611355932 learned_addr learned my addr 172.21.15.124:0/2611355932 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:33.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.620+0000 7f0eacbf8700 1 -- 172.21.15.124:0/2611355932 >> v1:172.21.15.192:6789/0 conn(0x7f0ea80cfab0 legacy=0x7f0ea80b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:33.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.620+0000 7f0eacbf8700 1 -- 172.21.15.124:0/2611355932 >> v1:172.21.15.124:6789/0 conn(0x7f0ea815d6b0 legacy=0x7f0ea806b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:33.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.620+0000 7f0eacbf8700 1 -- 172.21.15.124:0/2611355932 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea80cf2b0 con 0x7f0ea806bed0 2023-10-16T12:59:33.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.620+0000 7f0e9ffff700 1 -- 172.21.15.124:0/2611355932 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829395139 0 0) 0x7f0ea80cea10 con 0x7f0ea815d6b0 2023-10-16T12:59:33.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.620+0000 7f0eacbf8700 1 --2- 172.21.15.124:0/2611355932 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ea806bed0 0x7f0ea80ce380 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0e98009840 tx=0x7f0e98009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72456a0b8d564748 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:33.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.620+0000 7f0e9ffff700 1 -- 172.21.15.124:0/2611355932 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98004230 con 0x7f0ea806bed0 2023-10-16T12:59:33.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.621+0000 7f0e9ffff700 1 -- 172.21.15.124:0/2611355932 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e98004390 con 0x7f0ea806bed0 2023-10-16T12:59:33.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.621+0000 7f0e9ffff700 1 -- 172.21.15.124:0/2611355932 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e980036a0 con 0x7f0ea806bed0 2023-10-16T12:59:33.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.621+0000 7f0eaf65d700 1 -- 172.21.15.124:0/2611355932 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ea806bed0 msgr2=0x7f0ea80ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:33.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.621+0000 7f0eaf65d700 1 --2- 172.21.15.124:0/2611355932 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ea806bed0 0x7f0ea80ce380 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0e98009840 tx=0x7f0e98009b50 comp rx=0 tx=0).stop 2023-10-16T12:59:33.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.621+0000 7f0eaf65d700 1 -- 172.21.15.124:0/2611355932 shutdown_connections 2023-10-16T12:59:33.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.621+0000 7f0eaf65d700 1 --2- 172.21.15.124:0/2611355932 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ea806bed0 0x7f0ea80ce380 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:33.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.621+0000 7f0eaf65d700 1 -- 172.21.15.124:0/2611355932 >> 172.21.15.124:0/2611355932 conn(0x7f0ea8072340 msgr2=0x7f0ea8072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:33.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.621+0000 7f0eaf65d700 1 -- 172.21.15.124:0/2611355932 shutdown_connections 2023-10-16T12:59:33.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.621+0000 7f0eaf65d700 1 -- 172.21.15.124:0/2611355932 wait complete. 2023-10-16T12:59:33.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.622+0000 7f0eaf65d700 1 Processor -- start 2023-10-16T12:59:33.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.622+0000 7f0eaf65d700 1 -- start start 2023-10-16T12:59:33.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.623+0000 7f0eaf65d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ea806bed0 0x7f0ea8159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:33.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.623+0000 7f0eaf65d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ea80cfab0 0x7f0ea80cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:33.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.623+0000 7f0eaf65d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ea815d6b0 0x7f0ea80ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:33.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.623+0000 7f0eaf65d700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea8160af0 con 0x7f0ea80cfab0 2023-10-16T12:59:33.632 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.623+0000 7f0eaf65d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea8153320 con 0x7f0ea806bed0 2023-10-16T12:59:33.632 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.623+0000 7f0eaf65d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea81f2bf0 con 0x7f0ea815d6b0 2023-10-16T12:59:33.632 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.623+0000 7f0eacbf8700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ea80cfab0 0x7f0ea80cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:33.632 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.623+0000 7f0eacbf8700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ea80cfab0 0x7f0ea80cc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54476/0 (socket says 172.21.15.124:54476) 2023-10-16T12:59:33.632 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.623+0000 7f0eacbf8700 1 -- 172.21.15.124:0/590742966 learned_addr learned my addr 172.21.15.124:0/590742966 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:33.633 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.623+0000 7f0eadbfa700 1 --2- 172.21.15.124:0/590742966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ea815d6b0 0x7f0ea80ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:33.633 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.623+0000 7f0ead3f9700 1 --2- 172.21.15.124:0/590742966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ea806bed0 0x7f0ea8159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:33.633 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.624+0000 7f0eacbf8700 1 -- 172.21.15.124:0/590742966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ea815d6b0 msgr2=0x7f0ea80ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:33.633 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.624+0000 7f0eacbf8700 1 --2- 172.21.15.124:0/590742966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ea815d6b0 0x7f0ea80ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:33.633 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.624+0000 7f0eacbf8700 1 -- 172.21.15.124:0/590742966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ea806bed0 msgr2=0x7f0ea8159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:33.634 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.624+0000 7f0eacbf8700 1 --2- 172.21.15.124:0/590742966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ea806bed0 0x7f0ea8159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:33.634 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.624+0000 7f0eacbf8700 1 -- 172.21.15.124:0/590742966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e980094a0 con 0x7f0ea80cfab0 2023-10-16T12:59:33.634 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.624+0000 7f0eacbf8700 1 --2- 172.21.15.124:0/590742966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ea80cfab0 0x7f0ea80cc8a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0e98009f50 tx=0x7f0e98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:33.634 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.624+0000 7f0e9dffb700 1 -- 172.21.15.124:0/590742966 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98003e20 con 0x7f0ea80cfab0 2023-10-16T12:59:33.634 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.624+0000 7f0e9dffb700 1 -- 172.21.15.124:0/590742966 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9801e070 con 0x7f0ea80cfab0 2023-10-16T12:59:33.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.624+0000 7f0eaf65d700 1 -- 172.21.15.124:0/590742966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea815a030 con 0x7f0ea80cfab0 2023-10-16T12:59:33.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.624+0000 7f0e9dffb700 1 -- 172.21.15.124:0/590742966 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98011850 con 0x7f0ea80cfab0 2023-10-16T12:59:33.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.624+0000 7f0eaf65d700 1 -- 172.21.15.124:0/590742966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea80cb9a0 con 0x7f0ea80cfab0 2023-10-16T12:59:33.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.625+0000 7f0eaf65d700 1 -- 172.21.15.124:0/590742966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea81f3040 con 0x7f0ea80cfab0 2023-10-16T12:59:33.637 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.626+0000 7f0e9dffb700 1 -- 172.21.15.124:0/590742966 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0e980119b0 con 0x7f0ea80cfab0 2023-10-16T12:59:33.637 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.626+0000 7f0e9dffb700 1 --2- 172.21.15.124:0/590742966 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f0e8c06af00 0x7f0e8c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:33.637 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.626+0000 7f0ead3f9700 1 --2- 172.21.15.124:0/590742966 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f0e8c06af00 0x7f0e8c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:33.637 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.626+0000 7f0e9dffb700 1 -- 172.21.15.124:0/590742966 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f0e9808a970 con 0x7f0ea80cfab0 2023-10-16T12:59:33.637 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.626+0000 7f0ead3f9700 1 --2- 172.21.15.124:0/590742966 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f0e8c06af00 0x7f0e8c06d3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4000f60 tx=0x7f0ea4007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:33.638 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.630+0000 7f0e9dffb700 1 -- 172.21.15.124:0/590742966 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0e980556f0 con 0x7f0ea80cfab0 2023-10-16T12:59:33.824 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.821+0000 7f0eaf65d700 1 -- 172.21.15.124:0/590742966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0ea80cb9a0 con 0x7f0ea80cfab0 2023-10-16T12:59:33.825 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.822+0000 7f0e9dffb700 1 -- 172.21.15.124:0/590742966 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0e98020020 con 0x7f0ea80cfab0 2023-10-16T12:59:33.825 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:33.827 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.824+0000 7f0eaf65d700 1 -- 172.21.15.124:0/590742966 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f0e8c06af00 msgr2=0x7f0e8c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:33.827 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.824+0000 7f0eaf65d700 1 --2- 172.21.15.124:0/590742966 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f0e8c06af00 0x7f0e8c06d3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4000f60 tx=0x7f0ea4007e70 comp rx=0 tx=0).stop 2023-10-16T12:59:33.827 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.824+0000 7f0eaf65d700 1 -- 172.21.15.124:0/590742966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ea80cfab0 msgr2=0x7f0ea80cc8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:33.827 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.824+0000 7f0eaf65d700 1 --2- 172.21.15.124:0/590742966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ea80cfab0 0x7f0ea80cc8a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0e98009f50 tx=0x7f0e98004750 comp rx=0 tx=0).stop 2023-10-16T12:59:33.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.824+0000 7f0eaf65d700 1 -- 172.21.15.124:0/590742966 shutdown_connections 2023-10-16T12:59:33.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.824+0000 7f0eaf65d700 1 --2- 172.21.15.124:0/590742966 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f0e8c06af00 0x7f0e8c06d3c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:33.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.824+0000 7f0eaf65d700 1 --2- 172.21.15.124:0/590742966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ea815d6b0 0x7f0ea80ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:33.828 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.824+0000 7f0eaf65d700 1 --2- 172.21.15.124:0/590742966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ea806bed0 0x7f0ea8159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:33.829 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.824+0000 7f0eaf65d700 1 --2- 172.21.15.124:0/590742966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ea80cfab0 0x7f0ea80cc8a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:33.829 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.824+0000 7f0eaf65d700 1 -- 172.21.15.124:0/590742966 >> 172.21.15.124:0/590742966 conn(0x7f0ea8072340 msgr2=0x7f0ea815c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:33.829 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.824+0000 7f0eaf65d700 1 -- 172.21.15.124:0/590742966 shutdown_connections 2023-10-16T12:59:33.830 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.824+0000 7f0eaf65d700 1 -- 172.21.15.124:0/590742966 wait complete. 2023-10-16T12:59:33.841 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T12:59:33.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.962+0000 7fda300d8700 1 Processor -- start 2023-10-16T12:59:33.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.962+0000 7fda300d8700 1 -- start start 2023-10-16T12:59:33.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.963+0000 7fda300d8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fda2806dcc0 0x7fda280cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:33.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.963+0000 7fda300d8700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda280cba90 con 0x7fda2815dec0 2023-10-16T12:59:33.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.963+0000 7fda300d8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2815ee40 con 0x7fda2815a250 2023-10-16T12:59:33.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.963+0000 7fda300d8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda280cb510 con 0x7fda2806dcc0 2023-10-16T12:59:33.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.963+0000 7fda2d673700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fda2815dec0 0x7fda2806d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43152/0 (socket says 172.21.15.124:43152) 2023-10-16T12:59:33.970 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.963+0000 7fda2d673700 1 -- 172.21.15.124:0/1518039960 learned_addr learned my addr 172.21.15.124:0/1518039960 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:33.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2ce72700 1 -- 172.21.15.124:0/1518039960 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 139129356 0 0) 0x7fda280cba90 con 0x7fda2815dec0 2023-10-16T12:59:33.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2ce72700 1 -- 172.21.15.124:0/1518039960 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda140035b0 con 0x7fda2815dec0 2023-10-16T12:59:33.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2e675700 1 --2- 172.21.15.124:0/1518039960 >> v2:172.21.15.192:3300/0 conn(0x7fda2806dcc0 0x7fda280cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:33.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2ce72700 1 -- 172.21.15.124:0/1518039960 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3420731260 0 0) 0x7fda140035b0 con 0x7fda2815dec0 2023-10-16T12:59:33.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2ce72700 1 -- 172.21.15.124:0/1518039960 >> v2:172.21.15.192:3300/0 conn(0x7fda2806dcc0 msgr2=0x7fda280cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:33.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2ce72700 1 --2- 172.21.15.124:0/1518039960 >> v2:172.21.15.192:3300/0 conn(0x7fda2806dcc0 0x7fda280cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:33.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2ce72700 1 -- 172.21.15.124:0/1518039960 >> v1:172.21.15.192:6789/0 conn(0x7fda2815a250 legacy=0x7fda280717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:33.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2ce72700 1 -- 172.21.15.124:0/1518039960 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2815e880 con 0x7fda2815dec0 2023-10-16T12:59:33.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2ce72700 1 -- 172.21.15.124:0/1518039960 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7fda24001670 con 0x7fda2815dec0 2023-10-16T12:59:33.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2ce72700 1 -- 172.21.15.124:0/1518039960 >> v1:172.21.15.124:6789/0 conn(0x7fda2815dec0 legacy=0x7fda2806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:33.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2ce72700 1 --2- 172.21.15.124:0/1518039960 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda14003a00 0x7fda14003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:33.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2ce72700 1 --2- 172.21.15.124:0/1518039960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda14004850 0x7fda14004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:33.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2ce72700 1 --2- 172.21.15.124:0/1518039960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda14005210 0x7fda1400dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:33.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2ce72700 1 -- 172.21.15.124:0/1518039960 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda280cb510 con 0x7fda14003a00 2023-10-16T12:59:33.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2ce72700 1 -- 172.21.15.124:0/1518039960 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1400e370 con 0x7fda14005210 2023-10-16T12:59:33.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2ce72700 1 -- 172.21.15.124:0/1518039960 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1400e530 con 0x7fda14004850 2023-10-16T12:59:33.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2de74700 1 --2- 172.21.15.124:0/1518039960 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda14003a00 0x7fda14003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:33.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2e675700 1 --2- 172.21.15.124:0/1518039960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda14005210 0x7fda1400dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:33.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2d673700 1 --2- 172.21.15.124:0/1518039960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda14004850 0x7fda14004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:33.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2de74700 1 -- 172.21.15.124:0/1518039960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda14004850 msgr2=0x7fda14004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:33.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2de74700 1 --2- 172.21.15.124:0/1518039960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda14004850 0x7fda14004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:33.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2de74700 1 -- 172.21.15.124:0/1518039960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda14005210 msgr2=0x7fda1400dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:33.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2de74700 1 --2- 172.21.15.124:0/1518039960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda14005210 0x7fda1400dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:33.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2de74700 1 -- 172.21.15.124:0/1518039960 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda140035b0 con 0x7fda14003a00 2023-10-16T12:59:33.976 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2e675700 1 --2- 172.21.15.124:0/1518039960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda14005210 0x7fda1400dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:33.976 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.964+0000 7fda2e675700 1 -- 172.21.15.124:0/1518039960 reap_dead start 2023-10-16T12:59:33.976 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.965+0000 7fda2de74700 1 --2- 172.21.15.124:0/1518039960 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda14003a00 0x7fda14003e20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fda180017c0 tx=0x7fda14005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6667dfa7417acc8f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:33.976 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.965+0000 7fda2ce72700 1 -- 172.21.15.124:0/1518039960 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda180052d0 con 0x7fda14003a00 2023-10-16T12:59:33.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.965+0000 7fda2ce72700 1 -- 172.21.15.124:0/1518039960 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda18005430 con 0x7fda14003a00 2023-10-16T12:59:33.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.965+0000 7fda2ce72700 1 -- 172.21.15.124:0/1518039960 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda180038c0 con 0x7fda14003a00 2023-10-16T12:59:33.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.965+0000 7fda300d8700 1 -- 172.21.15.124:0/1518039960 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda14003a00 msgr2=0x7fda14003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:33.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.965+0000 7fda300d8700 1 --2- 172.21.15.124:0/1518039960 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda14003a00 0x7fda14003e20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fda180017c0 tx=0x7fda14005880 comp rx=0 tx=0).stop 2023-10-16T12:59:33.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.965+0000 7fda300d8700 1 -- 172.21.15.124:0/1518039960 shutdown_connections 2023-10-16T12:59:33.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.965+0000 7fda300d8700 1 --2- 172.21.15.124:0/1518039960 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda14003a00 0x7fda14003e20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:33.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.965+0000 7fda300d8700 1 -- 172.21.15.124:0/1518039960 >> 172.21.15.124:0/1518039960 conn(0x7fda280ccbe0 msgr2=0x7fda280ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:33.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.965+0000 7fda300d8700 1 -- 172.21.15.124:0/1518039960 shutdown_connections 2023-10-16T12:59:33.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.965+0000 7fda300d8700 1 -- 172.21.15.124:0/1518039960 wait complete. 2023-10-16T12:59:33.978 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.966+0000 7fda300d8700 1 Processor -- start 2023-10-16T12:59:33.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.966+0000 7fda300d8700 1 -- start start 2023-10-16T12:59:33.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.967+0000 7fda300d8700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda14003a00 0x7fda281529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:33.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.967+0000 7fda300d8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda280ae000 0x7fda281f6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:33.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.967+0000 7fda300d8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda281f6960 0x7fda28156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:33.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.967+0000 7fda300d8700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda281f6e10 con 0x7fda14003a00 2023-10-16T12:59:33.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.967+0000 7fda300d8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda280ad2d0 con 0x7fda280ae000 2023-10-16T12:59:33.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.967+0000 7fda300d8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda280af330 con 0x7fda281f6960 2023-10-16T12:59:33.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.967+0000 7fda2de74700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda14003a00 0x7fda281529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:33.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.967+0000 7fda2de74700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda14003a00 0x7fda281529b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54494/0 (socket says 172.21.15.124:54494) 2023-10-16T12:59:33.985 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.967+0000 7fda2de74700 1 -- 172.21.15.124:0/3750914180 learned_addr learned my addr 172.21.15.124:0/3750914180 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:33.985 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.967+0000 7fda2e675700 1 --2- 172.21.15.124:0/3750914180 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda281f6960 0x7fda28156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:33.985 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.967+0000 7fda2d673700 1 --2- 172.21.15.124:0/3750914180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda280ae000 0x7fda281f6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:33.986 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.968+0000 7fda2de74700 1 -- 172.21.15.124:0/3750914180 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda281f6960 msgr2=0x7fda28156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:33.986 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.968+0000 7fda2de74700 1 --2- 172.21.15.124:0/3750914180 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda281f6960 0x7fda28156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:33.986 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.968+0000 7fda2de74700 1 -- 172.21.15.124:0/3750914180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda280ae000 msgr2=0x7fda281f6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:33.987 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.968+0000 7fda2de74700 1 --2- 172.21.15.124:0/3750914180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda280ae000 0x7fda281f6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:33.987 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.968+0000 7fda2de74700 1 -- 172.21.15.124:0/3750914180 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda280ad520 con 0x7fda14003a00 2023-10-16T12:59:33.987 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.968+0000 7fda2d673700 1 --2- 172.21.15.124:0/3750914180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda280ae000 0x7fda281f6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:33.988 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.968+0000 7fda2de74700 1 --2- 172.21.15.124:0/3750914180 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda14003a00 0x7fda281529b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fda18005040 tx=0x7fda18001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:33.988 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.968+0000 7fda1e7fc700 1 -- 172.21.15.124:0/3750914180 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18001290 con 0x7fda14003a00 2023-10-16T12:59:33.989 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.968+0000 7fda1e7fc700 1 -- 172.21.15.124:0/3750914180 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1801d480 con 0x7fda14003a00 2023-10-16T12:59:33.989 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.968+0000 7fda300d8700 1 -- 172.21.15.124:0/3750914180 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda280ad800 con 0x7fda14003a00 2023-10-16T12:59:33.989 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.968+0000 7fda1e7fc700 1 -- 172.21.15.124:0/3750914180 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1801d810 con 0x7fda14003a00 2023-10-16T12:59:33.989 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.968+0000 7fda300d8700 1 -- 172.21.15.124:0/3750914180 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda280aef50 con 0x7fda14003a00 2023-10-16T12:59:33.990 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.969+0000 7fda300d8700 1 -- 172.21.15.124:0/3750914180 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda280ade50 con 0x7fda14003a00 2023-10-16T12:59:33.990 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.969+0000 7fda1e7fc700 1 -- 172.21.15.124:0/3750914180 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fda18019040 con 0x7fda14003a00 2023-10-16T12:59:33.990 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.970+0000 7fda1e7fc700 1 --2- 172.21.15.124:0/3750914180 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fda0c06af00 0x7fda0c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:33.991 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.970+0000 7fda1e7fc700 1 -- 172.21.15.124:0/3750914180 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6671+0+0 (secure 0 0 0) 0x7fda1808a430 con 0x7fda14003a00 2023-10-16T12:59:33.991 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.970+0000 7fda2d673700 1 --2- 172.21.15.124:0/3750914180 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fda0c06af00 0x7fda0c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:33.991 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.970+0000 7fda2d673700 1 --2- 172.21.15.124:0/3750914180 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fda0c06af00 0x7fda0c06d3c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fda280c5350 tx=0x7fda24009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:33.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:33.974+0000 7fda1e7fc700 1 -- 172.21.15.124:0/3750914180 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fda180552d0 con 0x7fda14003a00 2023-10-16T12:59:34.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.163+0000 7fda300d8700 1 -- 172.21.15.124:0/3750914180 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fda280af0e0 con 0x7fda14003a00 2023-10-16T12:59:34.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.163+0000 7fda1e7fc700 1 -- 172.21.15.124:0/3750914180 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fda180588f0 con 0x7fda14003a00 2023-10-16T12:59:34.166 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2023-10-16T12:59:34.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.165+0000 7fda300d8700 1 -- 172.21.15.124:0/3750914180 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fda0c06af00 msgr2=0x7fda0c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:34.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.165+0000 7fda300d8700 1 --2- 172.21.15.124:0/3750914180 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fda0c06af00 0x7fda0c06d3c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fda280c5350 tx=0x7fda24009040 comp rx=0 tx=0).stop 2023-10-16T12:59:34.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.165+0000 7fda300d8700 1 -- 172.21.15.124:0/3750914180 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda14003a00 msgr2=0x7fda281529b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:34.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.165+0000 7fda300d8700 1 --2- 172.21.15.124:0/3750914180 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda14003a00 0x7fda281529b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fda18005040 tx=0x7fda18001120 comp rx=0 tx=0).stop 2023-10-16T12:59:34.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.165+0000 7fda300d8700 1 -- 172.21.15.124:0/3750914180 shutdown_connections 2023-10-16T12:59:34.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.165+0000 7fda300d8700 1 --2- 172.21.15.124:0/3750914180 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fda0c06af00 0x7fda0c06d3c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.165+0000 7fda300d8700 1 --2- 172.21.15.124:0/3750914180 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda281f6960 0x7fda28156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.165+0000 7fda300d8700 1 --2- 172.21.15.124:0/3750914180 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda14003a00 0x7fda281529b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.165+0000 7fda300d8700 1 --2- 172.21.15.124:0/3750914180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda280ae000 0x7fda281f6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.165+0000 7fda300d8700 1 -- 172.21.15.124:0/3750914180 >> 172.21.15.124:0/3750914180 conn(0x7fda280ccbe0 msgr2=0x7fda280ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:34.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.165+0000 7fda300d8700 1 -- 172.21.15.124:0/3750914180 shutdown_connections 2023-10-16T12:59:34.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.165+0000 7fda300d8700 1 -- 172.21.15.124:0/3750914180 wait complete. 2023-10-16T12:59:34.180 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T12:59:34.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.300+0000 7f71b96ac700 1 Processor -- start 2023-10-16T12:59:34.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.300+0000 7f71b96ac700 1 -- start start 2023-10-16T12:59:34.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.301+0000 7f71b96ac700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f71b415d760 0x7f71b40b9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:34.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.301+0000 7f71b96ac700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71b406b7e0 0x7f71b406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:34.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.301+0000 7f71b96ac700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b40cf420 con 0x7f71b40ce0a0 2023-10-16T12:59:34.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.301+0000 7f71b96ac700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b40b95a0 con 0x7f71b415d760 2023-10-16T12:59:34.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.301+0000 7f71b96ac700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b406c1b0 con 0x7f71b406b7e0 2023-10-16T12:59:34.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.301+0000 7f71b27fc700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f71b40ce0a0 0x7f71b40cf8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43172/0 (socket says 172.21.15.124:43172) 2023-10-16T12:59:34.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.301+0000 7f71b27fc700 1 -- 172.21.15.124:0/1472844910 learned_addr learned my addr 172.21.15.124:0/1472844910 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:34.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.301+0000 7f71b2ffd700 1 --2- 172.21.15.124:0/1472844910 >> v2:172.21.15.192:3300/0 conn(0x7f71b415d760 0x7f71b40b9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:34.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.301+0000 7f71b37fe700 1 --2- 172.21.15.124:0/1472844910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71b406b7e0 0x7f71b406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:34.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.301+0000 7f71b1ffb700 1 -- 172.21.15.124:0/1472844910 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965637274 0 0) 0x7f71b40cf420 con 0x7f71b40ce0a0 2023-10-16T12:59:34.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.301+0000 7f71b1ffb700 1 -- 172.21.15.124:0/1472844910 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f719c0035b0 con 0x7f71b40ce0a0 2023-10-16T12:59:34.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.301+0000 7f71b1ffb700 1 -- 172.21.15.124:0/1472844910 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2559419631 0 0) 0x7f719c0035b0 con 0x7f71b40ce0a0 2023-10-16T12:59:34.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.301+0000 7f71b1ffb700 1 -- 172.21.15.124:0/1472844910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71b406b7e0 msgr2=0x7f71b406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:34.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.301+0000 7f71b1ffb700 1 --2- 172.21.15.124:0/1472844910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71b406b7e0 0x7f71b406bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.301+0000 7f71b1ffb700 1 -- 172.21.15.124:0/1472844910 >> v2:172.21.15.192:3300/0 conn(0x7f71b415d760 msgr2=0x7f71b40b9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:34.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.301+0000 7f71b1ffb700 1 --2- 172.21.15.124:0/1472844910 >> v2:172.21.15.192:3300/0 conn(0x7f71b415d760 0x7f71b40b9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.301+0000 7f71b1ffb700 1 -- 172.21.15.124:0/1472844910 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b40ce810 con 0x7f71b40ce0a0 2023-10-16T12:59:34.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.301+0000 7f71b1ffb700 1 -- 172.21.15.124:0/1472844910 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f71a4001670 con 0x7f71b40ce0a0 2023-10-16T12:59:34.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.301+0000 7f71b1ffb700 1 -- 172.21.15.124:0/1472844910 >> v1:172.21.15.124:6789/0 conn(0x7f71b40ce0a0 legacy=0x7f71b40cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:34.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.302+0000 7f71b1ffb700 1 --2- 172.21.15.124:0/1472844910 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f719c003a00 0x7f719c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:34.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.302+0000 7f71b1ffb700 1 --2- 172.21.15.124:0/1472844910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f719c004850 0x7f719c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:34.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.302+0000 7f71b1ffb700 1 --2- 172.21.15.124:0/1472844910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71b406b7e0 0x7f719c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:34.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.302+0000 7f71b1ffb700 1 -- 172.21.15.124:0/1472844910 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b406c1b0 con 0x7f719c003a00 2023-10-16T12:59:34.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.302+0000 7f71b1ffb700 1 -- 172.21.15.124:0/1472844910 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c00ba10 con 0x7f719c004850 2023-10-16T12:59:34.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.302+0000 7f71b1ffb700 1 -- 172.21.15.124:0/1472844910 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c00bb50 con 0x7f71b406b7e0 2023-10-16T12:59:34.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.302+0000 7f71b2ffd700 1 --2- 172.21.15.124:0/1472844910 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f719c003a00 0x7f719c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:34.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.302+0000 7f71b37fe700 1 --2- 172.21.15.124:0/1472844910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71b406b7e0 0x7f719c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:34.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.302+0000 7f71b27fc700 1 --2- 172.21.15.124:0/1472844910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f719c004850 0x7f719c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:34.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.302+0000 7f71b2ffd700 1 -- 172.21.15.124:0/1472844910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71b406b7e0 msgr2=0x7f719c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:34.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.302+0000 7f71b2ffd700 1 --2- 172.21.15.124:0/1472844910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71b406b7e0 0x7f719c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.302+0000 7f71b2ffd700 1 -- 172.21.15.124:0/1472844910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f719c004850 msgr2=0x7f719c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:34.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.302+0000 7f71b2ffd700 1 --2- 172.21.15.124:0/1472844910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f719c004850 0x7f719c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.302+0000 7f71b2ffd700 1 -- 172.21.15.124:0/1472844910 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c0035b0 con 0x7f719c003a00 2023-10-16T12:59:34.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.302+0000 7f71b2ffd700 1 --2- 172.21.15.124:0/1472844910 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f719c003a00 0x7f719c003e20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009b60 tx=0x7f719c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9126580894242c63 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:34.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.302+0000 7f71b1ffb700 1 -- 172.21.15.124:0/1472844910 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a800e6c0 con 0x7f719c003a00 2023-10-16T12:59:34.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.302+0000 7f71b1ffb700 1 -- 172.21.15.124:0/1472844910 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a800e820 con 0x7f719c003a00 2023-10-16T12:59:34.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.302+0000 7f71b1ffb700 1 -- 172.21.15.124:0/1472844910 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a800eb90 con 0x7f719c003a00 2023-10-16T12:59:34.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.303+0000 7f71b96ac700 1 -- 172.21.15.124:0/1472844910 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f719c003a00 msgr2=0x7f719c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:34.319 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.303+0000 7f71b96ac700 1 --2- 172.21.15.124:0/1472844910 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f719c003a00 0x7f719c003e20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009b60 tx=0x7f719c005880 comp rx=0 tx=0).stop 2023-10-16T12:59:34.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.303+0000 7f71b37fe700 1 -- 172.21.15.124:0/1472844910 reap_dead start 2023-10-16T12:59:34.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.303+0000 7f71b96ac700 1 -- 172.21.15.124:0/1472844910 shutdown_connections 2023-10-16T12:59:34.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.303+0000 7f71b96ac700 1 -- 172.21.15.124:0/1472844910 >> 172.21.15.124:0/1472844910 conn(0x7f71b4072340 msgr2=0x7f71b4072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:34.320 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.303+0000 7f71b96ac700 1 -- 172.21.15.124:0/1472844910 shutdown_connections 2023-10-16T12:59:34.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.303+0000 7f71b96ac700 1 -- 172.21.15.124:0/1472844910 wait complete. 2023-10-16T12:59:34.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.304+0000 7f71b96ac700 1 Processor -- start 2023-10-16T12:59:34.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.304+0000 7f71b96ac700 1 -- start start 2023-10-16T12:59:34.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.305+0000 7f71b96ac700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f719c003a00 0x7f71b40c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:34.321 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.305+0000 7f71b96ac700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71b40c7260 0x7f71b41f2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:34.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.305+0000 7f71b96ac700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71b40b4b20 0x7f71b40b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:34.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.305+0000 7f71b96ac700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b40b54e0 con 0x7f71b40c7260 2023-10-16T12:59:34.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.305+0000 7f71b96ac700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b40c93b0 con 0x7f719c003a00 2023-10-16T12:59:34.322 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.305+0000 7f71b96ac700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b40c9690 con 0x7f71b40b4b20 2023-10-16T12:59:34.323 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.305+0000 7f71b27fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71b40c7260 0x7f71b41f2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:34.323 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.305+0000 7f71b27fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71b40c7260 0x7f71b41f2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54516/0 (socket says 172.21.15.124:54516) 2023-10-16T12:59:34.323 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.305+0000 7f71b27fc700 1 -- 172.21.15.124:0/3070439659 learned_addr learned my addr 172.21.15.124:0/3070439659 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:34.324 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.305+0000 7f71b37fe700 1 --2- 172.21.15.124:0/3070439659 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71b40b4b20 0x7f71b40b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:34.324 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.305+0000 7f71b2ffd700 1 --2- 172.21.15.124:0/3070439659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f719c003a00 0x7f71b40c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:34.324 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.305+0000 7f71b27fc700 1 -- 172.21.15.124:0/3070439659 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71b40b4b20 msgr2=0x7f71b40b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:34.324 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.305+0000 7f71b27fc700 1 --2- 172.21.15.124:0/3070439659 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71b40b4b20 0x7f71b40b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.325 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.305+0000 7f71b27fc700 1 -- 172.21.15.124:0/3070439659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f719c003a00 msgr2=0x7f71b40c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:34.325 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.305+0000 7f71b27fc700 1 --2- 172.21.15.124:0/3070439659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f719c003a00 0x7f71b40c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.325 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.305+0000 7f71b27fc700 1 -- 172.21.15.124:0/3070439659 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b40c9970 con 0x7f71b40c7260 2023-10-16T12:59:34.326 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.305+0000 7f71b2ffd700 1 --2- 172.21.15.124:0/3070439659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f719c003a00 0x7f71b40c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:34.326 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.305+0000 7f71b27fc700 1 --2- 172.21.15.124:0/3070439659 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71b40c7260 0x7f71b41f2380 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f71a400e780 tx=0x7f71a400ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:34.326 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.305+0000 7f719b7fe700 1 -- 172.21.15.124:0/3070439659 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a4012590 con 0x7f71b40c7260 2023-10-16T12:59:34.326 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.305+0000 7f719b7fe700 1 -- 172.21.15.124:0/3070439659 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a4012710 con 0x7f71b40c7260 2023-10-16T12:59:34.327 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.305+0000 7f71b96ac700 1 -- 172.21.15.124:0/3070439659 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b40c9c50 con 0x7f71b40c7260 2023-10-16T12:59:34.327 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.306+0000 7f719b7fe700 1 -- 172.21.15.124:0/3070439659 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a4012ac0 con 0x7f71b40c7260 2023-10-16T12:59:34.327 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.306+0000 7f71b96ac700 1 -- 172.21.15.124:0/3070439659 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b40c76e0 con 0x7f71b40c7260 2023-10-16T12:59:34.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.307+0000 7f71b96ac700 1 -- 172.21.15.124:0/3070439659 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b404ebb0 con 0x7f71b40c7260 2023-10-16T12:59:34.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.307+0000 7f719b7fe700 1 -- 172.21.15.124:0/3070439659 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f71a4012c20 con 0x7f71b40c7260 2023-10-16T12:59:34.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.307+0000 7f719b7fe700 1 --2- 172.21.15.124:0/3070439659 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f71a006af00 0x7f71a006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:34.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.307+0000 7f71b2ffd700 1 --2- 172.21.15.124:0/3070439659 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f71a006af00 0x7f71a006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:34.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.307+0000 7f719b7fe700 1 -- 172.21.15.124:0/3070439659 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f71a40896d0 con 0x7f71b40c7260 2023-10-16T12:59:34.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.308+0000 7f71b2ffd700 1 --2- 172.21.15.124:0/3070439659 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f71a006af00 0x7f71a006d3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f71a80090b0 tx=0x7f71a8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:34.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.312+0000 7f719b7fe700 1 -- 172.21.15.124:0/3070439659 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f71a40543c0 con 0x7f71b40c7260 2023-10-16T12:59:34.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.507+0000 7f71b96ac700 1 -- 172.21.15.124:0/3070439659 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f71b406bf40 con 0x7f71b40c7260 2023-10-16T12:59:34.510 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.507+0000 7f719b7fe700 1 -- 172.21.15.124:0/3070439659 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f71a4012ed0 con 0x7f71b40c7260 2023-10-16T12:59:34.510 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:34.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.509+0000 7f71b96ac700 1 -- 172.21.15.124:0/3070439659 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f71a006af00 msgr2=0x7f71a006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:34.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.509+0000 7f71b96ac700 1 --2- 172.21.15.124:0/3070439659 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f71a006af00 0x7f71a006d3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f71a80090b0 tx=0x7f71a8008030 comp rx=0 tx=0).stop 2023-10-16T12:59:34.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.509+0000 7f71b96ac700 1 -- 172.21.15.124:0/3070439659 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71b40c7260 msgr2=0x7f71b41f2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:34.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.509+0000 7f71b96ac700 1 --2- 172.21.15.124:0/3070439659 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71b40c7260 0x7f71b41f2380 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f71a400e780 tx=0x7f71a400ea90 comp rx=0 tx=0).stop 2023-10-16T12:59:34.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.509+0000 7f71b96ac700 1 -- 172.21.15.124:0/3070439659 shutdown_connections 2023-10-16T12:59:34.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.509+0000 7f71b96ac700 1 --2- 172.21.15.124:0/3070439659 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f71a006af00 0x7f71a006d3c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.509+0000 7f71b96ac700 1 --2- 172.21.15.124:0/3070439659 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71b40b4b20 0x7f71b40b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.509+0000 7f71b96ac700 1 --2- 172.21.15.124:0/3070439659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f719c003a00 0x7f71b40c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.509+0000 7f71b96ac700 1 --2- 172.21.15.124:0/3070439659 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f71b40c7260 0x7f71b41f2380 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.509+0000 7f71b96ac700 1 -- 172.21.15.124:0/3070439659 >> 172.21.15.124:0/3070439659 conn(0x7f71b4072340 msgr2=0x7f71b415e820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:34.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.509+0000 7f71b96ac700 1 -- 172.21.15.124:0/3070439659 shutdown_connections 2023-10-16T12:59:34.514 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.509+0000 7f71b96ac700 1 -- 172.21.15.124:0/3070439659 wait complete. 2023-10-16T12:59:34.524 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:59:34.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.643+0000 7f36bb8a0700 1 Processor -- start 2023-10-16T12:59:34.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.643+0000 7f36bb8a0700 1 -- start start 2023-10-16T12:59:34.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.644+0000 7f36bb8a0700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f36b40ce4e0 0x7f36b40cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:34.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.644+0000 7f36bb8a0700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f36b40cef20 0x7f36b40cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:34.655 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.644+0000 7f36bb8a0700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b40cc060 con 0x7f36b41523b0 2023-10-16T12:59:34.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.644+0000 7f36bb8a0700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b40cf8d0 con 0x7f36b40cef20 2023-10-16T12:59:34.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.644+0000 7f36bb8a0700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b40cda20 con 0x7f36b40ce4e0 2023-10-16T12:59:34.656 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.644+0000 7f36b9e3d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f36b40cef20 0x7f36b40cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:34.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.644+0000 7f36b9e3d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f36b40cef20 0x7f36b40cf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54526/0 (socket says 172.21.15.124:54526) 2023-10-16T12:59:34.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.644+0000 7f36b9e3d700 1 -- 172.21.15.124:0/3310431742 learned_addr learned my addr 172.21.15.124:0/3310431742 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:34.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.645+0000 7f36b9e3d700 1 -- 172.21.15.124:0/3310431742 >> v2:172.21.15.192:3300/0 conn(0x7f36b40ce4e0 msgr2=0x7f36b40cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:34.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.645+0000 7f36b8e3b700 1 --2- 172.21.15.124:0/3310431742 >> v2:172.21.15.192:3300/0 conn(0x7f36b40ce4e0 0x7f36b40cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:34.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.645+0000 7f36b9e3d700 1 --2- 172.21.15.124:0/3310431742 >> v2:172.21.15.192:3300/0 conn(0x7f36b40ce4e0 0x7f36b40cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.645+0000 7f36b9e3d700 1 -- 172.21.15.124:0/3310431742 >> v1:172.21.15.192:6789/0 conn(0x7f36b41523b0 legacy=0x7f36b415c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:34.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.645+0000 7f36b9e3d700 1 -- 172.21.15.124:0/3310431742 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b40cdd00 con 0x7f36b40cef20 2023-10-16T12:59:34.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.645+0000 7f36b8e3b700 1 --2- 172.21.15.124:0/3310431742 >> v2:172.21.15.192:3300/0 conn(0x7f36b40ce4e0 0x7f36b40cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:34.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.645+0000 7f36b9e3d700 1 --2- 172.21.15.124:0/3310431742 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36b40cef20 0x7f36b40cf390 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f36b415b970 tx=0x7f36ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb368c17077710df server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:34.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.645+0000 7f36abfff700 1 -- 172.21.15.124:0/3310431742 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac00e070 con 0x7f36b40cef20 2023-10-16T12:59:34.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.645+0000 7f36abfff700 1 -- 172.21.15.124:0/3310431742 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ac003a70 con 0x7f36b40cef20 2023-10-16T12:59:34.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.645+0000 7f36abfff700 1 -- 172.21.15.124:0/3310431742 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac003e20 con 0x7f36b40cef20 2023-10-16T12:59:34.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.645+0000 7f36bb8a0700 1 -- 172.21.15.124:0/3310431742 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36b40cef20 msgr2=0x7f36b40cf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:34.661 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.645+0000 7f36bb8a0700 1 --2- 172.21.15.124:0/3310431742 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36b40cef20 0x7f36b40cf390 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f36b415b970 tx=0x7f36ac00b330 comp rx=0 tx=0).stop 2023-10-16T12:59:34.661 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.645+0000 7f36bb8a0700 1 -- 172.21.15.124:0/3310431742 shutdown_connections 2023-10-16T12:59:34.661 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.645+0000 7f36bb8a0700 1 --2- 172.21.15.124:0/3310431742 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36b40cef20 0x7f36b40cf390 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.661 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.645+0000 7f36bb8a0700 1 --2- 172.21.15.124:0/3310431742 >> v2:172.21.15.192:3300/0 conn(0x7f36b40ce4e0 0x7f36b40cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.645+0000 7f36bb8a0700 1 -- 172.21.15.124:0/3310431742 >> 172.21.15.124:0/3310431742 conn(0x7f36b4070460 msgr2=0x7f36b4070840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:34.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.646+0000 7f36bb8a0700 1 -- 172.21.15.124:0/3310431742 shutdown_connections 2023-10-16T12:59:34.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.646+0000 7f36bb8a0700 1 -- 172.21.15.124:0/3310431742 wait complete. 2023-10-16T12:59:34.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.647+0000 7f36bb8a0700 1 Processor -- start 2023-10-16T12:59:34.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.647+0000 7f36bb8a0700 1 -- start start 2023-10-16T12:59:34.663 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.648+0000 7f36bb8a0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36b40ce4e0 0x7f36b40c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:34.664 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.648+0000 7f36bb8a0700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36b40cef20 0x7f36b41f03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:34.664 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.648+0000 7f36bb8a0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36b41523b0 0x7f36b4140f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:34.664 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.648+0000 7f36bb8a0700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b40c99a0 con 0x7f36b40cef20 2023-10-16T12:59:34.665 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.648+0000 7f36bb8a0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b40c8d20 con 0x7f36b40ce4e0 2023-10-16T12:59:34.665 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.648+0000 7f36bb8a0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b40c9000 con 0x7f36b41523b0 2023-10-16T12:59:34.665 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.648+0000 7f36b8e3b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36b40cef20 0x7f36b41f03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:34.665 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.648+0000 7f36b8e3b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36b40cef20 0x7f36b41f03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54528/0 (socket says 172.21.15.124:54528) 2023-10-16T12:59:34.666 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.648+0000 7f36b8e3b700 1 -- 172.21.15.124:0/2263295068 learned_addr learned my addr 172.21.15.124:0/2263295068 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:34.666 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.648+0000 7f36b9e3d700 1 --2- 172.21.15.124:0/2263295068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36b41523b0 0x7f36b4140f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:34.666 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.648+0000 7f36b963c700 1 --2- 172.21.15.124:0/2263295068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36b40ce4e0 0x7f36b40c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:34.667 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.648+0000 7f36b8e3b700 1 -- 172.21.15.124:0/2263295068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36b41523b0 msgr2=0x7f36b4140f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:34.667 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.649+0000 7f36b8e3b700 1 --2- 172.21.15.124:0/2263295068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36b41523b0 0x7f36b4140f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.667 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.649+0000 7f36b8e3b700 1 -- 172.21.15.124:0/2263295068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36b40ce4e0 msgr2=0x7f36b40c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:34.668 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.649+0000 7f36b8e3b700 1 --2- 172.21.15.124:0/2263295068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36b40ce4e0 0x7f36b40c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.668 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.649+0000 7f36b8e3b700 1 -- 172.21.15.124:0/2263295068 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac009b30 con 0x7f36b40cef20 2023-10-16T12:59:34.668 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.649+0000 7f36b963c700 1 --2- 172.21.15.124:0/2263295068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36b40ce4e0 0x7f36b40c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:34.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.649+0000 7f36b8e3b700 1 --2- 172.21.15.124:0/2263295068 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36b40cef20 0x7f36b41f03f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f36b000c7f0 tx=0x7f36b000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:34.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.649+0000 7f36a9ffb700 1 -- 172.21.15.124:0/2263295068 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b0011800 con 0x7f36b40cef20 2023-10-16T12:59:34.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.649+0000 7f36a9ffb700 1 -- 172.21.15.124:0/2263295068 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b0011960 con 0x7f36b40cef20 2023-10-16T12:59:34.669 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.649+0000 7f36bb8a0700 1 -- 172.21.15.124:0/2263295068 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b40c92e0 con 0x7f36b40cef20 2023-10-16T12:59:34.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.649+0000 7f36a9ffb700 1 -- 172.21.15.124:0/2263295068 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b0011cd0 con 0x7f36b40cef20 2023-10-16T12:59:34.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.649+0000 7f36bb8a0700 1 -- 172.21.15.124:0/2263295068 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b40c8960 con 0x7f36b40cef20 2023-10-16T12:59:34.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.650+0000 7f36bb8a0700 1 -- 172.21.15.124:0/2263295068 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b404ebb0 con 0x7f36b40cef20 2023-10-16T12:59:34.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.650+0000 7f36a9ffb700 1 -- 172.21.15.124:0/2263295068 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f36b0022350 con 0x7f36b40cef20 2023-10-16T12:59:34.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.651+0000 7f36a9ffb700 1 --2- 172.21.15.124:0/2263295068 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f369806af00 0x7f369806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:34.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.651+0000 7f36b963c700 1 --2- 172.21.15.124:0/2263295068 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f369806af00 0x7f369806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:34.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.651+0000 7f36a9ffb700 1 -- 172.21.15.124:0/2263295068 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f36b00898a0 con 0x7f36b40cef20 2023-10-16T12:59:34.671 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.651+0000 7f36b963c700 1 --2- 172.21.15.124:0/2263295068 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f369806af00 0x7f369806d3c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f36a4009930 tx=0x7f36a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:34.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.655+0000 7f36a9ffb700 1 -- 172.21.15.124:0/2263295068 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f36b0054620 con 0x7f36b40cef20 2023-10-16T12:59:34.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.848+0000 7f36bb8a0700 1 -- 172.21.15.124:0/2263295068 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36b40c8af0 con 0x7f36b40cef20 2023-10-16T12:59:34.852 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.850+0000 7f36a9ffb700 1 -- 172.21.15.124:0/2263295068 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18751 (secure 0 0 0) 0x7f36b005e070 con 0x7f36b40cef20 2023-10-16T12:59:34.853 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:34.853 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":26,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:59:34.463212+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2},{"from":7,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:59:34.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.852+0000 7f36bb8a0700 1 -- 172.21.15.124:0/2263295068 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f369806af00 msgr2=0x7f369806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:34.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.852+0000 7f36bb8a0700 1 --2- 172.21.15.124:0/2263295068 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f369806af00 0x7f369806d3c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f36a4009930 tx=0x7f36a4008040 comp rx=0 tx=0).stop 2023-10-16T12:59:34.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.852+0000 7f36bb8a0700 1 -- 172.21.15.124:0/2263295068 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36b40cef20 msgr2=0x7f36b41f03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:34.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.852+0000 7f36bb8a0700 1 --2- 172.21.15.124:0/2263295068 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36b40cef20 0x7f36b41f03f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f36b000c7f0 tx=0x7f36b000cbb0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.852+0000 7f36bb8a0700 1 -- 172.21.15.124:0/2263295068 shutdown_connections 2023-10-16T12:59:34.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.852+0000 7f36bb8a0700 1 --2- 172.21.15.124:0/2263295068 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f369806af00 0x7f369806d3c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.852+0000 7f36bb8a0700 1 --2- 172.21.15.124:0/2263295068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36b41523b0 0x7f36b4140f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.852+0000 7f36bb8a0700 1 --2- 172.21.15.124:0/2263295068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36b40ce4e0 0x7f36b40c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.852+0000 7f36bb8a0700 1 --2- 172.21.15.124:0/2263295068 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36b40cef20 0x7f36b41f03f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.852+0000 7f36bb8a0700 1 -- 172.21.15.124:0/2263295068 >> 172.21.15.124:0/2263295068 conn(0x7f36b4070460 msgr2=0x7f36b4150b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:34.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.852+0000 7f36bb8a0700 1 -- 172.21.15.124:0/2263295068 shutdown_connections 2023-10-16T12:59:34.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.852+0000 7f36bb8a0700 1 -- 172.21.15.124:0/2263295068 wait complete. 2023-10-16T12:59:34.867 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T12:58:38.667813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T12:58:49.562073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T12:58:50.011419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T12:58:53.692890+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T12:59:34.868 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T12:59:34.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.989+0000 7f6d73d18700 1 Processor -- start 2023-10-16T12:59:34.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.989+0000 7f6d73d18700 1 -- start start 2023-10-16T12:59:34.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.990+0000 7f6d73d18700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6d6c0b33f0 0x7f6d6c06f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:34.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.990+0000 7f6d73d18700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d6c0cd770 0x7f6d6c0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:34.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.990+0000 7f6d73d18700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d6c070620 con 0x7f6d6c15b4e0 2023-10-16T12:59:34.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.990+0000 7f6d73d18700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6c070900 con 0x7f6d6c0b33f0 2023-10-16T12:59:34.995 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.990+0000 7f6d73d18700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c070be0 con 0x7f6d6c0cd770 2023-10-16T12:59:34.996 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.991+0000 7f6d722b5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d6c0cd770 0x7f6d6c0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:34.996 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.991+0000 7f6d712b3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6d6c0b33f0 0x7f6d6c06f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:34.996 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.991+0000 7f6d722b5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d6c0cd770 0x7f6d6c0b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:40616/0 (socket says 172.21.15.124:40616) 2023-10-16T12:59:34.996 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.991+0000 7f6d722b5700 1 -- 172.21.15.124:0/2460996774 learned_addr learned my addr 172.21.15.124:0/2460996774 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:34.996 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.991+0000 7f6d722b5700 1 -- 172.21.15.124:0/2460996774 >> v2:172.21.15.192:3300/0 conn(0x7f6d6c0b33f0 msgr2=0x7f6d6c06f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:34.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.991+0000 7f6d722b5700 1 --2- 172.21.15.124:0/2460996774 >> v2:172.21.15.192:3300/0 conn(0x7f6d6c0b33f0 0x7f6d6c06f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.991+0000 7f6d722b5700 1 -- 172.21.15.124:0/2460996774 >> v1:172.21.15.192:6789/0 conn(0x7f6d6c15b4e0 legacy=0x7f6d6c0b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:34.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.991+0000 7f6d722b5700 1 -- 172.21.15.124:0/2460996774 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c070ec0 con 0x7f6d6c0cd770 2023-10-16T12:59:34.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.991+0000 7f6d712b3700 1 --2- 172.21.15.124:0/2460996774 >> v2:172.21.15.192:3300/0 conn(0x7f6d6c0b33f0 0x7f6d6c06f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:59:34.997 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.991+0000 7f6d722b5700 1 --2- 172.21.15.124:0/2460996774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d6c0cd770 0x7f6d6c0b4450 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009e80 tx=0x7f6d6400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d4935e4edbf6b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:34.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.991+0000 7f6d70ab2700 1 -- 172.21.15.124:0/2460996774 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6400e070 con 0x7f6d6c0cd770 2023-10-16T12:59:34.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.991+0000 7f6d70ab2700 1 -- 172.21.15.124:0/2460996774 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6400b8d0 con 0x7f6d6c0cd770 2023-10-16T12:59:34.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.991+0000 7f6d70ab2700 1 -- 172.21.15.124:0/2460996774 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6400bc80 con 0x7f6d6c0cd770 2023-10-16T12:59:34.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.992+0000 7f6d73d18700 1 -- 172.21.15.124:0/2460996774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d6c0cd770 msgr2=0x7f6d6c0b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:34.998 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.992+0000 7f6d73d18700 1 --2- 172.21.15.124:0/2460996774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d6c0cd770 0x7f6d6c0b4450 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009e80 tx=0x7f6d6400b330 comp rx=0 tx=0).stop 2023-10-16T12:59:34.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.992+0000 7f6d73d18700 1 -- 172.21.15.124:0/2460996774 shutdown_connections 2023-10-16T12:59:34.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.992+0000 7f6d73d18700 1 --2- 172.21.15.124:0/2460996774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d6c0cd770 0x7f6d6c0b4450 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.992+0000 7f6d73d18700 1 --2- 172.21.15.124:0/2460996774 >> v2:172.21.15.192:3300/0 conn(0x7f6d6c0b33f0 0x7f6d6c06f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:34.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.992+0000 7f6d73d18700 1 -- 172.21.15.124:0/2460996774 >> 172.21.15.124:0/2460996774 conn(0x7f6d6c0cdce0 msgr2=0x7f6d6c0ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:34.999 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.992+0000 7f6d73d18700 1 -- 172.21.15.124:0/2460996774 shutdown_connections 2023-10-16T12:59:35.000 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.992+0000 7f6d73d18700 1 -- 172.21.15.124:0/2460996774 wait complete. 2023-10-16T12:59:35.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.993+0000 7f6d73d18700 1 Processor -- start 2023-10-16T12:59:35.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.993+0000 7f6d73d18700 1 -- start start 2023-10-16T12:59:35.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.994+0000 7f6d73d18700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d6c0b33f0 0x7f6d6c0a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:35.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.994+0000 7f6d73d18700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d6c0cd770 0x7f6d6c1f0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:35.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.994+0000 7f6d73d18700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d6c15b4e0 0x7f6d6c1f4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:35.003 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.994+0000 7f6d73d18700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c1e45f0 con 0x7f6d6c15b4e0 2023-10-16T12:59:35.004 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.994+0000 7f6d73d18700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c0a89f0 con 0x7f6d6c0cd770 2023-10-16T12:59:35.004 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.994+0000 7f6d73d18700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c1e4310 con 0x7f6d6c0b33f0 2023-10-16T12:59:35.004 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.994+0000 7f6d722b5700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d6c15b4e0 0x7f6d6c1f4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:35.004 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.994+0000 7f6d722b5700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d6c15b4e0 0x7f6d6c1f4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54544/0 (socket says 172.21.15.124:54544) 2023-10-16T12:59:35.004 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.994+0000 7f6d722b5700 1 -- 172.21.15.124:0/1729960082 learned_addr learned my addr 172.21.15.124:0/1729960082 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:35.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.994+0000 7f6d712b3700 1 --2- 172.21.15.124:0/1729960082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d6c0cd770 0x7f6d6c1f0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:35.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.994+0000 7f6d71ab4700 1 --2- 172.21.15.124:0/1729960082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d6c0b33f0 0x7f6d6c0a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:35.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.994+0000 7f6d722b5700 1 -- 172.21.15.124:0/1729960082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d6c0b33f0 msgr2=0x7f6d6c0a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:35.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.994+0000 7f6d722b5700 1 --2- 172.21.15.124:0/1729960082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d6c0b33f0 0x7f6d6c0a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.994+0000 7f6d722b5700 1 -- 172.21.15.124:0/1729960082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d6c0cd770 msgr2=0x7f6d6c1f0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:35.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.994+0000 7f6d722b5700 1 --2- 172.21.15.124:0/1729960082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d6c0cd770 0x7f6d6c1f0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.994+0000 7f6d722b5700 1 -- 172.21.15.124:0/1729960082 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d680094a0 con 0x7f6d6c15b4e0 2023-10-16T12:59:35.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.994+0000 7f6d722b5700 1 --2- 172.21.15.124:0/1729960082 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d6c15b4e0 0x7f6d6c1f4030 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c070d20 tx=0x7f6d64004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:35.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.995+0000 7f6d627fc700 1 -- 172.21.15.124:0/1729960082 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d64004800 con 0x7f6d6c15b4e0 2023-10-16T12:59:35.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.995+0000 7f6d627fc700 1 -- 172.21.15.124:0/1729960082 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d640092e0 con 0x7f6d6c15b4e0 2023-10-16T12:59:35.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.995+0000 7f6d73d18700 1 -- 172.21.15.124:0/1729960082 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d64009b30 con 0x7f6d6c15b4e0 2023-10-16T12:59:35.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.995+0000 7f6d627fc700 1 -- 172.21.15.124:0/1729960082 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6401c680 con 0x7f6d6c15b4e0 2023-10-16T12:59:35.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.995+0000 7f6d73d18700 1 -- 172.21.15.124:0/1729960082 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d6c14a770 con 0x7f6d6c15b4e0 2023-10-16T12:59:35.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.996+0000 7f6d73d18700 1 -- 172.21.15.124:0/1729960082 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d6c14a2f0 con 0x7f6d6c15b4e0 2023-10-16T12:59:35.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.996+0000 7f6d627fc700 1 -- 172.21.15.124:0/1729960082 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6d6401c7e0 con 0x7f6d6c15b4e0 2023-10-16T12:59:35.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.996+0000 7f6d627fc700 1 --2- 172.21.15.124:0/1729960082 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6d5006af00 0x7f6d5006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:35.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.996+0000 7f6d627fc700 1 -- 172.21.15.124:0/1729960082 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f6d6408b260 con 0x7f6d6c15b4e0 2023-10-16T12:59:35.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.996+0000 7f6d71ab4700 1 --2- 172.21.15.124:0/1729960082 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6d5006af00 0x7f6d5006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:35.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:34.997+0000 7f6d71ab4700 1 --2- 172.21.15.124:0/1729960082 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6d5006af00 0x7f6d5006d3c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c001800 tx=0x7f6d5c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:35.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.001+0000 7f6d627fc700 1 -- 172.21.15.124:0/1729960082 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6d6c14a2f0 con 0x7f6d6c15b4e0 2023-10-16T12:59:35.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.188+0000 7f6d73d18700 1 -- 172.21.15.124:0/1729960082 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6d6c14a2f0 con 0x7f6d6c15b4e0 2023-10-16T12:59:35.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.189+0000 7f6d627fc700 1 -- 172.21.15.124:0/1729960082 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d6c14a2f0 con 0x7f6d6c15b4e0 2023-10-16T12:59:35.192 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-16T12:59:35.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.191+0000 7f6d73d18700 1 -- 172.21.15.124:0/1729960082 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6d5006af00 msgr2=0x7f6d5006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:35.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.191+0000 7f6d73d18700 1 --2- 172.21.15.124:0/1729960082 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6d5006af00 0x7f6d5006d3c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c001800 tx=0x7f6d5c009040 comp rx=0 tx=0).stop 2023-10-16T12:59:35.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.191+0000 7f6d73d18700 1 -- 172.21.15.124:0/1729960082 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d6c15b4e0 msgr2=0x7f6d6c1f4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:35.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.191+0000 7f6d73d18700 1 --2- 172.21.15.124:0/1729960082 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d6c15b4e0 0x7f6d6c1f4030 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c070d20 tx=0x7f6d64004ad0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.191+0000 7f6d73d18700 1 -- 172.21.15.124:0/1729960082 shutdown_connections 2023-10-16T12:59:35.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.191+0000 7f6d73d18700 1 --2- 172.21.15.124:0/1729960082 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6d5006af00 0x7f6d5006d3c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.191+0000 7f6d73d18700 1 --2- 172.21.15.124:0/1729960082 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d6c15b4e0 0x7f6d6c1f4030 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.191+0000 7f6d73d18700 1 --2- 172.21.15.124:0/1729960082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d6c0b33f0 0x7f6d6c0a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.191+0000 7f6d73d18700 1 --2- 172.21.15.124:0/1729960082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d6c0cd770 0x7f6d6c1f0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.191+0000 7f6d73d18700 1 -- 172.21.15.124:0/1729960082 >> 172.21.15.124:0/1729960082 conn(0x7f6d6c0cdce0 msgr2=0x7f6d6c0c79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:35.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.191+0000 7f6d73d18700 1 -- 172.21.15.124:0/1729960082 shutdown_connections 2023-10-16T12:59:35.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.191+0000 7f6d73d18700 1 -- 172.21.15.124:0/1729960082 wait complete. 2023-10-16T12:59:35.205 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T12:59:35.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.325+0000 7fd38f266700 1 Processor -- start 2023-10-16T12:59:35.328 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.326+0000 7fd38f266700 1 -- start start 2023-10-16T12:59:35.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.327+0000 7fd38f266700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd38815dec0 0x7fd38806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:35.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.327+0000 7fd38f266700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd38815e350 0x7fd38806daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:35.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.327+0000 7fd38f266700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3880cba90 con 0x7fd38815a250 2023-10-16T12:59:35.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.327+0000 7fd38f266700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3880cb510 con 0x7fd38815dec0 2023-10-16T12:59:35.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.327+0000 7fd38f266700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd388071ec0 con 0x7fd38815e350 2023-10-16T12:59:35.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.327+0000 7fd38c801700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd38815dec0 0x7fd38806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:35.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.327+0000 7fd38c801700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd38815dec0 0x7fd38806d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54548/0 (socket says 172.21.15.124:54548) 2023-10-16T12:59:35.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.327+0000 7fd38c801700 1 -- 172.21.15.124:0/3862088590 learned_addr learned my addr 172.21.15.124:0/3862088590 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:35.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.327+0000 7fd38d803700 1 --2- 172.21.15.124:0/3862088590 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd38815e350 0x7fd38806daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:35.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.327+0000 7fd38c801700 1 -- 172.21.15.124:0/3862088590 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd38815e350 msgr2=0x7fd38806daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:35.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.327+0000 7fd38c801700 1 --2- 172.21.15.124:0/3862088590 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd38815e350 0x7fd38806daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.327+0000 7fd38c801700 1 -- 172.21.15.124:0/3862088590 >> v1:172.21.15.192:6789/0 conn(0x7fd38815a250 legacy=0x7fd3880717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:35.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.327+0000 7fd38c801700 1 -- 172.21.15.124:0/3862088590 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38815ee40 con 0x7fd38815dec0 2023-10-16T12:59:35.334 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.328+0000 7fd38c801700 1 --2- 172.21.15.124:0/3862088590 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd38815dec0 0x7fd38806d5b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd3840098f0 tx=0x7fd384009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c964f358dfb841cc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:35.334 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.328+0000 7fd37ffff700 1 -- 172.21.15.124:0/3862088590 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38400b8a0 con 0x7fd38815dec0 2023-10-16T12:59:35.334 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.328+0000 7fd37ffff700 1 -- 172.21.15.124:0/3862088590 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38400ba00 con 0x7fd38815dec0 2023-10-16T12:59:35.334 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.328+0000 7fd37ffff700 1 -- 172.21.15.124:0/3862088590 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38400bd90 con 0x7fd38815dec0 2023-10-16T12:59:35.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.328+0000 7fd38f266700 1 -- 172.21.15.124:0/3862088590 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd38815dec0 msgr2=0x7fd38806d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:35.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.328+0000 7fd38f266700 1 --2- 172.21.15.124:0/3862088590 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd38815dec0 0x7fd38806d5b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd3840098f0 tx=0x7fd384009c00 comp rx=0 tx=0).stop 2023-10-16T12:59:35.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.329+0000 7fd38f266700 1 -- 172.21.15.124:0/3862088590 shutdown_connections 2023-10-16T12:59:35.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.329+0000 7fd38f266700 1 --2- 172.21.15.124:0/3862088590 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd38815e350 0x7fd38806daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.329+0000 7fd38f266700 1 --2- 172.21.15.124:0/3862088590 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd38815dec0 0x7fd38806d5b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.329+0000 7fd38f266700 1 -- 172.21.15.124:0/3862088590 >> 172.21.15.124:0/3862088590 conn(0x7fd3880ccbe0 msgr2=0x7fd3880ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:35.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.329+0000 7fd38f266700 1 -- 172.21.15.124:0/3862088590 shutdown_connections 2023-10-16T12:59:35.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.329+0000 7fd38f266700 1 -- 172.21.15.124:0/3862088590 wait complete. 2023-10-16T12:59:35.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.330+0000 7fd38f266700 1 Processor -- start 2023-10-16T12:59:35.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.330+0000 7fd38f266700 1 -- start start 2023-10-16T12:59:35.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.331+0000 7fd38f266700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd38815a250 0x7fd388157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:35.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.331+0000 7fd38f266700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd38815dec0 0x7fd3880b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:35.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.331+0000 7fd38f266700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd38815e350 0x7fd3880b5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:35.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.331+0000 7fd38f266700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38815c060 con 0x7fd38815e350 2023-10-16T12:59:35.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.331+0000 7fd38f266700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880b4100 con 0x7fd38815a250 2023-10-16T12:59:35.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.331+0000 7fd38f266700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880b43e0 con 0x7fd38815dec0 2023-10-16T12:59:35.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.331+0000 7fd38d803700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd38815e350 0x7fd3880b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:35.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.331+0000 7fd38d803700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd38815e350 0x7fd3880b5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54556/0 (socket says 172.21.15.124:54556) 2023-10-16T12:59:35.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.331+0000 7fd38d803700 1 -- 172.21.15.124:0/2942676006 learned_addr learned my addr 172.21.15.124:0/2942676006 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:35.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.332+0000 7fd38c801700 1 --2- 172.21.15.124:0/2942676006 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd38815dec0 0x7fd3880b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:35.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.332+0000 7fd38d803700 1 -- 172.21.15.124:0/2942676006 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd38815dec0 msgr2=0x7fd3880b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:35.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.332+0000 7fd38d002700 1 --2- 172.21.15.124:0/2942676006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd38815a250 0x7fd388157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:35.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.332+0000 7fd38d803700 1 --2- 172.21.15.124:0/2942676006 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd38815dec0 0x7fd3880b37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.332+0000 7fd38d803700 1 -- 172.21.15.124:0/2942676006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd38815a250 msgr2=0x7fd388157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:35.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.332+0000 7fd38d803700 1 --2- 172.21.15.124:0/2942676006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd38815a250 0x7fd388157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.332+0000 7fd38d803700 1 -- 172.21.15.124:0/2942676006 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd384009550 con 0x7fd38815e350 2023-10-16T12:59:35.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.332+0000 7fd38c801700 1 --2- 172.21.15.124:0/2942676006 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd38815dec0 0x7fd3880b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:35.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.332+0000 7fd38d002700 1 --2- 172.21.15.124:0/2942676006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd38815a250 0x7fd388157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:35.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.332+0000 7fd38d803700 1 --2- 172.21.15.124:0/2942676006 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd38815e350 0x7fd3880b5430 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd380007e60 tx=0x7fd38000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:35.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.332+0000 7fd37dffb700 1 -- 172.21.15.124:0/2942676006 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38000ede0 con 0x7fd38815e350 2023-10-16T12:59:35.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.332+0000 7fd37dffb700 1 -- 172.21.15.124:0/2942676006 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd380014420 con 0x7fd38815e350 2023-10-16T12:59:35.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.332+0000 7fd38f266700 1 -- 172.21.15.124:0/2942676006 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3880b46c0 con 0x7fd38815e350 2023-10-16T12:59:35.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.332+0000 7fd37dffb700 1 -- 172.21.15.124:0/2942676006 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3800147d0 con 0x7fd38815e350 2023-10-16T12:59:35.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.332+0000 7fd38f266700 1 -- 172.21.15.124:0/2942676006 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd388158200 con 0x7fd38815e350 2023-10-16T12:59:35.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.333+0000 7fd38f266700 1 -- 172.21.15.124:0/2942676006 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd38804ebb0 con 0x7fd38815e350 2023-10-16T12:59:35.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.333+0000 7fd37dffb700 1 -- 172.21.15.124:0/2942676006 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd380014930 con 0x7fd38815e350 2023-10-16T12:59:35.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.334+0000 7fd37dffb700 1 --2- 172.21.15.124:0/2942676006 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd36c06af00 0x7fd36c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:35.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.334+0000 7fd37dffb700 1 -- 172.21.15.124:0/2942676006 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7fd38008a060 con 0x7fd38815e350 2023-10-16T12:59:35.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.334+0000 7fd38d002700 1 --2- 172.21.15.124:0/2942676006 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd36c06af00 0x7fd36c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:35.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.334+0000 7fd38d002700 1 --2- 172.21.15.124:0/2942676006 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd36c06af00 0x7fd36c06d3c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd378000f60 tx=0x7fd378009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:35.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.338+0000 7fd37dffb700 1 -- 172.21.15.124:0/2942676006 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd380054de0 con 0x7fd38815e350 2023-10-16T12:59:35.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.529+0000 7fd38f266700 1 -- 172.21.15.124:0/2942676006 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd3880b60e0 con 0x7fd38815e350 2023-10-16T12:59:35.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.529+0000 7fd37dffb700 1 -- 172.21.15.124:0/2942676006 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd380058400 con 0x7fd38815e350 2023-10-16T12:59:35.532 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:35.535 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.531+0000 7fd38f266700 1 -- 172.21.15.124:0/2942676006 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd36c06af00 msgr2=0x7fd36c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:35.535 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.531+0000 7fd38f266700 1 --2- 172.21.15.124:0/2942676006 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd36c06af00 0x7fd36c06d3c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd378000f60 tx=0x7fd378009040 comp rx=0 tx=0).stop 2023-10-16T12:59:35.535 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.531+0000 7fd38f266700 1 -- 172.21.15.124:0/2942676006 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd38815e350 msgr2=0x7fd3880b5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:35.535 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.531+0000 7fd38f266700 1 --2- 172.21.15.124:0/2942676006 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd38815e350 0x7fd3880b5430 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd380007e60 tx=0x7fd38000e3c0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.535 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.532+0000 7fd38f266700 1 -- 172.21.15.124:0/2942676006 shutdown_connections 2023-10-16T12:59:35.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.532+0000 7fd38f266700 1 --2- 172.21.15.124:0/2942676006 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd36c06af00 0x7fd36c06d3c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.532+0000 7fd38f266700 1 --2- 172.21.15.124:0/2942676006 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd38815e350 0x7fd3880b5430 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.532+0000 7fd38f266700 1 --2- 172.21.15.124:0/2942676006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd38815a250 0x7fd388157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.532+0000 7fd38f266700 1 --2- 172.21.15.124:0/2942676006 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd38815dec0 0x7fd3880b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.532+0000 7fd38f266700 1 -- 172.21.15.124:0/2942676006 >> 172.21.15.124:0/2942676006 conn(0x7fd3880ccbe0 msgr2=0x7fd3880cef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:35.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.532+0000 7fd38f266700 1 -- 172.21.15.124:0/2942676006 shutdown_connections 2023-10-16T12:59:35.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.532+0000 7fd38f266700 1 -- 172.21.15.124:0/2942676006 wait complete. 2023-10-16T12:59:35.547 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T12:59:35.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.667+0000 7f3463dbe700 1 Processor -- start 2023-10-16T12:59:35.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.667+0000 7f3463dbe700 1 -- start start 2023-10-16T12:59:35.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.668+0000 7f3463dbe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f345c15b4e0 0x7f345c06f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:35.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.668+0000 7f3463dbe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f345c0b33f0 0x7f345c0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:35.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.668+0000 7f3463dbe700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f345c070620 con 0x7f345c0cd770 2023-10-16T12:59:35.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.668+0000 7f3463dbe700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f345c070900 con 0x7f345c15b4e0 2023-10-16T12:59:35.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.668+0000 7f3463dbe700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f345c070be0 con 0x7f345c0b33f0 2023-10-16T12:59:35.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.668+0000 7f3461b5a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f345c15b4e0 0x7f345c06f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:35.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.668+0000 7f3461359700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f345c0cd770 0x7f345c0b2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43228/0 (socket says 172.21.15.124:43228) 2023-10-16T12:59:35.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.668+0000 7f3461b5a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f345c15b4e0 0x7f345c06f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54560/0 (socket says 172.21.15.124:54560) 2023-10-16T12:59:35.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.668+0000 7f3461359700 1 -- 172.21.15.124:0/154721206 learned_addr learned my addr 172.21.15.124:0/154721206 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:35.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.668+0000 7f346235b700 1 --2- 172.21.15.124:0/154721206 >> v2:172.21.15.192:3300/0 conn(0x7f345c0b33f0 0x7f345c0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:35.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.668+0000 7f3461b5a700 1 -- 172.21.15.124:0/154721206 >> v2:172.21.15.192:3300/0 conn(0x7f345c0b33f0 msgr2=0x7f345c0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:35.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.668+0000 7f3461b5a700 1 --2- 172.21.15.124:0/154721206 >> v2:172.21.15.192:3300/0 conn(0x7f345c0b33f0 0x7f345c0b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.668+0000 7f3461b5a700 1 -- 172.21.15.124:0/154721206 >> v1:172.21.15.124:6789/0 conn(0x7f345c0cd770 legacy=0x7f345c0b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:35.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.668+0000 7f3461b5a700 1 -- 172.21.15.124:0/154721206 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345c070ec0 con 0x7f345c15b4e0 2023-10-16T12:59:35.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.668+0000 7f346235b700 1 --2- 172.21.15.124:0/154721206 >> v2:172.21.15.192:3300/0 conn(0x7f345c0b33f0 0x7f345c0b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:35.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.669+0000 7f3461b5a700 1 --2- 172.21.15.124:0/154721206 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f345c15b4e0 0x7f345c06f280 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f345c0cce60 tx=0x7f344c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c644ee54996643 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:35.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.669+0000 7f3460b58700 1 -- 172.21.15.124:0/154721206 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c011830 con 0x7f345c15b4e0 2023-10-16T12:59:35.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.669+0000 7f3460b58700 1 -- 172.21.15.124:0/154721206 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344c011990 con 0x7f345c15b4e0 2023-10-16T12:59:35.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.669+0000 7f3460b58700 1 -- 172.21.15.124:0/154721206 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c011d20 con 0x7f345c15b4e0 2023-10-16T12:59:35.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.669+0000 7f3463dbe700 1 -- 172.21.15.124:0/154721206 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f345c15b4e0 msgr2=0x7f345c06f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:35.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.669+0000 7f3463dbe700 1 --2- 172.21.15.124:0/154721206 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f345c15b4e0 0x7f345c06f280 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f345c0cce60 tx=0x7f344c009b20 comp rx=0 tx=0).stop 2023-10-16T12:59:35.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.669+0000 7f3463dbe700 1 -- 172.21.15.124:0/154721206 shutdown_connections 2023-10-16T12:59:35.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.669+0000 7f3463dbe700 1 --2- 172.21.15.124:0/154721206 >> v2:172.21.15.192:3300/0 conn(0x7f345c0b33f0 0x7f345c0b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.669+0000 7f3463dbe700 1 --2- 172.21.15.124:0/154721206 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f345c15b4e0 0x7f345c06f280 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.669+0000 7f3463dbe700 1 -- 172.21.15.124:0/154721206 >> 172.21.15.124:0/154721206 conn(0x7f345c0cdce0 msgr2=0x7f345c0ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:35.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.669+0000 7f3463dbe700 1 -- 172.21.15.124:0/154721206 shutdown_connections 2023-10-16T12:59:35.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.669+0000 7f3463dbe700 1 -- 172.21.15.124:0/154721206 wait complete. 2023-10-16T12:59:35.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.670+0000 7f3463dbe700 1 Processor -- start 2023-10-16T12:59:35.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.671+0000 7f3463dbe700 1 -- start start 2023-10-16T12:59:35.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.671+0000 7f3463dbe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f345c0b33f0 0x7f345c0afd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:35.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.671+0000 7f3463dbe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f345c0cd770 0x7f345c14a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:35.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.671+0000 7f3463dbe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f345c15b4e0 0x7f345c1e5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:35.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.671+0000 7f3463dbe700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345c1e3670 con 0x7f345c0cd770 2023-10-16T12:59:35.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.671+0000 7f3463dbe700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345c1e3950 con 0x7f345c15b4e0 2023-10-16T12:59:35.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.671+0000 7f3463dbe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345c1e3c30 con 0x7f345c0b33f0 2023-10-16T12:59:35.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.671+0000 7f3461359700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f345c0cd770 0x7f345c14a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:35.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.671+0000 7f3461359700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f345c0cd770 0x7f345c14a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54566/0 (socket says 172.21.15.124:54566) 2023-10-16T12:59:35.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.671+0000 7f3461359700 1 -- 172.21.15.124:0/330671441 learned_addr learned my addr 172.21.15.124:0/330671441 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:35.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.671+0000 7f3461b5a700 1 --2- 172.21.15.124:0/330671441 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f345c0b33f0 0x7f345c0afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:35.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.671+0000 7f346235b700 1 --2- 172.21.15.124:0/330671441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f345c15b4e0 0x7f345c1e5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:35.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.672+0000 7f3461359700 1 -- 172.21.15.124:0/330671441 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f345c0b33f0 msgr2=0x7f345c0afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:35.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.672+0000 7f3461359700 1 --2- 172.21.15.124:0/330671441 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f345c0b33f0 0x7f345c0afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.672+0000 7f3461359700 1 -- 172.21.15.124:0/330671441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f345c15b4e0 msgr2=0x7f345c1e5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:35.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.672+0000 7f3461359700 1 --2- 172.21.15.124:0/330671441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f345c15b4e0 0x7f345c1e5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.672+0000 7f3461359700 1 -- 172.21.15.124:0/330671441 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344c0094a0 con 0x7f345c0cd770 2023-10-16T12:59:35.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.672+0000 7f346235b700 1 --2- 172.21.15.124:0/330671441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f345c15b4e0 0x7f345c1e5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:35.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.672+0000 7f3461359700 1 --2- 172.21.15.124:0/330671441 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f345c0cd770 0x7f345c14a420 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f345800c500 tx=0x7f345800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:35.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.672+0000 7f34527fc700 1 -- 172.21.15.124:0/330671441 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3458005d70 con 0x7f345c0cd770 2023-10-16T12:59:35.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.672+0000 7f34527fc700 1 -- 172.21.15.124:0/330671441 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34580070d0 con 0x7f345c0cd770 2023-10-16T12:59:35.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.672+0000 7f3463dbe700 1 -- 172.21.15.124:0/330671441 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f345c1e3f10 con 0x7f345c0cd770 2023-10-16T12:59:35.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.672+0000 7f34527fc700 1 -- 172.21.15.124:0/330671441 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3458007440 con 0x7f345c0cd770 2023-10-16T12:59:35.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.672+0000 7f3463dbe700 1 -- 172.21.15.124:0/330671441 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345c14a960 con 0x7f345c0cd770 2023-10-16T12:59:35.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.673+0000 7f3463dbe700 1 -- 172.21.15.124:0/330671441 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f345c1e4430 con 0x7f345c0cd770 2023-10-16T12:59:35.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.673+0000 7f34527fc700 1 -- 172.21.15.124:0/330671441 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f34580075a0 con 0x7f345c0cd770 2023-10-16T12:59:35.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.674+0000 7f34527fc700 1 --2- 172.21.15.124:0/330671441 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f344006af00 0x7f344006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:35.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.674+0000 7f3461b5a700 1 --2- 172.21.15.124:0/330671441 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f344006af00 0x7f344006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:35.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.674+0000 7f34527fc700 1 -- 172.21.15.124:0/330671441 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f3458088cb0 con 0x7f345c0cd770 2023-10-16T12:59:35.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.674+0000 7f3461b5a700 1 --2- 172.21.15.124:0/330671441 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f344006af00 0x7f344006d3c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f344c0090b0 tx=0x7f344c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:35.686 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.678+0000 7f34527fc700 1 -- 172.21.15.124:0/330671441 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f345c1e4430 con 0x7f345c0cd770 2023-10-16T12:59:35.872 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.870+0000 7f3463dbe700 1 -- 172.21.15.124:0/330671441 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f345c1e4430 con 0x7f345c0cd770 2023-10-16T12:59:35.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.870+0000 7f34527fc700 1 -- 172.21.15.124:0/330671441 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f345c1e4430 con 0x7f345c0cd770 2023-10-16T12:59:35.873 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2023-10-16T12:59:35.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.872+0000 7f3463dbe700 1 -- 172.21.15.124:0/330671441 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f344006af00 msgr2=0x7f344006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:35.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.872+0000 7f3463dbe700 1 --2- 172.21.15.124:0/330671441 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f344006af00 0x7f344006d3c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f344c0090b0 tx=0x7f344c01c040 comp rx=0 tx=0).stop 2023-10-16T12:59:35.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.872+0000 7f3463dbe700 1 -- 172.21.15.124:0/330671441 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f345c0cd770 msgr2=0x7f345c14a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:35.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.872+0000 7f3463dbe700 1 --2- 172.21.15.124:0/330671441 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f345c0cd770 0x7f345c14a420 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f345800c500 tx=0x7f345800c810 comp rx=0 tx=0).stop 2023-10-16T12:59:35.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.872+0000 7f3463dbe700 1 -- 172.21.15.124:0/330671441 shutdown_connections 2023-10-16T12:59:35.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.872+0000 7f3463dbe700 1 --2- 172.21.15.124:0/330671441 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f344006af00 0x7f344006d3c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.872+0000 7f3463dbe700 1 --2- 172.21.15.124:0/330671441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f345c15b4e0 0x7f345c1e5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.872+0000 7f3463dbe700 1 --2- 172.21.15.124:0/330671441 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f345c0b33f0 0x7f345c0afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.872+0000 7f3463dbe700 1 --2- 172.21.15.124:0/330671441 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f345c0cd770 0x7f345c14a420 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:35.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.872+0000 7f3463dbe700 1 -- 172.21.15.124:0/330671441 >> 172.21.15.124:0/330671441 conn(0x7f345c0cdce0 msgr2=0x7f345c0c7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:35.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.872+0000 7f3463dbe700 1 -- 172.21.15.124:0/330671441 shutdown_connections 2023-10-16T12:59:35.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:35.872+0000 7f3463dbe700 1 -- 172.21.15.124:0/330671441 wait complete. 2023-10-16T12:59:35.887 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T12:59:36.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.007+0000 7f842db9a700 1 Processor -- start 2023-10-16T12:59:36.011 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.008+0000 7f842db9a700 1 -- start start 2023-10-16T12:59:36.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.008+0000 7f842db9a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f84280af290 0x7f842815b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:36.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.008+0000 7f842db9a700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84280cb9b0 con 0x7f84280af6f0 2023-10-16T12:59:36.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.008+0000 7f842db9a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84280cbc90 con 0x7f84280717e0 2023-10-16T12:59:36.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.008+0000 7f842db9a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84280cbf70 con 0x7f84280af290 2023-10-16T12:59:36.017 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.008+0000 7f8427fff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f84280af6f0 0x7f842806df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43244/0 (socket says 172.21.15.124:43244) 2023-10-16T12:59:36.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.008+0000 7f8427fff700 1 -- 172.21.15.124:0/3570287668 learned_addr learned my addr 172.21.15.124:0/3570287668 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:36.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f84267fc700 1 -- 172.21.15.124:0/3570287668 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 642670786 0 0) 0x7f84280cb9b0 con 0x7f84280af6f0 2023-10-16T12:59:36.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f8426ffd700 1 --2- 172.21.15.124:0/3570287668 >> v2:172.21.15.192:3300/0 conn(0x7f84280af290 0x7f842815b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:36.018 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f84267fc700 1 -- 172.21.15.124:0/3570287668 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84140035b0 con 0x7f84280af6f0 2023-10-16T12:59:36.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f84267fc700 1 -- 172.21.15.124:0/3570287668 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 305735180 0 0) 0x7f84140035b0 con 0x7f84280af6f0 2023-10-16T12:59:36.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f84267fc700 1 -- 172.21.15.124:0/3570287668 >> v2:172.21.15.192:3300/0 conn(0x7f84280af290 msgr2=0x7f842815b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:36.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f84267fc700 1 --2- 172.21.15.124:0/3570287668 >> v2:172.21.15.192:3300/0 conn(0x7f84280af290 0x7f842815b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f84267fc700 1 -- 172.21.15.124:0/3570287668 >> v1:172.21.15.192:6789/0 conn(0x7f84280717e0 legacy=0x7f8428071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:36.019 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f84267fc700 1 -- 172.21.15.124:0/3570287668 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842815ac80 con 0x7f84280af6f0 2023-10-16T12:59:36.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f84267fc700 1 -- 172.21.15.124:0/3570287668 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f84200019f0 con 0x7f84280af6f0 2023-10-16T12:59:36.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f84267fc700 1 -- 172.21.15.124:0/3570287668 >> v1:172.21.15.124:6789/0 conn(0x7f84280af6f0 legacy=0x7f842806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:36.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f84267fc700 1 --2- 172.21.15.124:0/3570287668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8414003a00 0x7f8414003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:36.020 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f84267fc700 1 --2- 172.21.15.124:0/3570287668 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8414004850 0x7f8414004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:36.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f84267fc700 1 --2- 172.21.15.124:0/3570287668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8414005210 0x7f841400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:36.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f84267fc700 1 -- 172.21.15.124:0/3570287668 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84280cbf70 con 0x7f8414004850 2023-10-16T12:59:36.021 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f84267fc700 1 -- 172.21.15.124:0/3570287668 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841400c0b0 con 0x7f8414005210 2023-10-16T12:59:36.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f84267fc700 1 -- 172.21.15.124:0/3570287668 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841400c270 con 0x7f8414003a00 2023-10-16T12:59:36.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f8426ffd700 1 --2- 172.21.15.124:0/3570287668 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8414004850 0x7f8414004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:36.022 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f8427fff700 1 --2- 172.21.15.124:0/3570287668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8414005210 0x7f841400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:36.023 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f84277fe700 1 --2- 172.21.15.124:0/3570287668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8414003a00 0x7f8414003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:36.023 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f8426ffd700 1 -- 172.21.15.124:0/3570287668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8414003a00 msgr2=0x7f8414003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:36.023 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f8426ffd700 1 --2- 172.21.15.124:0/3570287668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8414003a00 0x7f8414003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.024 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f8426ffd700 1 -- 172.21.15.124:0/3570287668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8414005210 msgr2=0x7f841400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:36.024 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f8426ffd700 1 --2- 172.21.15.124:0/3570287668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8414005210 0x7f841400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.024 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f8426ffd700 1 -- 172.21.15.124:0/3570287668 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84140035b0 con 0x7f8414004850 2023-10-16T12:59:36.024 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f8427fff700 1 --2- 172.21.15.124:0/3570287668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8414005210 0x7f841400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:36.025 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.009+0000 7f8427fff700 1 -- 172.21.15.124:0/3570287668 reap_dead start 2023-10-16T12:59:36.025 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.010+0000 7f8426ffd700 1 --2- 172.21.15.124:0/3570287668 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8414004850 0x7f8414004cd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f84180096f0 tx=0x7f8414005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f9cb062d1c6f5b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:36.025 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.010+0000 7f84267fc700 1 -- 172.21.15.124:0/3570287668 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841800e6c0 con 0x7f8414004850 2023-10-16T12:59:36.025 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.010+0000 7f84267fc700 1 -- 172.21.15.124:0/3570287668 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841800e820 con 0x7f8414004850 2023-10-16T12:59:36.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.010+0000 7f84267fc700 1 -- 172.21.15.124:0/3570287668 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841800ebb0 con 0x7f8414004850 2023-10-16T12:59:36.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.010+0000 7f842db9a700 1 -- 172.21.15.124:0/3570287668 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8414004850 msgr2=0x7f8414004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:36.026 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.010+0000 7f842db9a700 1 --2- 172.21.15.124:0/3570287668 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8414004850 0x7f8414004cd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f84180096f0 tx=0x7f8414005880 comp rx=0 tx=0).stop 2023-10-16T12:59:36.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.010+0000 7f842db9a700 1 -- 172.21.15.124:0/3570287668 shutdown_connections 2023-10-16T12:59:36.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.010+0000 7f842db9a700 1 --2- 172.21.15.124:0/3570287668 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8414004850 0x7f8414004cd0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.010+0000 7f842db9a700 1 -- 172.21.15.124:0/3570287668 >> 172.21.15.124:0/3570287668 conn(0x7f84280d0180 msgr2=0x7f84280d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:36.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.010+0000 7f842db9a700 1 -- 172.21.15.124:0/3570287668 shutdown_connections 2023-10-16T12:59:36.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.010+0000 7f842db9a700 1 -- 172.21.15.124:0/3570287668 wait complete. 2023-10-16T12:59:36.028 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.011+0000 7f842db9a700 1 Processor -- start 2023-10-16T12:59:36.029 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.012+0000 7f842db9a700 1 -- start start 2023-10-16T12:59:36.029 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.012+0000 7f842db9a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8414004850 0x7f8428149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:36.029 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.012+0000 7f842db9a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84280b0e90 0x7f84280b5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:36.029 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.012+0000 7f842db9a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84280b1310 0x7f84280b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:36.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.012+0000 7f842db9a700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84280c9f90 con 0x7f8414004850 2023-10-16T12:59:36.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.012+0000 7f842db9a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842814a2f0 con 0x7f84280b0e90 2023-10-16T12:59:36.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.012+0000 7f842db9a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84280c9380 con 0x7f84280b1310 2023-10-16T12:59:36.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.012+0000 7f84277fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8414004850 0x7f8428149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:36.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.012+0000 7f84277fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8414004850 0x7f8428149db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54584/0 (socket says 172.21.15.124:54584) 2023-10-16T12:59:36.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.013+0000 7f84277fe700 1 -- 172.21.15.124:0/947636988 learned_addr learned my addr 172.21.15.124:0/947636988 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:36.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.013+0000 7f8426ffd700 1 --2- 172.21.15.124:0/947636988 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84280b0e90 0x7f84280b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:36.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.013+0000 7f8427fff700 1 --2- 172.21.15.124:0/947636988 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84280b1310 0x7f84280b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:36.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.013+0000 7f84277fe700 1 -- 172.21.15.124:0/947636988 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84280b1310 msgr2=0x7f84280b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:36.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.013+0000 7f84277fe700 1 --2- 172.21.15.124:0/947636988 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84280b1310 0x7f84280b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.013+0000 7f84277fe700 1 -- 172.21.15.124:0/947636988 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84280b0e90 msgr2=0x7f84280b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:36.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.013+0000 7f84277fe700 1 --2- 172.21.15.124:0/947636988 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84280b0e90 0x7f84280b5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.013+0000 7f84277fe700 1 -- 172.21.15.124:0/947636988 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84280c9660 con 0x7f8414004850 2023-10-16T12:59:36.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.013+0000 7f8427fff700 1 --2- 172.21.15.124:0/947636988 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84280b1310 0x7f84280b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:36.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.013+0000 7f84277fe700 1 --2- 172.21.15.124:0/947636988 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8414004850 0x7f8428149db0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f841000e550 tx=0x7f841000e860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:36.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.013+0000 7f841ffff700 1 -- 172.21.15.124:0/947636988 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84100052e0 con 0x7f8414004850 2023-10-16T12:59:36.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.013+0000 7f841ffff700 1 -- 172.21.15.124:0/947636988 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8410005440 con 0x7f8414004850 2023-10-16T12:59:36.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.013+0000 7f841ffff700 1 -- 172.21.15.124:0/947636988 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84100038a0 con 0x7f8414004850 2023-10-16T12:59:36.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.013+0000 7f842db9a700 1 -- 172.21.15.124:0/947636988 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84280c9940 con 0x7f8414004850 2023-10-16T12:59:36.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.013+0000 7f842db9a700 1 -- 172.21.15.124:0/947636988 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84280c8fe0 con 0x7f8414004850 2023-10-16T12:59:36.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.014+0000 7f842db9a700 1 -- 172.21.15.124:0/947636988 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f842806d840 con 0x7f8414004850 2023-10-16T12:59:36.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.014+0000 7f841ffff700 1 -- 172.21.15.124:0/947636988 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8410003a00 con 0x7f8414004850 2023-10-16T12:59:36.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.015+0000 7f841ffff700 1 --2- 172.21.15.124:0/947636988 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f840806af00 0x7f840806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:36.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.015+0000 7f8426ffd700 1 --2- 172.21.15.124:0/947636988 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f840806af00 0x7f840806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:36.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.015+0000 7f841ffff700 1 -- 172.21.15.124:0/947636988 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f8410088fe0 con 0x7f8414004850 2023-10-16T12:59:36.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.015+0000 7f8426ffd700 1 --2- 172.21.15.124:0/947636988 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f840806af00 0x7f840806d3c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f841801c040 tx=0x7f8418010040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:36.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.019+0000 7f841ffff700 1 -- 172.21.15.124:0/947636988 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8410053d80 con 0x7f8414004850 2023-10-16T12:59:36.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.209+0000 7f842db9a700 1 -- 172.21.15.124:0/947636988 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f842804ebb0 con 0x7f8414004850 2023-10-16T12:59:36.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.209+0000 7f841ffff700 1 -- 172.21.15.124:0/947636988 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f84100190a0 con 0x7f8414004850 2023-10-16T12:59:36.213 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:36.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.211+0000 7f842db9a700 1 -- 172.21.15.124:0/947636988 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f840806af00 msgr2=0x7f840806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:36.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.211+0000 7f842db9a700 1 --2- 172.21.15.124:0/947636988 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f840806af00 0x7f840806d3c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f841801c040 tx=0x7f8418010040 comp rx=0 tx=0).stop 2023-10-16T12:59:36.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.211+0000 7f842db9a700 1 -- 172.21.15.124:0/947636988 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8414004850 msgr2=0x7f8428149db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:36.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.211+0000 7f842db9a700 1 --2- 172.21.15.124:0/947636988 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8414004850 0x7f8428149db0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f841000e550 tx=0x7f841000e860 comp rx=0 tx=0).stop 2023-10-16T12:59:36.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.211+0000 7f842db9a700 1 -- 172.21.15.124:0/947636988 shutdown_connections 2023-10-16T12:59:36.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.211+0000 7f842db9a700 1 --2- 172.21.15.124:0/947636988 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f840806af00 0x7f840806d3c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.211+0000 7f842db9a700 1 --2- 172.21.15.124:0/947636988 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84280b1310 0x7f84280b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.211+0000 7f842db9a700 1 --2- 172.21.15.124:0/947636988 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8414004850 0x7f8428149db0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.211+0000 7f842db9a700 1 --2- 172.21.15.124:0/947636988 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84280b0e90 0x7f84280b5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.211+0000 7f842db9a700 1 -- 172.21.15.124:0/947636988 >> 172.21.15.124:0/947636988 conn(0x7f84280d0180 msgr2=0x7f84280ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:36.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.211+0000 7f842db9a700 1 -- 172.21.15.124:0/947636988 shutdown_connections 2023-10-16T12:59:36.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.211+0000 7f842db9a700 1 -- 172.21.15.124:0/947636988 wait complete. 2023-10-16T12:59:36.273 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-16T12:59:36.274 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:59:36.395 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.393+0000 7f9d4fdc9700 1 Processor -- start 2023-10-16T12:59:36.396 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.393+0000 7f9d4fdc9700 1 -- start start 2023-10-16T12:59:36.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.394+0000 7f9d4fdc9700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9d480712e0 0x7f9d480716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:36.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.394+0000 7f9d4fdc9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9d480cbf10 0x7f9d4806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:36.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.394+0000 7f9d4fdc9700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d48071c00 con 0x7f9d4806cf10 2023-10-16T12:59:36.399 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.394+0000 7f9d4fdc9700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d4806d9d0 con 0x7f9d480712e0 2023-10-16T12:59:36.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.394+0000 7f9d4fdc9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d4806dcb0 con 0x7f9d480cbf10 2023-10-16T12:59:36.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.394+0000 7f9d4db65700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9d480712e0 0x7f9d480716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:36.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.394+0000 7f9d4d364700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f9d4806cf10 0x7f9d4806a820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43260/0 (socket says 172.21.15.124:43260) 2023-10-16T12:59:36.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.394+0000 7f9d4d364700 1 -- 172.21.15.124:0/3126142732 learned_addr learned my addr 172.21.15.124:0/3126142732 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:36.400 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.394+0000 7f9d4e366700 1 --2- 172.21.15.124:0/3126142732 >> v2:172.21.15.192:3300/0 conn(0x7f9d480cbf10 0x7f9d4806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:36.401 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.394+0000 7f9d4db65700 1 -- 172.21.15.124:0/3126142732 >> v2:172.21.15.192:3300/0 conn(0x7f9d480cbf10 msgr2=0x7f9d4806d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:36.401 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.394+0000 7f9d4db65700 1 --2- 172.21.15.124:0/3126142732 >> v2:172.21.15.192:3300/0 conn(0x7f9d480cbf10 0x7f9d4806d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.401 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.394+0000 7f9d4db65700 1 -- 172.21.15.124:0/3126142732 >> v1:172.21.15.124:6789/0 conn(0x7f9d4806cf10 legacy=0x7f9d4806a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:36.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.394+0000 7f9d4db65700 1 -- 172.21.15.124:0/3126142732 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d480ca420 con 0x7f9d480712e0 2023-10-16T12:59:36.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.394+0000 7f9d4db65700 1 --2- 172.21.15.124:0/3126142732 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d480712e0 0x7f9d480716c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9d4806c2a0 tx=0x7f9d44009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803e84238fb2abda server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:36.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.394+0000 7f9d4cb63700 1 -- 172.21.15.124:0/3126142732 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d44011830 con 0x7f9d480712e0 2023-10-16T12:59:36.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.395+0000 7f9d4cb63700 1 -- 172.21.15.124:0/3126142732 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d44011990 con 0x7f9d480712e0 2023-10-16T12:59:36.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.395+0000 7f9d4cb63700 1 -- 172.21.15.124:0/3126142732 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d44011d20 con 0x7f9d480712e0 2023-10-16T12:59:36.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.395+0000 7f9d4fdc9700 1 -- 172.21.15.124:0/3126142732 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d480712e0 msgr2=0x7f9d480716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:36.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.395+0000 7f9d4fdc9700 1 --2- 172.21.15.124:0/3126142732 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d480712e0 0x7f9d480716c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9d4806c2a0 tx=0x7f9d44009b20 comp rx=0 tx=0).stop 2023-10-16T12:59:36.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.395+0000 7f9d4fdc9700 1 -- 172.21.15.124:0/3126142732 shutdown_connections 2023-10-16T12:59:36.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.395+0000 7f9d4fdc9700 1 --2- 172.21.15.124:0/3126142732 >> v2:172.21.15.192:3300/0 conn(0x7f9d480cbf10 0x7f9d4806d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.395+0000 7f9d4fdc9700 1 --2- 172.21.15.124:0/3126142732 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d480712e0 0x7f9d480716c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.395+0000 7f9d4fdc9700 1 -- 172.21.15.124:0/3126142732 >> 172.21.15.124:0/3126142732 conn(0x7f9d480cfcd0 msgr2=0x7f9d480d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:36.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.395+0000 7f9d4fdc9700 1 -- 172.21.15.124:0/3126142732 shutdown_connections 2023-10-16T12:59:36.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.395+0000 7f9d4fdc9700 1 -- 172.21.15.124:0/3126142732 wait complete. 2023-10-16T12:59:36.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.396+0000 7f9d4fdc9700 1 Processor -- start 2023-10-16T12:59:36.405 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.396+0000 7f9d4fdc9700 1 -- start start 2023-10-16T12:59:36.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.397+0000 7f9d4fdc9700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d4806cf10 0x7f9d48149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:36.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.397+0000 7f9d4fdc9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d480712e0 0x7f9d480c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:36.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.397+0000 7f9d4fdc9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d480cbf10 0x7f9d4815bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:36.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.397+0000 7f9d4fdc9700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d480c34b0 con 0x7f9d4806cf10 2023-10-16T12:59:36.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.397+0000 7f9d4fdc9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d480c3790 con 0x7f9d480712e0 2023-10-16T12:59:36.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.397+0000 7f9d4fdc9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d480c3a70 con 0x7f9d480cbf10 2023-10-16T12:59:36.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.397+0000 7f9d4db65700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d4806cf10 0x7f9d48149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:36.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.397+0000 7f9d4db65700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d4806cf10 0x7f9d48149130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54596/0 (socket says 172.21.15.124:54596) 2023-10-16T12:59:36.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.397+0000 7f9d4db65700 1 -- 172.21.15.124:0/323918399 learned_addr learned my addr 172.21.15.124:0/323918399 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:36.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.397+0000 7f9d4db65700 1 -- 172.21.15.124:0/323918399 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d480cbf10 msgr2=0x7f9d4815bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:36.410 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.397+0000 7f9d4db65700 1 --2- 172.21.15.124:0/323918399 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d480cbf10 0x7f9d4815bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.410 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.397+0000 7f9d4db65700 1 -- 172.21.15.124:0/323918399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d480712e0 msgr2=0x7f9d480c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:36.410 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.397+0000 7f9d4db65700 1 --2- 172.21.15.124:0/323918399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d480712e0 0x7f9d480c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.410 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.397+0000 7f9d4db65700 1 -- 172.21.15.124:0/323918399 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d440094a0 con 0x7f9d4806cf10 2023-10-16T12:59:36.410 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.398+0000 7f9d4db65700 1 --2- 172.21.15.124:0/323918399 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d4806cf10 0x7f9d48149130 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9d44000c00 tx=0x7f9d44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:36.411 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.398+0000 7f9d3e7fc700 1 -- 172.21.15.124:0/323918399 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d440036a0 con 0x7f9d4806cf10 2023-10-16T12:59:36.411 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.398+0000 7f9d3e7fc700 1 -- 172.21.15.124:0/323918399 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4401e070 con 0x7f9d4806cf10 2023-10-16T12:59:36.411 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.398+0000 7f9d4fdc9700 1 -- 172.21.15.124:0/323918399 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d480c3d50 con 0x7f9d4806cf10 2023-10-16T12:59:36.411 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.398+0000 7f9d3e7fc700 1 -- 172.21.15.124:0/323918399 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d44003a40 con 0x7f9d4806cf10 2023-10-16T12:59:36.412 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.398+0000 7f9d4fdc9700 1 -- 172.21.15.124:0/323918399 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d480c6bf0 con 0x7f9d4806cf10 2023-10-16T12:59:36.412 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.399+0000 7f9d4fdc9700 1 -- 172.21.15.124:0/323918399 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d480c4270 con 0x7f9d4806cf10 2023-10-16T12:59:36.412 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.399+0000 7f9d3e7fc700 1 -- 172.21.15.124:0/323918399 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9d44003ba0 con 0x7f9d4806cf10 2023-10-16T12:59:36.412 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.399+0000 7f9d3e7fc700 1 --2- 172.21.15.124:0/323918399 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f9d2c06af30 0x7f9d2c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:36.413 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.400+0000 7f9d3e7fc700 1 -- 172.21.15.124:0/323918399 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f9d4408a9d0 con 0x7f9d4806cf10 2023-10-16T12:59:36.413 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.400+0000 7f9d4d364700 1 --2- 172.21.15.124:0/323918399 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f9d2c06af30 0x7f9d2c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:36.413 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.400+0000 7f9d4d364700 1 --2- 172.21.15.124:0/323918399 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f9d2c06af30 0x7f9d2c06d3f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9d38000f60 tx=0x7f9d38007b10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:36.413 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.404+0000 7f9d3e7fc700 1 -- 172.21.15.124:0/323918399 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9d480c4270 con 0x7f9d4806cf10 2023-10-16T12:59:36.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.598+0000 7f9d4fdc9700 1 -- 172.21.15.124:0/323918399 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d480c4270 con 0x7f9d4806cf10 2023-10-16T12:59:36.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.599+0000 7f9d3e7fc700 1 -- 172.21.15.124:0/323918399 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18751 (secure 0 0 0) 0x7f9d480c4270 con 0x7f9d4806cf10 2023-10-16T12:59:36.602 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:36.602 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":26,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:59:34.463212+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2},{"from":7,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:59:36.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.601+0000 7f9d4fdc9700 1 -- 172.21.15.124:0/323918399 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f9d2c06af30 msgr2=0x7f9d2c06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:36.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.601+0000 7f9d4fdc9700 1 --2- 172.21.15.124:0/323918399 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f9d2c06af30 0x7f9d2c06d3f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9d38000f60 tx=0x7f9d38007b10 comp rx=0 tx=0).stop 2023-10-16T12:59:36.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.601+0000 7f9d4fdc9700 1 -- 172.21.15.124:0/323918399 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d4806cf10 msgr2=0x7f9d48149130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:36.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.601+0000 7f9d4fdc9700 1 --2- 172.21.15.124:0/323918399 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d4806cf10 0x7f9d48149130 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9d44000c00 tx=0x7f9d44004750 comp rx=0 tx=0).stop 2023-10-16T12:59:36.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.601+0000 7f9d4fdc9700 1 -- 172.21.15.124:0/323918399 shutdown_connections 2023-10-16T12:59:36.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.601+0000 7f9d4fdc9700 1 --2- 172.21.15.124:0/323918399 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f9d2c06af30 0x7f9d2c06d3f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.601+0000 7f9d4fdc9700 1 --2- 172.21.15.124:0/323918399 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d480cbf10 0x7f9d4815bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.601+0000 7f9d4fdc9700 1 --2- 172.21.15.124:0/323918399 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9d4806cf10 0x7f9d48149130 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.601+0000 7f9d4fdc9700 1 --2- 172.21.15.124:0/323918399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d480712e0 0x7f9d480c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.601+0000 7f9d4fdc9700 1 -- 172.21.15.124:0/323918399 >> 172.21.15.124:0/323918399 conn(0x7f9d480cfcd0 msgr2=0x7f9d48154050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:36.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.601+0000 7f9d4fdc9700 1 -- 172.21.15.124:0/323918399 shutdown_connections 2023-10-16T12:59:36.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.601+0000 7f9d4fdc9700 1 -- 172.21.15.124:0/323918399 wait complete. 2023-10-16T12:59:36.616 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T12:58:38.667813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T12:58:49.562073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T12:58:50.011419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T12:58:53.692890+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T12:59:36.617 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T12:59:36.740 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.737+0000 7f8ec7e29700 1 Processor -- start 2023-10-16T12:59:36.740 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.737+0000 7f8ec7e29700 1 -- start start 2023-10-16T12:59:36.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.738+0000 7f8ec7e29700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8ec015b4e0 0x7f8ec006f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:36.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.738+0000 7f8ec7e29700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ec00cd770 0x7f8ec00b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:36.743 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.738+0000 7f8ec7e29700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8ec00b3220 0x7f8ec00cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:36.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.738+0000 7f8ec7e29700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec00b36b0 con 0x7f8ec00b3220 2023-10-16T12:59:36.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.738+0000 7f8ec7e29700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec0070620 con 0x7f8ec015b4e0 2023-10-16T12:59:36.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.738+0000 7f8ec7e29700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec0070900 con 0x7f8ec00cd770 2023-10-16T12:59:36.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.738+0000 7f8ec63c6700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8ec00b3220 0x7f8ec00cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:36.744 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.738+0000 7f8ec63c6700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8ec00b3220 0x7f8ec00cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54606/0 (socket says 172.21.15.124:54606) 2023-10-16T12:59:36.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.738+0000 7f8ec63c6700 1 -- 172.21.15.124:0/2692034620 learned_addr learned my addr 172.21.15.124:0/2692034620 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:36.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.739+0000 7f8ec53c4700 1 --2- 172.21.15.124:0/2692034620 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ec00cd770 0x7f8ec00b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:36.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.739+0000 7f8ec5bc5700 1 --2- 172.21.15.124:0/2692034620 >> v2:172.21.15.192:3300/0 conn(0x7f8ec015b4e0 0x7f8ec006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:36.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.739+0000 7f8ec63c6700 1 -- 172.21.15.124:0/2692034620 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ec00cd770 msgr2=0x7f8ec00b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:36.745 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.739+0000 7f8ec63c6700 1 --2- 172.21.15.124:0/2692034620 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ec00cd770 0x7f8ec00b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.739+0000 7f8ec63c6700 1 -- 172.21.15.124:0/2692034620 >> v2:172.21.15.192:3300/0 conn(0x7f8ec015b4e0 msgr2=0x7f8ec006f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:36.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.739+0000 7f8ec63c6700 1 --2- 172.21.15.124:0/2692034620 >> v2:172.21.15.192:3300/0 conn(0x7f8ec015b4e0 0x7f8ec006f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.739+0000 7f8ec63c6700 1 -- 172.21.15.124:0/2692034620 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec0070be0 con 0x7f8ec00b3220 2023-10-16T12:59:36.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.739+0000 7f8ec53c4700 1 --2- 172.21.15.124:0/2692034620 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ec00cd770 0x7f8ec00b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:36.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.739+0000 7f8ec5bc5700 1 --2- 172.21.15.124:0/2692034620 >> v2:172.21.15.192:3300/0 conn(0x7f8ec015b4e0 0x7f8ec006f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:36.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.739+0000 7f8ec63c6700 1 --2- 172.21.15.124:0/2692034620 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8ec00b3220 0x7f8ec00cee30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00c4d60 tx=0x7f8eb800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9788633d98378f41 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:36.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.739+0000 7f8ec4bc3700 1 -- 172.21.15.124:0/2692034620 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb800e070 con 0x7f8ec00b3220 2023-10-16T12:59:36.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.739+0000 7f8ec4bc3700 1 -- 172.21.15.124:0/2692034620 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb800b9c0 con 0x7f8ec00b3220 2023-10-16T12:59:36.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.739+0000 7f8ec4bc3700 1 -- 172.21.15.124:0/2692034620 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb800bd70 con 0x7f8ec00b3220 2023-10-16T12:59:36.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.740+0000 7f8ec7e29700 1 -- 172.21.15.124:0/2692034620 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8ec00b3220 msgr2=0x7f8ec00cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:36.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.740+0000 7f8ec7e29700 1 --2- 172.21.15.124:0/2692034620 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8ec00b3220 0x7f8ec00cee30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00c4d60 tx=0x7f8eb800b330 comp rx=0 tx=0).stop 2023-10-16T12:59:36.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.740+0000 7f8ec7e29700 1 -- 172.21.15.124:0/2692034620 shutdown_connections 2023-10-16T12:59:36.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.740+0000 7f8ec7e29700 1 --2- 172.21.15.124:0/2692034620 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8ec00b3220 0x7f8ec00cee30 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.740+0000 7f8ec7e29700 1 --2- 172.21.15.124:0/2692034620 >> v2:172.21.15.192:3300/0 conn(0x7f8ec015b4e0 0x7f8ec006f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.748 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.740+0000 7f8ec7e29700 1 --2- 172.21.15.124:0/2692034620 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ec00cd770 0x7f8ec00b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.749 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.740+0000 7f8ec7e29700 1 -- 172.21.15.124:0/2692034620 >> 172.21.15.124:0/2692034620 conn(0x7f8ec00cdce0 msgr2=0x7f8ec00ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:36.749 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.740+0000 7f8ec7e29700 1 -- 172.21.15.124:0/2692034620 shutdown_connections 2023-10-16T12:59:36.749 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.740+0000 7f8ec7e29700 1 -- 172.21.15.124:0/2692034620 wait complete. 2023-10-16T12:59:36.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.741+0000 7f8ec7e29700 1 Processor -- start 2023-10-16T12:59:36.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.741+0000 7f8ec7e29700 1 -- start start 2023-10-16T12:59:36.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.742+0000 7f8ec7e29700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ec00b3220 0x7f8ec0140150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:36.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.742+0000 7f8ec7e29700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8ec00cd770 0x7f8ec01f0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:36.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.742+0000 7f8ec7e29700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ec015b4e0 0x7f8ec0142160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:36.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.742+0000 7f8ec7e29700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec01569a0 con 0x7f8ec00cd770 2023-10-16T12:59:36.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.742+0000 7f8ec7e29700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec0143110 con 0x7f8ec00b3220 2023-10-16T12:59:36.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.742+0000 7f8ec7e29700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec0142870 con 0x7f8ec015b4e0 2023-10-16T12:59:36.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.742+0000 7f8ec53c4700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8ec00cd770 0x7f8ec01f0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:36.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.742+0000 7f8ec53c4700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8ec00cd770 0x7f8ec01f0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54610/0 (socket says 172.21.15.124:54610) 2023-10-16T12:59:36.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.742+0000 7f8ec53c4700 1 -- 172.21.15.124:0/338557392 learned_addr learned my addr 172.21.15.124:0/338557392 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:36.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.742+0000 7f8ec63c6700 1 --2- 172.21.15.124:0/338557392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ec015b4e0 0x7f8ec0142160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:36.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.742+0000 7f8ec5bc5700 1 --2- 172.21.15.124:0/338557392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ec00b3220 0x7f8ec0140150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:36.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.742+0000 7f8ec53c4700 1 -- 172.21.15.124:0/338557392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ec015b4e0 msgr2=0x7f8ec0142160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:36.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.742+0000 7f8ec53c4700 1 --2- 172.21.15.124:0/338557392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ec015b4e0 0x7f8ec0142160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.742+0000 7f8ec53c4700 1 -- 172.21.15.124:0/338557392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ec00b3220 msgr2=0x7f8ec0140150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:36.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.742+0000 7f8ec53c4700 1 --2- 172.21.15.124:0/338557392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ec00b3220 0x7f8ec0140150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.742+0000 7f8ec53c4700 1 -- 172.21.15.124:0/338557392 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb8009b30 con 0x7f8ec00cd770 2023-10-16T12:59:36.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.742+0000 7f8ec5bc5700 1 --2- 172.21.15.124:0/338557392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ec00b3220 0x7f8ec0140150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:36.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.742+0000 7f8ec53c4700 1 --2- 172.21.15.124:0/338557392 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8ec00cd770 0x7f8ec01f0490 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00c7f0 tx=0x7f8ebc00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:36.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.743+0000 7f8eb67fc700 1 -- 172.21.15.124:0/338557392 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc011800 con 0x7f8ec00cd770 2023-10-16T12:59:36.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.743+0000 7f8eb67fc700 1 -- 172.21.15.124:0/338557392 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc011960 con 0x7f8ec00cd770 2023-10-16T12:59:36.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.743+0000 7f8ec7e29700 1 -- 172.21.15.124:0/338557392 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec0142b50 con 0x7f8ec00cd770 2023-10-16T12:59:36.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.743+0000 7f8eb67fc700 1 -- 172.21.15.124:0/338557392 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc011cf0 con 0x7f8ec00cd770 2023-10-16T12:59:36.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.743+0000 7f8ec7e29700 1 -- 172.21.15.124:0/338557392 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec01f49a0 con 0x7f8ec00cd770 2023-10-16T12:59:36.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.744+0000 7f8ec7e29700 1 -- 172.21.15.124:0/338557392 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec0156ae0 con 0x7f8ec00cd770 2023-10-16T12:59:36.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.744+0000 7f8eb67fc700 1 -- 172.21.15.124:0/338557392 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8ebc018360 con 0x7f8ec00cd770 2023-10-16T12:59:36.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.744+0000 7f8eb67fc700 1 --2- 172.21.15.124:0/338557392 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f8ea406af00 0x7f8ea406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:36.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.744+0000 7f8eb67fc700 1 -- 172.21.15.124:0/338557392 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f8ebc089940 con 0x7f8ec00cd770 2023-10-16T12:59:36.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.744+0000 7f8ec5bc5700 1 --2- 172.21.15.124:0/338557392 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f8ea406af00 0x7f8ea406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:36.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.745+0000 7f8ec5bc5700 1 --2- 172.21.15.124:0/338557392 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f8ea406af00 0x7f8ea406d3c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0006fd0 tx=0x7f8eb0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:36.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.749+0000 7f8eb67fc700 1 -- 172.21.15.124:0/338557392 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8ec0156ae0 con 0x7f8ec00cd770 2023-10-16T12:59:36.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.937+0000 7f8ec7e29700 1 -- 172.21.15.124:0/338557392 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8ec0156ae0 con 0x7f8ec00cd770 2023-10-16T12:59:36.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.938+0000 7f8eb67fc700 1 -- 172.21.15.124:0/338557392 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8ec0156ae0 con 0x7f8ec00cd770 2023-10-16T12:59:36.941 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-16T12:59:36.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.939+0000 7f8ec7e29700 1 -- 172.21.15.124:0/338557392 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f8ea406af00 msgr2=0x7f8ea406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:36.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.939+0000 7f8ec7e29700 1 --2- 172.21.15.124:0/338557392 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f8ea406af00 0x7f8ea406d3c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0006fd0 tx=0x7f8eb0008040 comp rx=0 tx=0).stop 2023-10-16T12:59:36.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.939+0000 7f8ec7e29700 1 -- 172.21.15.124:0/338557392 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8ec00cd770 msgr2=0x7f8ec01f0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:36.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.939+0000 7f8ec7e29700 1 --2- 172.21.15.124:0/338557392 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8ec00cd770 0x7f8ec01f0490 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00c7f0 tx=0x7f8ebc00cb00 comp rx=0 tx=0).stop 2023-10-16T12:59:36.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.940+0000 7f8ec7e29700 1 -- 172.21.15.124:0/338557392 shutdown_connections 2023-10-16T12:59:36.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.940+0000 7f8ec7e29700 1 --2- 172.21.15.124:0/338557392 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f8ea406af00 0x7f8ea406d3c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.940+0000 7f8ec7e29700 1 --2- 172.21.15.124:0/338557392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ec015b4e0 0x7f8ec0142160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.940+0000 7f8ec7e29700 1 --2- 172.21.15.124:0/338557392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ec00b3220 0x7f8ec0140150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.940+0000 7f8ec7e29700 1 --2- 172.21.15.124:0/338557392 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8ec00cd770 0x7f8ec01f0490 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:36.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.940+0000 7f8ec7e29700 1 -- 172.21.15.124:0/338557392 >> 172.21.15.124:0/338557392 conn(0x7f8ec00cdce0 msgr2=0x7f8ec00c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:36.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.940+0000 7f8ec7e29700 1 -- 172.21.15.124:0/338557392 shutdown_connections 2023-10-16T12:59:36.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:36.940+0000 7f8ec7e29700 1 -- 172.21.15.124:0/338557392 wait complete. 2023-10-16T12:59:36.954 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T12:59:37.077 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.075+0000 7fd96f357700 1 Processor -- start 2023-10-16T12:59:37.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.075+0000 7fd96f357700 1 -- start start 2023-10-16T12:59:37.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.076+0000 7fd96f357700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd9680ce440 0x7fd96815dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:37.080 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.076+0000 7fd96f357700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd968161360 con 0x7fd96806a820 2023-10-16T12:59:37.080 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.076+0000 7fd96f357700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96806b750 con 0x7fd96806b370 2023-10-16T12:59:37.080 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.076+0000 7fd96f357700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96806dcc0 con 0x7fd9680ce440 2023-10-16T12:59:37.080 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.076+0000 7fd96d8f4700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd9680ce440 0x7fd96815dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:37.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.076+0000 7fd96d8f4700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd9680ce440 0x7fd96815dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54620/0 (socket says 172.21.15.124:54620) 2023-10-16T12:59:37.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.076+0000 7fd96c8f2700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fd96806a820 0x7fd9680cdd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43284/0 (socket says 172.21.15.124:43284) 2023-10-16T12:59:37.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.076+0000 7fd96d8f4700 1 -- 172.21.15.124:0/4134038510 learned_addr learned my addr 172.21.15.124:0/4134038510 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:37.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.076+0000 7fd96d8f4700 1 -- 172.21.15.124:0/4134038510 >> v1:172.21.15.192:6789/0 conn(0x7fd96806b370 legacy=0x7fd96806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:37.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.076+0000 7fd96d8f4700 1 -- 172.21.15.124:0/4134038510 >> v1:172.21.15.124:6789/0 conn(0x7fd96806a820 legacy=0x7fd9680cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:37.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.076+0000 7fd95bfff700 1 -- 172.21.15.124:0/4134038510 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678295140 0 0) 0x7fd968161360 con 0x7fd96806a820 2023-10-16T12:59:37.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.076+0000 7fd96d8f4700 1 -- 172.21.15.124:0/4134038510 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96815e300 con 0x7fd9680ce440 2023-10-16T12:59:37.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.076+0000 7fd96d8f4700 1 --2- 172.21.15.124:0/4134038510 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9680ce440 0x7fd96815dcb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd960009e80 tx=0x7fd96000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8bd892e4413b12 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:37.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.076+0000 7fd95bfff700 1 -- 172.21.15.124:0/4134038510 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96000e070 con 0x7fd9680ce440 2023-10-16T12:59:37.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.076+0000 7fd95bfff700 1 -- 172.21.15.124:0/4134038510 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96000b980 con 0x7fd9680ce440 2023-10-16T12:59:37.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.076+0000 7fd95bfff700 1 -- 172.21.15.124:0/4134038510 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96000bd30 con 0x7fd9680ce440 2023-10-16T12:59:37.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.077+0000 7fd96f357700 1 -- 172.21.15.124:0/4134038510 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9680ce440 msgr2=0x7fd96815dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:37.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.077+0000 7fd96f357700 1 --2- 172.21.15.124:0/4134038510 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9680ce440 0x7fd96815dcb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd960009e80 tx=0x7fd96000b330 comp rx=0 tx=0).stop 2023-10-16T12:59:37.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.077+0000 7fd96f357700 1 -- 172.21.15.124:0/4134038510 shutdown_connections 2023-10-16T12:59:37.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.077+0000 7fd96f357700 1 --2- 172.21.15.124:0/4134038510 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9680ce440 0x7fd96815dcb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.077+0000 7fd96f357700 1 -- 172.21.15.124:0/4134038510 >> 172.21.15.124:0/4134038510 conn(0x7fd9680ccbe0 msgr2=0x7fd9680ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:37.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.077+0000 7fd96f357700 1 -- 172.21.15.124:0/4134038510 shutdown_connections 2023-10-16T12:59:37.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.077+0000 7fd96f357700 1 -- 172.21.15.124:0/4134038510 wait complete. 2023-10-16T12:59:37.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.078+0000 7fd96f357700 1 Processor -- start 2023-10-16T12:59:37.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.078+0000 7fd96f357700 1 -- start start 2023-10-16T12:59:37.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.079+0000 7fd96f357700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd96806a820 0x7fd9680b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:37.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.079+0000 7fd96f357700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd96806b370 0x7fd968158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:37.088 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.079+0000 7fd96f357700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9680ce440 0x7fd968146da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:37.088 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.079+0000 7fd96f357700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9680b5c30 con 0x7fd96806b370 2023-10-16T12:59:37.088 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.079+0000 7fd96f357700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96815aa40 con 0x7fd9680ce440 2023-10-16T12:59:37.088 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.079+0000 7fd96f357700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96815ad20 con 0x7fd96806a820 2023-10-16T12:59:37.088 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.079+0000 7fd96c8f2700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd96806b370 0x7fd968158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:37.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.079+0000 7fd96c8f2700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd96806b370 0x7fd968158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54622/0 (socket says 172.21.15.124:54622) 2023-10-16T12:59:37.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.079+0000 7fd96c8f2700 1 -- 172.21.15.124:0/2870566604 learned_addr learned my addr 172.21.15.124:0/2870566604 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:37.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.079+0000 7fd96c8f2700 1 -- 172.21.15.124:0/2870566604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd96806a820 msgr2=0x7fd9680b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:37.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.079+0000 7fd96d0f3700 1 --2- 172.21.15.124:0/2870566604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd96806a820 0x7fd9680b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:37.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.079+0000 7fd96d8f4700 1 --2- 172.21.15.124:0/2870566604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9680ce440 0x7fd968146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:37.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.079+0000 7fd96c8f2700 1 --2- 172.21.15.124:0/2870566604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd96806a820 0x7fd9680b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.079+0000 7fd96c8f2700 1 -- 172.21.15.124:0/2870566604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9680ce440 msgr2=0x7fd968146da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:37.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.079+0000 7fd96c8f2700 1 --2- 172.21.15.124:0/2870566604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9680ce440 0x7fd968146da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.079+0000 7fd96c8f2700 1 -- 172.21.15.124:0/2870566604 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd960009b30 con 0x7fd96806b370 2023-10-16T12:59:37.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.079+0000 7fd96d0f3700 1 --2- 172.21.15.124:0/2870566604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd96806a820 0x7fd9680b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:37.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.079+0000 7fd96d8f4700 1 --2- 172.21.15.124:0/2870566604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9680ce440 0x7fd968146da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:37.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.079+0000 7fd96c8f2700 1 --2- 172.21.15.124:0/2870566604 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd96806b370 0x7fd968158bb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd96400c450 tx=0x7fd96400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:37.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.080+0000 7fd959ffb700 1 -- 172.21.15.124:0/2870566604 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd964004c80 con 0x7fd96806b370 2023-10-16T12:59:37.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.080+0000 7fd959ffb700 1 -- 172.21.15.124:0/2870566604 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd964004e00 con 0x7fd96806b370 2023-10-16T12:59:37.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.080+0000 7fd96f357700 1 -- 172.21.15.124:0/2870566604 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96815b000 con 0x7fd96806b370 2023-10-16T12:59:37.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.080+0000 7fd959ffb700 1 -- 172.21.15.124:0/2870566604 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd964007310 con 0x7fd96806b370 2023-10-16T12:59:37.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.080+0000 7fd96f357700 1 -- 172.21.15.124:0/2870566604 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9681f65c0 con 0x7fd96806b370 2023-10-16T12:59:37.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.081+0000 7fd96f357700 1 -- 172.21.15.124:0/2870566604 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd968072d10 con 0x7fd96806b370 2023-10-16T12:59:37.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.081+0000 7fd959ffb700 1 -- 172.21.15.124:0/2870566604 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd964007470 con 0x7fd96806b370 2023-10-16T12:59:37.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.081+0000 7fd959ffb700 1 --2- 172.21.15.124:0/2870566604 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd94c06af00 0x7fd94c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:37.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.082+0000 7fd959ffb700 1 -- 172.21.15.124:0/2870566604 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7fd9640896a0 con 0x7fd96806b370 2023-10-16T12:59:37.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.082+0000 7fd96d0f3700 1 --2- 172.21.15.124:0/2870566604 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd94c06af00 0x7fd94c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:37.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.082+0000 7fd96d0f3700 1 --2- 172.21.15.124:0/2870566604 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd94c06af00 0x7fd94c06d3c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd95c000f60 tx=0x7fd95c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:37.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.086+0000 7fd959ffb700 1 -- 172.21.15.124:0/2870566604 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd9640542f0 con 0x7fd96806b370 2023-10-16T12:59:37.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.273+0000 7fd96f357700 1 -- 172.21.15.124:0/2870566604 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd9681f67e0 con 0x7fd96806b370 2023-10-16T12:59:37.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.273+0000 7fd959ffb700 1 -- 172.21.15.124:0/2870566604 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd964007720 con 0x7fd96806b370 2023-10-16T12:59:37.277 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:37.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.276+0000 7fd96f357700 1 -- 172.21.15.124:0/2870566604 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd94c06af00 msgr2=0x7fd94c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:37.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.276+0000 7fd96f357700 1 --2- 172.21.15.124:0/2870566604 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd94c06af00 0x7fd94c06d3c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd95c000f60 tx=0x7fd95c009040 comp rx=0 tx=0).stop 2023-10-16T12:59:37.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.276+0000 7fd96f357700 1 -- 172.21.15.124:0/2870566604 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd96806b370 msgr2=0x7fd968158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:37.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.276+0000 7fd96f357700 1 --2- 172.21.15.124:0/2870566604 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd96806b370 0x7fd968158bb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd96400c450 tx=0x7fd96400c810 comp rx=0 tx=0).stop 2023-10-16T12:59:37.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.276+0000 7fd96f357700 1 -- 172.21.15.124:0/2870566604 shutdown_connections 2023-10-16T12:59:37.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.276+0000 7fd96f357700 1 --2- 172.21.15.124:0/2870566604 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd94c06af00 0x7fd94c06d3c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.276+0000 7fd96f357700 1 --2- 172.21.15.124:0/2870566604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9680ce440 0x7fd968146da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.276+0000 7fd96f357700 1 --2- 172.21.15.124:0/2870566604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd96806a820 0x7fd9680b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.276+0000 7fd96f357700 1 --2- 172.21.15.124:0/2870566604 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd96806b370 0x7fd968158bb0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.276+0000 7fd96f357700 1 -- 172.21.15.124:0/2870566604 >> 172.21.15.124:0/2870566604 conn(0x7fd9680ccbe0 msgr2=0x7fd96815f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:37.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.276+0000 7fd96f357700 1 -- 172.21.15.124:0/2870566604 shutdown_connections 2023-10-16T12:59:37.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.276+0000 7fd96f357700 1 -- 172.21.15.124:0/2870566604 wait complete. 2023-10-16T12:59:37.291 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T12:59:37.416 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.410+0000 7f5d72f53700 1 Processor -- start 2023-10-16T12:59:37.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.411+0000 7f5d72f53700 1 -- start start 2023-10-16T12:59:37.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.411+0000 7f5d72f53700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5d6c06a820 0x7f5d6c15e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:37.417 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.411+0000 7f5d72f53700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5d6c0ca7d0 0x7f5d6c071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:37.418 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.411+0000 7f5d72f53700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d6c0718f0 con 0x7f5d6c06ac00 2023-10-16T12:59:37.418 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.411+0000 7f5d72f53700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d6c0cff70 con 0x7f5d6c0ca7d0 2023-10-16T12:59:37.418 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.411+0000 7f5d72f53700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d6c0af3c0 con 0x7f5d6c06a820 2023-10-16T12:59:37.418 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.411+0000 7f5d714f0700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5d6c0ca7d0 0x7f5d6c071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:37.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.412+0000 7f5d714f0700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5d6c0ca7d0 0x7f5d6c071dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54632/0 (socket says 172.21.15.124:54632) 2023-10-16T12:59:37.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.412+0000 7f5d714f0700 1 -- 172.21.15.124:0/614299472 learned_addr learned my addr 172.21.15.124:0/614299472 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:37.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.412+0000 7f5d70cef700 1 --2- 172.21.15.124:0/614299472 >> v2:172.21.15.192:3300/0 conn(0x7f5d6c06a820 0x7f5d6c15e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:37.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.412+0000 7f5d714f0700 1 -- 172.21.15.124:0/614299472 >> v2:172.21.15.192:3300/0 conn(0x7f5d6c06a820 msgr2=0x7f5d6c15e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:37.419 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.412+0000 7f5d714f0700 1 --2- 172.21.15.124:0/614299472 >> v2:172.21.15.192:3300/0 conn(0x7f5d6c06a820 0x7f5d6c15e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.412+0000 7f5d714f0700 1 -- 172.21.15.124:0/614299472 >> v1:172.21.15.192:6789/0 conn(0x7f5d6c06ac00 legacy=0x7f5d6c0cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:37.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.412+0000 7f5d714f0700 1 -- 172.21.15.124:0/614299472 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c0af6a0 con 0x7f5d6c0ca7d0 2023-10-16T12:59:37.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.412+0000 7f5d714f0700 1 --2- 172.21.15.124:0/614299472 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5d6c0ca7d0 0x7f5d6c071dd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0741a0 tx=0x7f5d6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111a295ed4bbe5a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:37.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.412+0000 7f5d6b7fe700 1 -- 172.21.15.124:0/614299472 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6400e070 con 0x7f5d6c0ca7d0 2023-10-16T12:59:37.420 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.412+0000 7f5d6b7fe700 1 -- 172.21.15.124:0/614299472 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6400b9c0 con 0x7f5d6c0ca7d0 2023-10-16T12:59:37.421 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.412+0000 7f5d6b7fe700 1 -- 172.21.15.124:0/614299472 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6400bd70 con 0x7f5d6c0ca7d0 2023-10-16T12:59:37.421 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.413+0000 7f5d72f53700 1 -- 172.21.15.124:0/614299472 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5d6c0ca7d0 msgr2=0x7f5d6c071dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:37.421 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.413+0000 7f5d72f53700 1 --2- 172.21.15.124:0/614299472 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5d6c0ca7d0 0x7f5d6c071dd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0741a0 tx=0x7f5d6400b330 comp rx=0 tx=0).stop 2023-10-16T12:59:37.421 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.413+0000 7f5d72f53700 1 -- 172.21.15.124:0/614299472 shutdown_connections 2023-10-16T12:59:37.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.413+0000 7f5d72f53700 1 --2- 172.21.15.124:0/614299472 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5d6c0ca7d0 0x7f5d6c071dd0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.413+0000 7f5d72f53700 1 --2- 172.21.15.124:0/614299472 >> v2:172.21.15.192:3300/0 conn(0x7f5d6c06a820 0x7f5d6c15e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.413+0000 7f5d72f53700 1 -- 172.21.15.124:0/614299472 >> 172.21.15.124:0/614299472 conn(0x7f5d6c0d0180 msgr2=0x7f5d6c0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:37.422 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.413+0000 7f5d72f53700 1 -- 172.21.15.124:0/614299472 shutdown_connections 2023-10-16T12:59:37.423 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.413+0000 7f5d72f53700 1 -- 172.21.15.124:0/614299472 wait complete. 2023-10-16T12:59:37.423 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.414+0000 7f5d72f53700 1 Processor -- start 2023-10-16T12:59:37.423 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.414+0000 7f5d72f53700 1 -- start start 2023-10-16T12:59:37.426 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.415+0000 7f5d72f53700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d6c06a820 0x7f5d6c0afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:37.426 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.415+0000 7f5d72f53700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5d6c06ac00 0x7f5d6c0c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:37.426 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.415+0000 7f5d72f53700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d6c0ca7d0 0x7f5d6c1453b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:37.426 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.415+0000 7f5d72f53700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c0c4d00 con 0x7f5d6c06ac00 2023-10-16T12:59:37.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.415+0000 7f5d72f53700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c0c4f10 con 0x7f5d6c06a820 2023-10-16T12:59:37.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.415+0000 7f5d72f53700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c0c51f0 con 0x7f5d6c0ca7d0 2023-10-16T12:59:37.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.415+0000 7f5d6bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5d6c06ac00 0x7f5d6c0c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:37.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.415+0000 7f5d6bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5d6c06ac00 0x7f5d6c0c5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54638/0 (socket says 172.21.15.124:54638) 2023-10-16T12:59:37.427 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.415+0000 7f5d6bfff700 1 -- 172.21.15.124:0/1903366904 learned_addr learned my addr 172.21.15.124:0/1903366904 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:37.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.415+0000 7f5d714f0700 1 --2- 172.21.15.124:0/1903366904 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d6c0ca7d0 0x7f5d6c1453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:37.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.415+0000 7f5d70cef700 1 --2- 172.21.15.124:0/1903366904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d6c06a820 0x7f5d6c0afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:37.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.415+0000 7f5d6bfff700 1 -- 172.21.15.124:0/1903366904 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d6c0ca7d0 msgr2=0x7f5d6c1453b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:37.428 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.415+0000 7f5d6bfff700 1 --2- 172.21.15.124:0/1903366904 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d6c0ca7d0 0x7f5d6c1453b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.415+0000 7f5d6bfff700 1 -- 172.21.15.124:0/1903366904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d6c06a820 msgr2=0x7f5d6c0afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:37.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.415+0000 7f5d6bfff700 1 --2- 172.21.15.124:0/1903366904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d6c06a820 0x7f5d6c0afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.415+0000 7f5d6bfff700 1 -- 172.21.15.124:0/1903366904 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d64009b30 con 0x7f5d6c06ac00 2023-10-16T12:59:37.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.415+0000 7f5d714f0700 1 --2- 172.21.15.124:0/1903366904 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d6c0ca7d0 0x7f5d6c1453b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:37.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.415+0000 7f5d70cef700 1 --2- 172.21.15.124:0/1903366904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d6c06a820 0x7f5d6c0afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:37.430 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.415+0000 7f5d6bfff700 1 --2- 172.21.15.124:0/1903366904 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5d6c06ac00 0x7f5d6c0c5fb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800c4e0 tx=0x7f5d5800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:37.430 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.415+0000 7f5d697fa700 1 -- 172.21.15.124:0/1903366904 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d580052d0 con 0x7f5d6c06ac00 2023-10-16T12:59:37.430 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.415+0000 7f5d697fa700 1 -- 172.21.15.124:0/1903366904 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d58005430 con 0x7f5d6c06ac00 2023-10-16T12:59:37.430 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.415+0000 7f5d72f53700 1 -- 172.21.15.124:0/1903366904 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d6c0c54d0 con 0x7f5d6c06ac00 2023-10-16T12:59:37.431 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.415+0000 7f5d697fa700 1 -- 172.21.15.124:0/1903366904 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d580038c0 con 0x7f5d6c06ac00 2023-10-16T12:59:37.431 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.416+0000 7f5d72f53700 1 -- 172.21.15.124:0/1903366904 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6c0c5a90 con 0x7f5d6c06ac00 2023-10-16T12:59:37.431 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.416+0000 7f5d72f53700 1 -- 172.21.15.124:0/1903366904 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d6c04ebb0 con 0x7f5d6c06ac00 2023-10-16T12:59:37.431 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.417+0000 7f5d697fa700 1 -- 172.21.15.124:0/1903366904 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5d58003a20 con 0x7f5d6c06ac00 2023-10-16T12:59:37.432 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.418+0000 7f5d697fa700 1 --2- 172.21.15.124:0/1903366904 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5d5006af00 0x7f5d5006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:37.432 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.418+0000 7f5d697fa700 1 -- 172.21.15.124:0/1903366904 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f5d58089180 con 0x7f5d6c06ac00 2023-10-16T12:59:37.432 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.418+0000 7f5d70cef700 1 --2- 172.21.15.124:0/1903366904 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5d5006af00 0x7f5d5006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:37.432 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.418+0000 7f5d70cef700 1 --2- 172.21.15.124:0/1903366904 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5d5006af00 0x7f5d5006d3c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5d60007a50 tx=0x7f5d60008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:37.432 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.421+0000 7f5d697fa700 1 -- 172.21.15.124:0/1903366904 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5d58053fe0 con 0x7f5d6c06ac00 2023-10-16T12:59:37.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.614+0000 7f5d72f53700 1 -- 172.21.15.124:0/1903366904 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5d6c06b500 con 0x7f5d6c06ac00 2023-10-16T12:59:37.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.614+0000 7f5d697fa700 1 -- 172.21.15.124:0/1903366904 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5d58017020 con 0x7f5d6c06ac00 2023-10-16T12:59:37.617 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2023-10-16T12:59:37.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.616+0000 7f5d72f53700 1 -- 172.21.15.124:0/1903366904 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5d5006af00 msgr2=0x7f5d5006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:37.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.616+0000 7f5d72f53700 1 --2- 172.21.15.124:0/1903366904 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5d5006af00 0x7f5d5006d3c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5d60007a50 tx=0x7f5d60008040 comp rx=0 tx=0).stop 2023-10-16T12:59:37.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.616+0000 7f5d72f53700 1 -- 172.21.15.124:0/1903366904 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5d6c06ac00 msgr2=0x7f5d6c0c5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:37.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.616+0000 7f5d72f53700 1 --2- 172.21.15.124:0/1903366904 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5d6c06ac00 0x7f5d6c0c5fb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800c4e0 tx=0x7f5d5800c8a0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.617+0000 7f5d72f53700 1 -- 172.21.15.124:0/1903366904 shutdown_connections 2023-10-16T12:59:37.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.617+0000 7f5d72f53700 1 --2- 172.21.15.124:0/1903366904 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5d5006af00 0x7f5d5006d3c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.617+0000 7f5d72f53700 1 --2- 172.21.15.124:0/1903366904 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d6c0ca7d0 0x7f5d6c1453b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.617+0000 7f5d72f53700 1 --2- 172.21.15.124:0/1903366904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d6c06a820 0x7f5d6c0afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.617+0000 7f5d72f53700 1 --2- 172.21.15.124:0/1903366904 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5d6c06ac00 0x7f5d6c0c5fb0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.617+0000 7f5d72f53700 1 -- 172.21.15.124:0/1903366904 >> 172.21.15.124:0/1903366904 conn(0x7f5d6c0d0180 msgr2=0x7f5d6c071c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:37.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.617+0000 7f5d72f53700 1 -- 172.21.15.124:0/1903366904 shutdown_connections 2023-10-16T12:59:37.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.617+0000 7f5d72f53700 1 -- 172.21.15.124:0/1903366904 wait complete. 2023-10-16T12:59:37.631 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T12:59:37.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.752+0000 7ff374f58700 1 Processor -- start 2023-10-16T12:59:37.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.752+0000 7ff374f58700 1 -- start start 2023-10-16T12:59:37.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.753+0000 7ff374f58700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff3700cf540 0x7ff3701685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:37.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.753+0000 7ff374f58700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3700b34f0 con 0x7ff370161f30 2023-10-16T12:59:37.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.753+0000 7ff374f58700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff370161450 con 0x7ff37015b210 2023-10-16T12:59:37.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.753+0000 7ff374f58700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff370161240 con 0x7ff3700cf540 2023-10-16T12:59:37.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.754+0000 7ff36dd9b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7ff370161f30 0x7ff3700cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43312/0 (socket says 172.21.15.124:43312) 2023-10-16T12:59:37.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.754+0000 7ff36dd9b700 1 -- 172.21.15.124:0/268998368 learned_addr learned my addr 172.21.15.124:0/268998368 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:37.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.754+0000 7ff36ed9d700 1 --2- 172.21.15.124:0/268998368 >> v2:172.21.15.192:3300/0 conn(0x7ff3700cf540 0x7ff3701685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:37.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.754+0000 7ff36d59a700 1 -- 172.21.15.124:0/268998368 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947361687 0 0) 0x7ff3700b34f0 con 0x7ff370161f30 2023-10-16T12:59:37.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.754+0000 7ff36d59a700 1 -- 172.21.15.124:0/268998368 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3580035b0 con 0x7ff370161f30 2023-10-16T12:59:37.762 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.754+0000 7ff36d59a700 1 -- 172.21.15.124:0/268998368 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4119544521 0 0) 0x7ff370161450 con 0x7ff37015b210 2023-10-16T12:59:37.762 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.754+0000 7ff36d59a700 1 -- 172.21.15.124:0/268998368 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3700b34f0 con 0x7ff37015b210 2023-10-16T12:59:37.762 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.754+0000 7ff36d59a700 1 -- 172.21.15.124:0/268998368 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1957632707 0 0) 0x7ff3580035b0 con 0x7ff370161f30 2023-10-16T12:59:37.762 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.754+0000 7ff36d59a700 1 -- 172.21.15.124:0/268998368 >> v2:172.21.15.192:3300/0 conn(0x7ff3700cf540 msgr2=0x7ff3701685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:37.762 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.754+0000 7ff36d59a700 1 --2- 172.21.15.124:0/268998368 >> v2:172.21.15.192:3300/0 conn(0x7ff3700cf540 0x7ff3701685d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.763 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.754+0000 7ff36d59a700 1 -- 172.21.15.124:0/268998368 >> v1:172.21.15.192:6789/0 conn(0x7ff37015b210 legacy=0x7ff3700b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:37.763 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.754+0000 7ff36d59a700 1 -- 172.21.15.124:0/268998368 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff370161730 con 0x7ff370161f30 2023-10-16T12:59:37.763 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.754+0000 7ff36d59a700 1 -- 172.21.15.124:0/268998368 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7ff360001670 con 0x7ff370161f30 2023-10-16T12:59:37.763 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.754+0000 7ff36d59a700 1 -- 172.21.15.124:0/268998368 >> v1:172.21.15.124:6789/0 conn(0x7ff370161f30 legacy=0x7ff3700cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:37.763 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.754+0000 7ff36d59a700 1 --2- 172.21.15.124:0/268998368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff358003b90 0x7ff358003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:37.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.754+0000 7ff36d59a700 1 --2- 172.21.15.124:0/268998368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff358004850 0x7ff358004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:37.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.754+0000 7ff36d59a700 1 --2- 172.21.15.124:0/268998368 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff358005210 0x7ff35800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:37.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.754+0000 7ff36d59a700 1 -- 172.21.15.124:0/268998368 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff370161240 con 0x7ff358005210 2023-10-16T12:59:37.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.754+0000 7ff36d59a700 1 -- 172.21.15.124:0/268998368 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35800c140 con 0x7ff358003b90 2023-10-16T12:59:37.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.754+0000 7ff36d59a700 1 -- 172.21.15.124:0/268998368 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35800c300 con 0x7ff358004850 2023-10-16T12:59:37.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.754+0000 7ff36ed9d700 1 --2- 172.21.15.124:0/268998368 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff358005210 0x7ff35800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:37.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.754+0000 7ff36e59c700 1 --2- 172.21.15.124:0/268998368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff358003b90 0x7ff358003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:37.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.754+0000 7ff36dd9b700 1 --2- 172.21.15.124:0/268998368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff358004850 0x7ff358004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:37.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.755+0000 7ff36ed9d700 1 -- 172.21.15.124:0/268998368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff358004850 msgr2=0x7ff358004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:37.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.755+0000 7ff36ed9d700 1 --2- 172.21.15.124:0/268998368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff358004850 0x7ff358004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.755+0000 7ff36ed9d700 1 -- 172.21.15.124:0/268998368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff358003b90 msgr2=0x7ff358003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:37.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.755+0000 7ff36ed9d700 1 --2- 172.21.15.124:0/268998368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff358003b90 0x7ff358003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.755+0000 7ff36ed9d700 1 -- 172.21.15.124:0/268998368 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3580035b0 con 0x7ff358005210 2023-10-16T12:59:37.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.755+0000 7ff36dd9b700 1 --2- 172.21.15.124:0/268998368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff358004850 0x7ff358004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:37.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.755+0000 7ff36ed9d700 1 -- 172.21.15.124:0/268998368 reap_dead start 2023-10-16T12:59:37.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.755+0000 7ff36ed9d700 1 --2- 172.21.15.124:0/268998368 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff358005210 0x7ff35800ba10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff368009fc0 tx=0x7ff358005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89653b12047fa1ae server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:37.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.755+0000 7ff36d59a700 1 -- 172.21.15.124:0/268998368 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff368003a20 con 0x7ff358005210 2023-10-16T12:59:37.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.755+0000 7ff36d59a700 1 -- 172.21.15.124:0/268998368 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36800f040 con 0x7ff358005210 2023-10-16T12:59:37.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.755+0000 7ff36d59a700 1 -- 172.21.15.124:0/268998368 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff368003de0 con 0x7ff358005210 2023-10-16T12:59:37.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.755+0000 7ff374f58700 1 -- 172.21.15.124:0/268998368 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff358005210 msgr2=0x7ff35800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:37.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.755+0000 7ff374f58700 1 --2- 172.21.15.124:0/268998368 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff358005210 0x7ff35800ba10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff368009fc0 tx=0x7ff358005880 comp rx=0 tx=0).stop 2023-10-16T12:59:37.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.755+0000 7ff374f58700 1 -- 172.21.15.124:0/268998368 shutdown_connections 2023-10-16T12:59:37.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.755+0000 7ff374f58700 1 --2- 172.21.15.124:0/268998368 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff358005210 0x7ff35800ba10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.755+0000 7ff374f58700 1 -- 172.21.15.124:0/268998368 >> 172.21.15.124:0/268998368 conn(0x7ff3700cdce0 msgr2=0x7ff3700ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:37.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.756+0000 7ff374f58700 1 -- 172.21.15.124:0/268998368 shutdown_connections 2023-10-16T12:59:37.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.756+0000 7ff374f58700 1 -- 172.21.15.124:0/268998368 wait complete. 2023-10-16T12:59:37.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.757+0000 7ff374f58700 1 Processor -- start 2023-10-16T12:59:37.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.757+0000 7ff374f58700 1 -- start start 2023-10-16T12:59:37.772 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.758+0000 7ff374f58700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff358005210 0x7ff3700b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:37.772 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.758+0000 7ff374f58700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff370143e70 0x7ff3701599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:37.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.758+0000 7ff374f58700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff370159f20 0x7ff3701f6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:37.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.758+0000 7ff374f58700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3700b6c40 con 0x7ff370159f20 2023-10-16T12:59:37.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.758+0000 7ff374f58700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3700b6430 con 0x7ff358005210 2023-10-16T12:59:37.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.758+0000 7ff374f58700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3700b50a0 con 0x7ff370143e70 2023-10-16T12:59:37.773 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.758+0000 7ff36ed9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff370159f20 0x7ff3701f6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:37.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.758+0000 7ff36ed9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff370159f20 0x7ff3701f6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54658/0 (socket says 172.21.15.124:54658) 2023-10-16T12:59:37.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.758+0000 7ff36ed9d700 1 -- 172.21.15.124:0/128998681 learned_addr learned my addr 172.21.15.124:0/128998681 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:37.774 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.758+0000 7ff36e59c700 1 --2- 172.21.15.124:0/128998681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff358005210 0x7ff3700b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:37.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.758+0000 7ff36dd9b700 1 --2- 172.21.15.124:0/128998681 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff370143e70 0x7ff3701599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:37.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.758+0000 7ff36ed9d700 1 -- 172.21.15.124:0/128998681 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff370143e70 msgr2=0x7ff3701599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:37.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.758+0000 7ff36ed9d700 1 --2- 172.21.15.124:0/128998681 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff370143e70 0x7ff3701599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.758+0000 7ff36ed9d700 1 -- 172.21.15.124:0/128998681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff358005210 msgr2=0x7ff3700b5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:37.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.758+0000 7ff36ed9d700 1 --2- 172.21.15.124:0/128998681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff358005210 0x7ff3700b5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.758+0000 7ff36ed9d700 1 -- 172.21.15.124:0/128998681 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3701442f0 con 0x7ff370159f20 2023-10-16T12:59:37.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.758+0000 7ff36dd9b700 1 --2- 172.21.15.124:0/128998681 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff370143e70 0x7ff3701599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:37.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.758+0000 7ff36ed9d700 1 --2- 172.21.15.124:0/128998681 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff370159f20 0x7ff3701f6910 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff36800e700 tx=0x7ff368009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:37.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.758+0000 7ff35effd700 1 -- 172.21.15.124:0/128998681 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff368007000 con 0x7ff370159f20 2023-10-16T12:59:37.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.758+0000 7ff35effd700 1 -- 172.21.15.124:0/128998681 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff368003e10 con 0x7ff370159f20 2023-10-16T12:59:37.776 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.758+0000 7ff374f58700 1 -- 172.21.15.124:0/128998681 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3700b6680 con 0x7ff370159f20 2023-10-16T12:59:37.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.758+0000 7ff35effd700 1 -- 172.21.15.124:0/128998681 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff368004450 con 0x7ff370159f20 2023-10-16T12:59:37.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.758+0000 7ff374f58700 1 -- 172.21.15.124:0/128998681 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37015a3d0 con 0x7ff370159f20 2023-10-16T12:59:37.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.759+0000 7ff374f58700 1 -- 172.21.15.124:0/128998681 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3700b4ed0 con 0x7ff370159f20 2023-10-16T12:59:37.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.760+0000 7ff35effd700 1 -- 172.21.15.124:0/128998681 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff3680045b0 con 0x7ff370159f20 2023-10-16T12:59:37.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.760+0000 7ff35effd700 1 --2- 172.21.15.124:0/128998681 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff35006af00 0x7ff35006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:37.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.760+0000 7ff35effd700 1 -- 172.21.15.124:0/128998681 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7ff36808aad0 con 0x7ff370159f20 2023-10-16T12:59:37.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.760+0000 7ff36e59c700 1 --2- 172.21.15.124:0/128998681 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff35006af00 0x7ff35006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:37.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.761+0000 7ff36e59c700 1 --2- 172.21.15.124:0/128998681 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff35006af00 0x7ff35006d3c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff3640010e0 tx=0x7ff364009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:37.778 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.764+0000 7ff35effd700 1 -- 172.21.15.124:0/128998681 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff368055850 con 0x7ff370159f20 2023-10-16T12:59:37.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.953+0000 7ff374f58700 1 -- 172.21.15.124:0/128998681 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff3700b5260 con 0x7ff370159f20 2023-10-16T12:59:37.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.953+0000 7ff35effd700 1 -- 172.21.15.124:0/128998681 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff368018020 con 0x7ff370159f20 2023-10-16T12:59:37.956 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:37.958 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.955+0000 7ff374f58700 1 -- 172.21.15.124:0/128998681 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff35006af00 msgr2=0x7ff35006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:37.958 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.955+0000 7ff374f58700 1 --2- 172.21.15.124:0/128998681 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff35006af00 0x7ff35006d3c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff3640010e0 tx=0x7ff364009040 comp rx=0 tx=0).stop 2023-10-16T12:59:37.958 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.955+0000 7ff374f58700 1 -- 172.21.15.124:0/128998681 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff370159f20 msgr2=0x7ff3701f6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:37.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.955+0000 7ff374f58700 1 --2- 172.21.15.124:0/128998681 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff370159f20 0x7ff3701f6910 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff36800e700 tx=0x7ff368009750 comp rx=0 tx=0).stop 2023-10-16T12:59:37.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.955+0000 7ff374f58700 1 -- 172.21.15.124:0/128998681 shutdown_connections 2023-10-16T12:59:37.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.955+0000 7ff374f58700 1 --2- 172.21.15.124:0/128998681 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff35006af00 0x7ff35006d3c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.955+0000 7ff374f58700 1 --2- 172.21.15.124:0/128998681 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff370159f20 0x7ff3701f6910 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.955+0000 7ff374f58700 1 --2- 172.21.15.124:0/128998681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff358005210 0x7ff3700b5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.960 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.955+0000 7ff374f58700 1 --2- 172.21.15.124:0/128998681 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff370143e70 0x7ff3701599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:37.960 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.955+0000 7ff374f58700 1 -- 172.21.15.124:0/128998681 >> 172.21.15.124:0/128998681 conn(0x7ff3700cdce0 msgr2=0x7ff37006cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:37.960 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.955+0000 7ff374f58700 1 -- 172.21.15.124:0/128998681 shutdown_connections 2023-10-16T12:59:37.960 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:37.955+0000 7ff374f58700 1 -- 172.21.15.124:0/128998681 wait complete. 2023-10-16T12:59:37.970 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-10-16T12:59:38.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.087+0000 7fb5250fe700 1 Processor -- start 2023-10-16T12:59:38.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.087+0000 7fb5250fe700 1 -- start start 2023-10-16T12:59:38.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.088+0000 7fb5250fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb5200cf7d0 0x7fb52015e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:38.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.088+0000 7fb5250fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5200ca7d0 0x7fb520071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:38.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.088+0000 7fb5250fe700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5200cfeb0 con 0x7fb52006a820 2023-10-16T12:59:38.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.088+0000 7fb5250fe700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5200ce410 con 0x7fb5200cf7d0 2023-10-16T12:59:38.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.088+0000 7fb5250fe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5200cfc30 con 0x7fb5200ca7d0 2023-10-16T12:59:38.094 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.088+0000 7fb51f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5200ca7d0 0x7fb520071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:38.094 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.088+0000 7fb51e59c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb5200cf7d0 0x7fb52015e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:38.094 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.088+0000 7fb51f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5200ca7d0 0x7fb520071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:40744/0 (socket says 172.21.15.124:40744) 2023-10-16T12:59:38.094 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.088+0000 7fb51f59e700 1 -- 172.21.15.124:0/1568096527 learned_addr learned my addr 172.21.15.124:0/1568096527 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:38.095 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.088+0000 7fb51ed9d700 1 --1- 172.21.15.124:0/1568096527 >> v1:172.21.15.192:6789/0 conn(0x7fb52006a820 0x7fb52006ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.124:55326/0 (socket says 172.21.15.124:55326) 2023-10-16T12:59:38.095 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.089+0000 7fb51dd9b700 1 -- 172.21.15.124:0/1568096527 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340814643 0 0) 0x7fb5200cfeb0 con 0x7fb52006a820 2023-10-16T12:59:38.095 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.089+0000 7fb51dd9b700 1 -- 172.21.15.124:0/1568096527 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5080035b0 con 0x7fb52006a820 2023-10-16T12:59:38.095 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.089+0000 7fb51e59c700 1 -- 172.21.15.124:0/1568096527 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5200ca7d0 msgr2=0x7fb520071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:38.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.089+0000 7fb51e59c700 1 --2- 172.21.15.124:0/1568096527 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5200ca7d0 0x7fb520071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:38.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.089+0000 7fb51e59c700 1 -- 172.21.15.124:0/1568096527 >> v1:172.21.15.192:6789/0 conn(0x7fb52006a820 legacy=0x7fb52006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:38.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.089+0000 7fb51e59c700 1 -- 172.21.15.124:0/1568096527 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5200af9d0 con 0x7fb5200cf7d0 2023-10-16T12:59:38.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.089+0000 7fb51f59e700 1 --2- 172.21.15.124:0/1568096527 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5200ca7d0 0x7fb520071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:59:38.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.089+0000 7fb51e59c700 1 --2- 172.21.15.124:0/1568096527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5200cf7d0 0x7fb52015e7f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb510009840 tx=0x7fb510009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7082327a2578c0ea server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:38.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.089+0000 7fb51dd9b700 1 -- 172.21.15.124:0/1568096527 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb510011830 con 0x7fb5200cf7d0 2023-10-16T12:59:38.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.089+0000 7fb51dd9b700 1 -- 172.21.15.124:0/1568096527 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb510011990 con 0x7fb5200cf7d0 2023-10-16T12:59:38.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.089+0000 7fb51dd9b700 1 -- 172.21.15.124:0/1568096527 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb510011d00 con 0x7fb5200cf7d0 2023-10-16T12:59:38.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.090+0000 7fb5250fe700 1 -- 172.21.15.124:0/1568096527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5200cf7d0 msgr2=0x7fb52015e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:38.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.090+0000 7fb5250fe700 1 --2- 172.21.15.124:0/1568096527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5200cf7d0 0x7fb52015e7f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb510009840 tx=0x7fb510009b50 comp rx=0 tx=0).stop 2023-10-16T12:59:38.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.090+0000 7fb5250fe700 1 -- 172.21.15.124:0/1568096527 shutdown_connections 2023-10-16T12:59:38.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.090+0000 7fb5250fe700 1 --2- 172.21.15.124:0/1568096527 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5200ca7d0 0x7fb520071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:38.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.090+0000 7fb5250fe700 1 --2- 172.21.15.124:0/1568096527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5200cf7d0 0x7fb52015e7f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:38.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.090+0000 7fb5250fe700 1 -- 172.21.15.124:0/1568096527 >> 172.21.15.124:0/1568096527 conn(0x7fb5200d0180 msgr2=0x7fb5200d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:38.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.090+0000 7fb5250fe700 1 -- 172.21.15.124:0/1568096527 shutdown_connections 2023-10-16T12:59:38.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.090+0000 7fb5250fe700 1 -- 172.21.15.124:0/1568096527 wait complete. 2023-10-16T12:59:38.101 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.091+0000 7fb5250fe700 1 Processor -- start 2023-10-16T12:59:38.101 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.091+0000 7fb5250fe700 1 -- start start 2023-10-16T12:59:38.101 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.092+0000 7fb5250fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb52006a820 0x7fb5201f2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:38.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.092+0000 7fb5250fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5200ca7d0 0x7fb5200b5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:38.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.092+0000 7fb5250fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5200cf7d0 0x7fb5200b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:38.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.092+0000 7fb5250fe700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5200aee50 con 0x7fb52006a820 2023-10-16T12:59:38.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.092+0000 7fb5250fe700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5200ace80 con 0x7fb5200cf7d0 2023-10-16T12:59:38.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.092+0000 7fb5250fe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5200b5ab0 con 0x7fb5200ca7d0 2023-10-16T12:59:38.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.092+0000 7fb51ed9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb52006a820 0x7fb5201f2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:38.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.092+0000 7fb51ed9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb52006a820 0x7fb5201f2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54668/0 (socket says 172.21.15.124:54668) 2023-10-16T12:59:38.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.092+0000 7fb51ed9d700 1 -- 172.21.15.124:0/4162409821 learned_addr learned my addr 172.21.15.124:0/4162409821 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:38.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.092+0000 7fb51f59e700 1 --2- 172.21.15.124:0/4162409821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5200cf7d0 0x7fb5200b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:38.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.092+0000 7fb51e59c700 1 --2- 172.21.15.124:0/4162409821 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5200ca7d0 0x7fb5200b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:38.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.092+0000 7fb51ed9d700 1 -- 172.21.15.124:0/4162409821 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5200ca7d0 msgr2=0x7fb5200b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:38.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.092+0000 7fb51ed9d700 1 --2- 172.21.15.124:0/4162409821 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5200ca7d0 0x7fb5200b5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:38.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.092+0000 7fb51ed9d700 1 -- 172.21.15.124:0/4162409821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5200cf7d0 msgr2=0x7fb5200b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:38.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.092+0000 7fb51ed9d700 1 --2- 172.21.15.124:0/4162409821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5200cf7d0 0x7fb5200b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:38.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.092+0000 7fb51ed9d700 1 -- 172.21.15.124:0/4162409821 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb518009b30 con 0x7fb52006a820 2023-10-16T12:59:38.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.092+0000 7fb51ed9d700 1 --2- 172.21.15.124:0/4162409821 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb52006a820 0x7fb5201f2d40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb51400c500 tx=0x7fb51400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:38.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.093+0000 7fb5077fe700 1 -- 172.21.15.124:0/4162409821 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb514005cb0 con 0x7fb52006a820 2023-10-16T12:59:38.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.093+0000 7fb5077fe700 1 -- 172.21.15.124:0/4162409821 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb514005e10 con 0x7fb52006a820 2023-10-16T12:59:38.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.093+0000 7fb5250fe700 1 -- 172.21.15.124:0/4162409821 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5100094a0 con 0x7fb52006a820 2023-10-16T12:59:38.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.093+0000 7fb5077fe700 1 -- 172.21.15.124:0/4162409821 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb514007310 con 0x7fb52006a820 2023-10-16T12:59:38.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.093+0000 7fb5250fe700 1 -- 172.21.15.124:0/4162409821 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5201f3320 con 0x7fb52006a820 2023-10-16T12:59:38.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.094+0000 7fb5250fe700 1 -- 172.21.15.124:0/4162409821 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb52004ebb0 con 0x7fb52006a820 2023-10-16T12:59:38.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.094+0000 7fb5077fe700 1 -- 172.21.15.124:0/4162409821 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb514007470 con 0x7fb52006a820 2023-10-16T12:59:38.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.094+0000 7fb5077fe700 1 --2- 172.21.15.124:0/4162409821 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb50c06af00 0x7fb50c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:38.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.095+0000 7fb51e59c700 1 --2- 172.21.15.124:0/4162409821 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb50c06af00 0x7fb50c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:38.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.095+0000 7fb5077fe700 1 -- 172.21.15.124:0/4162409821 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7fb514088e50 con 0x7fb52006a820 2023-10-16T12:59:38.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.095+0000 7fb51e59c700 1 --2- 172.21.15.124:0/4162409821 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb50c06af00 0x7fb50c06d3c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb5100090b0 tx=0x7fb510008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:38.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.099+0000 7fb5077fe700 1 -- 172.21.15.124:0/4162409821 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb514053b80 con 0x7fb52006a820 2023-10-16T12:59:38.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.371+0000 7fb5250fe700 1 -- 172.21.15.124:0/4162409821 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fb52015d1c0 con 0x7fb52006a820 2023-10-16T12:59:38.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.488+0000 7fb5077fe700 1 -- 172.21.15.124:0/4162409821 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v67) v1 ==== 147+0+0 (secure 0 0 0) 0x7fb514007720 con 0x7fb52006a820 2023-10-16T12:59:38.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.491+0000 7fb5250fe700 1 -- 172.21.15.124:0/4162409821 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb50c06af00 msgr2=0x7fb50c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:38.494 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.491+0000 7fb5250fe700 1 --2- 172.21.15.124:0/4162409821 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb50c06af00 0x7fb50c06d3c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb5100090b0 tx=0x7fb510008030 comp rx=0 tx=0).stop 2023-10-16T12:59:38.494 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.491+0000 7fb5250fe700 1 -- 172.21.15.124:0/4162409821 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb52006a820 msgr2=0x7fb5201f2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:38.494 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.491+0000 7fb5250fe700 1 --2- 172.21.15.124:0/4162409821 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb52006a820 0x7fb5201f2d40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb51400c500 tx=0x7fb51400c810 comp rx=0 tx=0).stop 2023-10-16T12:59:38.494 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.491+0000 7fb5250fe700 1 -- 172.21.15.124:0/4162409821 shutdown_connections 2023-10-16T12:59:38.495 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.491+0000 7fb5250fe700 1 --2- 172.21.15.124:0/4162409821 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb50c06af00 0x7fb50c06d3c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:38.495 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.491+0000 7fb5250fe700 1 --2- 172.21.15.124:0/4162409821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5200cf7d0 0x7fb5200b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:38.495 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.491+0000 7fb5250fe700 1 --2- 172.21.15.124:0/4162409821 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb52006a820 0x7fb5201f2d40 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:38.495 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.491+0000 7fb5250fe700 1 --2- 172.21.15.124:0/4162409821 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5200ca7d0 0x7fb5200b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:38.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.491+0000 7fb5250fe700 1 -- 172.21.15.124:0/4162409821 >> 172.21.15.124:0/4162409821 conn(0x7fb5200d0180 msgr2=0x7fb5200cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:38.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.491+0000 7fb5250fe700 1 -- 172.21.15.124:0/4162409821 shutdown_connections 2023-10-16T12:59:38.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.491+0000 7fb5250fe700 1 -- 172.21.15.124:0/4162409821 wait complete. 2023-10-16T12:59:38.506 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-16T12:59:38.632 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.629+0000 7f7617c58700 1 Processor -- start 2023-10-16T12:59:38.632 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.629+0000 7f7617c58700 1 -- start start 2023-10-16T12:59:38.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.630+0000 7f7617c58700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f761015d6b0 0x7f76100ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:38.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.630+0000 7f7617c58700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f761006bed0 0x7f76100b9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:38.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.630+0000 7f7617c58700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76100cea10 con 0x7f76100cfab0 2023-10-16T12:59:38.636 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.630+0000 7f7617c58700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76100b9590 con 0x7f761015d6b0 2023-10-16T12:59:38.636 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.630+0000 7f7617c58700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76100cecf0 con 0x7f761006bed0 2023-10-16T12:59:38.636 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.630+0000 7f76159f4700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f761015d6b0 0x7f76100ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:38.636 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.630+0000 7f76159f4700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f761015d6b0 0x7f76100ce380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54676/0 (socket says 172.21.15.124:54676) 2023-10-16T12:59:38.636 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.630+0000 7f76159f4700 1 -- 172.21.15.124:0/2602402390 learned_addr learned my addr 172.21.15.124:0/2602402390 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:38.637 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.630+0000 7f76161f5700 1 --2- 172.21.15.124:0/2602402390 >> v2:172.21.15.192:3300/0 conn(0x7f761006bed0 0x7f76100b9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:38.637 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.630+0000 7f76159f4700 1 -- 172.21.15.124:0/2602402390 >> v2:172.21.15.192:3300/0 conn(0x7f761006bed0 msgr2=0x7f76100b9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:38.637 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.630+0000 7f76159f4700 1 --2- 172.21.15.124:0/2602402390 >> v2:172.21.15.192:3300/0 conn(0x7f761006bed0 0x7f76100b9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:38.637 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.630+0000 7f76159f4700 1 -- 172.21.15.124:0/2602402390 >> v1:172.21.15.192:6789/0 conn(0x7f76100cfab0 legacy=0x7f761006b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:38.637 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.630+0000 7f76159f4700 1 -- 172.21.15.124:0/2602402390 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76100cefd0 con 0x7f761015d6b0 2023-10-16T12:59:38.638 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.630+0000 7f76161f5700 1 --2- 172.21.15.124:0/2602402390 >> v2:172.21.15.192:3300/0 conn(0x7f761006bed0 0x7f76100b9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:38.638 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.631+0000 7f76159f4700 1 --2- 172.21.15.124:0/2602402390 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f761015d6b0 0x7f76100ce380 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f76100b6430 tx=0x7f7600009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad060f341dab92c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:38.638 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.631+0000 7f76149f2700 1 -- 172.21.15.124:0/2602402390 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7600004230 con 0x7f761015d6b0 2023-10-16T12:59:38.638 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.631+0000 7f76149f2700 1 -- 172.21.15.124:0/2602402390 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7600004390 con 0x7f761015d6b0 2023-10-16T12:59:38.638 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.631+0000 7f76149f2700 1 -- 172.21.15.124:0/2602402390 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76000036a0 con 0x7f761015d6b0 2023-10-16T12:59:38.639 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.631+0000 7f7617c58700 1 -- 172.21.15.124:0/2602402390 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f761015d6b0 msgr2=0x7f76100ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:38.639 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.631+0000 7f7617c58700 1 --2- 172.21.15.124:0/2602402390 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f761015d6b0 0x7f76100ce380 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f76100b6430 tx=0x7f7600009bd0 comp rx=0 tx=0).stop 2023-10-16T12:59:38.639 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.631+0000 7f7617c58700 1 -- 172.21.15.124:0/2602402390 shutdown_connections 2023-10-16T12:59:38.639 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.631+0000 7f7617c58700 1 --2- 172.21.15.124:0/2602402390 >> v2:172.21.15.192:3300/0 conn(0x7f761006bed0 0x7f76100b9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:38.639 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.631+0000 7f7617c58700 1 --2- 172.21.15.124:0/2602402390 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f761015d6b0 0x7f76100ce380 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:38.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.631+0000 7f7617c58700 1 -- 172.21.15.124:0/2602402390 >> 172.21.15.124:0/2602402390 conn(0x7f7610072340 msgr2=0x7f7610072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:38.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.632+0000 7f7617c58700 1 -- 172.21.15.124:0/2602402390 shutdown_connections 2023-10-16T12:59:38.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.632+0000 7f7617c58700 1 -- 172.21.15.124:0/2602402390 wait complete. 2023-10-16T12:59:38.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.633+0000 7f7617c58700 1 Processor -- start 2023-10-16T12:59:38.640 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.633+0000 7f7617c58700 1 -- start start 2023-10-16T12:59:38.643 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.633+0000 7f7617c58700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f761006bed0 0x7f76101e5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:38.643 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.633+0000 7f7617c58700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76100cfab0 0x7f76100cd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:38.643 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.633+0000 7f7617c58700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f761015d6b0 0x7f76100cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:38.643 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.633+0000 7f7617c58700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76100cbac0 con 0x7f761006bed0 2023-10-16T12:59:38.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.633+0000 7f7617c58700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76100cbd60 con 0x7f761015d6b0 2023-10-16T12:59:38.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.633+0000 7f7617c58700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76100cc040 con 0x7f76100cfab0 2023-10-16T12:59:38.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.634+0000 7f76159f4700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f761006bed0 0x7f76101e5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:38.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.634+0000 7f76159f4700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f761006bed0 0x7f76101e5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54682/0 (socket says 172.21.15.124:54682) 2023-10-16T12:59:38.644 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.634+0000 7f76159f4700 1 -- 172.21.15.124:0/1859428508 learned_addr learned my addr 172.21.15.124:0/1859428508 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:38.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.634+0000 7f76151f3700 1 --2- 172.21.15.124:0/1859428508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76100cfab0 0x7f76100cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:38.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.634+0000 7f76161f5700 1 --2- 172.21.15.124:0/1859428508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f761015d6b0 0x7f76100cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:38.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.634+0000 7f76159f4700 1 -- 172.21.15.124:0/1859428508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76100cfab0 msgr2=0x7f76100cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:38.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.634+0000 7f76159f4700 1 --2- 172.21.15.124:0/1859428508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76100cfab0 0x7f76100cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:38.645 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.634+0000 7f76159f4700 1 -- 172.21.15.124:0/1859428508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f761015d6b0 msgr2=0x7f76100cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:38.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.634+0000 7f76159f4700 1 --2- 172.21.15.124:0/1859428508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f761015d6b0 0x7f76100cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:38.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.634+0000 7f76159f4700 1 -- 172.21.15.124:0/1859428508 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7600009550 con 0x7f761006bed0 2023-10-16T12:59:38.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.634+0000 7f76159f4700 1 --2- 172.21.15.124:0/1859428508 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f761006bed0 0x7f76101e5e00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7600009130 tx=0x7f7600004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:38.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.634+0000 7f76067fc700 1 -- 172.21.15.124:0/1859428508 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7600011630 con 0x7f761006bed0 2023-10-16T12:59:38.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.634+0000 7f76067fc700 1 -- 172.21.15.124:0/1859428508 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7600011790 con 0x7f761006bed0 2023-10-16T12:59:38.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.634+0000 7f7617c58700 1 -- 172.21.15.124:0/1859428508 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76100cc320 con 0x7f761006bed0 2023-10-16T12:59:38.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.634+0000 7f76067fc700 1 -- 172.21.15.124:0/1859428508 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7600011b40 con 0x7f761006bed0 2023-10-16T12:59:38.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.634+0000 7f7617c58700 1 -- 172.21.15.124:0/1859428508 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76100ccd60 con 0x7f761006bed0 2023-10-16T12:59:38.647 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.635+0000 7f7617c58700 1 -- 172.21.15.124:0/1859428508 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76100cc690 con 0x7f761006bed0 2023-10-16T12:59:38.648 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.636+0000 7f76067fc700 1 -- 172.21.15.124:0/1859428508 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7600011ca0 con 0x7f761006bed0 2023-10-16T12:59:38.648 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.636+0000 7f76067fc700 1 --2- 172.21.15.124:0/1859428508 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f75f406af00 0x7f75f406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:38.648 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.636+0000 7f76067fc700 1 -- 172.21.15.124:0/1859428508 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f760008b020 con 0x7f761006bed0 2023-10-16T12:59:38.648 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.636+0000 7f76151f3700 1 --2- 172.21.15.124:0/1859428508 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f75f406af00 0x7f75f406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:38.648 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.636+0000 7f76151f3700 1 --2- 172.21.15.124:0/1859428508 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f75f406af00 0x7f75f406d3c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f76100caee0 tx=0x7f760c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:38.649 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.640+0000 7f76067fc700 1 -- 172.21.15.124:0/1859428508 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7600055da0 con 0x7f761006bed0 2023-10-16T12:59:38.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.836+0000 7f7617c58700 1 -- 172.21.15.124:0/1859428508 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f761004ebb0 con 0x7f761006bed0 2023-10-16T12:59:38.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.841+0000 7f76067fc700 1 -- 172.21.15.124:0/1859428508 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f76000593c0 con 0x7f761006bed0 2023-10-16T12:59:38.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.843+0000 7f7617c58700 1 -- 172.21.15.124:0/1859428508 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f75f406af00 msgr2=0x7f75f406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:38.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.843+0000 7f7617c58700 1 --2- 172.21.15.124:0/1859428508 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f75f406af00 0x7f75f406d3c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f76100caee0 tx=0x7f760c009040 comp rx=0 tx=0).stop 2023-10-16T12:59:38.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.843+0000 7f7617c58700 1 -- 172.21.15.124:0/1859428508 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f761006bed0 msgr2=0x7f76101e5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:38.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.843+0000 7f7617c58700 1 --2- 172.21.15.124:0/1859428508 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f761006bed0 0x7f76101e5e00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7600009130 tx=0x7f7600004750 comp rx=0 tx=0).stop 2023-10-16T12:59:38.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.843+0000 7f7617c58700 1 -- 172.21.15.124:0/1859428508 shutdown_connections 2023-10-16T12:59:38.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.843+0000 7f7617c58700 1 --2- 172.21.15.124:0/1859428508 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f75f406af00 0x7f75f406d3c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:38.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.843+0000 7f7617c58700 1 --2- 172.21.15.124:0/1859428508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f761015d6b0 0x7f76100cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:38.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.843+0000 7f7617c58700 1 --2- 172.21.15.124:0/1859428508 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f761006bed0 0x7f76101e5e00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:38.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.843+0000 7f7617c58700 1 --2- 172.21.15.124:0/1859428508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76100cfab0 0x7f76100cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:38.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.843+0000 7f7617c58700 1 -- 172.21.15.124:0/1859428508 >> 172.21.15.124:0/1859428508 conn(0x7f7610072340 msgr2=0x7f76100b8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:38.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.843+0000 7f7617c58700 1 -- 172.21.15.124:0/1859428508 shutdown_connections 2023-10-16T12:59:38.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:38.843+0000 7f7617c58700 1 -- 172.21.15.124:0/1859428508 wait complete. 2023-10-16T12:59:38.858 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-16T12:59:38.859 DEBUG:teuthology.orchestra.run.smithi124:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T12:59:38.896 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T12:59:38.945 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-16T12:59:38.946 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:59:38.946 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:59:38.967 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:59:38.968 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:59:39.027 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:59:39.027 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:59:39.085 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:59:39.244 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.242+0000 7fa0eef8e700 1 Processor -- start 2023-10-16T12:59:39.245 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.242+0000 7fa0eef8e700 1 -- start start 2023-10-16T12:59:39.247 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.242+0000 7fa0eef8e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa0e806a820 0x7fa0e80cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:39.247 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.242+0000 7fa0eef8e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa0e80ca7d0 0x7fa0e8071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:39.247 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.243+0000 7fa0eef8e700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e80cfeb0 con 0x7fa0e815e7f0 2023-10-16T12:59:39.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.243+0000 7fa0eef8e700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e80ce410 con 0x7fa0e806a820 2023-10-16T12:59:39.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.243+0000 7fa0eef8e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e815ec50 con 0x7fa0e80ca7d0 2023-10-16T12:59:39.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.243+0000 7fa0ecd2a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa0e806a820 0x7fa0e80cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:39.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.243+0000 7fa0ecd2a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa0e806a820 0x7fa0e80cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54690/0 (socket says 172.21.15.124:54690) 2023-10-16T12:59:39.248 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.243+0000 7fa0ecd2a700 1 -- 172.21.15.124:0/791579243 learned_addr learned my addr 172.21.15.124:0/791579243 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:39.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.243+0000 7fa0e7fff700 1 --1- 172.21.15.124:0/791579243 >> v1:172.21.15.124:6789/0 conn(0x7fa0e815e7f0 0x7fa0e806ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43360/0 (socket says 172.21.15.124:43360) 2023-10-16T12:59:39.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.243+0000 7fa0ed52b700 1 --2- 172.21.15.124:0/791579243 >> v2:172.21.15.192:3300/0 conn(0x7fa0e80ca7d0 0x7fa0e8071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:39.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.243+0000 7fa0ecd2a700 1 -- 172.21.15.124:0/791579243 >> v2:172.21.15.192:3300/0 conn(0x7fa0e80ca7d0 msgr2=0x7fa0e8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:39.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.243+0000 7fa0ecd2a700 1 --2- 172.21.15.124:0/791579243 >> v2:172.21.15.192:3300/0 conn(0x7fa0e80ca7d0 0x7fa0e8071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:39.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.243+0000 7fa0ecd2a700 1 -- 172.21.15.124:0/791579243 >> v1:172.21.15.124:6789/0 conn(0x7fa0e815e7f0 legacy=0x7fa0e806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:39.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.243+0000 7fa0e77fe700 1 -- 172.21.15.124:0/791579243 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1972144138 0 0) 0x7fa0e80cfeb0 con 0x7fa0e815e7f0 2023-10-16T12:59:39.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.243+0000 7fa0ecd2a700 1 -- 172.21.15.124:0/791579243 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e80af9d0 con 0x7fa0e806a820 2023-10-16T12:59:39.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.243+0000 7fa0ecd2a700 1 --2- 172.21.15.124:0/791579243 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa0e806a820 0x7fa0e80cf7d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80b2cb0 tx=0x7fa0dc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6bcd0e1517a3c42 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:39.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.243+0000 7fa0e77fe700 1 -- 172.21.15.124:0/791579243 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc00b870 con 0x7fa0e806a820 2023-10-16T12:59:39.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.243+0000 7fa0e77fe700 1 -- 172.21.15.124:0/791579243 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0dc00b9d0 con 0x7fa0e806a820 2023-10-16T12:59:39.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.243+0000 7fa0e77fe700 1 -- 172.21.15.124:0/791579243 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc00bd60 con 0x7fa0e806a820 2023-10-16T12:59:39.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.244+0000 7fa0eef8e700 1 -- 172.21.15.124:0/791579243 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa0e806a820 msgr2=0x7fa0e80cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:39.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.244+0000 7fa0eef8e700 1 --2- 172.21.15.124:0/791579243 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa0e806a820 0x7fa0e80cf7d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80b2cb0 tx=0x7fa0dc009bd0 comp rx=0 tx=0).stop 2023-10-16T12:59:39.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.244+0000 7fa0eef8e700 1 -- 172.21.15.124:0/791579243 shutdown_connections 2023-10-16T12:59:39.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.244+0000 7fa0eef8e700 1 --2- 172.21.15.124:0/791579243 >> v2:172.21.15.192:3300/0 conn(0x7fa0e80ca7d0 0x7fa0e8071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:39.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.244+0000 7fa0eef8e700 1 --2- 172.21.15.124:0/791579243 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa0e806a820 0x7fa0e80cf7d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:39.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.244+0000 7fa0eef8e700 1 -- 172.21.15.124:0/791579243 >> 172.21.15.124:0/791579243 conn(0x7fa0e80d0180 msgr2=0x7fa0e80d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:39.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.244+0000 7fa0eef8e700 1 -- 172.21.15.124:0/791579243 shutdown_connections 2023-10-16T12:59:39.252 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.244+0000 7fa0eef8e700 1 -- 172.21.15.124:0/791579243 wait complete. 2023-10-16T12:59:39.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.245+0000 7fa0eef8e700 1 Processor -- start 2023-10-16T12:59:39.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.245+0000 7fa0eef8e700 1 -- start start 2023-10-16T12:59:39.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.246+0000 7fa0eef8e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa0e806a820 0x7fa0e8157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:39.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.246+0000 7fa0eef8e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0e80ca7d0 0x7fa0e80acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:39.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.246+0000 7fa0eef8e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0e815e7f0 0x7fa0e81f4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:39.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.246+0000 7fa0eef8e700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e80c3c90 con 0x7fa0e806a820 2023-10-16T12:59:39.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.246+0000 7fa0eef8e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e8157c40 con 0x7fa0e80ca7d0 2023-10-16T12:59:39.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.246+0000 7fa0eef8e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e80ad640 con 0x7fa0e815e7f0 2023-10-16T12:59:39.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.247+0000 7fa0ecd2a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa0e806a820 0x7fa0e8157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:39.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.247+0000 7fa0ecd2a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa0e806a820 0x7fa0e8157700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54696/0 (socket says 172.21.15.124:54696) 2023-10-16T12:59:39.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.247+0000 7fa0ecd2a700 1 -- 172.21.15.124:0/942111514 learned_addr learned my addr 172.21.15.124:0/942111514 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:39.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.247+0000 7fa0e7fff700 1 --2- 172.21.15.124:0/942111514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0e80ca7d0 0x7fa0e80acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:39.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.247+0000 7fa0ed52b700 1 --2- 172.21.15.124:0/942111514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0e815e7f0 0x7fa0e81f4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:39.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.247+0000 7fa0ecd2a700 1 -- 172.21.15.124:0/942111514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0e815e7f0 msgr2=0x7fa0e81f4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:39.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.247+0000 7fa0ecd2a700 1 --2- 172.21.15.124:0/942111514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0e815e7f0 0x7fa0e81f4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:39.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.247+0000 7fa0ecd2a700 1 -- 172.21.15.124:0/942111514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0e80ca7d0 msgr2=0x7fa0e80acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:39.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.247+0000 7fa0ecd2a700 1 --2- 172.21.15.124:0/942111514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0e80ca7d0 0x7fa0e80acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:39.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.247+0000 7fa0ecd2a700 1 -- 172.21.15.124:0/942111514 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0dc009550 con 0x7fa0e806a820 2023-10-16T12:59:39.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.247+0000 7fa0ecd2a700 1 --2- 172.21.15.124:0/942111514 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa0e806a820 0x7fa0e8157700 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc009840 tx=0x7fa0dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:39.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.247+0000 7fa0e57fa700 1 -- 172.21.15.124:0/942111514 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc004310 con 0x7fa0e806a820 2023-10-16T12:59:39.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.247+0000 7fa0e57fa700 1 -- 172.21.15.124:0/942111514 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0dc01f070 con 0x7fa0e806a820 2023-10-16T12:59:39.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.247+0000 7fa0eef8e700 1 -- 172.21.15.124:0/942111514 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e80ad920 con 0x7fa0e806a820 2023-10-16T12:59:39.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.247+0000 7fa0e57fa700 1 -- 172.21.15.124:0/942111514 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc0036a0 con 0x7fa0e806a820 2023-10-16T12:59:39.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.247+0000 7fa0eef8e700 1 -- 172.21.15.124:0/942111514 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e80c3ee0 con 0x7fa0e806a820 2023-10-16T12:59:39.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.248+0000 7fa0eef8e700 1 -- 172.21.15.124:0/942111514 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e804ebb0 con 0x7fa0e806a820 2023-10-16T12:59:39.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.249+0000 7fa0e57fa700 1 -- 172.21.15.124:0/942111514 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa0dc021030 con 0x7fa0e806a820 2023-10-16T12:59:39.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.249+0000 7fa0e57fa700 1 --2- 172.21.15.124:0/942111514 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa0cc06af00 0x7fa0cc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:39.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.249+0000 7fa0e7fff700 1 --2- 172.21.15.124:0/942111514 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa0cc06af00 0x7fa0cc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:39.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.249+0000 7fa0e57fa700 1 -- 172.21.15.124:0/942111514 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7fa0dc08af30 con 0x7fa0e806a820 2023-10-16T12:59:39.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.249+0000 7fa0e7fff700 1 --2- 172.21.15.124:0/942111514 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa0cc06af00 0x7fa0cc06d3c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80ca480 tx=0x7fa0d4007c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:39.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.253+0000 7fa0e57fa700 1 -- 172.21.15.124:0/942111514 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa0dc055dd0 con 0x7fa0e806a820 2023-10-16T12:59:39.448 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.446+0000 7fa0eef8e700 1 -- 172.21.15.124:0/942111514 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0e806b490 con 0x7fa0e806a820 2023-10-16T12:59:39.449 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.447+0000 7fa0e57fa700 1 -- 172.21.15.124:0/942111514 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18751 (secure 0 0 0) 0x7fa0dc0593f0 con 0x7fa0e806a820 2023-10-16T12:59:39.450 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:39.450 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":26,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:59:34.463212+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2},{"from":7,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:59:39.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.449+0000 7fa0eef8e700 1 -- 172.21.15.124:0/942111514 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa0cc06af00 msgr2=0x7fa0cc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:39.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.449+0000 7fa0eef8e700 1 --2- 172.21.15.124:0/942111514 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa0cc06af00 0x7fa0cc06d3c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80ca480 tx=0x7fa0d4007c90 comp rx=0 tx=0).stop 2023-10-16T12:59:39.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.449+0000 7fa0eef8e700 1 -- 172.21.15.124:0/942111514 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa0e806a820 msgr2=0x7fa0e8157700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:39.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.449+0000 7fa0eef8e700 1 --2- 172.21.15.124:0/942111514 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa0e806a820 0x7fa0e8157700 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc009840 tx=0x7fa0dc004750 comp rx=0 tx=0).stop 2023-10-16T12:59:39.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.449+0000 7fa0eef8e700 1 -- 172.21.15.124:0/942111514 shutdown_connections 2023-10-16T12:59:39.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.449+0000 7fa0eef8e700 1 --2- 172.21.15.124:0/942111514 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa0cc06af00 0x7fa0cc06d3c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:39.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.449+0000 7fa0eef8e700 1 --2- 172.21.15.124:0/942111514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0e815e7f0 0x7fa0e81f4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:39.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.449+0000 7fa0eef8e700 1 --2- 172.21.15.124:0/942111514 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa0e806a820 0x7fa0e8157700 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:39.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.449+0000 7fa0eef8e700 1 --2- 172.21.15.124:0/942111514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0e80ca7d0 0x7fa0e80acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:39.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.449+0000 7fa0eef8e700 1 -- 172.21.15.124:0/942111514 >> 172.21.15.124:0/942111514 conn(0x7fa0e80d0180 msgr2=0x7fa0e80b0640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:39.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.449+0000 7fa0eef8e700 1 -- 172.21.15.124:0/942111514 shutdown_connections 2023-10-16T12:59:39.454 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.449+0000 7fa0eef8e700 1 -- 172.21.15.124:0/942111514 wait complete. 2023-10-16T12:59:39.464 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T12:58:38.667813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T12:58:49.562073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T12:58:50.011419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T12:58:53.692890+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T12:59:39.465 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T12:59:39.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.587+0000 7f6b531b4700 1 Processor -- start 2023-10-16T12:59:39.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.587+0000 7f6b531b4700 1 -- start start 2023-10-16T12:59:39.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.587+0000 7f6b531b4700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f6b4c0b33f0 0x7f6b4c06f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:39.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.587+0000 7f6b531b4700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4c070620 con 0x7f6b4c15b4e0 2023-10-16T12:59:39.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.587+0000 7f6b531b4700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4c070900 con 0x7f6b4c0cd770 2023-10-16T12:59:39.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.587+0000 7f6b531b4700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b4c070be0 con 0x7f6b4c0b33f0 2023-10-16T12:59:39.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.588+0000 7f6b4bfff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f6b4c0b33f0 0x7f6b4c06f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:39.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.588+0000 7f6b50f50700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f6b4c15b4e0 0x7f6b4c0b2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43372/0 (socket says 172.21.15.124:43372) 2023-10-16T12:59:39.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.588+0000 7f6b4bfff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f6b4c0b33f0 0x7f6b4c06f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54706/0 (socket says 172.21.15.124:54706) 2023-10-16T12:59:39.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.588+0000 7f6b50f50700 1 -- 172.21.15.124:0/3329865805 learned_addr learned my addr 172.21.15.124:0/3329865805 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:39.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.588+0000 7f6b4bfff700 1 -- 172.21.15.124:0/3329865805 >> v1:172.21.15.192:6789/0 conn(0x7f6b4c0cd770 legacy=0x7f6b4c0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:39.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.588+0000 7f6b4bfff700 1 -- 172.21.15.124:0/3329865805 >> v1:172.21.15.124:6789/0 conn(0x7f6b4c15b4e0 legacy=0x7f6b4c0b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:39.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.588+0000 7f6b4b7fe700 1 -- 172.21.15.124:0/3329865805 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 992360079 0 0) 0x7f6b4c070620 con 0x7f6b4c15b4e0 2023-10-16T12:59:39.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.588+0000 7f6b4bfff700 1 -- 172.21.15.124:0/3329865805 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4c070ec0 con 0x7f6b4c0b33f0 2023-10-16T12:59:39.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.588+0000 7f6b4bfff700 1 --2- 172.21.15.124:0/3329865805 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6b4c0b33f0 0x7f6b4c06f280 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6b38009870 tx=0x7f6b38009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61bcc3f2d8d76818 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:39.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.588+0000 7f6b4b7fe700 1 -- 172.21.15.124:0/3329865805 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b38004230 con 0x7f6b4c0b33f0 2023-10-16T12:59:39.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.588+0000 7f6b4b7fe700 1 -- 172.21.15.124:0/3329865805 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b38004390 con 0x7f6b4c0b33f0 2023-10-16T12:59:39.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.588+0000 7f6b4b7fe700 1 -- 172.21.15.124:0/3329865805 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b380036a0 con 0x7f6b4c0b33f0 2023-10-16T12:59:39.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.589+0000 7f6b531b4700 1 -- 172.21.15.124:0/3329865805 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6b4c0b33f0 msgr2=0x7f6b4c06f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:39.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.589+0000 7f6b531b4700 1 --2- 172.21.15.124:0/3329865805 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6b4c0b33f0 0x7f6b4c06f280 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6b38009870 tx=0x7f6b38009b80 comp rx=0 tx=0).stop 2023-10-16T12:59:39.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.589+0000 7f6b531b4700 1 -- 172.21.15.124:0/3329865805 shutdown_connections 2023-10-16T12:59:39.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.589+0000 7f6b531b4700 1 --2- 172.21.15.124:0/3329865805 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6b4c0b33f0 0x7f6b4c06f280 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:39.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.589+0000 7f6b531b4700 1 -- 172.21.15.124:0/3329865805 >> 172.21.15.124:0/3329865805 conn(0x7f6b4c0cdce0 msgr2=0x7f6b4c0ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:39.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.589+0000 7f6b531b4700 1 -- 172.21.15.124:0/3329865805 shutdown_connections 2023-10-16T12:59:39.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.589+0000 7f6b531b4700 1 -- 172.21.15.124:0/3329865805 wait complete. 2023-10-16T12:59:39.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.590+0000 7f6b531b4700 1 Processor -- start 2023-10-16T12:59:39.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.590+0000 7f6b531b4700 1 -- start start 2023-10-16T12:59:39.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.591+0000 7f6b531b4700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6b4c0b33f0 0x7f6b4c14cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:39.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.591+0000 7f6b531b4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b4c0cd770 0x7f6b4c150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:39.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.591+0000 7f6b531b4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b4c15b4e0 0x7f6b4c0b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:39.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.591+0000 7f6b531b4700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c14d4d0 con 0x7f6b4c0b33f0 2023-10-16T12:59:39.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.591+0000 7f6b531b4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c0b0780 con 0x7f6b4c15b4e0 2023-10-16T12:59:39.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.591+0000 7f6b531b4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c0b0a20 con 0x7f6b4c0cd770 2023-10-16T12:59:39.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.591+0000 7f6b50f50700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6b4c0b33f0 0x7f6b4c14cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:39.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.591+0000 7f6b50f50700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6b4c0b33f0 0x7f6b4c14cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54710/0 (socket says 172.21.15.124:54710) 2023-10-16T12:59:39.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.591+0000 7f6b50f50700 1 -- 172.21.15.124:0/2451546160 learned_addr learned my addr 172.21.15.124:0/2451546160 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:39.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.591+0000 7f6b4bfff700 1 --2- 172.21.15.124:0/2451546160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b4c0cd770 0x7f6b4c150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:39.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.591+0000 7f6b51751700 1 --2- 172.21.15.124:0/2451546160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b4c15b4e0 0x7f6b4c0b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:39.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.591+0000 7f6b50f50700 1 -- 172.21.15.124:0/2451546160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b4c0cd770 msgr2=0x7f6b4c150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:39.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.591+0000 7f6b50f50700 1 --2- 172.21.15.124:0/2451546160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b4c0cd770 0x7f6b4c150120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:39.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.591+0000 7f6b50f50700 1 -- 172.21.15.124:0/2451546160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b4c15b4e0 msgr2=0x7f6b4c0b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:39.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.591+0000 7f6b50f50700 1 --2- 172.21.15.124:0/2451546160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b4c15b4e0 0x7f6b4c0b1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:39.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.591+0000 7f6b50f50700 1 -- 172.21.15.124:0/2451546160 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b380094a0 con 0x7f6b4c0b33f0 2023-10-16T12:59:39.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.591+0000 7f6b51751700 1 --2- 172.21.15.124:0/2451546160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b4c15b4e0 0x7f6b4c0b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:39.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.591+0000 7f6b50f50700 1 --2- 172.21.15.124:0/2451546160 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6b4c0b33f0 0x7f6b4c14cf90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000c550 tx=0x7f6b4000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:39.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.592+0000 7f6b497fa700 1 -- 172.21.15.124:0/2451546160 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b40004c80 con 0x7f6b4c0b33f0 2023-10-16T12:59:39.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.592+0000 7f6b497fa700 1 -- 172.21.15.124:0/2451546160 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b40004e00 con 0x7f6b4c0b33f0 2023-10-16T12:59:39.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.592+0000 7f6b531b4700 1 -- 172.21.15.124:0/2451546160 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4c0b0d00 con 0x7f6b4c0b33f0 2023-10-16T12:59:39.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.592+0000 7f6b497fa700 1 -- 172.21.15.124:0/2451546160 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b40007310 con 0x7f6b4c0b33f0 2023-10-16T12:59:39.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.592+0000 7f6b531b4700 1 -- 172.21.15.124:0/2451546160 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4c0b12c0 con 0x7f6b4c0b33f0 2023-10-16T12:59:39.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.592+0000 7f6b531b4700 1 -- 172.21.15.124:0/2451546160 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4c04ebb0 con 0x7f6b4c0b33f0 2023-10-16T12:59:39.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.593+0000 7f6b497fa700 1 -- 172.21.15.124:0/2451546160 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6b40007470 con 0x7f6b4c0b33f0 2023-10-16T12:59:39.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.593+0000 7f6b497fa700 1 --2- 172.21.15.124:0/2451546160 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6b3006af00 0x7f6b3006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:39.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.593+0000 7f6b497fa700 1 -- 172.21.15.124:0/2451546160 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f6b400895e0 con 0x7f6b4c0b33f0 2023-10-16T12:59:39.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.593+0000 7f6b4bfff700 1 --2- 172.21.15.124:0/2451546160 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6b3006af00 0x7f6b3006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:39.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.594+0000 7f6b4bfff700 1 --2- 172.21.15.124:0/2451546160 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6b3006af00 0x7f6b3006d3c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6b38009870 tx=0x7f6b3801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:39.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.598+0000 7f6b497fa700 1 -- 172.21.15.124:0/2451546160 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6b40054360 con 0x7f6b4c0b33f0 2023-10-16T12:59:39.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.786+0000 7f6b531b4700 1 -- 172.21.15.124:0/2451546160 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b4c0d0bf0 con 0x7f6b4c0b33f0 2023-10-16T12:59:39.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.786+0000 7f6b497fa700 1 -- 172.21.15.124:0/2451546160 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b40057980 con 0x7f6b4c0b33f0 2023-10-16T12:59:39.789 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-16T12:59:39.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.788+0000 7f6b531b4700 1 -- 172.21.15.124:0/2451546160 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6b3006af00 msgr2=0x7f6b3006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:39.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.788+0000 7f6b531b4700 1 --2- 172.21.15.124:0/2451546160 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6b3006af00 0x7f6b3006d3c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6b38009870 tx=0x7f6b3801c040 comp rx=0 tx=0).stop 2023-10-16T12:59:39.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.788+0000 7f6b531b4700 1 -- 172.21.15.124:0/2451546160 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6b4c0b33f0 msgr2=0x7f6b4c14cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:39.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.788+0000 7f6b531b4700 1 --2- 172.21.15.124:0/2451546160 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6b4c0b33f0 0x7f6b4c14cf90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000c550 tx=0x7f6b4000c910 comp rx=0 tx=0).stop 2023-10-16T12:59:39.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.788+0000 7f6b531b4700 1 -- 172.21.15.124:0/2451546160 shutdown_connections 2023-10-16T12:59:39.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.788+0000 7f6b531b4700 1 --2- 172.21.15.124:0/2451546160 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6b3006af00 0x7f6b3006d3c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:39.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.788+0000 7f6b531b4700 1 --2- 172.21.15.124:0/2451546160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b4c15b4e0 0x7f6b4c0b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:39.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.788+0000 7f6b531b4700 1 --2- 172.21.15.124:0/2451546160 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6b4c0b33f0 0x7f6b4c14cf90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:39.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.788+0000 7f6b531b4700 1 --2- 172.21.15.124:0/2451546160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b4c0cd770 0x7f6b4c150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:39.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.788+0000 7f6b531b4700 1 -- 172.21.15.124:0/2451546160 >> 172.21.15.124:0/2451546160 conn(0x7f6b4c0cdce0 msgr2=0x7f6b4c0cba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:39.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.788+0000 7f6b531b4700 1 -- 172.21.15.124:0/2451546160 shutdown_connections 2023-10-16T12:59:39.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.788+0000 7f6b531b4700 1 -- 172.21.15.124:0/2451546160 wait complete. 2023-10-16T12:59:39.803 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T12:59:39.927 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.924+0000 7f3c6cadd700 1 Processor -- start 2023-10-16T12:59:39.927 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.924+0000 7f3c6cadd700 1 -- start start 2023-10-16T12:59:39.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.925+0000 7f3c6cadd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c680ce440 0x7f3c6815dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:39.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.925+0000 7f3c6cadd700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c68161360 con 0x7f3c6806a820 2023-10-16T12:59:39.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.925+0000 7f3c6cadd700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c6806b750 con 0x7f3c6806b370 2023-10-16T12:59:39.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.925+0000 7f3c6cadd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6806dcc0 con 0x7f3c680ce440 2023-10-16T12:59:39.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.925+0000 7f3c65d9b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f3c6806a820 0x7f3c680cdd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43386/0 (socket says 172.21.15.124:43386) 2023-10-16T12:59:39.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.925+0000 7f3c65d9b700 1 -- 172.21.15.124:0/3499311940 learned_addr learned my addr 172.21.15.124:0/3499311940 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:39.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.925+0000 7f3c66d9d700 1 --2- 172.21.15.124:0/3499311940 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c680ce440 0x7f3c6815dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:39.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.925+0000 7f3c6559a700 1 -- 172.21.15.124:0/3499311940 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473305151 0 0) 0x7f3c68161360 con 0x7f3c6806a820 2023-10-16T12:59:39.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.926+0000 7f3c6559a700 1 -- 172.21.15.124:0/3499311940 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c500035b0 con 0x7f3c6806a820 2023-10-16T12:59:39.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.926+0000 7f3c66d9d700 1 -- 172.21.15.124:0/3499311940 >> v1:172.21.15.192:6789/0 conn(0x7f3c6806b370 legacy=0x7f3c6806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:39.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.926+0000 7f3c6559a700 1 -- 172.21.15.124:0/3499311940 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862361421 0 0) 0x7f3c6806b750 con 0x7f3c6806b370 2023-10-16T12:59:39.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.926+0000 7f3c66d9d700 1 -- 172.21.15.124:0/3499311940 >> v1:172.21.15.124:6789/0 conn(0x7f3c6806a820 legacy=0x7f3c680cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:39.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.926+0000 7f3c66d9d700 1 -- 172.21.15.124:0/3499311940 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6815e300 con 0x7f3c680ce440 2023-10-16T12:59:39.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.926+0000 7f3c66d9d700 1 --2- 172.21.15.124:0/3499311940 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c680ce440 0x7f3c6815dcb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3c60009dc0 tx=0x7f3c6000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=892c76f7e7bda3f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:39.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.926+0000 7f3c6559a700 1 -- 172.21.15.124:0/3499311940 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6000e070 con 0x7f3c680ce440 2023-10-16T12:59:39.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.926+0000 7f3c6559a700 1 -- 172.21.15.124:0/3499311940 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6000bb20 con 0x7f3c680ce440 2023-10-16T12:59:39.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.926+0000 7f3c6559a700 1 -- 172.21.15.124:0/3499311940 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6000bed0 con 0x7f3c680ce440 2023-10-16T12:59:39.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.927+0000 7f3c6cadd700 1 -- 172.21.15.124:0/3499311940 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c680ce440 msgr2=0x7f3c6815dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:39.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.927+0000 7f3c6cadd700 1 --2- 172.21.15.124:0/3499311940 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c680ce440 0x7f3c6815dcb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3c60009dc0 tx=0x7f3c6000b330 comp rx=0 tx=0).stop 2023-10-16T12:59:39.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.927+0000 7f3c6cadd700 1 -- 172.21.15.124:0/3499311940 shutdown_connections 2023-10-16T12:59:39.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.927+0000 7f3c6cadd700 1 --2- 172.21.15.124:0/3499311940 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c680ce440 0x7f3c6815dcb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:39.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.927+0000 7f3c6cadd700 1 -- 172.21.15.124:0/3499311940 >> 172.21.15.124:0/3499311940 conn(0x7f3c680ccbe0 msgr2=0x7f3c680ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:39.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.927+0000 7f3c6cadd700 1 -- 172.21.15.124:0/3499311940 shutdown_connections 2023-10-16T12:59:39.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.927+0000 7f3c6cadd700 1 -- 172.21.15.124:0/3499311940 wait complete. 2023-10-16T12:59:39.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.928+0000 7f3c6cadd700 1 Processor -- start 2023-10-16T12:59:39.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.928+0000 7f3c6cadd700 1 -- start start 2023-10-16T12:59:39.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.929+0000 7f3c6cadd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c6806a820 0x7f3c68156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:39.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.929+0000 7f3c6cadd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c6806b370 0x7f3c68071c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:39.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.929+0000 7f3c6cadd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c680ce440 0x7f3c68072190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:39.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.929+0000 7f3c6cadd700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c681e72b0 con 0x7f3c680ce440 2023-10-16T12:59:39.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.929+0000 7f3c6cadd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c681e6630 con 0x7f3c6806b370 2023-10-16T12:59:39.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.929+0000 7f3c6cadd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c681e6910 con 0x7f3c6806a820 2023-10-16T12:59:39.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.929+0000 7f3c66d9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c680ce440 0x7f3c68072190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:39.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.929+0000 7f3c66d9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c680ce440 0x7f3c68072190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54728/0 (socket says 172.21.15.124:54728) 2023-10-16T12:59:39.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.929+0000 7f3c66d9d700 1 -- 172.21.15.124:0/3474222274 learned_addr learned my addr 172.21.15.124:0/3474222274 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:39.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.929+0000 7f3c65d9b700 1 --2- 172.21.15.124:0/3474222274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c6806b370 0x7f3c68071c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:39.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.929+0000 7f3c6659c700 1 --2- 172.21.15.124:0/3474222274 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c6806a820 0x7f3c68156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:39.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.929+0000 7f3c66d9d700 1 -- 172.21.15.124:0/3474222274 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c6806a820 msgr2=0x7f3c68156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:39.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.929+0000 7f3c66d9d700 1 --2- 172.21.15.124:0/3474222274 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c6806a820 0x7f3c68156210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:39.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.929+0000 7f3c66d9d700 1 -- 172.21.15.124:0/3474222274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c6806b370 msgr2=0x7f3c68071c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:39.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.929+0000 7f3c66d9d700 1 --2- 172.21.15.124:0/3474222274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c6806b370 0x7f3c68071c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:39.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.929+0000 7f3c66d9d700 1 -- 172.21.15.124:0/3474222274 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c60009a70 con 0x7f3c680ce440 2023-10-16T12:59:39.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.929+0000 7f3c66d9d700 1 --2- 172.21.15.124:0/3474222274 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c680ce440 0x7f3c68072190 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3c60009f30 tx=0x7f3c60004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:39.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.930+0000 7f3c56ffd700 1 -- 172.21.15.124:0/3474222274 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6001b8d0 con 0x7f3c680ce440 2023-10-16T12:59:39.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.930+0000 7f3c56ffd700 1 -- 172.21.15.124:0/3474222274 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c60020070 con 0x7f3c680ce440 2023-10-16T12:59:39.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.930+0000 7f3c6cadd700 1 -- 172.21.15.124:0/3474222274 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c681e6bf0 con 0x7f3c680ce440 2023-10-16T12:59:39.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.930+0000 7f3c56ffd700 1 -- 172.21.15.124:0/3474222274 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6001bc70 con 0x7f3c680ce440 2023-10-16T12:59:39.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.930+0000 7f3c6cadd700 1 -- 172.21.15.124:0/3474222274 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c681e7b50 con 0x7f3c680ce440 2023-10-16T12:59:39.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.931+0000 7f3c6cadd700 1 -- 172.21.15.124:0/3474222274 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c680b3960 con 0x7f3c680ce440 2023-10-16T12:59:39.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.931+0000 7f3c56ffd700 1 -- 172.21.15.124:0/3474222274 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3c6001c400 con 0x7f3c680ce440 2023-10-16T12:59:39.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.931+0000 7f3c56ffd700 1 --2- 172.21.15.124:0/3474222274 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f3c4806af00 0x7f3c4806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:39.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.931+0000 7f3c56ffd700 1 -- 172.21.15.124:0/3474222274 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f3c60022070 con 0x7f3c680ce440 2023-10-16T12:59:39.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.931+0000 7f3c6659c700 1 --2- 172.21.15.124:0/3474222274 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f3c4806af00 0x7f3c4806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:39.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.932+0000 7f3c6659c700 1 --2- 172.21.15.124:0/3474222274 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f3c4806af00 0x7f3c4806d3c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c007fd0 tx=0x7f3c5c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:39.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:39.936+0000 7f3c56ffd700 1 -- 172.21.15.124:0/3474222274 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3c60056af0 con 0x7f3c680ce440 2023-10-16T12:59:40.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.127+0000 7f3c6cadd700 1 -- 172.21.15.124:0/3474222274 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3c68072d10 con 0x7f3c680ce440 2023-10-16T12:59:40.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.127+0000 7f3c56ffd700 1 -- 172.21.15.124:0/3474222274 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3c6005a110 con 0x7f3c680ce440 2023-10-16T12:59:40.144 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:40.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.129+0000 7f3c6cadd700 1 -- 172.21.15.124:0/3474222274 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f3c4806af00 msgr2=0x7f3c4806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:40.146 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.129+0000 7f3c6cadd700 1 --2- 172.21.15.124:0/3474222274 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f3c4806af00 0x7f3c4806d3c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c007fd0 tx=0x7f3c5c009040 comp rx=0 tx=0).stop 2023-10-16T12:59:40.146 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.129+0000 7f3c6cadd700 1 -- 172.21.15.124:0/3474222274 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c680ce440 msgr2=0x7f3c68072190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:40.146 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.129+0000 7f3c6cadd700 1 --2- 172.21.15.124:0/3474222274 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c680ce440 0x7f3c68072190 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3c60009f30 tx=0x7f3c60004ad0 comp rx=0 tx=0).stop 2023-10-16T12:59:40.146 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.129+0000 7f3c6cadd700 1 -- 172.21.15.124:0/3474222274 shutdown_connections 2023-10-16T12:59:40.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.129+0000 7f3c6cadd700 1 --2- 172.21.15.124:0/3474222274 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f3c4806af00 0x7f3c4806d3c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:40.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.129+0000 7f3c6cadd700 1 --2- 172.21.15.124:0/3474222274 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c680ce440 0x7f3c68072190 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:40.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.129+0000 7f3c6cadd700 1 --2- 172.21.15.124:0/3474222274 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c6806a820 0x7f3c68156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:40.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.129+0000 7f3c6cadd700 1 --2- 172.21.15.124:0/3474222274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c6806b370 0x7f3c68071c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:40.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.129+0000 7f3c6cadd700 1 -- 172.21.15.124:0/3474222274 >> 172.21.15.124:0/3474222274 conn(0x7f3c680ccbe0 msgr2=0x7f3c681573f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:40.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.129+0000 7f3c6cadd700 1 -- 172.21.15.124:0/3474222274 shutdown_connections 2023-10-16T12:59:40.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.130+0000 7f3c6cadd700 1 -- 172.21.15.124:0/3474222274 wait complete. 2023-10-16T12:59:40.148 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T12:59:40.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.268+0000 7fb179051700 1 Processor -- start 2023-10-16T12:59:41.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.269+0000 7fb179051700 1 -- start start 2023-10-16T12:59:41.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.269+0000 7fb179051700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb17406b930 0x7fb1740cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:41.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.269+0000 7fb179051700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb1740cf4c0 0x7fb17415df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:41.158 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.269+0000 7fb179051700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1740cf910 con 0x7fb1740b2ce0 2023-10-16T12:59:41.158 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.269+0000 7fb179051700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17415b610 con 0x7fb17406b930 2023-10-16T12:59:41.158 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.269+0000 7fb179051700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb174161210 con 0x7fb1740cf4c0 2023-10-16T12:59:41.158 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.269+0000 7fb17259c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb17406b930 0x7fb1740cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:41.159 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.269+0000 7fb17259c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb17406b930 0x7fb1740cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54734/0 (socket says 172.21.15.124:54734) 2023-10-16T12:59:41.159 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.270+0000 7fb17259c700 1 -- 172.21.15.124:0/809188049 learned_addr learned my addr 172.21.15.124:0/809188049 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:41.159 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.270+0000 7fb17359e700 1 --2- 172.21.15.124:0/809188049 >> v2:172.21.15.192:3300/0 conn(0x7fb1740cf4c0 0x7fb17415df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:41.159 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.270+0000 7fb17259c700 1 -- 172.21.15.124:0/809188049 >> v2:172.21.15.192:3300/0 conn(0x7fb1740cf4c0 msgr2=0x7fb17415df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:41.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.270+0000 7fb17259c700 1 --2- 172.21.15.124:0/809188049 >> v2:172.21.15.192:3300/0 conn(0x7fb1740cf4c0 0x7fb17415df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.270+0000 7fb17259c700 1 -- 172.21.15.124:0/809188049 >> v1:172.21.15.192:6789/0 conn(0x7fb1740b2ce0 legacy=0x7fb1740b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:41.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.270+0000 7fb17259c700 1 -- 172.21.15.124:0/809188049 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1741614f0 con 0x7fb17406b930 2023-10-16T12:59:41.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.270+0000 7fb17359e700 1 --2- 172.21.15.124:0/809188049 >> v2:172.21.15.192:3300/0 conn(0x7fb1740cf4c0 0x7fb17415df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:41.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.270+0000 7fb17259c700 1 --2- 172.21.15.124:0/809188049 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb17406b930 0x7fb1740cef80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb1640098f0 tx=0x7fb164009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6003150354d3aa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:41.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.270+0000 7fb171d9b700 1 -- 172.21.15.124:0/809188049 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16400b860 con 0x7fb17406b930 2023-10-16T12:59:41.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.270+0000 7fb171d9b700 1 -- 172.21.15.124:0/809188049 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16400b9c0 con 0x7fb17406b930 2023-10-16T12:59:41.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.270+0000 7fb171d9b700 1 -- 172.21.15.124:0/809188049 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16400bd50 con 0x7fb17406b930 2023-10-16T12:59:41.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.270+0000 7fb179051700 1 -- 172.21.15.124:0/809188049 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb17406b930 msgr2=0x7fb1740cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:41.162 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.270+0000 7fb179051700 1 --2- 172.21.15.124:0/809188049 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb17406b930 0x7fb1740cef80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb1640098f0 tx=0x7fb164009c00 comp rx=0 tx=0).stop 2023-10-16T12:59:41.162 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.271+0000 7fb179051700 1 -- 172.21.15.124:0/809188049 shutdown_connections 2023-10-16T12:59:41.162 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.271+0000 7fb179051700 1 --2- 172.21.15.124:0/809188049 >> v2:172.21.15.192:3300/0 conn(0x7fb1740cf4c0 0x7fb17415df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.162 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.271+0000 7fb179051700 1 --2- 172.21.15.124:0/809188049 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb17406b930 0x7fb1740cef80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.271+0000 7fb179051700 1 -- 172.21.15.124:0/809188049 >> 172.21.15.124:0/809188049 conn(0x7fb1740cdce0 msgr2=0x7fb1740ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:41.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.271+0000 7fb179051700 1 -- 172.21.15.124:0/809188049 shutdown_connections 2023-10-16T12:59:41.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.271+0000 7fb179051700 1 -- 172.21.15.124:0/809188049 wait complete. 2023-10-16T12:59:41.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.272+0000 7fb179051700 1 Processor -- start 2023-10-16T12:59:41.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.272+0000 7fb179051700 1 -- start start 2023-10-16T12:59:41.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.273+0000 7fb179051700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb17406b930 0x7fb1740c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:41.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.273+0000 7fb179051700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb1740b2ce0 0x7fb174156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:41.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.273+0000 7fb179051700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1740cf4c0 0x7fb1740b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:41.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.273+0000 7fb179051700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17415ee20 con 0x7fb1740b2ce0 2023-10-16T12:59:41.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.273+0000 7fb179051700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17415e1a0 con 0x7fb1740cf4c0 2023-10-16T12:59:41.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.273+0000 7fb179051700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17415e480 con 0x7fb17406b930 2023-10-16T12:59:41.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.273+0000 7fb17259c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb1740b2ce0 0x7fb174156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:41.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.273+0000 7fb17259c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb1740b2ce0 0x7fb174156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54740/0 (socket says 172.21.15.124:54740) 2023-10-16T12:59:41.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.273+0000 7fb17259c700 1 -- 172.21.15.124:0/2034490367 learned_addr learned my addr 172.21.15.124:0/2034490367 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:41.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.273+0000 7fb17359e700 1 --2- 172.21.15.124:0/2034490367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1740cf4c0 0x7fb1740b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:41.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.273+0000 7fb172d9d700 1 --2- 172.21.15.124:0/2034490367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb17406b930 0x7fb1740c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:41.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.273+0000 7fb17259c700 1 -- 172.21.15.124:0/2034490367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb17406b930 msgr2=0x7fb1740c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:41.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.273+0000 7fb17259c700 1 --2- 172.21.15.124:0/2034490367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb17406b930 0x7fb1740c7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.273+0000 7fb17259c700 1 -- 172.21.15.124:0/2034490367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1740cf4c0 msgr2=0x7fb1740b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:41.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.273+0000 7fb17259c700 1 --2- 172.21.15.124:0/2034490367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1740cf4c0 0x7fb1740b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.273+0000 7fb17259c700 1 -- 172.21.15.124:0/2034490367 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb164009550 con 0x7fb1740b2ce0 2023-10-16T12:59:41.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.273+0000 7fb17359e700 1 --2- 172.21.15.124:0/2034490367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1740cf4c0 0x7fb1740b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:41.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.273+0000 7fb172d9d700 1 --2- 172.21.15.124:0/2034490367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb17406b930 0x7fb1740c7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:41.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.273+0000 7fb17259c700 1 --2- 172.21.15.124:0/2034490367 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb1740b2ce0 0x7fb174156ac0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb164009c40 tx=0x7fb164004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:41.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.274+0000 7fb15b7fe700 1 -- 172.21.15.124:0/2034490367 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb164004400 con 0x7fb1740b2ce0 2023-10-16T12:59:41.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.274+0000 7fb15b7fe700 1 -- 172.21.15.124:0/2034490367 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16401f070 con 0x7fb1740b2ce0 2023-10-16T12:59:41.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.274+0000 7fb179051700 1 -- 172.21.15.124:0/2034490367 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17415e760 con 0x7fb1740b2ce0 2023-10-16T12:59:41.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.274+0000 7fb15b7fe700 1 -- 172.21.15.124:0/2034490367 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1640038c0 con 0x7fb1740b2ce0 2023-10-16T12:59:41.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.274+0000 7fb179051700 1 -- 172.21.15.124:0/2034490367 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17415de30 con 0x7fb1740b2ce0 2023-10-16T12:59:41.171 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.275+0000 7fb179051700 1 -- 172.21.15.124:0/2034490367 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17404ebb0 con 0x7fb1740b2ce0 2023-10-16T12:59:41.171 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.275+0000 7fb15b7fe700 1 -- 172.21.15.124:0/2034490367 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb164021030 con 0x7fb1740b2ce0 2023-10-16T12:59:41.172 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.275+0000 7fb15b7fe700 1 --2- 172.21.15.124:0/2034490367 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb16006af00 0x7fb16006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:41.172 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.275+0000 7fb15b7fe700 1 -- 172.21.15.124:0/2034490367 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7fb16408ae10 con 0x7fb1740b2ce0 2023-10-16T12:59:41.172 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.275+0000 7fb172d9d700 1 --2- 172.21.15.124:0/2034490367 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb16006af00 0x7fb16006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:41.172 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.276+0000 7fb172d9d700 1 --2- 172.21.15.124:0/2034490367 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb16006af00 0x7fb16006d3c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb168000f60 tx=0x7fb168009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:41.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.280+0000 7fb15b7fe700 1 -- 172.21.15.124:0/2034490367 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb164055b10 con 0x7fb1740b2ce0 2023-10-16T12:59:41.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.470+0000 7fb179051700 1 -- 172.21.15.124:0/2034490367 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb17406f4e0 con 0x7fb1740b2ce0 2023-10-16T12:59:41.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.470+0000 7fb15b7fe700 1 -- 172.21.15.124:0/2034490367 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb164015020 con 0x7fb1740b2ce0 2023-10-16T12:59:41.174 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2023-10-16T12:59:41.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.472+0000 7fb179051700 1 -- 172.21.15.124:0/2034490367 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb16006af00 msgr2=0x7fb16006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:41.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.472+0000 7fb179051700 1 --2- 172.21.15.124:0/2034490367 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb16006af00 0x7fb16006d3c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb168000f60 tx=0x7fb168009040 comp rx=0 tx=0).stop 2023-10-16T12:59:41.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.472+0000 7fb179051700 1 -- 172.21.15.124:0/2034490367 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb1740b2ce0 msgr2=0x7fb174156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:41.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.472+0000 7fb179051700 1 --2- 172.21.15.124:0/2034490367 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb1740b2ce0 0x7fb174156ac0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb164009c40 tx=0x7fb164004750 comp rx=0 tx=0).stop 2023-10-16T12:59:41.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.472+0000 7fb179051700 1 -- 172.21.15.124:0/2034490367 shutdown_connections 2023-10-16T12:59:41.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.472+0000 7fb179051700 1 --2- 172.21.15.124:0/2034490367 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb16006af00 0x7fb16006d3c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.472+0000 7fb179051700 1 --2- 172.21.15.124:0/2034490367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1740cf4c0 0x7fb1740b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.472+0000 7fb179051700 1 --2- 172.21.15.124:0/2034490367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb17406b930 0x7fb1740c7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.472+0000 7fb179051700 1 --2- 172.21.15.124:0/2034490367 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb1740b2ce0 0x7fb174156ac0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.472+0000 7fb179051700 1 -- 172.21.15.124:0/2034490367 >> 172.21.15.124:0/2034490367 conn(0x7fb1740cdce0 msgr2=0x7fb17406cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:41.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.472+0000 7fb179051700 1 -- 172.21.15.124:0/2034490367 shutdown_connections 2023-10-16T12:59:41.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:40.472+0000 7fb179051700 1 -- 172.21.15.124:0/2034490367 wait complete. 2023-10-16T12:59:41.179 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T12:59:41.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.346+0000 7f313457f700 1 Processor -- start 2023-10-16T12:59:41.349 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.346+0000 7f313457f700 1 -- start start 2023-10-16T12:59:41.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.347+0000 7f313457f700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f312c06a820 0x7f312c15dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:41.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.347+0000 7f313457f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f312c0cdd30 0x7f312c0ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:41.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.347+0000 7f313457f700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f312c161360 con 0x7f312c06b370 2023-10-16T12:59:41.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.347+0000 7f313457f700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f312c0ce720 con 0x7f312c06a820 2023-10-16T12:59:41.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.347+0000 7f313457f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f312c06b750 con 0x7f312c0cdd30 2023-10-16T12:59:41.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.347+0000 7f3131b1a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f312c06a820 0x7f312c15dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:41.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.347+0000 7f313231b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f312c06b370 0x7f312c06d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43414/0 (socket says 172.21.15.124:43414) 2023-10-16T12:59:41.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.347+0000 7f313231b700 1 -- 172.21.15.124:0/1130381432 learned_addr learned my addr 172.21.15.124:0/1130381432 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:41.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.348+0000 7f3132b1c700 1 --2- 172.21.15.124:0/1130381432 >> v2:172.21.15.192:3300/0 conn(0x7f312c0cdd30 0x7f312c0ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:41.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.348+0000 7f3131b1a700 1 -- 172.21.15.124:0/1130381432 >> v2:172.21.15.192:3300/0 conn(0x7f312c0cdd30 msgr2=0x7f312c0ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:41.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.348+0000 7f3131b1a700 1 --2- 172.21.15.124:0/1130381432 >> v2:172.21.15.192:3300/0 conn(0x7f312c0cdd30 0x7f312c0ce1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.348+0000 7f3131b1a700 1 -- 172.21.15.124:0/1130381432 >> v1:172.21.15.124:6789/0 conn(0x7f312c06b370 legacy=0x7f312c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:41.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.348+0000 7f3131319700 1 -- 172.21.15.124:0/1130381432 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489355270 0 0) 0x7f312c161360 con 0x7f312c06b370 2023-10-16T12:59:41.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.348+0000 7f3131b1a700 1 -- 172.21.15.124:0/1130381432 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312c06dcc0 con 0x7f312c06a820 2023-10-16T12:59:41.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.348+0000 7f3131b1a700 1 --2- 172.21.15.124:0/1130381432 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f312c06a820 0x7f312c15dcb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f312c15b880 tx=0x7f3128009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4039c128202c12 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:41.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.348+0000 7f3131319700 1 -- 172.21.15.124:0/1130381432 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3128011830 con 0x7f312c06a820 2023-10-16T12:59:41.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.348+0000 7f3131319700 1 -- 172.21.15.124:0/1130381432 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3128011990 con 0x7f312c06a820 2023-10-16T12:59:41.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.348+0000 7f3131319700 1 -- 172.21.15.124:0/1130381432 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3128011d20 con 0x7f312c06a820 2023-10-16T12:59:41.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.348+0000 7f313457f700 1 -- 172.21.15.124:0/1130381432 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f312c06a820 msgr2=0x7f312c15dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:41.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.348+0000 7f313457f700 1 --2- 172.21.15.124:0/1130381432 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f312c06a820 0x7f312c15dcb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f312c15b880 tx=0x7f3128009b20 comp rx=0 tx=0).stop 2023-10-16T12:59:41.356 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.349+0000 7f313457f700 1 -- 172.21.15.124:0/1130381432 shutdown_connections 2023-10-16T12:59:41.356 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.349+0000 7f313457f700 1 --2- 172.21.15.124:0/1130381432 >> v2:172.21.15.192:3300/0 conn(0x7f312c0cdd30 0x7f312c0ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.356 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.349+0000 7f313457f700 1 --2- 172.21.15.124:0/1130381432 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f312c06a820 0x7f312c15dcb0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.356 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.349+0000 7f313457f700 1 -- 172.21.15.124:0/1130381432 >> 172.21.15.124:0/1130381432 conn(0x7f312c0ccbe0 msgr2=0x7f312c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:41.356 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.349+0000 7f313457f700 1 -- 172.21.15.124:0/1130381432 shutdown_connections 2023-10-16T12:59:41.357 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.349+0000 7f313457f700 1 -- 172.21.15.124:0/1130381432 wait complete. 2023-10-16T12:59:41.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.350+0000 7f313457f700 1 Processor -- start 2023-10-16T12:59:41.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.350+0000 7f313457f700 1 -- start start 2023-10-16T12:59:41.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.350+0000 7f313457f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f312c06a820 0x7f312c156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:41.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.351+0000 7f313457f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f312c06b370 0x7f312c0b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:41.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.351+0000 7f313457f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f312c0cdd30 0x7f312c0c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:41.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.351+0000 7f313457f700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c15b400 con 0x7f312c06a820 2023-10-16T12:59:41.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.351+0000 7f313457f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c1561c0 con 0x7f312c06b370 2023-10-16T12:59:41.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.351+0000 7f313457f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312c15d130 con 0x7f312c0cdd30 2023-10-16T12:59:41.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.351+0000 7f313231b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f312c06a820 0x7f312c156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:41.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.351+0000 7f313231b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f312c06a820 0x7f312c156810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54752/0 (socket says 172.21.15.124:54752) 2023-10-16T12:59:41.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.351+0000 7f313231b700 1 -- 172.21.15.124:0/3855942638 learned_addr learned my addr 172.21.15.124:0/3855942638 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:41.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.351+0000 7f3132b1c700 1 --2- 172.21.15.124:0/3855942638 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f312c0cdd30 0x7f312c0c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:41.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.351+0000 7f3131b1a700 1 --2- 172.21.15.124:0/3855942638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f312c06b370 0x7f312c0b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:41.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.351+0000 7f313231b700 1 -- 172.21.15.124:0/3855942638 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f312c0cdd30 msgr2=0x7f312c0c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:41.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.351+0000 7f313231b700 1 --2- 172.21.15.124:0/3855942638 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f312c0cdd30 0x7f312c0c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.351+0000 7f313231b700 1 -- 172.21.15.124:0/3855942638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f312c06b370 msgr2=0x7f312c0b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:41.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.351+0000 7f313231b700 1 --2- 172.21.15.124:0/3855942638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f312c06b370 0x7f312c0b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.351+0000 7f313231b700 1 -- 172.21.15.124:0/3855942638 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31280094a0 con 0x7f312c06a820 2023-10-16T12:59:41.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.351+0000 7f3131b1a700 1 --2- 172.21.15.124:0/3855942638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f312c06b370 0x7f312c0b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:41.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.351+0000 7f3132b1c700 1 --2- 172.21.15.124:0/3855942638 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f312c0cdd30 0x7f312c0c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:41.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.351+0000 7f313231b700 1 --2- 172.21.15.124:0/3855942638 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f312c06a820 0x7f312c156810 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f311c0011e0 tx=0x7f311c00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:41.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.351+0000 7f3122ffd700 1 -- 172.21.15.124:0/3855942638 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311c004c80 con 0x7f312c06a820 2023-10-16T12:59:41.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.351+0000 7f3122ffd700 1 -- 172.21.15.124:0/3855942638 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311c004e00 con 0x7f312c06a820 2023-10-16T12:59:41.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.351+0000 7f313457f700 1 -- 172.21.15.124:0/3855942638 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312c15ad40 con 0x7f312c06a820 2023-10-16T12:59:41.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.351+0000 7f3122ffd700 1 -- 172.21.15.124:0/3855942638 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311c007310 con 0x7f312c06a820 2023-10-16T12:59:41.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.351+0000 7f313457f700 1 -- 172.21.15.124:0/3855942638 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312c15a980 con 0x7f312c06a820 2023-10-16T12:59:41.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.352+0000 7f313457f700 1 -- 172.21.15.124:0/3855942638 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f312c072d10 con 0x7f312c06a820 2023-10-16T12:59:41.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.353+0000 7f3122ffd700 1 -- 172.21.15.124:0/3855942638 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f311c007470 con 0x7f312c06a820 2023-10-16T12:59:41.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.353+0000 7f3122ffd700 1 --2- 172.21.15.124:0/3855942638 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f311006af00 0x7f311006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:41.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.353+0000 7f3122ffd700 1 -- 172.21.15.124:0/3855942638 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f311c0896d0 con 0x7f312c06a820 2023-10-16T12:59:41.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.353+0000 7f3131b1a700 1 --2- 172.21.15.124:0/3855942638 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f311006af00 0x7f311006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:41.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.353+0000 7f3131b1a700 1 --2- 172.21.15.124:0/3855942638 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f311006af00 0x7f311006d3c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f312c15b880 tx=0x7f3128008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:41.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.357+0000 7f3122ffd700 1 -- 172.21.15.124:0/3855942638 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f311c054450 con 0x7f312c06a820 2023-10-16T12:59:41.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.551+0000 7f313457f700 1 -- 172.21.15.124:0/3855942638 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f312c15ab70 con 0x7f312c06a820 2023-10-16T12:59:41.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.551+0000 7f3122ffd700 1 -- 172.21.15.124:0/3855942638 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f311c057a70 con 0x7f312c06a820 2023-10-16T12:59:41.554 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:41.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.554+0000 7f313457f700 1 -- 172.21.15.124:0/3855942638 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f311006af00 msgr2=0x7f311006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:41.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.554+0000 7f313457f700 1 --2- 172.21.15.124:0/3855942638 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f311006af00 0x7f311006d3c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f312c15b880 tx=0x7f3128008030 comp rx=0 tx=0).stop 2023-10-16T12:59:41.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.554+0000 7f313457f700 1 -- 172.21.15.124:0/3855942638 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f312c06a820 msgr2=0x7f312c156810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:41.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.554+0000 7f313457f700 1 --2- 172.21.15.124:0/3855942638 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f312c06a820 0x7f312c156810 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f311c0011e0 tx=0x7f311c00cae0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.554+0000 7f313457f700 1 -- 172.21.15.124:0/3855942638 shutdown_connections 2023-10-16T12:59:41.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.554+0000 7f313457f700 1 --2- 172.21.15.124:0/3855942638 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f311006af00 0x7f311006d3c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.554+0000 7f313457f700 1 --2- 172.21.15.124:0/3855942638 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f312c0cdd30 0x7f312c0c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.554+0000 7f313457f700 1 --2- 172.21.15.124:0/3855942638 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f312c06a820 0x7f312c156810 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.554+0000 7f313457f700 1 --2- 172.21.15.124:0/3855942638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f312c06b370 0x7f312c0b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.554+0000 7f313457f700 1 -- 172.21.15.124:0/3855942638 >> 172.21.15.124:0/3855942638 conn(0x7f312c0ccbe0 msgr2=0x7f312c0ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:41.559 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.554+0000 7f313457f700 1 -- 172.21.15.124:0/3855942638 shutdown_connections 2023-10-16T12:59:41.559 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.554+0000 7f313457f700 1 -- 172.21.15.124:0/3855942638 wait complete. 2023-10-16T12:59:41.568 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T12:59:41.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.687+0000 7fb7a7073700 1 Processor -- start 2023-10-16T12:59:41.690 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.688+0000 7fb7a7073700 1 -- start start 2023-10-16T12:59:41.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.688+0000 7fb7a7073700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7a0152470 0x7fb7a00cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:41.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.688+0000 7fb7a7073700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb7a00cb8d0 0x7fb7a00b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:41.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.688+0000 7fb7a7073700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a0070d70 con 0x7fb7a00b3240 2023-10-16T12:59:41.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.688+0000 7fb7a7073700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a00b36d0 con 0x7fb7a00cb8d0 2023-10-16T12:59:41.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.688+0000 7fb7a7073700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a0071200 con 0x7fb7a0152470 2023-10-16T12:59:41.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.688+0000 7fb79ffff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb7a00cb8d0 0x7fb7a00b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:41.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.688+0000 7fb7a5610700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fb7a00b3240 0x7fb7a00b60f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43432/0 (socket says 172.21.15.124:43432) 2023-10-16T12:59:41.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.688+0000 7fb7a5610700 1 -- 172.21.15.124:0/3024341319 learned_addr learned my addr 172.21.15.124:0/3024341319 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:41.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.689+0000 7fb7a4e0f700 1 --2- 172.21.15.124:0/3024341319 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7a0152470 0x7fb7a00cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:41.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.689+0000 7fb79ffff700 1 -- 172.21.15.124:0/3024341319 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7a0152470 msgr2=0x7fb7a00cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:41.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.689+0000 7fb79ffff700 1 --2- 172.21.15.124:0/3024341319 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7a0152470 0x7fb7a00cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.689+0000 7fb79f7fe700 1 -- 172.21.15.124:0/3024341319 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187479324 0 0) 0x7fb7a0070d70 con 0x7fb7a00b3240 2023-10-16T12:59:41.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.689+0000 7fb79ffff700 1 -- 172.21.15.124:0/3024341319 >> v1:172.21.15.124:6789/0 conn(0x7fb7a00b3240 legacy=0x7fb7a00b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:41.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.689+0000 7fb79ffff700 1 -- 172.21.15.124:0/3024341319 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a0070440 con 0x7fb7a00cb8d0 2023-10-16T12:59:41.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.689+0000 7fb79ffff700 1 --2- 172.21.15.124:0/3024341319 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb7a00cb8d0 0x7fb7a00b2d00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb78c009840 tx=0x7fb78c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b815f54ff2e3a324 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:41.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.689+0000 7fb79f7fe700 1 -- 172.21.15.124:0/3024341319 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c011830 con 0x7fb7a00cb8d0 2023-10-16T12:59:41.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.689+0000 7fb79f7fe700 1 -- 172.21.15.124:0/3024341319 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78c011990 con 0x7fb7a00cb8d0 2023-10-16T12:59:41.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.689+0000 7fb79f7fe700 1 -- 172.21.15.124:0/3024341319 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c011d20 con 0x7fb7a00cb8d0 2023-10-16T12:59:41.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.690+0000 7fb7a7073700 1 -- 172.21.15.124:0/3024341319 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb7a00cb8d0 msgr2=0x7fb7a00b2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:41.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.690+0000 7fb7a7073700 1 --2- 172.21.15.124:0/3024341319 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb7a00cb8d0 0x7fb7a00b2d00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb78c009840 tx=0x7fb78c009b50 comp rx=0 tx=0).stop 2023-10-16T12:59:41.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.690+0000 7fb7a7073700 1 -- 172.21.15.124:0/3024341319 shutdown_connections 2023-10-16T12:59:41.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.690+0000 7fb7a7073700 1 --2- 172.21.15.124:0/3024341319 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7a0152470 0x7fb7a00cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.690+0000 7fb7a7073700 1 --2- 172.21.15.124:0/3024341319 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb7a00cb8d0 0x7fb7a00b2d00 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.690+0000 7fb7a7073700 1 -- 172.21.15.124:0/3024341319 >> 172.21.15.124:0/3024341319 conn(0x7fb7a00cdd00 msgr2=0x7fb7a00ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:41.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.690+0000 7fb7a7073700 1 -- 172.21.15.124:0/3024341319 shutdown_connections 2023-10-16T12:59:41.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.690+0000 7fb7a7073700 1 -- 172.21.15.124:0/3024341319 wait complete. 2023-10-16T12:59:41.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.691+0000 7fb7a7073700 1 Processor -- start 2023-10-16T12:59:41.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.691+0000 7fb7a7073700 1 -- start start 2023-10-16T12:59:41.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.692+0000 7fb7a7073700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a00b3240 0x7fb7a006bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:41.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.692+0000 7fb7a7073700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb7a00cb8d0 0x7fb7a015a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:41.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.692+0000 7fb7a7073700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7a0152470 0x7fb7a015a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:41.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.692+0000 7fb7a7073700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a006d8c0 con 0x7fb7a00cb8d0 2023-10-16T12:59:41.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.692+0000 7fb7a7073700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a006c820 con 0x7fb7a00b3240 2023-10-16T12:59:41.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.692+0000 7fb7a7073700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a006cb00 con 0x7fb7a0152470 2023-10-16T12:59:41.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.692+0000 7fb79ffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb7a00cb8d0 0x7fb7a015a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:41.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.692+0000 7fb79ffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb7a00cb8d0 0x7fb7a015a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54768/0 (socket says 172.21.15.124:54768) 2023-10-16T12:59:41.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.692+0000 7fb79ffff700 1 -- 172.21.15.124:0/2560385177 learned_addr learned my addr 172.21.15.124:0/2560385177 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:41.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.692+0000 7fb7a5610700 1 --2- 172.21.15.124:0/2560385177 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7a0152470 0x7fb7a015a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:41.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.692+0000 7fb7a4e0f700 1 --2- 172.21.15.124:0/2560385177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a00b3240 0x7fb7a006bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:41.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.692+0000 7fb79ffff700 1 -- 172.21.15.124:0/2560385177 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7a0152470 msgr2=0x7fb7a015a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:41.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.692+0000 7fb79ffff700 1 --2- 172.21.15.124:0/2560385177 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7a0152470 0x7fb7a015a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.692+0000 7fb79ffff700 1 -- 172.21.15.124:0/2560385177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a00b3240 msgr2=0x7fb7a006bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:41.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.692+0000 7fb79ffff700 1 --2- 172.21.15.124:0/2560385177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a00b3240 0x7fb7a006bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.692+0000 7fb79ffff700 1 -- 172.21.15.124:0/2560385177 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78c0094a0 con 0x7fb7a00cb8d0 2023-10-16T12:59:41.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.692+0000 7fb7a4e0f700 1 --2- 172.21.15.124:0/2560385177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a00b3240 0x7fb7a006bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:41.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.692+0000 7fb7a5610700 1 --2- 172.21.15.124:0/2560385177 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7a0152470 0x7fb7a015a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:41.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.692+0000 7fb79ffff700 1 --2- 172.21.15.124:0/2560385177 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb7a00cb8d0 0x7fb7a015a450 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0090b0 tx=0x7fb78c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:41.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.692+0000 7fb79d7fa700 1 -- 172.21.15.124:0/2560385177 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c0038a0 con 0x7fb7a00cb8d0 2023-10-16T12:59:41.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.693+0000 7fb79d7fa700 1 -- 172.21.15.124:0/2560385177 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78c01f070 con 0x7fb7a00cb8d0 2023-10-16T12:59:41.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.693+0000 7fb7a7073700 1 -- 172.21.15.124:0/2560385177 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a006cde0 con 0x7fb7a00cb8d0 2023-10-16T12:59:41.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.693+0000 7fb79d7fa700 1 -- 172.21.15.124:0/2560385177 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c003c20 con 0x7fb7a00cb8d0 2023-10-16T12:59:41.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.693+0000 7fb7a7073700 1 -- 172.21.15.124:0/2560385177 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a006d3a0 con 0x7fb7a00cb8d0 2023-10-16T12:59:41.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.694+0000 7fb7a7073700 1 -- 172.21.15.124:0/2560385177 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a004ebb0 con 0x7fb7a00cb8d0 2023-10-16T12:59:41.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.694+0000 7fb79d7fa700 1 -- 172.21.15.124:0/2560385177 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb78c01a430 con 0x7fb7a00cb8d0 2023-10-16T12:59:41.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.694+0000 7fb79d7fa700 1 --2- 172.21.15.124:0/2560385177 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb78406af00 0x7fb78406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:41.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.694+0000 7fb79d7fa700 1 -- 172.21.15.124:0/2560385177 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7fb78c021070 con 0x7fb7a00cb8d0 2023-10-16T12:59:41.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.694+0000 7fb7a4e0f700 1 --2- 172.21.15.124:0/2560385177 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb78406af00 0x7fb78406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:41.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.695+0000 7fb7a4e0f700 1 --2- 172.21.15.124:0/2560385177 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb78406af00 0x7fb78406d3c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb794007a50 tx=0x7fb794008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:41.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.699+0000 7fb79d7fa700 1 -- 172.21.15.124:0/2560385177 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb78c056190 con 0x7fb7a00cb8d0 2023-10-16T12:59:41.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.903+0000 7fb7a7073700 1 -- 172.21.15.124:0/2560385177 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb7a00cb5b0 con 0x7fb7a00cb8d0 2023-10-16T12:59:41.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.904+0000 7fb79d7fa700 1 -- 172.21.15.124:0/2560385177 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb78c0597b0 con 0x7fb7a00cb8d0 2023-10-16T12:59:41.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.906+0000 7fb7a7073700 1 -- 172.21.15.124:0/2560385177 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb78406af00 msgr2=0x7fb78406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:41.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.906+0000 7fb7a7073700 1 --2- 172.21.15.124:0/2560385177 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb78406af00 0x7fb78406d3c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb794007a50 tx=0x7fb794008040 comp rx=0 tx=0).stop 2023-10-16T12:59:41.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.906+0000 7fb7a7073700 1 -- 172.21.15.124:0/2560385177 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb7a00cb8d0 msgr2=0x7fb7a015a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:41.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.906+0000 7fb7a7073700 1 --2- 172.21.15.124:0/2560385177 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb7a00cb8d0 0x7fb7a015a450 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0090b0 tx=0x7fb78c004750 comp rx=0 tx=0).stop 2023-10-16T12:59:41.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.906+0000 7fb7a7073700 1 -- 172.21.15.124:0/2560385177 shutdown_connections 2023-10-16T12:59:41.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.906+0000 7fb7a7073700 1 --2- 172.21.15.124:0/2560385177 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb78406af00 0x7fb78406d3c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.906+0000 7fb7a7073700 1 --2- 172.21.15.124:0/2560385177 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7a0152470 0x7fb7a015a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.906+0000 7fb7a7073700 1 --2- 172.21.15.124:0/2560385177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7a00b3240 0x7fb7a006bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.906+0000 7fb7a7073700 1 --2- 172.21.15.124:0/2560385177 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb7a00cb8d0 0x7fb7a015a450 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:41.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.906+0000 7fb7a7073700 1 -- 172.21.15.124:0/2560385177 >> 172.21.15.124:0/2560385177 conn(0x7fb7a00cdd00 msgr2=0x7fb7a00cee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:41.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.906+0000 7fb7a7073700 1 -- 172.21.15.124:0/2560385177 shutdown_connections 2023-10-16T12:59:41.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:41.906+0000 7fb7a7073700 1 -- 172.21.15.124:0/2560385177 wait complete. 2023-10-16T12:59:41.911 INFO:teuthology.orchestra.run.smithi124.stderr:listed 0 entries 2023-10-16T12:59:41.920 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-16T12:59:41.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:41.921 DEBUG:teuthology.orchestra.run.smithi124:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-16T12:59:41.968 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi124.front.sepia.ceph.com 2023-10-16T12:59:41.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:41.969 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-16T12:59:41.986 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:59:41.986 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:59:42.008 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:59:42.008 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:59:42.069 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:59:42.069 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:59:42.130 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:59:42.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.248+0000 7fc0c565b700 1 Processor -- start 2023-10-16T12:59:42.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.248+0000 7fc0c565b700 1 -- start start 2023-10-16T12:59:42.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.249+0000 7fc0c565b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0c0160b50 0x7fc0c00cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:42.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.249+0000 7fc0c565b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc0c00b9000 0x7fc0c00b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:42.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.249+0000 7fc0c565b700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c00d0010 con 0x7fc0c00b5530 2023-10-16T12:59:42.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.249+0000 7fc0c565b700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c00b59c0 con 0x7fc0c00b9000 2023-10-16T12:59:42.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.249+0000 7fc0c565b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c00d02f0 con 0x7fc0c0160b50 2023-10-16T12:59:42.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.249+0000 7fc0be7fc700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc0c00b9000 0x7fc0c00b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:42.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.249+0000 7fc0be7fc700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc0c00b9000 0x7fc0c00b4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54776/0 (socket says 172.21.15.124:54776) 2023-10-16T12:59:42.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.249+0000 7fc0be7fc700 1 -- 172.21.15.124:0/1925927011 learned_addr learned my addr 172.21.15.124:0/1925927011 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:42.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.249+0000 7fc0bf7fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fc0c00b5530 0x7fc0c01611f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43446/0 (socket says 172.21.15.124:43446) 2023-10-16T12:59:42.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.249+0000 7fc0beffd700 1 --2- 172.21.15.124:0/1925927011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0c0160b50 0x7fc0c00cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:42.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.249+0000 7fc0be7fc700 1 -- 172.21.15.124:0/1925927011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0c0160b50 msgr2=0x7fc0c00cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:42.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.249+0000 7fc0be7fc700 1 --2- 172.21.15.124:0/1925927011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0c0160b50 0x7fc0c00cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.249+0000 7fc0be7fc700 1 -- 172.21.15.124:0/1925927011 >> v1:172.21.15.124:6789/0 conn(0x7fc0c00b5530 legacy=0x7fc0c01611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:42.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.249+0000 7fc0be7fc700 1 -- 172.21.15.124:0/1925927011 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c00d05d0 con 0x7fc0c00b9000 2023-10-16T12:59:42.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.249+0000 7fc0bdffb700 1 -- 172.21.15.124:0/1925927011 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945844956 0 0) 0x7fc0c00d0010 con 0x7fc0c00b5530 2023-10-16T12:59:42.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.250+0000 7fc0be7fc700 1 --2- 172.21.15.124:0/1925927011 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc0c00b9000 0x7fc0c00b4ff0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc0a80098f0 tx=0x7fc0a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f23bce2e9fe7cdd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:42.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.250+0000 7fc0bdffb700 1 -- 172.21.15.124:0/1925927011 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a800b8a0 con 0x7fc0c00b9000 2023-10-16T12:59:42.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.250+0000 7fc0bdffb700 1 -- 172.21.15.124:0/1925927011 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a800ba00 con 0x7fc0c00b9000 2023-10-16T12:59:42.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.250+0000 7fc0bdffb700 1 -- 172.21.15.124:0/1925927011 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a800bd90 con 0x7fc0c00b9000 2023-10-16T12:59:42.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.250+0000 7fc0c565b700 1 -- 172.21.15.124:0/1925927011 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc0c00b9000 msgr2=0x7fc0c00b4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:42.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.250+0000 7fc0c565b700 1 --2- 172.21.15.124:0/1925927011 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc0c00b9000 0x7fc0c00b4ff0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc0a80098f0 tx=0x7fc0a8009c00 comp rx=0 tx=0).stop 2023-10-16T12:59:42.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.251+0000 7fc0c565b700 1 -- 172.21.15.124:0/1925927011 shutdown_connections 2023-10-16T12:59:42.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.251+0000 7fc0c565b700 1 --2- 172.21.15.124:0/1925927011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0c0160b50 0x7fc0c00cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.251+0000 7fc0c565b700 1 --2- 172.21.15.124:0/1925927011 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc0c00b9000 0x7fc0c00b4ff0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.251+0000 7fc0c565b700 1 -- 172.21.15.124:0/1925927011 >> 172.21.15.124:0/1925927011 conn(0x7fc0c006bc70 msgr2=0x7fc0c006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:42.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.251+0000 7fc0c565b700 1 -- 172.21.15.124:0/1925927011 shutdown_connections 2023-10-16T12:59:42.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.251+0000 7fc0c565b700 1 -- 172.21.15.124:0/1925927011 wait complete. 2023-10-16T12:59:42.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.252+0000 7fc0c565b700 1 Processor -- start 2023-10-16T12:59:42.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.252+0000 7fc0c565b700 1 -- start start 2023-10-16T12:59:42.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.253+0000 7fc0c565b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc0c00b5530 0x7fc0c00c9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:42.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.253+0000 7fc0c565b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0c00b9000 0x7fc0c00c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:42.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.253+0000 7fc0c565b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0c0160b50 0x7fc0c00c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:42.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.253+0000 7fc0c565b700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c00cc710 con 0x7fc0c00b5530 2023-10-16T12:59:42.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.253+0000 7fc0c565b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c00c9d40 con 0x7fc0c0160b50 2023-10-16T12:59:42.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.253+0000 7fc0c565b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c0145f30 con 0x7fc0c00b9000 2023-10-16T12:59:42.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.253+0000 7fc0beffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc0c00b5530 0x7fc0c00c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:42.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.253+0000 7fc0beffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc0c00b5530 0x7fc0c00c9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54780/0 (socket says 172.21.15.124:54780) 2023-10-16T12:59:42.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.253+0000 7fc0beffd700 1 -- 172.21.15.124:0/342656057 learned_addr learned my addr 172.21.15.124:0/342656057 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:42.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.253+0000 7fc0be7fc700 1 --2- 172.21.15.124:0/342656057 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0c00b9000 0x7fc0c00c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:42.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.253+0000 7fc0bf7fe700 1 --2- 172.21.15.124:0/342656057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0c0160b50 0x7fc0c00c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:42.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.253+0000 7fc0beffd700 1 -- 172.21.15.124:0/342656057 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0c00b9000 msgr2=0x7fc0c00c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:42.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.253+0000 7fc0beffd700 1 --2- 172.21.15.124:0/342656057 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0c00b9000 0x7fc0c00c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.253+0000 7fc0beffd700 1 -- 172.21.15.124:0/342656057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0c0160b50 msgr2=0x7fc0c00c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:42.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.253+0000 7fc0beffd700 1 --2- 172.21.15.124:0/342656057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0c0160b50 0x7fc0c00c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.253+0000 7fc0beffd700 1 -- 172.21.15.124:0/342656057 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a8009550 con 0x7fc0c00b5530 2023-10-16T12:59:42.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.253+0000 7fc0be7fc700 1 --2- 172.21.15.124:0/342656057 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0c00b9000 0x7fc0c00c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:42.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.253+0000 7fc0beffd700 1 --2- 172.21.15.124:0/342656057 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc0c00b5530 0x7fc0c00c9800 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0007e40 tx=0x7fc0b000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:42.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.253+0000 7fc0b77fe700 1 -- 172.21.15.124:0/342656057 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b000eea0 con 0x7fc0c00b5530 2023-10-16T12:59:42.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.253+0000 7fc0b77fe700 1 -- 172.21.15.124:0/342656057 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b0014420 con 0x7fc0c00b5530 2023-10-16T12:59:42.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.253+0000 7fc0c565b700 1 -- 172.21.15.124:0/342656057 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c0146210 con 0x7fc0c00b5530 2023-10-16T12:59:42.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.253+0000 7fc0b77fe700 1 -- 172.21.15.124:0/342656057 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b00147d0 con 0x7fc0c00b5530 2023-10-16T12:59:42.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.253+0000 7fc0c565b700 1 -- 172.21.15.124:0/342656057 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c01467d0 con 0x7fc0c00b5530 2023-10-16T12:59:42.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.254+0000 7fc0c565b700 1 -- 172.21.15.124:0/342656057 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c00cc550 con 0x7fc0c00b5530 2023-10-16T12:59:42.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.255+0000 7fc0b77fe700 1 -- 172.21.15.124:0/342656057 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc0b0014930 con 0x7fc0c00b5530 2023-10-16T12:59:42.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.255+0000 7fc0b77fe700 1 --2- 172.21.15.124:0/342656057 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fc0a006af00 0x7fc0a006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:42.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.255+0000 7fc0b77fe700 1 -- 172.21.15.124:0/342656057 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7fc0b008a130 con 0x7fc0c00b5530 2023-10-16T12:59:42.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.255+0000 7fc0be7fc700 1 --2- 172.21.15.124:0/342656057 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fc0a006af00 0x7fc0a006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:42.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.256+0000 7fc0be7fc700 1 --2- 172.21.15.124:0/342656057 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fc0a006af00 0x7fc0a006d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8000c00 tx=0x7fc0a8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:42.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.260+0000 7fc0b77fe700 1 -- 172.21.15.124:0/342656057 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc0c00cc550 con 0x7fc0c00b5530 2023-10-16T12:59:42.452 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.450+0000 7fc0c565b700 1 -- 172.21.15.124:0/342656057 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0c00cc550 con 0x7fc0c00b5530 2023-10-16T12:59:42.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.451+0000 7fc0b77fe700 1 -- 172.21.15.124:0/342656057 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18751 (secure 0 0 0) 0x7fc0c00cc550 con 0x7fc0c00b5530 2023-10-16T12:59:42.454 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:42.454 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":26,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:59:34.463212+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2},{"from":7,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:59:42.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.453+0000 7fc0c565b700 1 -- 172.21.15.124:0/342656057 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fc0a006af00 msgr2=0x7fc0a006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:42.456 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.453+0000 7fc0c565b700 1 --2- 172.21.15.124:0/342656057 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fc0a006af00 0x7fc0a006d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8000c00 tx=0x7fc0a8008030 comp rx=0 tx=0).stop 2023-10-16T12:59:42.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.453+0000 7fc0c565b700 1 -- 172.21.15.124:0/342656057 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc0c00b5530 msgr2=0x7fc0c00c9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:42.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.453+0000 7fc0c565b700 1 --2- 172.21.15.124:0/342656057 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc0c00b5530 0x7fc0c00c9800 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0007e40 tx=0x7fc0b000e3c0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.453+0000 7fc0c565b700 1 -- 172.21.15.124:0/342656057 shutdown_connections 2023-10-16T12:59:42.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.453+0000 7fc0c565b700 1 --2- 172.21.15.124:0/342656057 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fc0a006af00 0x7fc0a006d3c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.457 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.453+0000 7fc0c565b700 1 --2- 172.21.15.124:0/342656057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0c0160b50 0x7fc0c00c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.458 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.453+0000 7fc0c565b700 1 --2- 172.21.15.124:0/342656057 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc0c00b5530 0x7fc0c00c9800 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.458 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.453+0000 7fc0c565b700 1 --2- 172.21.15.124:0/342656057 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0c00b9000 0x7fc0c00c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.458 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.453+0000 7fc0c565b700 1 -- 172.21.15.124:0/342656057 >> 172.21.15.124:0/342656057 conn(0x7fc0c006bc70 msgr2=0x7fc0c015fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:42.458 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.453+0000 7fc0c565b700 1 -- 172.21.15.124:0/342656057 shutdown_connections 2023-10-16T12:59:42.461 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.453+0000 7fc0c565b700 1 -- 172.21.15.124:0/342656057 wait complete. 2023-10-16T12:59:42.468 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T12:58:38.667813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T12:58:49.562073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T12:58:50.011419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T12:58:53.692890+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T12:59:42.469 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T12:59:42.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.591+0000 7f389de5e700 1 Processor -- start 2023-10-16T12:59:42.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.591+0000 7f389de5e700 1 -- start start 2023-10-16T12:59:42.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.592+0000 7f389de5e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f389806bed0 0x7f38980ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:42.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.592+0000 7f389de5e700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38980cea10 con 0x7f389815d6b0 2023-10-16T12:59:42.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.592+0000 7f389de5e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38980cecf0 con 0x7f38980cfab0 2023-10-16T12:59:42.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.592+0000 7f389de5e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38980cefd0 con 0x7f389806bed0 2023-10-16T12:59:42.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.592+0000 7f38977fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f389815d6b0 0x7f389806b7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43456/0 (socket says 172.21.15.124:43456) 2023-10-16T12:59:42.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.592+0000 7f38977fe700 1 -- 172.21.15.124:0/2429779160 learned_addr learned my addr 172.21.15.124:0/2429779160 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:42.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f38967fc700 1 -- 172.21.15.124:0/2429779160 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1766204458 0 0) 0x7f38980cea10 con 0x7f389815d6b0 2023-10-16T12:59:42.599 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f3896ffd700 1 --2- 172.21.15.124:0/2429779160 >> v2:172.21.15.192:3300/0 conn(0x7f389806bed0 0x7f38980ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:42.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f38967fc700 1 -- 172.21.15.124:0/2429779160 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38800035b0 con 0x7f389815d6b0 2023-10-16T12:59:42.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f38967fc700 1 -- 172.21.15.124:0/2429779160 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 825959367 0 0) 0x7f38800035b0 con 0x7f389815d6b0 2023-10-16T12:59:42.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f38967fc700 1 -- 172.21.15.124:0/2429779160 >> v2:172.21.15.192:3300/0 conn(0x7f389806bed0 msgr2=0x7f38980ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:42.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f38967fc700 1 --2- 172.21.15.124:0/2429779160 >> v2:172.21.15.192:3300/0 conn(0x7f389806bed0 0x7f38980ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f38967fc700 1 -- 172.21.15.124:0/2429779160 >> v1:172.21.15.192:6789/0 conn(0x7f38980cfab0 legacy=0x7f38980b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:42.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f38967fc700 1 -- 172.21.15.124:0/2429779160 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38980cf2b0 con 0x7f389815d6b0 2023-10-16T12:59:42.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f38967fc700 1 -- 172.21.15.124:0/2429779160 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f388c001670 con 0x7f389815d6b0 2023-10-16T12:59:42.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f38967fc700 1 -- 172.21.15.124:0/2429779160 >> v1:172.21.15.124:6789/0 conn(0x7f389815d6b0 legacy=0x7f389806b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:42.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f38967fc700 1 --2- 172.21.15.124:0/2429779160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3880003a00 0x7f3880003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:42.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f38967fc700 1 --2- 172.21.15.124:0/2429779160 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3880004850 0x7f3880004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:42.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f38967fc700 1 --2- 172.21.15.124:0/2429779160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3880005210 0x7f388000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:42.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f38967fc700 1 -- 172.21.15.124:0/2429779160 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38980cefd0 con 0x7f3880004850 2023-10-16T12:59:42.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f38967fc700 1 -- 172.21.15.124:0/2429779160 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388000c0c0 con 0x7f3880005210 2023-10-16T12:59:42.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f38967fc700 1 -- 172.21.15.124:0/2429779160 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f388000c280 con 0x7f3880003a00 2023-10-16T12:59:42.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f3896ffd700 1 --2- 172.21.15.124:0/2429779160 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3880004850 0x7f3880004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:42.602 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f38977fe700 1 --2- 172.21.15.124:0/2429779160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3880003a00 0x7f3880003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:42.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f3897fff700 1 --2- 172.21.15.124:0/2429779160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3880005210 0x7f388000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:42.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f3896ffd700 1 -- 172.21.15.124:0/2429779160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3880003a00 msgr2=0x7f3880003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:42.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f3896ffd700 1 --2- 172.21.15.124:0/2429779160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3880003a00 0x7f3880003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f3896ffd700 1 -- 172.21.15.124:0/2429779160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3880005210 msgr2=0x7f388000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:42.603 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f3896ffd700 1 --2- 172.21.15.124:0/2429779160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3880005210 0x7f388000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f3897fff700 1 -- 172.21.15.124:0/2429779160 reap_dead start 2023-10-16T12:59:42.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f3896ffd700 1 -- 172.21.15.124:0/2429779160 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38800035b0 con 0x7f3880004850 2023-10-16T12:59:42.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.593+0000 7f3896ffd700 1 --2- 172.21.15.124:0/2429779160 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3880004850 0x7f3880004cd0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3888009b60 tx=0x7f3880005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20d906b88d6191d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:42.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.594+0000 7f38967fc700 1 -- 172.21.15.124:0/2429779160 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388800e6c0 con 0x7f3880004850 2023-10-16T12:59:42.604 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.594+0000 7f38967fc700 1 -- 172.21.15.124:0/2429779160 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388800e820 con 0x7f3880004850 2023-10-16T12:59:42.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.594+0000 7f38967fc700 1 -- 172.21.15.124:0/2429779160 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388800eb90 con 0x7f3880004850 2023-10-16T12:59:42.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.594+0000 7f389de5e700 1 -- 172.21.15.124:0/2429779160 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3880004850 msgr2=0x7f3880004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:42.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.594+0000 7f389de5e700 1 --2- 172.21.15.124:0/2429779160 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3880004850 0x7f3880004cd0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3888009b60 tx=0x7f3880005880 comp rx=0 tx=0).stop 2023-10-16T12:59:42.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.594+0000 7f389de5e700 1 -- 172.21.15.124:0/2429779160 shutdown_connections 2023-10-16T12:59:42.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.594+0000 7f389de5e700 1 --2- 172.21.15.124:0/2429779160 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3880004850 0x7f3880004cd0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.605 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.594+0000 7f389de5e700 1 -- 172.21.15.124:0/2429779160 >> 172.21.15.124:0/2429779160 conn(0x7f3898072340 msgr2=0x7f3898072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:42.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.594+0000 7f389de5e700 1 -- 172.21.15.124:0/2429779160 shutdown_connections 2023-10-16T12:59:42.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.594+0000 7f389de5e700 1 -- 172.21.15.124:0/2429779160 wait complete. 2023-10-16T12:59:42.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.595+0000 7f389de5e700 1 Processor -- start 2023-10-16T12:59:42.606 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.596+0000 7f389de5e700 1 -- start start 2023-10-16T12:59:42.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.596+0000 7f389de5e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3880004850 0x7f389815fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:42.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.596+0000 7f389de5e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3898149a50 0x7f3898155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:42.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.596+0000 7f389de5e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38981588c0 0x7f3898158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:42.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.596+0000 7f389de5e700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3898157f50 con 0x7f3880004850 2023-10-16T12:59:42.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.596+0000 7f389de5e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3898159280 con 0x7f3898149a50 2023-10-16T12:59:42.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.596+0000 7f389de5e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38981564c0 con 0x7f38981588c0 2023-10-16T12:59:42.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.596+0000 7f38977fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3880004850 0x7f389815fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:42.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.596+0000 7f38977fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3880004850 0x7f389815fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54802/0 (socket says 172.21.15.124:54802) 2023-10-16T12:59:42.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.596+0000 7f38977fe700 1 -- 172.21.15.124:0/1070572082 learned_addr learned my addr 172.21.15.124:0/1070572082 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:42.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.597+0000 7f3896ffd700 1 --2- 172.21.15.124:0/1070572082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3898149a50 0x7f3898155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:42.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.597+0000 7f3897fff700 1 --2- 172.21.15.124:0/1070572082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38981588c0 0x7f3898158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:42.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.597+0000 7f38977fe700 1 -- 172.21.15.124:0/1070572082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38981588c0 msgr2=0x7f3898158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:42.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.597+0000 7f38977fe700 1 --2- 172.21.15.124:0/1070572082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38981588c0 0x7f3898158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.597+0000 7f38977fe700 1 -- 172.21.15.124:0/1070572082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3898149a50 msgr2=0x7f3898155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:42.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.597+0000 7f38977fe700 1 --2- 172.21.15.124:0/1070572082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3898149a50 0x7f3898155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.597+0000 7f38977fe700 1 -- 172.21.15.124:0/1070572082 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3898157c70 con 0x7f3880004850 2023-10-16T12:59:42.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.597+0000 7f38977fe700 1 --2- 172.21.15.124:0/1070572082 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3880004850 0x7f389815fa60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f388c00e840 tx=0x7f388c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:42.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.597+0000 7f387ffff700 1 -- 172.21.15.124:0/1070572082 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c00c620 con 0x7f3880004850 2023-10-16T12:59:42.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.597+0000 7f387ffff700 1 -- 172.21.15.124:0/1070572082 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c00c780 con 0x7f3880004850 2023-10-16T12:59:42.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.597+0000 7f389de5e700 1 -- 172.21.15.124:0/1070572082 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f389815ef80 con 0x7f3880004850 2023-10-16T12:59:42.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.597+0000 7f387ffff700 1 -- 172.21.15.124:0/1070572082 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c00cb30 con 0x7f3880004850 2023-10-16T12:59:42.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.597+0000 7f389de5e700 1 -- 172.21.15.124:0/1070572082 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f389815f540 con 0x7f3880004850 2023-10-16T12:59:42.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.598+0000 7f389de5e700 1 -- 172.21.15.124:0/1070572082 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38980ce300 con 0x7f3880004850 2023-10-16T12:59:42.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.598+0000 7f387ffff700 1 -- 172.21.15.124:0/1070572082 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f388c00cc90 con 0x7f3880004850 2023-10-16T12:59:42.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.599+0000 7f387ffff700 1 --2- 172.21.15.124:0/1070572082 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f388406af00 0x7f388406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:42.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.599+0000 7f387ffff700 1 -- 172.21.15.124:0/1070572082 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f388c089770 con 0x7f3880004850 2023-10-16T12:59:42.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.599+0000 7f3896ffd700 1 --2- 172.21.15.124:0/1070572082 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f388406af00 0x7f388406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:42.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.599+0000 7f3896ffd700 1 --2- 172.21.15.124:0/1070572082 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f388406af00 0x7f388406d3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f38880090b0 tx=0x7f3888008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:42.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.603+0000 7f387ffff700 1 -- 172.21.15.124:0/1070572082 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f388c0544f0 con 0x7f3880004850 2023-10-16T12:59:42.796 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.793+0000 7f389de5e700 1 -- 172.21.15.124:0/1070572082 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f389804ebb0 con 0x7f3880004850 2023-10-16T12:59:42.796 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.793+0000 7f387ffff700 1 -- 172.21.15.124:0/1070572082 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f388c057b10 con 0x7f3880004850 2023-10-16T12:59:42.796 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-16T12:59:42.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.795+0000 7f389de5e700 1 -- 172.21.15.124:0/1070572082 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f388406af00 msgr2=0x7f388406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:42.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.796+0000 7f389de5e700 1 --2- 172.21.15.124:0/1070572082 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f388406af00 0x7f388406d3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f38880090b0 tx=0x7f3888008030 comp rx=0 tx=0).stop 2023-10-16T12:59:42.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.796+0000 7f389de5e700 1 -- 172.21.15.124:0/1070572082 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3880004850 msgr2=0x7f389815fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:42.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.796+0000 7f389de5e700 1 --2- 172.21.15.124:0/1070572082 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3880004850 0x7f389815fa60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f388c00e840 tx=0x7f388c00ec00 comp rx=0 tx=0).stop 2023-10-16T12:59:42.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.796+0000 7f389de5e700 1 -- 172.21.15.124:0/1070572082 shutdown_connections 2023-10-16T12:59:42.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.796+0000 7f389de5e700 1 --2- 172.21.15.124:0/1070572082 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f388406af00 0x7f388406d3c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.796+0000 7f389de5e700 1 --2- 172.21.15.124:0/1070572082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38981588c0 0x7f3898158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.796+0000 7f389de5e700 1 --2- 172.21.15.124:0/1070572082 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3880004850 0x7f389815fa60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.796+0000 7f389de5e700 1 --2- 172.21.15.124:0/1070572082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3898149a50 0x7f3898155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.796+0000 7f389de5e700 1 -- 172.21.15.124:0/1070572082 >> 172.21.15.124:0/1070572082 conn(0x7f3898072340 msgr2=0x7f38980b7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:42.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.796+0000 7f389de5e700 1 -- 172.21.15.124:0/1070572082 shutdown_connections 2023-10-16T12:59:42.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.796+0000 7f389de5e700 1 -- 172.21.15.124:0/1070572082 wait complete. 2023-10-16T12:59:42.810 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T12:59:42.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.931+0000 7ffad2d76700 1 Processor -- start 2023-10-16T12:59:42.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.931+0000 7ffad2d76700 1 -- start start 2023-10-16T12:59:42.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.932+0000 7ffad2d76700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ffacc15a250 0x7ffacc0717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:42.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.932+0000 7ffad2d76700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffacc06dcc0 0x7ffacc0cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:42.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.932+0000 7ffad2d76700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffacc0cba90 con 0x7ffacc15dec0 2023-10-16T12:59:42.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.932+0000 7ffad2d76700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffacc0cb510 con 0x7ffacc15a250 2023-10-16T12:59:42.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.932+0000 7ffad2d76700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffacc15ee40 con 0x7ffacc06dcc0 2023-10-16T12:59:42.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.932+0000 7ffad0b12700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ffacc15a250 0x7ffacc0717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:42.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.932+0000 7ffad0b12700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ffacc15a250 0x7ffacc0717b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54808/0 (socket says 172.21.15.124:54808) 2023-10-16T12:59:42.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.932+0000 7ffad0b12700 1 -- 172.21.15.124:0/1220223761 learned_addr learned my addr 172.21.15.124:0/1220223761 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:42.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.932+0000 7ffad1313700 1 --2- 172.21.15.124:0/1220223761 >> v2:172.21.15.192:3300/0 conn(0x7ffacc06dcc0 0x7ffacc0cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:42.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.932+0000 7ffad0b12700 1 -- 172.21.15.124:0/1220223761 >> v2:172.21.15.192:3300/0 conn(0x7ffacc06dcc0 msgr2=0x7ffacc0cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:42.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.932+0000 7ffad0b12700 1 --2- 172.21.15.124:0/1220223761 >> v2:172.21.15.192:3300/0 conn(0x7ffacc06dcc0 0x7ffacc0cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.932+0000 7ffad0b12700 1 -- 172.21.15.124:0/1220223761 >> v1:172.21.15.192:6789/0 conn(0x7ffacc15dec0 legacy=0x7ffacc06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:42.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.932+0000 7ffad0b12700 1 -- 172.21.15.124:0/1220223761 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc15e880 con 0x7ffacc15a250 2023-10-16T12:59:42.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.932+0000 7ffad0b12700 1 --2- 172.21.15.124:0/1220223761 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffacc15a250 0x7ffacc0717b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ffacc067ac0 tx=0x7ffac000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50a6356a5d9c7fd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:42.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.932+0000 7ffacb7fe700 1 -- 172.21.15.124:0/1220223761 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac000dcf0 con 0x7ffacc15a250 2023-10-16T12:59:42.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.932+0000 7ffacb7fe700 1 -- 172.21.15.124:0/1220223761 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac000de50 con 0x7ffacc15a250 2023-10-16T12:59:42.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.932+0000 7ffacb7fe700 1 -- 172.21.15.124:0/1220223761 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0004250 con 0x7ffacc15a250 2023-10-16T12:59:42.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.933+0000 7ffad2d76700 1 -- 172.21.15.124:0/1220223761 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffacc15a250 msgr2=0x7ffacc0717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:42.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.933+0000 7ffad2d76700 1 --2- 172.21.15.124:0/1220223761 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffacc15a250 0x7ffacc0717b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ffacc067ac0 tx=0x7ffac000be70 comp rx=0 tx=0).stop 2023-10-16T12:59:42.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.933+0000 7ffad2d76700 1 -- 172.21.15.124:0/1220223761 shutdown_connections 2023-10-16T12:59:42.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.933+0000 7ffad2d76700 1 --2- 172.21.15.124:0/1220223761 >> v2:172.21.15.192:3300/0 conn(0x7ffacc06dcc0 0x7ffacc0cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.933+0000 7ffad2d76700 1 --2- 172.21.15.124:0/1220223761 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffacc15a250 0x7ffacc0717b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.933+0000 7ffad2d76700 1 -- 172.21.15.124:0/1220223761 >> 172.21.15.124:0/1220223761 conn(0x7ffacc0ccbe0 msgr2=0x7ffacc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:42.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.933+0000 7ffad2d76700 1 -- 172.21.15.124:0/1220223761 shutdown_connections 2023-10-16T12:59:42.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.933+0000 7ffad2d76700 1 -- 172.21.15.124:0/1220223761 wait complete. 2023-10-16T12:59:42.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.934+0000 7ffad2d76700 1 Processor -- start 2023-10-16T12:59:42.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.934+0000 7ffad2d76700 1 -- start start 2023-10-16T12:59:42.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.935+0000 7ffad2d76700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffacc06dcc0 0x7ffacc0c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:42.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.935+0000 7ffad2d76700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffacc15a250 0x7ffacc0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:42.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.935+0000 7ffad2d76700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffacc15dec0 0x7ffacc0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:42.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.935+0000 7ffad2d76700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc1f31d0 con 0x7ffacc15dec0 2023-10-16T12:59:42.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.935+0000 7ffad2d76700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc15b6b0 con 0x7ffacc15a250 2023-10-16T12:59:42.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.935+0000 7ffad2d76700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc15aaa0 con 0x7ffacc06dcc0 2023-10-16T12:59:42.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.935+0000 7ffad1313700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffacc15dec0 0x7ffacc0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:42.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.935+0000 7ffad1313700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffacc15dec0 0x7ffacc0cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54818/0 (socket says 172.21.15.124:54818) 2023-10-16T12:59:42.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.935+0000 7ffad1313700 1 -- 172.21.15.124:0/553129589 learned_addr learned my addr 172.21.15.124:0/553129589 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:42.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.935+0000 7ffad0b12700 1 --2- 172.21.15.124:0/553129589 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffacc06dcc0 0x7ffacc0c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:42.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.935+0000 7ffacbfff700 1 --2- 172.21.15.124:0/553129589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffacc15a250 0x7ffacc0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:42.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.936+0000 7ffad1313700 1 -- 172.21.15.124:0/553129589 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffacc06dcc0 msgr2=0x7ffacc0c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:42.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.936+0000 7ffad1313700 1 --2- 172.21.15.124:0/553129589 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffacc06dcc0 0x7ffacc0c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.936+0000 7ffad1313700 1 -- 172.21.15.124:0/553129589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffacc15a250 msgr2=0x7ffacc0c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:42.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.936+0000 7ffad1313700 1 --2- 172.21.15.124:0/553129589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffacc15a250 0x7ffacc0c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:42.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.936+0000 7ffad1313700 1 -- 172.21.15.124:0/553129589 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac000b7f0 con 0x7ffacc15dec0 2023-10-16T12:59:42.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.936+0000 7ffad1313700 1 --2- 172.21.15.124:0/553129589 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffacc15dec0 0x7ffacc0cdcf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ffac4007d70 tx=0x7ffac400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:42.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.936+0000 7ffac97fa700 1 -- 172.21.15.124:0/553129589 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac400ed30 con 0x7ffacc15dec0 2023-10-16T12:59:42.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.936+0000 7ffac97fa700 1 -- 172.21.15.124:0/553129589 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac400eeb0 con 0x7ffacc15dec0 2023-10-16T12:59:42.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.936+0000 7ffad2d76700 1 -- 172.21.15.124:0/553129589 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffacc15ad80 con 0x7ffacc15dec0 2023-10-16T12:59:42.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.936+0000 7ffac97fa700 1 -- 172.21.15.124:0/553129589 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4014640 con 0x7ffacc15dec0 2023-10-16T12:59:42.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.936+0000 7ffad2d76700 1 -- 172.21.15.124:0/553129589 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffacc15b340 con 0x7ffacc15dec0 2023-10-16T12:59:42.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.937+0000 7ffad2d76700 1 -- 172.21.15.124:0/553129589 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffacc15b840 con 0x7ffacc15dec0 2023-10-16T12:59:42.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.937+0000 7ffac97fa700 1 -- 172.21.15.124:0/553129589 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffac40147a0 con 0x7ffacc15dec0 2023-10-16T12:59:42.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.938+0000 7ffac97fa700 1 --2- 172.21.15.124:0/553129589 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ffab006af00 0x7ffab006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:42.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.938+0000 7ffad0b12700 1 --2- 172.21.15.124:0/553129589 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ffab006af00 0x7ffab006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:42.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.938+0000 7ffac97fa700 1 -- 172.21.15.124:0/553129589 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7ffac4089fa0 con 0x7ffacc15dec0 2023-10-16T12:59:42.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.938+0000 7ffad0b12700 1 --2- 172.21.15.124:0/553129589 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ffab006af00 0x7ffab006d3c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ffac000b340 tx=0x7ffac001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:42.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:42.942+0000 7ffac97fa700 1 -- 172.21.15.124:0/553129589 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffac40bcca0 con 0x7ffacc15dec0 2023-10-16T12:59:43.135 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.132+0000 7ffad2d76700 1 -- 172.21.15.124:0/553129589 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffacc04ebb0 con 0x7ffacc15dec0 2023-10-16T12:59:43.135 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.132+0000 7ffac97fa700 1 -- 172.21.15.124:0/553129589 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffac4054c00 con 0x7ffacc15dec0 2023-10-16T12:59:43.135 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:43.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.134+0000 7ffad2d76700 1 -- 172.21.15.124:0/553129589 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ffab006af00 msgr2=0x7ffab006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:43.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.134+0000 7ffad2d76700 1 --2- 172.21.15.124:0/553129589 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ffab006af00 0x7ffab006d3c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ffac000b340 tx=0x7ffac001c040 comp rx=0 tx=0).stop 2023-10-16T12:59:43.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.134+0000 7ffad2d76700 1 -- 172.21.15.124:0/553129589 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffacc15dec0 msgr2=0x7ffacc0cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:43.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.134+0000 7ffad2d76700 1 --2- 172.21.15.124:0/553129589 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffacc15dec0 0x7ffacc0cdcf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ffac4007d70 tx=0x7ffac400e3c0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.134+0000 7ffad2d76700 1 -- 172.21.15.124:0/553129589 shutdown_connections 2023-10-16T12:59:43.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.134+0000 7ffad2d76700 1 --2- 172.21.15.124:0/553129589 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ffab006af00 0x7ffab006d3c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.134+0000 7ffad2d76700 1 --2- 172.21.15.124:0/553129589 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffacc15dec0 0x7ffacc0cdcf0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.134+0000 7ffad2d76700 1 --2- 172.21.15.124:0/553129589 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffacc06dcc0 0x7ffacc0c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.139 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.134+0000 7ffad2d76700 1 --2- 172.21.15.124:0/553129589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffacc15a250 0x7ffacc0c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.139 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.135+0000 7ffad2d76700 1 -- 172.21.15.124:0/553129589 >> 172.21.15.124:0/553129589 conn(0x7ffacc0ccbe0 msgr2=0x7ffacc0cee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:43.139 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.135+0000 7ffad2d76700 1 -- 172.21.15.124:0/553129589 shutdown_connections 2023-10-16T12:59:43.139 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.135+0000 7ffad2d76700 1 -- 172.21.15.124:0/553129589 wait complete. 2023-10-16T12:59:43.149 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T12:59:43.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.270+0000 7f51fcb9d700 1 Processor -- start 2023-10-16T12:59:43.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.270+0000 7f51fcb9d700 1 -- start start 2023-10-16T12:59:43.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.271+0000 7f51fcb9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51f80ae6f0 0x7f51f806b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:43.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.271+0000 7f51fcb9d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f51f806bc80 0x7f51f80cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:43.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.271+0000 7f51fcb9d700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f806e6b0 con 0x7f51f80cd9e0 2023-10-16T12:59:43.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.271+0000 7f51fcb9d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f815d9e0 con 0x7f51f806bc80 2023-10-16T12:59:43.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.271+0000 7f51fcb9d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f80cddf0 con 0x7f51f80ae6f0 2023-10-16T12:59:43.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.271+0000 7f51f7fff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f51f80cd9e0 0x7f51f81610b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43490/0 (socket says 172.21.15.124:43490) 2023-10-16T12:59:43.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.271+0000 7f51f7fff700 1 -- 172.21.15.124:0/3007187979 learned_addr learned my addr 172.21.15.124:0/3007187979 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:43.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f67fc700 1 -- 172.21.15.124:0/3007187979 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823936717 0 0) 0x7f51f806e6b0 con 0x7f51f80cd9e0 2023-10-16T12:59:43.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f67fc700 1 -- 172.21.15.124:0/3007187979 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51e00035b0 con 0x7f51f80cd9e0 2023-10-16T12:59:43.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f6ffd700 1 --2- 172.21.15.124:0/3007187979 >> v2:172.21.15.192:3300/0 conn(0x7f51f806bc80 0x7f51f80cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:43.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f77fe700 1 --2- 172.21.15.124:0/3007187979 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51f80ae6f0 0x7f51f806b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:43.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f67fc700 1 -- 172.21.15.124:0/3007187979 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2700724285 0 0) 0x7f51e00035b0 con 0x7f51f80cd9e0 2023-10-16T12:59:43.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f67fc700 1 -- 172.21.15.124:0/3007187979 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51f80ae6f0 msgr2=0x7f51f806b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:43.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f67fc700 1 --2- 172.21.15.124:0/3007187979 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51f80ae6f0 0x7f51f806b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f67fc700 1 -- 172.21.15.124:0/3007187979 >> v2:172.21.15.192:3300/0 conn(0x7f51f806bc80 msgr2=0x7f51f80cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:43.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f67fc700 1 --2- 172.21.15.124:0/3007187979 >> v2:172.21.15.192:3300/0 conn(0x7f51f806bc80 0x7f51f80cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f67fc700 1 -- 172.21.15.124:0/3007187979 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f806c120 con 0x7f51f80cd9e0 2023-10-16T12:59:43.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f67fc700 1 -- 172.21.15.124:0/3007187979 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f51f00019f0 con 0x7f51f80cd9e0 2023-10-16T12:59:43.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f67fc700 1 -- 172.21.15.124:0/3007187979 >> v1:172.21.15.124:6789/0 conn(0x7f51f80cd9e0 legacy=0x7f51f81610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:43.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f67fc700 1 --2- 172.21.15.124:0/3007187979 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f51e0003a00 0x7f51e0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:43.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f67fc700 1 --2- 172.21.15.124:0/3007187979 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51e0004850 0x7f51e0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:43.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f67fc700 1 --2- 172.21.15.124:0/3007187979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51e0005210 0x7f51e000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:43.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f67fc700 1 -- 172.21.15.124:0/3007187979 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f815d9e0 con 0x7f51e0003a00 2023-10-16T12:59:43.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f67fc700 1 -- 172.21.15.124:0/3007187979 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f80cddf0 con 0x7f51e0005210 2023-10-16T12:59:43.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f67fc700 1 -- 172.21.15.124:0/3007187979 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e000bf80 con 0x7f51e0004850 2023-10-16T12:59:43.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f77fe700 1 --2- 172.21.15.124:0/3007187979 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51f80ae6f0 0x7f51f806b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:43.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f77fe700 1 --2- 172.21.15.124:0/3007187979 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f51e0003a00 0x7f51e0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:43.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f6ffd700 1 --2- 172.21.15.124:0/3007187979 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51e0004850 0x7f51e0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:43.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f7fff700 1 --2- 172.21.15.124:0/3007187979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51e0005210 0x7f51e000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:43.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f77fe700 1 -- 172.21.15.124:0/3007187979 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51e0004850 msgr2=0x7f51e0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:43.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f77fe700 1 --2- 172.21.15.124:0/3007187979 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51e0004850 0x7f51e0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f77fe700 1 -- 172.21.15.124:0/3007187979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51e0005210 msgr2=0x7f51e000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:43.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f77fe700 1 --2- 172.21.15.124:0/3007187979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51e0005210 0x7f51e000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f77fe700 1 -- 172.21.15.124:0/3007187979 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e00035b0 con 0x7f51e0003a00 2023-10-16T12:59:43.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.272+0000 7f51f77fe700 1 --2- 172.21.15.124:0/3007187979 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f51e0003a00 0x7f51e0003e20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f51f8073f10 tx=0x7f51e0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a62ac15e6951f874 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:43.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.273+0000 7f51f67fc700 1 -- 172.21.15.124:0/3007187979 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec00c070 con 0x7f51e0003a00 2023-10-16T12:59:43.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.273+0000 7f51f67fc700 1 -- 172.21.15.124:0/3007187979 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec013630 con 0x7f51e0003a00 2023-10-16T12:59:43.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.273+0000 7f51f67fc700 1 -- 172.21.15.124:0/3007187979 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec0093d0 con 0x7f51e0003a00 2023-10-16T12:59:43.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.273+0000 7f51fcb9d700 1 -- 172.21.15.124:0/3007187979 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f51e0003a00 msgr2=0x7f51e0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:43.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.273+0000 7f51fcb9d700 1 --2- 172.21.15.124:0/3007187979 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f51e0003a00 0x7f51e0003e20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f51f8073f10 tx=0x7f51e0005880 comp rx=0 tx=0).stop 2023-10-16T12:59:43.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.273+0000 7f51f7fff700 1 -- 172.21.15.124:0/3007187979 reap_dead start 2023-10-16T12:59:43.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.273+0000 7f51fcb9d700 1 -- 172.21.15.124:0/3007187979 shutdown_connections 2023-10-16T12:59:43.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.273+0000 7f51fcb9d700 1 -- 172.21.15.124:0/3007187979 >> 172.21.15.124:0/3007187979 conn(0x7f51f80b13c0 msgr2=0x7f51f80b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:43.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.273+0000 7f51fcb9d700 1 -- 172.21.15.124:0/3007187979 shutdown_connections 2023-10-16T12:59:43.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.273+0000 7f51fcb9d700 1 -- 172.21.15.124:0/3007187979 wait complete. 2023-10-16T12:59:43.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.274+0000 7f51fcb9d700 1 Processor -- start 2023-10-16T12:59:43.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.275+0000 7f51fcb9d700 1 -- start start 2023-10-16T12:59:43.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.275+0000 7f51fcb9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f51e0003a00 0x7f51f815b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:43.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.275+0000 7f51fcb9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51f8159490 0x7f51f8159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:43.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.275+0000 7f51fcb9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51f81f28f0 0x7f51f81f2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:43.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.275+0000 7f51fcb9d700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f8159f50 con 0x7f51e0003a00 2023-10-16T12:59:43.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.275+0000 7f51fcb9d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f815a230 con 0x7f51f8159490 2023-10-16T12:59:43.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.275+0000 7f51fcb9d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f815a510 con 0x7f51f81f28f0 2023-10-16T12:59:43.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.275+0000 7f51f77fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f51e0003a00 0x7f51f815b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:43.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.275+0000 7f51f77fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f51e0003a00 0x7f51f815b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54832/0 (socket says 172.21.15.124:54832) 2023-10-16T12:59:43.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.276+0000 7f51f77fe700 1 -- 172.21.15.124:0/2614072993 learned_addr learned my addr 172.21.15.124:0/2614072993 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:43.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.276+0000 7f51f6ffd700 1 --2- 172.21.15.124:0/2614072993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51f8159490 0x7f51f8159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:43.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.276+0000 7f51f7fff700 1 --2- 172.21.15.124:0/2614072993 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51f81f28f0 0x7f51f81f2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:43.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.276+0000 7f51f77fe700 1 -- 172.21.15.124:0/2614072993 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51f81f28f0 msgr2=0x7f51f81f2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:43.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.276+0000 7f51f77fe700 1 --2- 172.21.15.124:0/2614072993 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51f81f28f0 0x7f51f81f2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.276+0000 7f51f77fe700 1 -- 172.21.15.124:0/2614072993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51f8159490 msgr2=0x7f51f8159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:43.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.276+0000 7f51f77fe700 1 --2- 172.21.15.124:0/2614072993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51f8159490 0x7f51f8159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.276+0000 7f51f77fe700 1 -- 172.21.15.124:0/2614072993 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f815a7f0 con 0x7f51e0003a00 2023-10-16T12:59:43.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.276+0000 7f51f77fe700 1 --2- 172.21.15.124:0/2614072993 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f51e0003a00 0x7f51f815b520 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009d00 tx=0x7f51ec0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:43.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.276+0000 7f51dffff700 1 -- 172.21.15.124:0/2614072993 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec01d810 con 0x7f51e0003a00 2023-10-16T12:59:43.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.276+0000 7f51dffff700 1 -- 172.21.15.124:0/2614072993 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec01d970 con 0x7f51e0003a00 2023-10-16T12:59:43.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.276+0000 7f51fcb9d700 1 -- 172.21.15.124:0/2614072993 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f815aad0 con 0x7f51e0003a00 2023-10-16T12:59:43.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.276+0000 7f51dffff700 1 -- 172.21.15.124:0/2614072993 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec01dd00 con 0x7f51e0003a00 2023-10-16T12:59:43.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.276+0000 7f51fcb9d700 1 -- 172.21.15.124:0/2614072993 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f80c4ad0 con 0x7f51e0003a00 2023-10-16T12:59:43.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.277+0000 7f51fcb9d700 1 -- 172.21.15.124:0/2614072993 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f80743d0 con 0x7f51e0003a00 2023-10-16T12:59:43.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.278+0000 7f51dffff700 1 -- 172.21.15.124:0/2614072993 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f51ec0273e0 con 0x7f51e0003a00 2023-10-16T12:59:43.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.278+0000 7f51dffff700 1 --2- 172.21.15.124:0/2614072993 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f51e406af50 0x7f51e406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:43.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.278+0000 7f51dffff700 1 -- 172.21.15.124:0/2614072993 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f51ec023030 con 0x7f51e0003a00 2023-10-16T12:59:43.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.278+0000 7f51f6ffd700 1 --2- 172.21.15.124:0/2614072993 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f51e406af50 0x7f51e406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:43.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.278+0000 7f51f6ffd700 1 --2- 172.21.15.124:0/2614072993 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f51e406af50 0x7f51e406d410 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f51f80c55b0 tx=0x7f51e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:43.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.282+0000 7f51dffff700 1 -- 172.21.15.124:0/2614072993 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f51ec055ac0 con 0x7f51e0003a00 2023-10-16T12:59:43.472 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.470+0000 7f51fcb9d700 1 -- 172.21.15.124:0/2614072993 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f51f81f3490 con 0x7f51e0003a00 2023-10-16T12:59:43.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.470+0000 7f51dffff700 1 -- 172.21.15.124:0/2614072993 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f51ec01de60 con 0x7f51e0003a00 2023-10-16T12:59:43.473 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2023-10-16T12:59:43.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.472+0000 7f51fcb9d700 1 -- 172.21.15.124:0/2614072993 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f51e406af50 msgr2=0x7f51e406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:43.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.472+0000 7f51fcb9d700 1 --2- 172.21.15.124:0/2614072993 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f51e406af50 0x7f51e406d410 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f51f80c55b0 tx=0x7f51e8008040 comp rx=0 tx=0).stop 2023-10-16T12:59:43.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.472+0000 7f51fcb9d700 1 -- 172.21.15.124:0/2614072993 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f51e0003a00 msgr2=0x7f51f815b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:43.476 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.472+0000 7f51fcb9d700 1 --2- 172.21.15.124:0/2614072993 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f51e0003a00 0x7f51f815b520 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009d00 tx=0x7f51ec0047c0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.476 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.472+0000 7f51fcb9d700 1 -- 172.21.15.124:0/2614072993 shutdown_connections 2023-10-16T12:59:43.476 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.472+0000 7f51fcb9d700 1 --2- 172.21.15.124:0/2614072993 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f51e406af50 0x7f51e406d410 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.476 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.472+0000 7f51fcb9d700 1 --2- 172.21.15.124:0/2614072993 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51f81f28f0 0x7f51f81f2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.476 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.472+0000 7f51fcb9d700 1 --2- 172.21.15.124:0/2614072993 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f51e0003a00 0x7f51f815b520 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.477 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.472+0000 7f51fcb9d700 1 --2- 172.21.15.124:0/2614072993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51f8159490 0x7f51f8159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.477 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.472+0000 7f51fcb9d700 1 -- 172.21.15.124:0/2614072993 >> 172.21.15.124:0/2614072993 conn(0x7f51f80b13c0 msgr2=0x7f51f80adc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:43.477 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.472+0000 7f51fcb9d700 1 -- 172.21.15.124:0/2614072993 shutdown_connections 2023-10-16T12:59:43.477 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.472+0000 7f51fcb9d700 1 -- 172.21.15.124:0/2614072993 wait complete. 2023-10-16T12:59:43.487 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T12:59:43.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.609+0000 7f05fbfa1700 1 Processor -- start 2023-10-16T12:59:43.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.610+0000 7f05fbfa1700 1 -- start start 2023-10-16T12:59:43.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.610+0000 7f05fbfa1700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f05f406dcc0 0x7f05f40cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:43.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.610+0000 7f05fbfa1700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f40cba90 con 0x7f05f415dec0 2023-10-16T12:59:43.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.610+0000 7f05fbfa1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f415ee40 con 0x7f05f415a250 2023-10-16T12:59:43.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.610+0000 7f05fbfa1700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f40cb510 con 0x7f05f406dcc0 2023-10-16T12:59:43.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.611+0000 7f05fa53e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f05f406dcc0 0x7f05f40cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:43.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.611+0000 7f05fa53e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f05f406dcc0 0x7f05f40cbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54844/0 (socket says 172.21.15.124:54844) 2023-10-16T12:59:43.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.611+0000 7f05f953c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f05f415dec0 0x7f05f406d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43508/0 (socket says 172.21.15.124:43508) 2023-10-16T12:59:43.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.611+0000 7f05fa53e700 1 -- 172.21.15.124:0/4077637949 learned_addr learned my addr 172.21.15.124:0/4077637949 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:43.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.611+0000 7f05fa53e700 1 -- 172.21.15.124:0/4077637949 >> v1:172.21.15.192:6789/0 conn(0x7f05f415a250 legacy=0x7f05f40717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:43.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.611+0000 7f05fa53e700 1 -- 172.21.15.124:0/4077637949 >> v1:172.21.15.124:6789/0 conn(0x7f05f415dec0 legacy=0x7f05f406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:43.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.611+0000 7f05fa53e700 1 -- 172.21.15.124:0/4077637949 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f415e880 con 0x7f05f406dcc0 2023-10-16T12:59:43.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.611+0000 7f05f8d3b700 1 -- 172.21.15.124:0/4077637949 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2605526433 0 0) 0x7f05f40cba90 con 0x7f05f415dec0 2023-10-16T12:59:43.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.611+0000 7f05fa53e700 1 --2- 172.21.15.124:0/4077637949 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f05f406dcc0 0x7f05f40cbf20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f05ec009e50 tx=0x7f05ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d987caff5f836a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:43.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.611+0000 7f05f8d3b700 1 -- 172.21.15.124:0/4077637949 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec00e070 con 0x7f05f406dcc0 2023-10-16T12:59:43.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.611+0000 7f05f8d3b700 1 -- 172.21.15.124:0/4077637949 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ec003a20 con 0x7f05f406dcc0 2023-10-16T12:59:43.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.611+0000 7f05f8d3b700 1 -- 172.21.15.124:0/4077637949 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec003dd0 con 0x7f05f406dcc0 2023-10-16T12:59:43.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.612+0000 7f05fbfa1700 1 -- 172.21.15.124:0/4077637949 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f05f406dcc0 msgr2=0x7f05f40cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:43.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.612+0000 7f05fbfa1700 1 --2- 172.21.15.124:0/4077637949 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f05f406dcc0 0x7f05f40cbf20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f05ec009e50 tx=0x7f05ec00b330 comp rx=0 tx=0).stop 2023-10-16T12:59:43.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.612+0000 7f05fbfa1700 1 -- 172.21.15.124:0/4077637949 shutdown_connections 2023-10-16T12:59:43.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.612+0000 7f05fbfa1700 1 --2- 172.21.15.124:0/4077637949 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f05f406dcc0 0x7f05f40cbf20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.612+0000 7f05fbfa1700 1 -- 172.21.15.124:0/4077637949 >> 172.21.15.124:0/4077637949 conn(0x7f05f40ccbe0 msgr2=0x7f05f40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:43.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.612+0000 7f05fbfa1700 1 -- 172.21.15.124:0/4077637949 shutdown_connections 2023-10-16T12:59:43.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.612+0000 7f05fbfa1700 1 -- 172.21.15.124:0/4077637949 wait complete. 2023-10-16T12:59:43.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.613+0000 7f05fbfa1700 1 Processor -- start 2023-10-16T12:59:43.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.613+0000 7f05fbfa1700 1 -- start start 2023-10-16T12:59:43.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.614+0000 7f05fbfa1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05f406dcc0 0x7f05f415d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:43.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.614+0000 7f05fbfa1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05f415a250 0x7f05f415a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:43.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.614+0000 7f05fbfa1700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f05f415dec0 0x7f05f4142fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:43.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.614+0000 7f05fbfa1700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f415c6f0 con 0x7f05f415dec0 2023-10-16T12:59:43.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.614+0000 7f05fbfa1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f415c950 con 0x7f05f415a250 2023-10-16T12:59:43.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.614+0000 7f05fbfa1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f4143d10 con 0x7f05f406dcc0 2023-10-16T12:59:43.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.614+0000 7f05fa53e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f05f415dec0 0x7f05f4142fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:43.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.614+0000 7f05fa53e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f05f415dec0 0x7f05f4142fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54850/0 (socket says 172.21.15.124:54850) 2023-10-16T12:59:43.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.614+0000 7f05fa53e700 1 -- 172.21.15.124:0/1964431365 learned_addr learned my addr 172.21.15.124:0/1964431365 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:43.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.614+0000 7f05f953c700 1 --2- 172.21.15.124:0/1964431365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05f415a250 0x7f05f415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:43.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.614+0000 7f05f9d3d700 1 --2- 172.21.15.124:0/1964431365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05f406dcc0 0x7f05f415d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:43.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.614+0000 7f05fa53e700 1 -- 172.21.15.124:0/1964431365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05f406dcc0 msgr2=0x7f05f415d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:43.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.614+0000 7f05fa53e700 1 --2- 172.21.15.124:0/1964431365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05f406dcc0 0x7f05f415d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.614+0000 7f05fa53e700 1 -- 172.21.15.124:0/1964431365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05f415a250 msgr2=0x7f05f415a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:43.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.614+0000 7f05fa53e700 1 --2- 172.21.15.124:0/1964431365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05f415a250 0x7f05f415a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.614+0000 7f05fa53e700 1 -- 172.21.15.124:0/1964431365 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec009b30 con 0x7f05f415dec0 2023-10-16T12:59:43.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.614+0000 7f05fa53e700 1 --2- 172.21.15.124:0/1964431365 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f05f415dec0 0x7f05f4142fe0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f05ec004000 tx=0x7f05ec004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:43.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.614+0000 7f05ea7fc700 1 -- 172.21.15.124:0/1964431365 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec004440 con 0x7f05f415dec0 2023-10-16T12:59:43.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.614+0000 7f05ea7fc700 1 -- 172.21.15.124:0/1964431365 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ec0045a0 con 0x7f05f415dec0 2023-10-16T12:59:43.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.614+0000 7f05fbfa1700 1 -- 172.21.15.124:0/1964431365 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f415cc10 con 0x7f05f415dec0 2023-10-16T12:59:43.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.614+0000 7f05ea7fc700 1 -- 172.21.15.124:0/1964431365 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec004950 con 0x7f05f415dec0 2023-10-16T12:59:43.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.615+0000 7f05fbfa1700 1 -- 172.21.15.124:0/1964431365 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f415d950 con 0x7f05f415dec0 2023-10-16T12:59:43.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.615+0000 7f05fbfa1700 1 -- 172.21.15.124:0/1964431365 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f415d130 con 0x7f05f415dec0 2023-10-16T12:59:43.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.616+0000 7f05ea7fc700 1 -- 172.21.15.124:0/1964431365 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f05ec012430 con 0x7f05f415dec0 2023-10-16T12:59:43.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.616+0000 7f05ea7fc700 1 --2- 172.21.15.124:0/1964431365 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f05d806af00 0x7f05d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:43.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.616+0000 7f05ea7fc700 1 -- 172.21.15.124:0/1964431365 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f05ec08c170 con 0x7f05f415dec0 2023-10-16T12:59:43.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.616+0000 7f05f9d3d700 1 --2- 172.21.15.124:0/1964431365 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f05d806af00 0x7f05d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:43.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.617+0000 7f05f9d3d700 1 --2- 172.21.15.124:0/1964431365 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f05d806af00 0x7f05d806d3c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f05e4004f30 tx=0x7f05e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:43.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.621+0000 7f05ea7fc700 1 -- 172.21.15.124:0/1964431365 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f05f415d130 con 0x7f05f415dec0 2023-10-16T12:59:43.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.814+0000 7f05fbfa1700 1 -- 172.21.15.124:0/1964431365 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f05f415d130 con 0x7f05f415dec0 2023-10-16T12:59:43.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.814+0000 7f05ea7fc700 1 -- 172.21.15.124:0/1964431365 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f05f415d130 con 0x7f05f415dec0 2023-10-16T12:59:43.817 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:43.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.816+0000 7f05fbfa1700 1 -- 172.21.15.124:0/1964431365 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f05d806af00 msgr2=0x7f05d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:43.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.816+0000 7f05fbfa1700 1 --2- 172.21.15.124:0/1964431365 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f05d806af00 0x7f05d806d3c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f05e4004f30 tx=0x7f05e4009040 comp rx=0 tx=0).stop 2023-10-16T12:59:43.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.816+0000 7f05fbfa1700 1 -- 172.21.15.124:0/1964431365 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f05f415dec0 msgr2=0x7f05f4142fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:43.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.816+0000 7f05fbfa1700 1 --2- 172.21.15.124:0/1964431365 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f05f415dec0 0x7f05f4142fe0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f05ec004000 tx=0x7f05ec004ad0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.816+0000 7f05fbfa1700 1 -- 172.21.15.124:0/1964431365 shutdown_connections 2023-10-16T12:59:43.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.816+0000 7f05fbfa1700 1 --2- 172.21.15.124:0/1964431365 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f05d806af00 0x7f05d806d3c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.816+0000 7f05fbfa1700 1 --2- 172.21.15.124:0/1964431365 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f05f415dec0 0x7f05f4142fe0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.816+0000 7f05fbfa1700 1 --2- 172.21.15.124:0/1964431365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05f406dcc0 0x7f05f415d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.816+0000 7f05fbfa1700 1 --2- 172.21.15.124:0/1964431365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05f415a250 0x7f05f415a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.816+0000 7f05fbfa1700 1 -- 172.21.15.124:0/1964431365 >> 172.21.15.124:0/1964431365 conn(0x7f05f40ccbe0 msgr2=0x7f05f4071790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:43.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.816+0000 7f05fbfa1700 1 -- 172.21.15.124:0/1964431365 shutdown_connections 2023-10-16T12:59:43.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.816+0000 7f05fbfa1700 1 -- 172.21.15.124:0/1964431365 wait complete. 2023-10-16T12:59:43.831 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T12:59:43.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.949+0000 7f0643c21700 1 Processor -- start 2023-10-16T12:59:43.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.949+0000 7f0643c21700 1 -- start start 2023-10-16T12:59:43.954 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.950+0000 7f0643c21700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f063c15d5c0 0x7f063c06f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:43.954 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.950+0000 7f0643c21700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f063c15d9a0 0x7f063c0cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:43.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.950+0000 7f0643c21700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063c15e2d0 con 0x7f063c06d6e0 2023-10-16T12:59:43.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.950+0000 7f0643c21700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063c071810 con 0x7f063c15d5c0 2023-10-16T12:59:43.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.950+0000 7f0643c21700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c15e5b0 con 0x7f063c15d9a0 2023-10-16T12:59:43.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.950+0000 7f06419bd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f063c15d5c0 0x7f063c06f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:43.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.950+0000 7f06411bc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f063c15d9a0 0x7f063c0cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:43.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.950+0000 7f06411bc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f063c15d9a0 0x7f063c0cb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:40934/0 (socket says 172.21.15.124:40934) 2023-10-16T12:59:43.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.950+0000 7f06421be700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f063c06d6e0 0x7f063c071c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.124:55522/0 (socket says 172.21.15.124:55522) 2023-10-16T12:59:43.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.950+0000 7f06411bc700 1 -- 172.21.15.124:0/9172036 learned_addr learned my addr 172.21.15.124:0/9172036 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:43.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.951+0000 7f06409bb700 1 -- 172.21.15.124:0/9172036 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363467464 0 0) 0x7f063c15e2d0 con 0x7f063c06d6e0 2023-10-16T12:59:43.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.951+0000 7f06409bb700 1 -- 172.21.15.124:0/9172036 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06280035b0 con 0x7f063c06d6e0 2023-10-16T12:59:43.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.951+0000 7f06411bc700 1 -- 172.21.15.124:0/9172036 >> v2:172.21.15.192:3300/0 conn(0x7f063c15d5c0 msgr2=0x7f063c06f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:43.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.951+0000 7f06411bc700 1 --2- 172.21.15.124:0/9172036 >> v2:172.21.15.192:3300/0 conn(0x7f063c15d5c0 0x7f063c06f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.951+0000 7f06411bc700 1 -- 172.21.15.124:0/9172036 >> v1:172.21.15.192:6789/0 conn(0x7f063c06d6e0 legacy=0x7f063c071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:43.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.951+0000 7f06411bc700 1 -- 172.21.15.124:0/9172036 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c15e890 con 0x7f063c15d9a0 2023-10-16T12:59:43.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.951+0000 7f06419bd700 1 --2- 172.21.15.124:0/9172036 >> v2:172.21.15.192:3300/0 conn(0x7f063c15d5c0 0x7f063c06f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:59:43.958 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.951+0000 7f06411bc700 1 --2- 172.21.15.124:0/9172036 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f063c15d9a0 0x7f063c0cb6a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f06380098f0 tx=0x7f0638009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=581dcbb537dc23f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:43.958 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.951+0000 7f06409bb700 1 -- 172.21.15.124:0/9172036 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063800f8a0 con 0x7f063c15d9a0 2023-10-16T12:59:43.958 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.951+0000 7f06409bb700 1 -- 172.21.15.124:0/9172036 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063800fa00 con 0x7f063c15d9a0 2023-10-16T12:59:43.958 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.951+0000 7f06409bb700 1 -- 172.21.15.124:0/9172036 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063800fd90 con 0x7f063c15d9a0 2023-10-16T12:59:43.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.952+0000 7f0643c21700 1 -- 172.21.15.124:0/9172036 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f063c15d9a0 msgr2=0x7f063c0cb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:43.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.952+0000 7f0643c21700 1 --2- 172.21.15.124:0/9172036 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f063c15d9a0 0x7f063c0cb6a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f06380098f0 tx=0x7f0638009c00 comp rx=0 tx=0).stop 2023-10-16T12:59:43.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.952+0000 7f0643c21700 1 -- 172.21.15.124:0/9172036 shutdown_connections 2023-10-16T12:59:43.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.952+0000 7f0643c21700 1 --2- 172.21.15.124:0/9172036 >> v2:172.21.15.192:3300/0 conn(0x7f063c15d5c0 0x7f063c06f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.959 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.952+0000 7f0643c21700 1 --2- 172.21.15.124:0/9172036 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f063c15d9a0 0x7f063c0cb6a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.960 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.952+0000 7f0643c21700 1 -- 172.21.15.124:0/9172036 >> 172.21.15.124:0/9172036 conn(0x7f063c0d0260 msgr2=0x7f063c0d0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:43.960 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.952+0000 7f0643c21700 1 -- 172.21.15.124:0/9172036 shutdown_connections 2023-10-16T12:59:43.960 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.952+0000 7f0643c21700 1 -- 172.21.15.124:0/9172036 wait complete. 2023-10-16T12:59:43.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.953+0000 7f0643c21700 1 Processor -- start 2023-10-16T12:59:43.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.953+0000 7f0643c21700 1 -- start start 2023-10-16T12:59:43.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.954+0000 7f0643c21700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f063c06d6e0 0x7f063c0c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:43.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.954+0000 7f0643c21700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f063c15d5c0 0x7f063c1f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:43.963 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.954+0000 7f0643c21700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f063c15d9a0 0x7f063c0b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:43.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.954+0000 7f0643c21700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c1f2b20 con 0x7f063c15d9a0 2023-10-16T12:59:43.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.954+0000 7f0643c21700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0ac8c0 con 0x7f063c15d5c0 2023-10-16T12:59:43.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.954+0000 7f0643c21700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0b33e0 con 0x7f063c06d6e0 2023-10-16T12:59:43.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.954+0000 7f06421be700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f063c15d9a0 0x7f063c0b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:43.964 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.954+0000 7f06421be700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f063c15d9a0 0x7f063c0b2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54864/0 (socket says 172.21.15.124:54864) 2023-10-16T12:59:43.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.954+0000 7f06421be700 1 -- 172.21.15.124:0/3663078397 learned_addr learned my addr 172.21.15.124:0/3663078397 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:43.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.954+0000 7f06419bd700 1 --2- 172.21.15.124:0/3663078397 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f063c06d6e0 0x7f063c0c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:43.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.954+0000 7f06411bc700 1 --2- 172.21.15.124:0/3663078397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f063c15d5c0 0x7f063c1f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:43.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.954+0000 7f06421be700 1 -- 172.21.15.124:0/3663078397 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f063c06d6e0 msgr2=0x7f063c0c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:43.965 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.954+0000 7f06421be700 1 --2- 172.21.15.124:0/3663078397 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f063c06d6e0 0x7f063c0c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.966 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.954+0000 7f06421be700 1 -- 172.21.15.124:0/3663078397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f063c15d5c0 msgr2=0x7f063c1f25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:43.966 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.954+0000 7f06421be700 1 --2- 172.21.15.124:0/3663078397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f063c15d5c0 0x7f063c1f25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:43.966 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.954+0000 7f06421be700 1 -- 172.21.15.124:0/3663078397 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c0094a0 con 0x7f063c15d9a0 2023-10-16T12:59:43.966 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.954+0000 7f06421be700 1 --2- 172.21.15.124:0/3663078397 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f063c15d9a0 0x7f063c0b2ea0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f063400cb10 tx=0x7f063400ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:43.966 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.954+0000 7f06327fc700 1 -- 172.21.15.124:0/3663078397 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063400a980 con 0x7f063c15d9a0 2023-10-16T12:59:43.967 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.955+0000 7f06327fc700 1 -- 172.21.15.124:0/3663078397 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063400aae0 con 0x7f063c15d9a0 2023-10-16T12:59:43.967 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.955+0000 7f0643c21700 1 -- 172.21.15.124:0/3663078397 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0638009550 con 0x7f063c15d9a0 2023-10-16T12:59:43.967 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.955+0000 7f06327fc700 1 -- 172.21.15.124:0/3663078397 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063400ae70 con 0x7f063c15d9a0 2023-10-16T12:59:43.967 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.955+0000 7f0643c21700 1 -- 172.21.15.124:0/3663078397 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063c0b41e0 con 0x7f063c15d9a0 2023-10-16T12:59:43.967 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.955+0000 7f0643c21700 1 -- 172.21.15.124:0/3663078397 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063c0b4370 con 0x7f063c15d9a0 2023-10-16T12:59:43.967 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.956+0000 7f06327fc700 1 -- 172.21.15.124:0/3663078397 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0634007070 con 0x7f063c15d9a0 2023-10-16T12:59:43.968 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.956+0000 7f06327fc700 1 --2- 172.21.15.124:0/3663078397 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f062006af00 0x7f062006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:43.968 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.956+0000 7f06327fc700 1 -- 172.21.15.124:0/3663078397 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f0634089760 con 0x7f063c15d9a0 2023-10-16T12:59:43.968 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.956+0000 7f06419bd700 1 --2- 172.21.15.124:0/3663078397 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f062006af00 0x7f062006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:43.968 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.957+0000 7f06419bd700 1 --2- 172.21.15.124:0/3663078397 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f062006af00 0x7f062006d3c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f062c009d70 tx=0x7f062c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:43.969 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:43.961+0000 7f06327fc700 1 -- 172.21.15.124:0/3663078397 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0634054330 con 0x7f063c15d9a0 2023-10-16T12:59:44.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.163+0000 7f0643c21700 1 -- 172.21.15.124:0/3663078397 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f063c15de80 con 0x7f063c15d9a0 2023-10-16T12:59:44.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.163+0000 7f06327fc700 1 -- 172.21.15.124:0/3663078397 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0634057950 con 0x7f063c15d9a0 2023-10-16T12:59:44.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.165+0000 7f0643c21700 1 -- 172.21.15.124:0/3663078397 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f062006af00 msgr2=0x7f062006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:44.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.165+0000 7f0643c21700 1 --2- 172.21.15.124:0/3663078397 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f062006af00 0x7f062006d3c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f062c009d70 tx=0x7f062c009210 comp rx=0 tx=0).stop 2023-10-16T12:59:44.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.165+0000 7f0643c21700 1 -- 172.21.15.124:0/3663078397 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f063c15d9a0 msgr2=0x7f063c0b2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:44.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.165+0000 7f0643c21700 1 --2- 172.21.15.124:0/3663078397 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f063c15d9a0 0x7f063c0b2ea0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f063400cb10 tx=0x7f063400ce20 comp rx=0 tx=0).stop 2023-10-16T12:59:44.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.166+0000 7f0643c21700 1 -- 172.21.15.124:0/3663078397 shutdown_connections 2023-10-16T12:59:44.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.166+0000 7f0643c21700 1 --2- 172.21.15.124:0/3663078397 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f062006af00 0x7f062006d3c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:44.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.166+0000 7f0643c21700 1 --2- 172.21.15.124:0/3663078397 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f063c15d9a0 0x7f063c0b2ea0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:44.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.166+0000 7f0643c21700 1 --2- 172.21.15.124:0/3663078397 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f063c06d6e0 0x7f063c0c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:44.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.166+0000 7f0643c21700 1 --2- 172.21.15.124:0/3663078397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f063c15d5c0 0x7f063c1f25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:44.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.166+0000 7f0643c21700 1 -- 172.21.15.124:0/3663078397 >> 172.21.15.124:0/3663078397 conn(0x7f063c0d0260 msgr2=0x7f063c071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:44.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.166+0000 7f0643c21700 1 -- 172.21.15.124:0/3663078397 shutdown_connections 2023-10-16T12:59:44.171 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.166+0000 7f0643c21700 1 -- 172.21.15.124:0/3663078397 wait complete. 2023-10-16T12:59:44.171 INFO:teuthology.orchestra.run.smithi124.stderr:listed 0 entries 2023-10-16T12:59:44.180 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-16T12:59:44.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:44.181 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-16T12:59:44.225 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-10-16T12:59:44.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:44.226 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-16T12:59:44.290 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:59:44.291 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:59:44.308 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:59:44.309 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:59:44.365 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T12:59:44.366 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:59:44.422 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:59:44.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.580+0000 7f40aed5f700 1 Processor -- start 2023-10-16T12:59:44.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.580+0000 7f40aed5f700 1 -- start start 2023-10-16T12:59:44.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.580+0000 7f40aed5f700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f40a8152470 0x7f40a80cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:44.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.580+0000 7f40aed5f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40a80b3410 0x7f40a80b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:44.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.580+0000 7f40aed5f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a8070d70 con 0x7f40a80cb8d0 2023-10-16T12:59:44.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.580+0000 7f40aed5f700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a8071200 con 0x7f40a8152470 2023-10-16T12:59:44.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.580+0000 7f40aed5f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a80cbd80 con 0x7f40a80b3410 2023-10-16T12:59:44.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.581+0000 7f40acafb700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f40a8152470 0x7f40a80cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:44.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.581+0000 7f40acafb700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f40a8152470 0x7f40a80cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54868/0 (socket says 172.21.15.124:54868) 2023-10-16T12:59:44.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.581+0000 7f40acafb700 1 -- 172.21.15.124:0/2862079233 learned_addr learned my addr 172.21.15.124:0/2862079233 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:44.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.581+0000 7f40ad2fc700 1 --2- 172.21.15.124:0/2862079233 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40a80b3410 0x7f40a80b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:44.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.581+0000 7f40acafb700 1 -- 172.21.15.124:0/2862079233 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40a80b3410 msgr2=0x7f40a80b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:44.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.581+0000 7f40acafb700 1 --2- 172.21.15.124:0/2862079233 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40a80b3410 0x7f40a80b60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:44.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.581+0000 7f40acafb700 1 -- 172.21.15.124:0/2862079233 >> v1:172.21.15.192:6789/0 conn(0x7f40a80cb8d0 legacy=0x7f40a80b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:44.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.581+0000 7f40acafb700 1 -- 172.21.15.124:0/2862079233 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a8070440 con 0x7f40a8152470 2023-10-16T12:59:44.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.581+0000 7f40acafb700 1 --2- 172.21.15.124:0/2862079233 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40a8152470 0x7f40a80cd570 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f409c0098f0 tx=0x7f409c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9b765af281785c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:44.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.581+0000 7f40a77fe700 1 -- 172.21.15.124:0/2862079233 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c011830 con 0x7f40a8152470 2023-10-16T12:59:44.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.581+0000 7f40a77fe700 1 -- 172.21.15.124:0/2862079233 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409c011990 con 0x7f40a8152470 2023-10-16T12:59:44.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.581+0000 7f40a77fe700 1 -- 172.21.15.124:0/2862079233 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c011d20 con 0x7f40a8152470 2023-10-16T12:59:44.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.582+0000 7f40aed5f700 1 -- 172.21.15.124:0/2862079233 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40a8152470 msgr2=0x7f40a80cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:44.588 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.582+0000 7f40aed5f700 1 --2- 172.21.15.124:0/2862079233 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40a8152470 0x7f40a80cd570 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f409c0098f0 tx=0x7f409c009c00 comp rx=0 tx=0).stop 2023-10-16T12:59:44.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.582+0000 7f40aed5f700 1 -- 172.21.15.124:0/2862079233 shutdown_connections 2023-10-16T12:59:44.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.582+0000 7f40aed5f700 1 --2- 172.21.15.124:0/2862079233 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40a80b3410 0x7f40a80b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:44.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.582+0000 7f40aed5f700 1 --2- 172.21.15.124:0/2862079233 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40a8152470 0x7f40a80cd570 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:44.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.582+0000 7f40aed5f700 1 -- 172.21.15.124:0/2862079233 >> 172.21.15.124:0/2862079233 conn(0x7f40a80cdd00 msgr2=0x7f40a80ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:44.589 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.582+0000 7f40aed5f700 1 -- 172.21.15.124:0/2862079233 shutdown_connections 2023-10-16T12:59:44.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.582+0000 7f40aed5f700 1 -- 172.21.15.124:0/2862079233 wait complete. 2023-10-16T12:59:44.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.583+0000 7f40aed5f700 1 Processor -- start 2023-10-16T12:59:44.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.583+0000 7f40aed5f700 1 -- start start 2023-10-16T12:59:44.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.584+0000 7f40aed5f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40a80b3410 0x7f40a81f3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:44.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.584+0000 7f40aed5f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40a80cb8d0 0x7f40a80cee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:44.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.584+0000 7f40aed5f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40a8152470 0x7f40a80cf340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:44.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.584+0000 7f40aed5f700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a81f39e0 con 0x7f40a80b3410 2023-10-16T12:59:44.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.584+0000 7f40aed5f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a806bab0 con 0x7f40a80cb8d0 2023-10-16T12:59:44.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.584+0000 7f40aed5f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a806bd90 con 0x7f40a8152470 2023-10-16T12:59:44.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.584+0000 7f40acafb700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40a80b3410 0x7f40a81f3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:44.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.584+0000 7f40acafb700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40a80b3410 0x7f40a81f3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54874/0 (socket says 172.21.15.124:54874) 2023-10-16T12:59:44.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.584+0000 7f40acafb700 1 -- 172.21.15.124:0/1046829425 learned_addr learned my addr 172.21.15.124:0/1046829425 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:44.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.584+0000 7f40ad2fc700 1 --2- 172.21.15.124:0/1046829425 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40a8152470 0x7f40a80cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:44.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.584+0000 7f40a7fff700 1 --2- 172.21.15.124:0/1046829425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40a80cb8d0 0x7f40a80cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:44.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.584+0000 7f40acafb700 1 -- 172.21.15.124:0/1046829425 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40a8152470 msgr2=0x7f40a80cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:44.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.584+0000 7f40acafb700 1 --2- 172.21.15.124:0/1046829425 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40a8152470 0x7f40a80cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:44.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.584+0000 7f40acafb700 1 -- 172.21.15.124:0/1046829425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40a80cb8d0 msgr2=0x7f40a80cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:44.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.584+0000 7f40acafb700 1 --2- 172.21.15.124:0/1046829425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40a80cb8d0 0x7f40a80cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:44.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.584+0000 7f40acafb700 1 -- 172.21.15.124:0/1046829425 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409c009550 con 0x7f40a80b3410 2023-10-16T12:59:44.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.584+0000 7f40acafb700 1 --2- 172.21.15.124:0/1046829425 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40a80b3410 0x7f40a81f3e00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f409c009c40 tx=0x7f409c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:44.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.585+0000 7f40a57fa700 1 -- 172.21.15.124:0/1046829425 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c004510 con 0x7f40a80b3410 2023-10-16T12:59:44.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.585+0000 7f40a57fa700 1 -- 172.21.15.124:0/1046829425 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409c01e070 con 0x7f40a80b3410 2023-10-16T12:59:44.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.585+0000 7f40a57fa700 1 -- 172.21.15.124:0/1046829425 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c0038e0 con 0x7f40a80b3410 2023-10-16T12:59:44.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.585+0000 7f40aed5f700 1 -- 172.21.15.124:0/1046829425 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a806c070 con 0x7f40a80b3410 2023-10-16T12:59:44.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.585+0000 7f40aed5f700 1 -- 172.21.15.124:0/1046829425 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a806c570 con 0x7f40a80b3410 2023-10-16T12:59:44.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.585+0000 7f40aed5f700 1 -- 172.21.15.124:0/1046829425 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a806c3e0 con 0x7f40a80b3410 2023-10-16T12:59:44.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.587+0000 7f40a57fa700 1 -- 172.21.15.124:0/1046829425 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f409c003a40 con 0x7f40a80b3410 2023-10-16T12:59:44.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.587+0000 7f40a57fa700 1 --2- 172.21.15.124:0/1046829425 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f408c06af00 0x7f408c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:44.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.587+0000 7f40a57fa700 1 -- 172.21.15.124:0/1046829425 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f409c020070 con 0x7f40a80b3410 2023-10-16T12:59:44.597 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.587+0000 7f40a7fff700 1 --2- 172.21.15.124:0/1046829425 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f408c06af00 0x7f408c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:44.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.588+0000 7f40a7fff700 1 --2- 172.21.15.124:0/1046829425 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f408c06af00 0x7f408c06d3c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f40a80d0230 tx=0x7f4094009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:44.598 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.591+0000 7f40a57fa700 1 -- 172.21.15.124:0/1046829425 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f409c055bc0 con 0x7f40a80b3410 2023-10-16T12:59:44.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.783+0000 7f40aed5f700 1 -- 172.21.15.124:0/1046829425 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40a804ebb0 con 0x7f40a80b3410 2023-10-16T12:59:44.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.784+0000 7f40a57fa700 1 -- 172.21.15.124:0/1046829425 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18751 (secure 0 0 0) 0x7f409c015020 con 0x7f40a80b3410 2023-10-16T12:59:44.787 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:44.787 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":26,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:59:34.463212+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2},{"from":7,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:59:44.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.786+0000 7f40aed5f700 1 -- 172.21.15.124:0/1046829425 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f408c06af00 msgr2=0x7f408c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:44.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.786+0000 7f40aed5f700 1 --2- 172.21.15.124:0/1046829425 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f408c06af00 0x7f408c06d3c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f40a80d0230 tx=0x7f4094009040 comp rx=0 tx=0).stop 2023-10-16T12:59:44.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.786+0000 7f40aed5f700 1 -- 172.21.15.124:0/1046829425 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40a80b3410 msgr2=0x7f40a81f3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:44.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.786+0000 7f40aed5f700 1 --2- 172.21.15.124:0/1046829425 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40a80b3410 0x7f40a81f3e00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f409c009c40 tx=0x7f409c004750 comp rx=0 tx=0).stop 2023-10-16T12:59:44.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.786+0000 7f40aed5f700 1 -- 172.21.15.124:0/1046829425 shutdown_connections 2023-10-16T12:59:44.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.786+0000 7f40aed5f700 1 --2- 172.21.15.124:0/1046829425 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f408c06af00 0x7f408c06d3c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:44.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.786+0000 7f40aed5f700 1 --2- 172.21.15.124:0/1046829425 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40a8152470 0x7f40a80cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:44.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.786+0000 7f40aed5f700 1 --2- 172.21.15.124:0/1046829425 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40a80b3410 0x7f40a81f3e00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:44.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.786+0000 7f40aed5f700 1 --2- 172.21.15.124:0/1046829425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40a80cb8d0 0x7f40a80cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:44.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.786+0000 7f40aed5f700 1 -- 172.21.15.124:0/1046829425 >> 172.21.15.124:0/1046829425 conn(0x7f40a80cdd00 msgr2=0x7f40a80b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:44.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.786+0000 7f40aed5f700 1 -- 172.21.15.124:0/1046829425 shutdown_connections 2023-10-16T12:59:44.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.786+0000 7f40aed5f700 1 -- 172.21.15.124:0/1046829425 wait complete. 2023-10-16T12:59:44.801 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T12:58:38.667813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T12:58:49.562073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T12:58:50.011419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T12:58:53.692890+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T12:59:44.802 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T12:59:44.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.921+0000 7f82c908f700 1 Processor -- start 2023-10-16T12:59:44.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.921+0000 7f82c908f700 1 -- start start 2023-10-16T12:59:44.927 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.922+0000 7f82c908f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f82c4159b50 0x7f82c406bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:44.927 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.922+0000 7f82c908f700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f82c406e310 0x7f82c40cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:44.927 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.922+0000 7f82c908f700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c4159f30 con 0x7f82c406e7c0 2023-10-16T12:59:44.927 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.922+0000 7f82c908f700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c4066cb0 con 0x7f82c406e310 2023-10-16T12:59:44.927 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.922+0000 7f82c908f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c406ac90 con 0x7f82c4159b50 2023-10-16T12:59:44.928 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.922+0000 7f82c259c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f82c406e310 0x7f82c40cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:44.928 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.922+0000 7f82c259c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f82c406e310 0x7f82c40cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54882/0 (socket says 172.21.15.124:54882) 2023-10-16T12:59:44.928 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.922+0000 7f82c259c700 1 -- 172.21.15.124:0/334852590 learned_addr learned my addr 172.21.15.124:0/334852590 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:44.928 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.923+0000 7f82c2d9d700 1 --2- 172.21.15.124:0/334852590 >> v2:172.21.15.192:3300/0 conn(0x7f82c4159b50 0x7f82c406bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:44.928 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.923+0000 7f82c259c700 1 -- 172.21.15.124:0/334852590 >> v2:172.21.15.192:3300/0 conn(0x7f82c4159b50 msgr2=0x7f82c406bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:44.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.923+0000 7f82c259c700 1 --2- 172.21.15.124:0/334852590 >> v2:172.21.15.192:3300/0 conn(0x7f82c4159b50 0x7f82c406bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:44.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.923+0000 7f82c259c700 1 -- 172.21.15.124:0/334852590 >> v1:172.21.15.124:6789/0 conn(0x7f82c406e7c0 legacy=0x7f82c40665a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:44.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.923+0000 7f82c259c700 1 -- 172.21.15.124:0/334852590 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c406af70 con 0x7f82c406e310 2023-10-16T12:59:44.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.923+0000 7f82c1d9b700 1 -- 172.21.15.124:0/334852590 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709591069 0 0) 0x7f82c4159f30 con 0x7f82c406e7c0 2023-10-16T12:59:44.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.923+0000 7f82c259c700 1 --2- 172.21.15.124:0/334852590 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82c406e310 0x7f82c40cdd40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f82c4070840 tx=0x7f82b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cecd15d6b978781e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:44.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.923+0000 7f82c1d9b700 1 -- 172.21.15.124:0/334852590 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b400b870 con 0x7f82c406e310 2023-10-16T12:59:44.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.923+0000 7f82c1d9b700 1 -- 172.21.15.124:0/334852590 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b400b9d0 con 0x7f82c406e310 2023-10-16T12:59:44.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.923+0000 7f82c1d9b700 1 -- 172.21.15.124:0/334852590 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b400bd60 con 0x7f82c406e310 2023-10-16T12:59:44.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.923+0000 7f82c908f700 1 -- 172.21.15.124:0/334852590 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82c406e310 msgr2=0x7f82c40cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:44.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.923+0000 7f82c908f700 1 --2- 172.21.15.124:0/334852590 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82c406e310 0x7f82c40cdd40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f82c4070840 tx=0x7f82b4009bd0 comp rx=0 tx=0).stop 2023-10-16T12:59:44.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.923+0000 7f82c908f700 1 -- 172.21.15.124:0/334852590 shutdown_connections 2023-10-16T12:59:44.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.923+0000 7f82c908f700 1 --2- 172.21.15.124:0/334852590 >> v2:172.21.15.192:3300/0 conn(0x7f82c4159b50 0x7f82c406bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:44.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.923+0000 7f82c908f700 1 --2- 172.21.15.124:0/334852590 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82c406e310 0x7f82c40cdd40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:44.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.923+0000 7f82c908f700 1 -- 172.21.15.124:0/334852590 >> 172.21.15.124:0/334852590 conn(0x7f82c40b13e0 msgr2=0x7f82c40b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:44.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.923+0000 7f82c908f700 1 -- 172.21.15.124:0/334852590 shutdown_connections 2023-10-16T12:59:44.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.924+0000 7f82c908f700 1 -- 172.21.15.124:0/334852590 wait complete. 2023-10-16T12:59:44.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.925+0000 7f82c908f700 1 Processor -- start 2023-10-16T12:59:44.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.925+0000 7f82c908f700 1 -- start start 2023-10-16T12:59:44.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.926+0000 7f82c908f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82c406e310 0x7f82c41f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:44.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.926+0000 7f82c908f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82c406e7c0 0x7f82c41f4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:44.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.926+0000 7f82c908f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82c4159b50 0x7f82c41629a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:44.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.926+0000 7f82c908f700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c4155080 con 0x7f82c4159b50 2023-10-16T12:59:44.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.926+0000 7f82c908f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c4155360 con 0x7f82c406e310 2023-10-16T12:59:44.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.926+0000 7f82c908f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c4155640 con 0x7f82c406e7c0 2023-10-16T12:59:44.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.926+0000 7f82c359e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82c4159b50 0x7f82c41629a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:44.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.926+0000 7f82c359e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82c4159b50 0x7f82c41629a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54890/0 (socket says 172.21.15.124:54890) 2023-10-16T12:59:44.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.926+0000 7f82c359e700 1 -- 172.21.15.124:0/1256791409 learned_addr learned my addr 172.21.15.124:0/1256791409 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:44.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.926+0000 7f82c2d9d700 1 --2- 172.21.15.124:0/1256791409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82c406e310 0x7f82c41f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:44.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.926+0000 7f82c259c700 1 --2- 172.21.15.124:0/1256791409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82c406e7c0 0x7f82c41f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:44.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.926+0000 7f82c359e700 1 -- 172.21.15.124:0/1256791409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82c406e7c0 msgr2=0x7f82c41f4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:44.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.926+0000 7f82c359e700 1 --2- 172.21.15.124:0/1256791409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82c406e7c0 0x7f82c41f4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:44.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.926+0000 7f82c359e700 1 -- 172.21.15.124:0/1256791409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82c406e310 msgr2=0x7f82c41f3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:44.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.926+0000 7f82c359e700 1 --2- 172.21.15.124:0/1256791409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82c406e310 0x7f82c41f3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:44.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.926+0000 7f82c359e700 1 -- 172.21.15.124:0/1256791409 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b4009550 con 0x7f82c4159b50 2023-10-16T12:59:44.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.926+0000 7f82c359e700 1 --2- 172.21.15.124:0/1256791409 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82c4159b50 0x7f82c41629a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00c820 tx=0x7f82bc00cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:44.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.926+0000 7f82ab7fe700 1 -- 172.21.15.124:0/1256791409 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc003e30 con 0x7f82c4159b50 2023-10-16T12:59:44.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.926+0000 7f82ab7fe700 1 -- 172.21.15.124:0/1256791409 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82bc0050f0 con 0x7f82c4159b50 2023-10-16T12:59:44.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.926+0000 7f82c908f700 1 -- 172.21.15.124:0/1256791409 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c40c6a60 con 0x7f82c4159b50 2023-10-16T12:59:44.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.926+0000 7f82ab7fe700 1 -- 172.21.15.124:0/1256791409 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc0054a0 con 0x7f82c4159b50 2023-10-16T12:59:44.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.927+0000 7f82c908f700 1 -- 172.21.15.124:0/1256791409 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c41f4020 con 0x7f82c4159b50 2023-10-16T12:59:44.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.927+0000 7f82c908f700 1 -- 172.21.15.124:0/1256791409 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c40c6f80 con 0x7f82c4159b50 2023-10-16T12:59:44.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.928+0000 7f82ab7fe700 1 -- 172.21.15.124:0/1256791409 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f82bc005600 con 0x7f82c4159b50 2023-10-16T12:59:44.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.928+0000 7f82ab7fe700 1 --2- 172.21.15.124:0/1256791409 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f82b006af00 0x7f82b006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:44.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.928+0000 7f82c2d9d700 1 --2- 172.21.15.124:0/1256791409 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f82b006af00 0x7f82b006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:44.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.929+0000 7f82ab7fe700 1 -- 172.21.15.124:0/1256791409 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f82bc0890b0 con 0x7f82c4159b50 2023-10-16T12:59:44.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.929+0000 7f82c2d9d700 1 --2- 172.21.15.124:0/1256791409 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f82b006af00 0x7f82b006d3c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f82b8006b20 tx=0x7f82b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:44.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:44.933+0000 7f82ab7fe700 1 -- 172.21.15.124:0/1256791409 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f82c40c6f80 con 0x7f82c4159b50 2023-10-16T12:59:45.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.121+0000 7f82c908f700 1 -- 172.21.15.124:0/1256791409 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82c40c6f80 con 0x7f82c4159b50 2023-10-16T12:59:45.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.122+0000 7f82ab7fe700 1 -- 172.21.15.124:0/1256791409 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f82c40c6f80 con 0x7f82c4159b50 2023-10-16T12:59:45.125 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-16T12:59:45.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.124+0000 7f82c908f700 1 -- 172.21.15.124:0/1256791409 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f82b006af00 msgr2=0x7f82b006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:45.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.124+0000 7f82c908f700 1 --2- 172.21.15.124:0/1256791409 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f82b006af00 0x7f82b006d3c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f82b8006b20 tx=0x7f82b8008040 comp rx=0 tx=0).stop 2023-10-16T12:59:45.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.124+0000 7f82c908f700 1 -- 172.21.15.124:0/1256791409 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82c4159b50 msgr2=0x7f82c41629a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:45.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.124+0000 7f82c908f700 1 --2- 172.21.15.124:0/1256791409 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82c4159b50 0x7f82c41629a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00c820 tx=0x7f82bc00cb30 comp rx=0 tx=0).stop 2023-10-16T12:59:45.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.124+0000 7f82c908f700 1 -- 172.21.15.124:0/1256791409 shutdown_connections 2023-10-16T12:59:45.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.124+0000 7f82c908f700 1 --2- 172.21.15.124:0/1256791409 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f82b006af00 0x7f82b006d3c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.124+0000 7f82c908f700 1 --2- 172.21.15.124:0/1256791409 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82c4159b50 0x7f82c41629a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.124+0000 7f82c908f700 1 --2- 172.21.15.124:0/1256791409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82c406e310 0x7f82c41f3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.124+0000 7f82c908f700 1 --2- 172.21.15.124:0/1256791409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82c406e7c0 0x7f82c41f4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.124+0000 7f82c908f700 1 -- 172.21.15.124:0/1256791409 >> 172.21.15.124:0/1256791409 conn(0x7f82c40b13e0 msgr2=0x7f82c414faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:45.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.124+0000 7f82c908f700 1 -- 172.21.15.124:0/1256791409 shutdown_connections 2023-10-16T12:59:45.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.124+0000 7f82c908f700 1 -- 172.21.15.124:0/1256791409 wait complete. 2023-10-16T12:59:45.138 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T12:59:45.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.259+0000 7fa875953700 1 Processor -- start 2023-10-16T12:59:45.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.259+0000 7fa875953700 1 -- start start 2023-10-16T12:59:45.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.259+0000 7fa875953700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa870157d10 0x7fa87015b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:45.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.259+0000 7fa875953700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa8700b0b50 0x7fa8700b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:45.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.259+0000 7fa875953700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87015a9a0 con 0x7fa8700ce0e0 2023-10-16T12:59:45.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.259+0000 7fa875953700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8700b15a0 con 0x7fa8700b0b50 2023-10-16T12:59:45.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.259+0000 7fa875953700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8700b1880 con 0x7fa870157d10 2023-10-16T12:59:45.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.260+0000 7fa86f7fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fa8700ce0e0 0x7fa87015df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43564/0 (socket says 172.21.15.124:43564) 2023-10-16T12:59:45.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.260+0000 7fa86f7fe700 1 -- 172.21.15.124:0/351981601 learned_addr learned my addr 172.21.15.124:0/351981601 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:45.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.260+0000 7fa86effd700 1 --2- 172.21.15.124:0/351981601 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa870157d10 0x7fa87015b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:45.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.260+0000 7fa86e7fc700 1 --2- 172.21.15.124:0/351981601 >> v2:172.21.15.192:3300/0 conn(0x7fa8700b0b50 0x7fa8700b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:45.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.260+0000 7fa86dffb700 1 -- 172.21.15.124:0/351981601 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1493910727 0 0) 0x7fa87015a9a0 con 0x7fa8700ce0e0 2023-10-16T12:59:45.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.260+0000 7fa86dffb700 1 -- 172.21.15.124:0/351981601 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8580035b0 con 0x7fa8700ce0e0 2023-10-16T12:59:45.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.260+0000 7fa86dffb700 1 -- 172.21.15.124:0/351981601 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2083196808 0 0) 0x7fa8580035b0 con 0x7fa8700ce0e0 2023-10-16T12:59:45.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.260+0000 7fa86dffb700 1 -- 172.21.15.124:0/351981601 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa870157d10 msgr2=0x7fa87015b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:45.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.260+0000 7fa86dffb700 1 --2- 172.21.15.124:0/351981601 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa870157d10 0x7fa87015b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.260+0000 7fa86dffb700 1 -- 172.21.15.124:0/351981601 >> v2:172.21.15.192:3300/0 conn(0x7fa8700b0b50 msgr2=0x7fa8700b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:45.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.260+0000 7fa86dffb700 1 --2- 172.21.15.124:0/351981601 >> v2:172.21.15.192:3300/0 conn(0x7fa8700b0b50 0x7fa8700b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.260+0000 7fa86dffb700 1 -- 172.21.15.124:0/351981601 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87015abf0 con 0x7fa8700ce0e0 2023-10-16T12:59:45.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.260+0000 7fa86dffb700 1 -- 172.21.15.124:0/351981601 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7fa8680019f0 con 0x7fa8700ce0e0 2023-10-16T12:59:45.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.260+0000 7fa86dffb700 1 -- 172.21.15.124:0/351981601 >> v1:172.21.15.124:6789/0 conn(0x7fa8700ce0e0 legacy=0x7fa87015df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:45.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.260+0000 7fa86dffb700 1 --2- 172.21.15.124:0/351981601 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa870157d10 0x7fa858003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:45.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.260+0000 7fa86dffb700 1 --2- 172.21.15.124:0/351981601 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa858003f80 0x7fa858004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:45.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.260+0000 7fa86dffb700 1 --2- 172.21.15.124:0/351981601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa858004d90 0x7fa858005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:45.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.260+0000 7fa86dffb700 1 -- 172.21.15.124:0/351981601 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8700b15a0 con 0x7fa858003f80 2023-10-16T12:59:45.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.260+0000 7fa86dffb700 1 -- 172.21.15.124:0/351981601 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8700b1880 con 0x7fa858004d90 2023-10-16T12:59:45.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.260+0000 7fa86dffb700 1 -- 172.21.15.124:0/351981601 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85800ba10 con 0x7fa870157d10 2023-10-16T12:59:45.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.260+0000 7fa86e7fc700 1 --2- 172.21.15.124:0/351981601 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa858003f80 0x7fa858004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:45.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.260+0000 7fa86effd700 1 --2- 172.21.15.124:0/351981601 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa870157d10 0x7fa858003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:45.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.260+0000 7fa86f7fe700 1 --2- 172.21.15.124:0/351981601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa858004d90 0x7fa858005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:45.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.261+0000 7fa86e7fc700 1 -- 172.21.15.124:0/351981601 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa870157d10 msgr2=0x7fa858003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:45.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.261+0000 7fa86e7fc700 1 --2- 172.21.15.124:0/351981601 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa870157d10 0x7fa858003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.261+0000 7fa86e7fc700 1 -- 172.21.15.124:0/351981601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa858004d90 msgr2=0x7fa858005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:45.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.261+0000 7fa86e7fc700 1 --2- 172.21.15.124:0/351981601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa858004d90 0x7fa858005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.261+0000 7fa86e7fc700 1 -- 172.21.15.124:0/351981601 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8580035b0 con 0x7fa858003f80 2023-10-16T12:59:45.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.261+0000 7fa86f7fe700 1 --2- 172.21.15.124:0/351981601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa858004d90 0x7fa858005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:45.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.261+0000 7fa86e7fc700 1 --2- 172.21.15.124:0/351981601 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa858003f80 0x7fa858004850 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa864009b30 tx=0x7fa858005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae6ff77bb830d98 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:45.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.261+0000 7fa86dffb700 1 -- 172.21.15.124:0/351981601 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86400e660 con 0x7fa858003f80 2023-10-16T12:59:45.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.261+0000 7fa86dffb700 1 -- 172.21.15.124:0/351981601 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86400e7c0 con 0x7fa858003f80 2023-10-16T12:59:45.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.261+0000 7fa86dffb700 1 -- 172.21.15.124:0/351981601 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86400eb30 con 0x7fa858003f80 2023-10-16T12:59:45.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.261+0000 7fa875953700 1 -- 172.21.15.124:0/351981601 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa858003f80 msgr2=0x7fa858004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:45.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.261+0000 7fa875953700 1 --2- 172.21.15.124:0/351981601 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa858003f80 0x7fa858004850 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa864009b30 tx=0x7fa858005880 comp rx=0 tx=0).stop 2023-10-16T12:59:45.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.261+0000 7fa86f7fe700 1 -- 172.21.15.124:0/351981601 reap_dead start 2023-10-16T12:59:45.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.261+0000 7fa875953700 1 -- 172.21.15.124:0/351981601 shutdown_connections 2023-10-16T12:59:45.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.261+0000 7fa875953700 1 -- 172.21.15.124:0/351981601 >> 172.21.15.124:0/351981601 conn(0x7fa8700cbb50 msgr2=0x7fa8700cbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:45.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.261+0000 7fa875953700 1 -- 172.21.15.124:0/351981601 shutdown_connections 2023-10-16T12:59:45.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.261+0000 7fa875953700 1 -- 172.21.15.124:0/351981601 wait complete. 2023-10-16T12:59:45.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.263+0000 7fa875953700 1 Processor -- start 2023-10-16T12:59:45.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.263+0000 7fa875953700 1 -- start start 2023-10-16T12:59:45.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.263+0000 7fa875953700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa858003f80 0x7fa87015c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:45.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.264+0000 7fa875953700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8700a84b0 0x7fa8700afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:45.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.264+0000 7fa875953700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa8700affe0 0x7fa8701f52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:45.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.264+0000 7fa875953700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa870154fe0 con 0x7fa8700affe0 2023-10-16T12:59:45.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.264+0000 7fa875953700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8701552c0 con 0x7fa8700a84b0 2023-10-16T12:59:45.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.264+0000 7fa875953700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8701555a0 con 0x7fa858003f80 2023-10-16T12:59:45.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.264+0000 7fa86f7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa8700affe0 0x7fa8701f52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:45.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.264+0000 7fa86f7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa8700affe0 0x7fa8701f52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54910/0 (socket says 172.21.15.124:54910) 2023-10-16T12:59:45.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.264+0000 7fa86f7fe700 1 -- 172.21.15.124:0/3642666555 learned_addr learned my addr 172.21.15.124:0/3642666555 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:45.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.264+0000 7fa86e7fc700 1 --2- 172.21.15.124:0/3642666555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8700a84b0 0x7fa8700afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:45.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.264+0000 7fa86effd700 1 --2- 172.21.15.124:0/3642666555 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa858003f80 0x7fa87015c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:45.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.264+0000 7fa86f7fe700 1 -- 172.21.15.124:0/3642666555 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa858003f80 msgr2=0x7fa87015c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:45.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.264+0000 7fa86f7fe700 1 --2- 172.21.15.124:0/3642666555 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa858003f80 0x7fa87015c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.264+0000 7fa86f7fe700 1 -- 172.21.15.124:0/3642666555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8700a84b0 msgr2=0x7fa8700afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:45.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.264+0000 7fa86f7fe700 1 --2- 172.21.15.124:0/3642666555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8700a84b0 0x7fa8700afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.264+0000 7fa86f7fe700 1 -- 172.21.15.124:0/3642666555 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa870155880 con 0x7fa8700affe0 2023-10-16T12:59:45.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.264+0000 7fa86f7fe700 1 --2- 172.21.15.124:0/3642666555 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa8700affe0 0x7fa8701f52a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa868000f80 tx=0x7fa86800e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:45.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.264+0000 7fa857fff700 1 -- 172.21.15.124:0/3642666555 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86800ec10 con 0x7fa8700affe0 2023-10-16T12:59:45.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.264+0000 7fa857fff700 1 -- 172.21.15.124:0/3642666555 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86800ed70 con 0x7fa8700affe0 2023-10-16T12:59:45.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.264+0000 7fa875953700 1 -- 172.21.15.124:0/3642666555 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa870155b60 con 0x7fa8700affe0 2023-10-16T12:59:45.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.264+0000 7fa857fff700 1 -- 172.21.15.124:0/3642666555 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86800eee0 con 0x7fa8700affe0 2023-10-16T12:59:45.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.264+0000 7fa875953700 1 -- 172.21.15.124:0/3642666555 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87015caf0 con 0x7fa8700affe0 2023-10-16T12:59:45.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.265+0000 7fa875953700 1 -- 172.21.15.124:0/3642666555 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa87015cd40 con 0x7fa8700affe0 2023-10-16T12:59:45.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.266+0000 7fa857fff700 1 -- 172.21.15.124:0/3642666555 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa868013660 con 0x7fa8700affe0 2023-10-16T12:59:45.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.266+0000 7fa857fff700 1 --2- 172.21.15.124:0/3642666555 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa85c06af00 0x7fa85c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:45.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.266+0000 7fa857fff700 1 -- 172.21.15.124:0/3642666555 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7fa868089eb0 con 0x7fa8700affe0 2023-10-16T12:59:45.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.266+0000 7fa86effd700 1 --2- 172.21.15.124:0/3642666555 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa85c06af00 0x7fa85c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:45.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.266+0000 7fa86effd700 1 --2- 172.21.15.124:0/3642666555 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa85c06af00 0x7fa85c06d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa860009b80 tx=0x7fa860009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:45.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.270+0000 7fa857fff700 1 -- 172.21.15.124:0/3642666555 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa868054ba0 con 0x7fa8700affe0 2023-10-16T12:59:45.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.460+0000 7fa875953700 1 -- 172.21.15.124:0/3642666555 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa870155d50 con 0x7fa8700affe0 2023-10-16T12:59:45.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.460+0000 7fa857fff700 1 -- 172.21.15.124:0/3642666555 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa8680581c0 con 0x7fa8700affe0 2023-10-16T12:59:45.463 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:45.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.462+0000 7fa875953700 1 -- 172.21.15.124:0/3642666555 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa85c06af00 msgr2=0x7fa85c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:45.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.462+0000 7fa875953700 1 --2- 172.21.15.124:0/3642666555 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa85c06af00 0x7fa85c06d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa860009b80 tx=0x7fa860009210 comp rx=0 tx=0).stop 2023-10-16T12:59:45.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.462+0000 7fa875953700 1 -- 172.21.15.124:0/3642666555 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa8700affe0 msgr2=0x7fa8701f52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:45.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.462+0000 7fa875953700 1 --2- 172.21.15.124:0/3642666555 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa8700affe0 0x7fa8701f52a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa868000f80 tx=0x7fa86800e440 comp rx=0 tx=0).stop 2023-10-16T12:59:45.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.462+0000 7fa875953700 1 -- 172.21.15.124:0/3642666555 shutdown_connections 2023-10-16T12:59:45.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.462+0000 7fa875953700 1 --2- 172.21.15.124:0/3642666555 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa85c06af00 0x7fa85c06d3c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.462+0000 7fa875953700 1 --2- 172.21.15.124:0/3642666555 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa8700affe0 0x7fa8701f52a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.462+0000 7fa875953700 1 --2- 172.21.15.124:0/3642666555 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa858003f80 0x7fa87015c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.467 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.462+0000 7fa875953700 1 --2- 172.21.15.124:0/3642666555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8700a84b0 0x7fa8700afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.467 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.462+0000 7fa875953700 1 -- 172.21.15.124:0/3642666555 >> 172.21.15.124:0/3642666555 conn(0x7fa8700cbb50 msgr2=0x7fa870158790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:45.467 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.462+0000 7fa875953700 1 -- 172.21.15.124:0/3642666555 shutdown_connections 2023-10-16T12:59:45.467 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.462+0000 7fa875953700 1 -- 172.21.15.124:0/3642666555 wait complete. 2023-10-16T12:59:45.477 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T12:59:45.600 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.597+0000 7f11a125f700 1 Processor -- start 2023-10-16T12:59:45.601 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.598+0000 7f11a125f700 1 -- start start 2023-10-16T12:59:45.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f11a125f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f119c06a820 0x7f119c06ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:45.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f11a125f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f119c0717b0 0x7f119c071c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:45.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f11a125f700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119c0cad30 con 0x7f119c072170 2023-10-16T12:59:45.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f11a125f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f119c0ca7b0 con 0x7f119c06a820 2023-10-16T12:59:45.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f11a125f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119c0cb1c0 con 0x7f119c0717b0 2023-10-16T12:59:45.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f119b59e700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f119c072170 0x7f119c15ed30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43586/0 (socket says 172.21.15.124:43586) 2023-10-16T12:59:45.608 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f119b59e700 1 -- 172.21.15.124:0/3625423388 learned_addr learned my addr 172.21.15.124:0/3625423388 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:45.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f119a59c700 1 --2- 172.21.15.124:0/3625423388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f119c0717b0 0x7f119c071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:45.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f119ad9d700 1 --2- 172.21.15.124:0/3625423388 >> v2:172.21.15.192:3300/0 conn(0x7f119c06a820 0x7f119c06ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:45.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f1199d9b700 1 -- 172.21.15.124:0/3625423388 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4290838313 0 0) 0x7f119c0cad30 con 0x7f119c072170 2023-10-16T12:59:45.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f1199d9b700 1 -- 172.21.15.124:0/3625423388 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11840035b0 con 0x7f119c072170 2023-10-16T12:59:45.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f1199d9b700 1 -- 172.21.15.124:0/3625423388 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2450906306 0 0) 0x7f11840035b0 con 0x7f119c072170 2023-10-16T12:59:45.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f1199d9b700 1 -- 172.21.15.124:0/3625423388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f119c0717b0 msgr2=0x7f119c071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:45.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f1199d9b700 1 --2- 172.21.15.124:0/3625423388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f119c0717b0 0x7f119c071c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f1199d9b700 1 -- 172.21.15.124:0/3625423388 >> v2:172.21.15.192:3300/0 conn(0x7f119c06a820 msgr2=0x7f119c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:45.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f1199d9b700 1 --2- 172.21.15.124:0/3625423388 >> v2:172.21.15.192:3300/0 conn(0x7f119c06a820 0x7f119c06ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f1199d9b700 1 -- 172.21.15.124:0/3625423388 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c072600 con 0x7f119c072170 2023-10-16T12:59:45.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f1199d9b700 1 -- 172.21.15.124:0/3625423388 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f11940019f0 con 0x7f119c072170 2023-10-16T12:59:45.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f119ad9d700 1 --2- 172.21.15.124:0/3625423388 >> v2:172.21.15.192:3300/0 conn(0x7f119c06a820 0x7f119c06ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:59:45.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f1199d9b700 1 -- 172.21.15.124:0/3625423388 >> v1:172.21.15.124:6789/0 conn(0x7f119c072170 legacy=0x7f119c15ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:45.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f1199d9b700 1 --2- 172.21.15.124:0/3625423388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1184003a00 0x7f1184003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:45.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f1199d9b700 1 --2- 172.21.15.124:0/3625423388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f119c0717b0 0x7f1184004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:45.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f1199d9b700 1 --2- 172.21.15.124:0/3625423388 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1184004d90 0x7f1184005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:45.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f1199d9b700 1 -- 172.21.15.124:0/3625423388 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c0ca7b0 con 0x7f1184004d90 2023-10-16T12:59:45.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f1199d9b700 1 -- 172.21.15.124:0/3625423388 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c0cb1c0 con 0x7f1184003a00 2023-10-16T12:59:45.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.599+0000 7f1199d9b700 1 -- 172.21.15.124:0/3625423388 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118400ba10 con 0x7f119c0717b0 2023-10-16T12:59:45.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.600+0000 7f119b59e700 1 --2- 172.21.15.124:0/3625423388 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1184004d90 0x7f1184005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:45.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.600+0000 7f119ad9d700 1 --2- 172.21.15.124:0/3625423388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1184003a00 0x7f1184003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:45.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.600+0000 7f119a59c700 1 --2- 172.21.15.124:0/3625423388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f119c0717b0 0x7f1184004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:45.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.600+0000 7f119b59e700 1 -- 172.21.15.124:0/3625423388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f119c0717b0 msgr2=0x7f1184004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:45.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.600+0000 7f119b59e700 1 --2- 172.21.15.124:0/3625423388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f119c0717b0 0x7f1184004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.600+0000 7f119b59e700 1 -- 172.21.15.124:0/3625423388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1184003a00 msgr2=0x7f1184003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:45.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.600+0000 7f119b59e700 1 --2- 172.21.15.124:0/3625423388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1184003a00 0x7f1184003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.600+0000 7f119b59e700 1 -- 172.21.15.124:0/3625423388 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11840035b0 con 0x7f1184004d90 2023-10-16T12:59:45.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.600+0000 7f119b59e700 1 --2- 172.21.15.124:0/3625423388 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1184004d90 0x7f1184005210 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f119400a8d0 tx=0x7f1184005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c1d1d7f8688868 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:45.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.600+0000 7f1199d9b700 1 -- 172.21.15.124:0/3625423388 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119400a340 con 0x7f1184004d90 2023-10-16T12:59:45.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.600+0000 7f1199d9b700 1 -- 172.21.15.124:0/3625423388 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1194012600 con 0x7f1184004d90 2023-10-16T12:59:45.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.600+0000 7f1199d9b700 1 -- 172.21.15.124:0/3625423388 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11940129b0 con 0x7f1184004d90 2023-10-16T12:59:45.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.601+0000 7f11a125f700 1 -- 172.21.15.124:0/3625423388 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1184004d90 msgr2=0x7f1184005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:45.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.601+0000 7f11a125f700 1 --2- 172.21.15.124:0/3625423388 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1184004d90 0x7f1184005210 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f119400a8d0 tx=0x7f1184005880 comp rx=0 tx=0).stop 2023-10-16T12:59:45.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.601+0000 7f119b59e700 1 -- 172.21.15.124:0/3625423388 reap_dead start 2023-10-16T12:59:45.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.601+0000 7f11a125f700 1 -- 172.21.15.124:0/3625423388 shutdown_connections 2023-10-16T12:59:45.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.601+0000 7f11a125f700 1 -- 172.21.15.124:0/3625423388 >> 172.21.15.124:0/3625423388 conn(0x7f119c0ccbe0 msgr2=0x7f119c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:45.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.601+0000 7f11a125f700 1 -- 172.21.15.124:0/3625423388 shutdown_connections 2023-10-16T12:59:45.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.601+0000 7f11a125f700 1 -- 172.21.15.124:0/3625423388 wait complete. 2023-10-16T12:59:45.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.602+0000 7f11a125f700 1 Processor -- start 2023-10-16T12:59:45.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.602+0000 7f11a125f700 1 -- start start 2023-10-16T12:59:45.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.603+0000 7f11a125f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f119c1f3df0 0x7f119c0a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:45.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.603+0000 7f11a125f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f119c1f0610 0x7f119c157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:45.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.603+0000 7f11a125f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f119c1f41d0 0x7f119c157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:45.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.603+0000 7f11a125f700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c0a96f0 con 0x7f119c1f41d0 2023-10-16T12:59:45.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.603+0000 7f11a125f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c15bb60 con 0x7f119c1f0610 2023-10-16T12:59:45.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.603+0000 7f11a125f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119c15be40 con 0x7f119c1f3df0 2023-10-16T12:59:45.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.603+0000 7f119b59e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f119c1f41d0 0x7f119c157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:45.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.603+0000 7f119b59e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f119c1f41d0 0x7f119c157580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54930/0 (socket says 172.21.15.124:54930) 2023-10-16T12:59:45.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.603+0000 7f119b59e700 1 -- 172.21.15.124:0/345160058 learned_addr learned my addr 172.21.15.124:0/345160058 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:45.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.603+0000 7f119ad9d700 1 --2- 172.21.15.124:0/345160058 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f119c1f3df0 0x7f119c0a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:45.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.603+0000 7f119a59c700 1 --2- 172.21.15.124:0/345160058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f119c1f0610 0x7f119c157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:45.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.603+0000 7f119b59e700 1 -- 172.21.15.124:0/345160058 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f119c1f3df0 msgr2=0x7f119c0a8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:45.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.603+0000 7f119b59e700 1 --2- 172.21.15.124:0/345160058 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f119c1f3df0 0x7f119c0a8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.603+0000 7f119b59e700 1 -- 172.21.15.124:0/345160058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f119c1f0610 msgr2=0x7f119c157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:45.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.603+0000 7f119b59e700 1 --2- 172.21.15.124:0/345160058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f119c1f0610 0x7f119c157040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.603+0000 7f119b59e700 1 -- 172.21.15.124:0/345160058 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c15c120 con 0x7f119c1f41d0 2023-10-16T12:59:45.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.603+0000 7f119b59e700 1 --2- 172.21.15.124:0/345160058 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f119c1f41d0 0x7f119c157580 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1194015040 tx=0x7f1194001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:45.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.604+0000 7f11837fe700 1 -- 172.21.15.124:0/345160058 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119400a340 con 0x7f119c1f41d0 2023-10-16T12:59:45.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.604+0000 7f11837fe700 1 -- 172.21.15.124:0/345160058 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11940019c0 con 0x7f119c1f41d0 2023-10-16T12:59:45.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.604+0000 7f11837fe700 1 -- 172.21.15.124:0/345160058 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1194027410 con 0x7f119c1f41d0 2023-10-16T12:59:45.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.604+0000 7f11a125f700 1 -- 172.21.15.124:0/345160058 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119c0a93d0 con 0x7f119c1f41d0 2023-10-16T12:59:45.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.604+0000 7f11a125f700 1 -- 172.21.15.124:0/345160058 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f119c1f4720 con 0x7f119c1f41d0 2023-10-16T12:59:45.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.605+0000 7f11a125f700 1 -- 172.21.15.124:0/345160058 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119c04ebb0 con 0x7f119c1f41d0 2023-10-16T12:59:45.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.605+0000 7f11837fe700 1 -- 172.21.15.124:0/345160058 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1194019070 con 0x7f119c1f41d0 2023-10-16T12:59:45.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.605+0000 7f11837fe700 1 --2- 172.21.15.124:0/345160058 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f118806af00 0x7f118806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:45.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.606+0000 7f119ad9d700 1 --2- 172.21.15.124:0/345160058 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f118806af00 0x7f118806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:45.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.606+0000 7f11837fe700 1 -- 172.21.15.124:0/345160058 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f119408ad50 con 0x7f119c1f41d0 2023-10-16T12:59:45.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.606+0000 7f119ad9d700 1 --2- 172.21.15.124:0/345160058 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f118806af00 0x7f118806d3c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1190009470 tx=0x7f1190009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:45.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.610+0000 7f11837fe700 1 -- 172.21.15.124:0/345160058 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1194055af0 con 0x7f119c1f41d0 2023-10-16T12:59:45.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.800+0000 7f11a125f700 1 -- 172.21.15.124:0/345160058 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f119c0c9580 con 0x7f119c1f41d0 2023-10-16T12:59:45.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.801+0000 7f11837fe700 1 -- 172.21.15.124:0/345160058 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1194059110 con 0x7f119c1f41d0 2023-10-16T12:59:45.804 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2023-10-16T12:59:45.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.803+0000 7f11a125f700 1 -- 172.21.15.124:0/345160058 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f118806af00 msgr2=0x7f118806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:45.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.803+0000 7f11a125f700 1 --2- 172.21.15.124:0/345160058 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f118806af00 0x7f118806d3c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1190009470 tx=0x7f1190009210 comp rx=0 tx=0).stop 2023-10-16T12:59:45.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.803+0000 7f11a125f700 1 -- 172.21.15.124:0/345160058 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f119c1f41d0 msgr2=0x7f119c157580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:45.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.803+0000 7f11a125f700 1 --2- 172.21.15.124:0/345160058 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f119c1f41d0 0x7f119c157580 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1194015040 tx=0x7f1194001360 comp rx=0 tx=0).stop 2023-10-16T12:59:45.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.803+0000 7f11a125f700 1 -- 172.21.15.124:0/345160058 shutdown_connections 2023-10-16T12:59:45.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.803+0000 7f11a125f700 1 --2- 172.21.15.124:0/345160058 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f118806af00 0x7f118806d3c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.803+0000 7f11a125f700 1 --2- 172.21.15.124:0/345160058 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f119c1f41d0 0x7f119c157580 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.803+0000 7f11a125f700 1 --2- 172.21.15.124:0/345160058 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f119c1f3df0 0x7f119c0a8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.803+0000 7f11a125f700 1 --2- 172.21.15.124:0/345160058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f119c1f0610 0x7f119c157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.803+0000 7f11a125f700 1 -- 172.21.15.124:0/345160058 >> 172.21.15.124:0/345160058 conn(0x7f119c0ccbe0 msgr2=0x7f119c0b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:45.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.803+0000 7f11a125f700 1 -- 172.21.15.124:0/345160058 shutdown_connections 2023-10-16T12:59:45.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.803+0000 7f11a125f700 1 -- 172.21.15.124:0/345160058 wait complete. 2023-10-16T12:59:45.817 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T12:59:45.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.938+0000 7fe37dc8a700 1 Processor -- start 2023-10-16T12:59:45.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.938+0000 7fe37dc8a700 1 -- start start 2023-10-16T12:59:45.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.939+0000 7fe37dc8a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe37806b370 0x7fe37815dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:45.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.939+0000 7fe37dc8a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe3780cdd30 0x7fe3780ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:45.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.939+0000 7fe37dc8a700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3780ce6d0 con 0x7fe37806a820 2023-10-16T12:59:45.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.939+0000 7fe37dc8a700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe378161360 con 0x7fe3780cdd30 2023-10-16T12:59:45.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.939+0000 7fe37dc8a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37806b750 con 0x7fe37806b370 2023-10-16T12:59:45.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.939+0000 7fe377fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe3780cdd30 0x7fe3780ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:45.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.939+0000 7fe376ffd700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fe37806a820 0x7fe37806d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43602/0 (socket says 172.21.15.124:43602) 2023-10-16T12:59:45.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.939+0000 7fe377fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe3780cdd30 0x7fe3780ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54938/0 (socket says 172.21.15.124:54938) 2023-10-16T12:59:45.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.939+0000 7fe376ffd700 1 -- 172.21.15.124:0/1548278884 learned_addr learned my addr 172.21.15.124:0/1548278884 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:45.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.939+0000 7fe3777fe700 1 --2- 172.21.15.124:0/1548278884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe37806b370 0x7fe37815dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:45.945 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.939+0000 7fe377fff700 1 -- 172.21.15.124:0/1548278884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe37806b370 msgr2=0x7fe37815dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:45.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.939+0000 7fe377fff700 1 --2- 172.21.15.124:0/1548278884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe37806b370 0x7fe37815dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.939+0000 7fe377fff700 1 -- 172.21.15.124:0/1548278884 >> v1:172.21.15.124:6789/0 conn(0x7fe37806a820 legacy=0x7fe37806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:45.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.939+0000 7fe377fff700 1 -- 172.21.15.124:0/1548278884 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37806dcc0 con 0x7fe3780cdd30 2023-10-16T12:59:45.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.939+0000 7fe3767fc700 1 -- 172.21.15.124:0/1548278884 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2484401449 0 0) 0x7fe3780ce6d0 con 0x7fe37806a820 2023-10-16T12:59:45.946 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.940+0000 7fe377fff700 1 --2- 172.21.15.124:0/1548278884 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe3780cdd30 0x7fe3780ce190 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe370009d90 tx=0x7fe37000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d643ee35b28be9e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:45.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.940+0000 7fe3767fc700 1 -- 172.21.15.124:0/1548278884 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37000e070 con 0x7fe3780cdd30 2023-10-16T12:59:45.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.940+0000 7fe3767fc700 1 -- 172.21.15.124:0/1548278884 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37000bbd0 con 0x7fe3780cdd30 2023-10-16T12:59:45.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.940+0000 7fe3767fc700 1 -- 172.21.15.124:0/1548278884 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe370012430 con 0x7fe3780cdd30 2023-10-16T12:59:45.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.940+0000 7fe37dc8a700 1 -- 172.21.15.124:0/1548278884 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe3780cdd30 msgr2=0x7fe3780ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:45.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.940+0000 7fe37dc8a700 1 --2- 172.21.15.124:0/1548278884 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe3780cdd30 0x7fe3780ce190 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe370009d90 tx=0x7fe37000b330 comp rx=0 tx=0).stop 2023-10-16T12:59:45.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.940+0000 7fe37dc8a700 1 -- 172.21.15.124:0/1548278884 shutdown_connections 2023-10-16T12:59:45.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.940+0000 7fe37dc8a700 1 --2- 172.21.15.124:0/1548278884 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe3780cdd30 0x7fe3780ce190 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.940+0000 7fe37dc8a700 1 --2- 172.21.15.124:0/1548278884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe37806b370 0x7fe37815dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.940+0000 7fe37dc8a700 1 -- 172.21.15.124:0/1548278884 >> 172.21.15.124:0/1548278884 conn(0x7fe3780ccbe0 msgr2=0x7fe3780ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:45.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.940+0000 7fe37dc8a700 1 -- 172.21.15.124:0/1548278884 shutdown_connections 2023-10-16T12:59:45.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.940+0000 7fe37dc8a700 1 -- 172.21.15.124:0/1548278884 wait complete. 2023-10-16T12:59:45.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.942+0000 7fe37dc8a700 1 Processor -- start 2023-10-16T12:59:45.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.942+0000 7fe37dc8a700 1 -- start start 2023-10-16T12:59:45.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.942+0000 7fe37dc8a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe37806a820 0x7fe378149500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:45.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.942+0000 7fe37dc8a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe37806b370 0x7fe3780ad140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:45.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.943+0000 7fe37dc8a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3780cdd30 0x7fe3780ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:45.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.943+0000 7fe37dc8a700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe378155910 con 0x7fe37806a820 2023-10-16T12:59:45.953 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.943+0000 7fe37dc8a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3781e7e70 con 0x7fe3780cdd30 2023-10-16T12:59:45.953 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.943+0000 7fe37dc8a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3781e70b0 con 0x7fe37806b370 2023-10-16T12:59:45.953 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.943+0000 7fe3777fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe37806a820 0x7fe378149500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:45.953 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.943+0000 7fe3777fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe37806a820 0x7fe378149500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54940/0 (socket says 172.21.15.124:54940) 2023-10-16T12:59:45.953 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.943+0000 7fe3777fe700 1 -- 172.21.15.124:0/889298681 learned_addr learned my addr 172.21.15.124:0/889298681 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:45.954 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.943+0000 7fe376ffd700 1 --2- 172.21.15.124:0/889298681 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe37806b370 0x7fe3780ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:45.954 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.943+0000 7fe377fff700 1 --2- 172.21.15.124:0/889298681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3780cdd30 0x7fe3780ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:45.954 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.943+0000 7fe3777fe700 1 -- 172.21.15.124:0/889298681 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe37806b370 msgr2=0x7fe3780ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:45.954 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.943+0000 7fe3777fe700 1 --2- 172.21.15.124:0/889298681 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe37806b370 0x7fe3780ad140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.954 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.943+0000 7fe3777fe700 1 -- 172.21.15.124:0/889298681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3780cdd30 msgr2=0x7fe3780ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:45.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.943+0000 7fe3777fe700 1 --2- 172.21.15.124:0/889298681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3780cdd30 0x7fe3780ad680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:45.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.943+0000 7fe3777fe700 1 -- 172.21.15.124:0/889298681 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe370009a70 con 0x7fe37806a820 2023-10-16T12:59:45.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.943+0000 7fe377fff700 1 --2- 172.21.15.124:0/889298681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3780cdd30 0x7fe3780ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:45.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.943+0000 7fe3777fe700 1 --2- 172.21.15.124:0/889298681 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe37806a820 0x7fe378149500 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00e840 tx=0x7fe36c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:45.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.943+0000 7fe35ffff700 1 -- 172.21.15.124:0/889298681 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c013610 con 0x7fe37806a820 2023-10-16T12:59:45.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.943+0000 7fe35ffff700 1 -- 172.21.15.124:0/889298681 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36c013770 con 0x7fe37806a820 2023-10-16T12:59:45.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.943+0000 7fe35ffff700 1 -- 172.21.15.124:0/889298681 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c013b20 con 0x7fe37806a820 2023-10-16T12:59:45.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.943+0000 7fe37dc8a700 1 -- 172.21.15.124:0/889298681 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3781e7390 con 0x7fe37806a820 2023-10-16T12:59:45.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.943+0000 7fe37dc8a700 1 -- 172.21.15.124:0/889298681 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3781e7950 con 0x7fe37806a820 2023-10-16T12:59:45.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.944+0000 7fe37dc8a700 1 -- 172.21.15.124:0/889298681 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe378072d10 con 0x7fe37806a820 2023-10-16T12:59:45.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.945+0000 7fe35ffff700 1 -- 172.21.15.124:0/889298681 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe36c013c80 con 0x7fe37806a820 2023-10-16T12:59:45.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.945+0000 7fe35ffff700 1 --2- 172.21.15.124:0/889298681 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe36406af00 0x7fe36406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:45.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.945+0000 7fe35ffff700 1 -- 172.21.15.124:0/889298681 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7fe36c0895e0 con 0x7fe37806a820 2023-10-16T12:59:45.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.945+0000 7fe376ffd700 1 --2- 172.21.15.124:0/889298681 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe36406af00 0x7fe36406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:45.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.945+0000 7fe376ffd700 1 --2- 172.21.15.124:0/889298681 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe36406af00 0x7fe36406d3c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe378155db0 tx=0x7fe368007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:45.958 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:45.949+0000 7fe35ffff700 1 -- 172.21.15.124:0/889298681 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe36c0542e0 con 0x7fe37806a820 2023-10-16T12:59:46.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.142+0000 7fe37dc8a700 1 -- 172.21.15.124:0/889298681 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe3780cdb50 con 0x7fe37806a820 2023-10-16T12:59:46.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.142+0000 7fe35ffff700 1 -- 172.21.15.124:0/889298681 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe36c057900 con 0x7fe37806a820 2023-10-16T12:59:46.145 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:46.147 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.144+0000 7fe37dc8a700 1 -- 172.21.15.124:0/889298681 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe36406af00 msgr2=0x7fe36406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:46.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.144+0000 7fe37dc8a700 1 --2- 172.21.15.124:0/889298681 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe36406af00 0x7fe36406d3c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe378155db0 tx=0x7fe368007e70 comp rx=0 tx=0).stop 2023-10-16T12:59:46.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.144+0000 7fe37dc8a700 1 -- 172.21.15.124:0/889298681 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe37806a820 msgr2=0x7fe378149500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:46.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.144+0000 7fe37dc8a700 1 --2- 172.21.15.124:0/889298681 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe37806a820 0x7fe378149500 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00e840 tx=0x7fe36c00eb50 comp rx=0 tx=0).stop 2023-10-16T12:59:46.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.144+0000 7fe37dc8a700 1 -- 172.21.15.124:0/889298681 shutdown_connections 2023-10-16T12:59:46.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.144+0000 7fe37dc8a700 1 --2- 172.21.15.124:0/889298681 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe36406af00 0x7fe36406d3c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:46.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.144+0000 7fe37dc8a700 1 --2- 172.21.15.124:0/889298681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3780cdd30 0x7fe3780ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:46.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.144+0000 7fe37dc8a700 1 --2- 172.21.15.124:0/889298681 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe37806a820 0x7fe378149500 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:46.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.144+0000 7fe37dc8a700 1 --2- 172.21.15.124:0/889298681 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe37806b370 0x7fe3780ad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:46.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.144+0000 7fe37dc8a700 1 -- 172.21.15.124:0/889298681 >> 172.21.15.124:0/889298681 conn(0x7fe3780ccbe0 msgr2=0x7fe37815eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:46.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.145+0000 7fe37dc8a700 1 -- 172.21.15.124:0/889298681 shutdown_connections 2023-10-16T12:59:46.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.145+0000 7fe37dc8a700 1 -- 172.21.15.124:0/889298681 wait complete. 2023-10-16T12:59:46.159 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T12:59:46.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.277+0000 7fd39c9ee700 1 Processor -- start 2023-10-16T12:59:46.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.277+0000 7fd39c9ee700 1 -- start start 2023-10-16T12:59:46.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.278+0000 7fd39c9ee700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd39806a820 0x7fd3980cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:46.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.278+0000 7fd39c9ee700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd39815e7f0 0x7fd39806ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:46.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.278+0000 7fd39c9ee700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3980cfeb0 con 0x7fd3980ca7d0 2023-10-16T12:59:46.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.278+0000 7fd39c9ee700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3980ce410 con 0x7fd39815e7f0 2023-10-16T12:59:46.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.278+0000 7fd39c9ee700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39815ec70 con 0x7fd39806a820 2023-10-16T12:59:46.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.278+0000 7fd395d9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd39815e7f0 0x7fd39806ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:46.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.278+0000 7fd395d9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd39815e7f0 0x7fd39806ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54948/0 (socket says 172.21.15.124:54948) 2023-10-16T12:59:46.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.278+0000 7fd395d9b700 1 -- 172.21.15.124:0/404160392 learned_addr learned my addr 172.21.15.124:0/404160392 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:46.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.278+0000 7fd39659c700 1 --2- 172.21.15.124:0/404160392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd39806a820 0x7fd3980cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:46.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.279+0000 7fd395d9b700 1 -- 172.21.15.124:0/404160392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd39806a820 msgr2=0x7fd3980cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:46.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.279+0000 7fd395d9b700 1 --2- 172.21.15.124:0/404160392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd39806a820 0x7fd3980cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:46.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.279+0000 7fd395d9b700 1 -- 172.21.15.124:0/404160392 >> v1:172.21.15.192:6789/0 conn(0x7fd3980ca7d0 legacy=0x7fd398071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:46.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.279+0000 7fd395d9b700 1 -- 172.21.15.124:0/404160392 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3980af9d0 con 0x7fd39815e7f0 2023-10-16T12:59:46.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.279+0000 7fd395d9b700 1 --2- 172.21.15.124:0/404160392 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd39815e7f0 0x7fd39806ac00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd3880098f0 tx=0x7fd388009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ce1bd425d4e2ab server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:46.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.279+0000 7fd39559a700 1 -- 172.21.15.124:0/404160392 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38800b8a0 con 0x7fd39815e7f0 2023-10-16T12:59:46.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.279+0000 7fd39559a700 1 -- 172.21.15.124:0/404160392 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38800ba00 con 0x7fd39815e7f0 2023-10-16T12:59:46.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.279+0000 7fd39559a700 1 -- 172.21.15.124:0/404160392 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38800bd90 con 0x7fd39815e7f0 2023-10-16T12:59:46.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.279+0000 7fd39c9ee700 1 -- 172.21.15.124:0/404160392 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd39815e7f0 msgr2=0x7fd39806ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:46.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.279+0000 7fd39c9ee700 1 --2- 172.21.15.124:0/404160392 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd39815e7f0 0x7fd39806ac00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd3880098f0 tx=0x7fd388009c00 comp rx=0 tx=0).stop 2023-10-16T12:59:46.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.279+0000 7fd39c9ee700 1 -- 172.21.15.124:0/404160392 shutdown_connections 2023-10-16T12:59:46.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.279+0000 7fd39c9ee700 1 --2- 172.21.15.124:0/404160392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd39806a820 0x7fd3980cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:46.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.279+0000 7fd39c9ee700 1 --2- 172.21.15.124:0/404160392 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd39815e7f0 0x7fd39806ac00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:46.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.279+0000 7fd39c9ee700 1 -- 172.21.15.124:0/404160392 >> 172.21.15.124:0/404160392 conn(0x7fd3980d0180 msgr2=0x7fd3980d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:46.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.280+0000 7fd39c9ee700 1 -- 172.21.15.124:0/404160392 shutdown_connections 2023-10-16T12:59:46.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.280+0000 7fd39c9ee700 1 -- 172.21.15.124:0/404160392 wait complete. 2023-10-16T12:59:46.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.281+0000 7fd39c9ee700 1 Processor -- start 2023-10-16T12:59:46.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.281+0000 7fd39c9ee700 1 -- start start 2023-10-16T12:59:46.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.282+0000 7fd39c9ee700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd39806a820 0x7fd3980c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:46.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.282+0000 7fd39c9ee700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3980ca7d0 0x7fd39815c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:46.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.282+0000 7fd39c9ee700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd39815e7f0 0x7fd3980b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:46.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.282+0000 7fd39c9ee700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980c9560 con 0x7fd39806a820 2023-10-16T12:59:46.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.282+0000 7fd39c9ee700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980c6b30 con 0x7fd3980ca7d0 2023-10-16T12:59:46.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.282+0000 7fd39c9ee700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980c88e0 con 0x7fd39815e7f0 2023-10-16T12:59:46.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.282+0000 7fd39659c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd39806a820 0x7fd3980c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:46.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.282+0000 7fd39659c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd39806a820 0x7fd3980c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54954/0 (socket says 172.21.15.124:54954) 2023-10-16T12:59:46.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.282+0000 7fd39659c700 1 -- 172.21.15.124:0/2114180786 learned_addr learned my addr 172.21.15.124:0/2114180786 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:46.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.282+0000 7fd396d9d700 1 --2- 172.21.15.124:0/2114180786 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd39815e7f0 0x7fd3980b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:46.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.282+0000 7fd395d9b700 1 --2- 172.21.15.124:0/2114180786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3980ca7d0 0x7fd39815c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:46.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.282+0000 7fd39659c700 1 -- 172.21.15.124:0/2114180786 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd39815e7f0 msgr2=0x7fd3980b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:46.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.282+0000 7fd39659c700 1 --2- 172.21.15.124:0/2114180786 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd39815e7f0 0x7fd3980b1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:46.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.282+0000 7fd39659c700 1 -- 172.21.15.124:0/2114180786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3980ca7d0 msgr2=0x7fd39815c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:46.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.282+0000 7fd39659c700 1 --2- 172.21.15.124:0/2114180786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3980ca7d0 0x7fd39815c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:46.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.282+0000 7fd39659c700 1 -- 172.21.15.124:0/2114180786 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd388009550 con 0x7fd39806a820 2023-10-16T12:59:46.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.282+0000 7fd39659c700 1 --2- 172.21.15.124:0/2114180786 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd39806a820 0x7fd3980c65f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00e810 tx=0x7fd38c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:46.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.282+0000 7fd386ffd700 1 -- 172.21.15.124:0/2114180786 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c00c070 con 0x7fd39806a820 2023-10-16T12:59:46.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.282+0000 7fd386ffd700 1 -- 172.21.15.124:0/2114180786 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38c013610 con 0x7fd39806a820 2023-10-16T12:59:46.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.282+0000 7fd39c9ee700 1 -- 172.21.15.124:0/2114180786 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3980c8bc0 con 0x7fd39806a820 2023-10-16T12:59:46.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.282+0000 7fd386ffd700 1 -- 172.21.15.124:0/2114180786 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c0139c0 con 0x7fd39806a820 2023-10-16T12:59:46.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.282+0000 7fd39c9ee700 1 -- 172.21.15.124:0/2114180786 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3980c9180 con 0x7fd39806a820 2023-10-16T12:59:46.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.283+0000 7fd39c9ee700 1 -- 172.21.15.124:0/2114180786 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39804ebb0 con 0x7fd39806a820 2023-10-16T12:59:46.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.284+0000 7fd386ffd700 1 -- 172.21.15.124:0/2114180786 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd38c013b20 con 0x7fd39806a820 2023-10-16T12:59:46.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.284+0000 7fd386ffd700 1 --2- 172.21.15.124:0/2114180786 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd37806af00 0x7fd37806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:46.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.284+0000 7fd386ffd700 1 -- 172.21.15.124:0/2114180786 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7fd38c0893d0 con 0x7fd39806a820 2023-10-16T12:59:46.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.284+0000 7fd395d9b700 1 --2- 172.21.15.124:0/2114180786 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd37806af00 0x7fd37806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:46.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.284+0000 7fd395d9b700 1 --2- 172.21.15.124:0/2114180786 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd37806af00 0x7fd37806d3c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd388014040 tx=0x7fd388008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:46.296 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.288+0000 7fd386ffd700 1 -- 172.21.15.124:0/2114180786 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd38c054150 con 0x7fd39806a820 2023-10-16T12:59:46.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.493+0000 7fd39c9ee700 1 -- 172.21.15.124:0/2114180786 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd39806b490 con 0x7fd39806a820 2023-10-16T12:59:46.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.493+0000 7fd386ffd700 1 -- 172.21.15.124:0/2114180786 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd38c057770 con 0x7fd39806a820 2023-10-16T12:59:46.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.495+0000 7fd39c9ee700 1 -- 172.21.15.124:0/2114180786 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd37806af00 msgr2=0x7fd37806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:46.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.495+0000 7fd39c9ee700 1 --2- 172.21.15.124:0/2114180786 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd37806af00 0x7fd37806d3c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd388014040 tx=0x7fd388008030 comp rx=0 tx=0).stop 2023-10-16T12:59:46.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.495+0000 7fd39c9ee700 1 -- 172.21.15.124:0/2114180786 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd39806a820 msgr2=0x7fd3980c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:46.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.495+0000 7fd39c9ee700 1 --2- 172.21.15.124:0/2114180786 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd39806a820 0x7fd3980c65f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00e810 tx=0x7fd38c00eb20 comp rx=0 tx=0).stop 2023-10-16T12:59:46.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.495+0000 7fd39c9ee700 1 -- 172.21.15.124:0/2114180786 shutdown_connections 2023-10-16T12:59:46.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.495+0000 7fd39c9ee700 1 --2- 172.21.15.124:0/2114180786 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd37806af00 0x7fd37806d3c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:46.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.495+0000 7fd39c9ee700 1 --2- 172.21.15.124:0/2114180786 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd39815e7f0 0x7fd3980b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:46.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.495+0000 7fd39c9ee700 1 --2- 172.21.15.124:0/2114180786 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd39806a820 0x7fd3980c65f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:46.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.495+0000 7fd39c9ee700 1 --2- 172.21.15.124:0/2114180786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3980ca7d0 0x7fd39815c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:46.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.495+0000 7fd39c9ee700 1 -- 172.21.15.124:0/2114180786 >> 172.21.15.124:0/2114180786 conn(0x7fd3980d0180 msgr2=0x7fd39806d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:46.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.495+0000 7fd39c9ee700 1 -- 172.21.15.124:0/2114180786 shutdown_connections 2023-10-16T12:59:46.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.495+0000 7fd39c9ee700 1 -- 172.21.15.124:0/2114180786 wait complete. 2023-10-16T12:59:46.502 INFO:teuthology.orchestra.run.smithi124.stderr:listed 0 entries 2023-10-16T12:59:46.510 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-16T12:59:46.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:46.511 DEBUG:teuthology.orchestra.run.smithi124:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-16T12:59:46.555 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi124.front.sepia.ceph.com 2023-10-16T12:59:46.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:46.556 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-16T12:59:46.573 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:59:46.574 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:59:46.597 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:59:46.597 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:59:46.656 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T12:59:46.657 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:59:46.717 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:59:46.838 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.836+0000 7f6d1e1dc700 1 Processor -- start 2023-10-16T12:59:46.839 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.836+0000 7f6d1e1dc700 1 -- start start 2023-10-16T12:59:46.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.836+0000 7f6d1e1dc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d180ce4e0 0x7f6d180cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:46.844 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.836+0000 7f6d1e1dc700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d180cc060 con 0x7f6d180cef20 2023-10-16T12:59:46.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.836+0000 7f6d1e1dc700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d180cda20 con 0x7f6d181523b0 2023-10-16T12:59:46.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.836+0000 7f6d1e1dc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d180cdd00 con 0x7f6d180ce4e0 2023-10-16T12:59:46.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.837+0000 7f6d17fff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f6d180cef20 0x7f6d180d0460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43634/0 (socket says 172.21.15.124:43634) 2023-10-16T12:59:46.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.837+0000 7f6d17fff700 1 -- 172.21.15.124:0/3406008246 learned_addr learned my addr 172.21.15.124:0/3406008246 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:46.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.837+0000 7f6d167fc700 1 -- 172.21.15.124:0/3406008246 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257652111 0 0) 0x7f6d180cc060 con 0x7f6d180cef20 2023-10-16T12:59:46.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.837+0000 7f6d16ffd700 1 --2- 172.21.15.124:0/3406008246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d180ce4e0 0x7f6d180cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:46.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.837+0000 7f6d167fc700 1 -- 172.21.15.124:0/3406008246 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d040035b0 con 0x7f6d180cef20 2023-10-16T12:59:46.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.837+0000 7f6d167fc700 1 -- 172.21.15.124:0/3406008246 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3377577956 0 0) 0x7f6d040035b0 con 0x7f6d180cef20 2023-10-16T12:59:46.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.837+0000 7f6d167fc700 1 -- 172.21.15.124:0/3406008246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d180ce4e0 msgr2=0x7f6d180cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:46.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.837+0000 7f6d167fc700 1 --2- 172.21.15.124:0/3406008246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d180ce4e0 0x7f6d180cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:46.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.837+0000 7f6d167fc700 1 -- 172.21.15.124:0/3406008246 >> v1:172.21.15.192:6789/0 conn(0x7f6d181523b0 legacy=0x7f6d1815c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:46.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.837+0000 7f6d167fc700 1 -- 172.21.15.124:0/3406008246 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d180cdfe0 con 0x7f6d180cef20 2023-10-16T12:59:46.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.837+0000 7f6d167fc700 1 -- 172.21.15.124:0/3406008246 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f6d10001a40 con 0x7f6d180cef20 2023-10-16T12:59:46.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.837+0000 7f6d167fc700 1 -- 172.21.15.124:0/3406008246 >> v1:172.21.15.124:6789/0 conn(0x7f6d180cef20 legacy=0x7f6d180d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:46.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.837+0000 7f6d167fc700 1 --2- 172.21.15.124:0/3406008246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d04003a30 0x7f6d04003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:46.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.837+0000 7f6d167fc700 1 --2- 172.21.15.124:0/3406008246 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d04004850 0x7f6d04004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:46.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.837+0000 7f6d167fc700 1 --2- 172.21.15.124:0/3406008246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d180ce4e0 0x7f6d04005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:46.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.837+0000 7f6d167fc700 1 -- 172.21.15.124:0/3406008246 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d180cdd00 con 0x7f6d04004850 2023-10-16T12:59:46.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.837+0000 7f6d167fc700 1 -- 172.21.15.124:0/3406008246 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0400bac0 con 0x7f6d04003a30 2023-10-16T12:59:46.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.837+0000 7f6d167fc700 1 -- 172.21.15.124:0/3406008246 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0400bc80 con 0x7f6d180ce4e0 2023-10-16T12:59:46.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.837+0000 7f6d16ffd700 1 --2- 172.21.15.124:0/3406008246 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d04004850 0x7f6d04004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:46.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.837+0000 7f6d17fff700 1 --2- 172.21.15.124:0/3406008246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d180ce4e0 0x7f6d04005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:46.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.837+0000 7f6d177fe700 1 --2- 172.21.15.124:0/3406008246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d04003a30 0x7f6d04003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:46.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.837+0000 7f6d16ffd700 1 -- 172.21.15.124:0/3406008246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d180ce4e0 msgr2=0x7f6d04005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:46.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.837+0000 7f6d16ffd700 1 --2- 172.21.15.124:0/3406008246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d180ce4e0 0x7f6d04005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:46.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.838+0000 7f6d16ffd700 1 -- 172.21.15.124:0/3406008246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d04003a30 msgr2=0x7f6d04003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:46.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.838+0000 7f6d16ffd700 1 --2- 172.21.15.124:0/3406008246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d04003a30 0x7f6d04003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:46.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.838+0000 7f6d16ffd700 1 -- 172.21.15.124:0/3406008246 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d040035b0 con 0x7f6d04004850 2023-10-16T12:59:46.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.838+0000 7f6d17fff700 1 --2- 172.21.15.124:0/3406008246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d180ce4e0 0x7f6d04005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:46.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.838+0000 7f6d16ffd700 1 --2- 172.21.15.124:0/3406008246 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d04004850 0x7f6d04004cd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6d180ce8f0 tx=0x7f6d04005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d027d50b8d8bddd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:46.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.838+0000 7f6d167fc700 1 -- 172.21.15.124:0/3406008246 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0800e6c0 con 0x7f6d04004850 2023-10-16T12:59:46.852 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.838+0000 7f6d167fc700 1 -- 172.21.15.124:0/3406008246 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0800e820 con 0x7f6d04004850 2023-10-16T12:59:46.852 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.838+0000 7f6d167fc700 1 -- 172.21.15.124:0/3406008246 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0800ebb0 con 0x7f6d04004850 2023-10-16T12:59:46.852 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.838+0000 7f6d1e1dc700 1 -- 172.21.15.124:0/3406008246 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d04004850 msgr2=0x7f6d04004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:46.852 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.838+0000 7f6d1e1dc700 1 --2- 172.21.15.124:0/3406008246 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d04004850 0x7f6d04004cd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6d180ce8f0 tx=0x7f6d04005880 comp rx=0 tx=0).stop 2023-10-16T12:59:46.852 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.838+0000 7f6d17fff700 1 -- 172.21.15.124:0/3406008246 reap_dead start 2023-10-16T12:59:46.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.838+0000 7f6d1e1dc700 1 -- 172.21.15.124:0/3406008246 shutdown_connections 2023-10-16T12:59:46.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.838+0000 7f6d1e1dc700 1 -- 172.21.15.124:0/3406008246 >> 172.21.15.124:0/3406008246 conn(0x7f6d18070460 msgr2=0x7f6d18070840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:46.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.838+0000 7f6d1e1dc700 1 -- 172.21.15.124:0/3406008246 shutdown_connections 2023-10-16T12:59:46.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.838+0000 7f6d1e1dc700 1 -- 172.21.15.124:0/3406008246 wait complete. 2023-10-16T12:59:46.853 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.839+0000 7f6d1e1dc700 1 Processor -- start 2023-10-16T12:59:46.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.840+0000 7f6d1e1dc700 1 -- start start 2023-10-16T12:59:46.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.840+0000 7f6d1e1dc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d04004850 0x7f6d180c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:46.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.840+0000 7f6d1e1dc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d180c9120 0x7f6d181517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:46.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.840+0000 7f6d1e1dc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d1806cab0 0x7f6d180c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:46.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.841+0000 7f6d1e1dc700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d180c8260 con 0x7f6d04004850 2023-10-16T12:59:46.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.841+0000 7f6d1e1dc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1806c340 con 0x7f6d1806cab0 2023-10-16T12:59:46.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.841+0000 7f6d1e1dc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d180c4e80 con 0x7f6d180c9120 2023-10-16T12:59:46.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.841+0000 7f6d177fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d04004850 0x7f6d180c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:46.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.841+0000 7f6d177fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d04004850 0x7f6d180c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54974/0 (socket says 172.21.15.124:54974) 2023-10-16T12:59:46.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.841+0000 7f6d177fe700 1 -- 172.21.15.124:0/3936293520 learned_addr learned my addr 172.21.15.124:0/3936293520 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:46.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.841+0000 7f6d16ffd700 1 --2- 172.21.15.124:0/3936293520 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d180c9120 0x7f6d181517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:46.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.841+0000 7f6d17fff700 1 --2- 172.21.15.124:0/3936293520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d1806cab0 0x7f6d180c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:46.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.841+0000 7f6d177fe700 1 -- 172.21.15.124:0/3936293520 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d180c9120 msgr2=0x7f6d181517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:46.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.841+0000 7f6d177fe700 1 --2- 172.21.15.124:0/3936293520 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d180c9120 0x7f6d181517f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:46.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.841+0000 7f6d177fe700 1 -- 172.21.15.124:0/3936293520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d1806cab0 msgr2=0x7f6d180c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:46.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.841+0000 7f6d177fe700 1 --2- 172.21.15.124:0/3936293520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d1806cab0 0x7f6d180c98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:46.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.841+0000 7f6d177fe700 1 -- 172.21.15.124:0/3936293520 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d180c5d10 con 0x7f6d04004850 2023-10-16T12:59:46.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.841+0000 7f6d177fe700 1 --2- 172.21.15.124:0/3936293520 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d04004850 0x7f6d180c57d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000e7b0 tx=0x7f6d0000eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:46.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.841+0000 7f6d0ffff700 1 -- 172.21.15.124:0/3936293520 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d000052e0 con 0x7f6d04004850 2023-10-16T12:59:46.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.841+0000 7f6d0ffff700 1 -- 172.21.15.124:0/3936293520 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d00005440 con 0x7f6d04004850 2023-10-16T12:59:46.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.841+0000 7f6d0ffff700 1 -- 172.21.15.124:0/3936293520 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d000038a0 con 0x7f6d04004850 2023-10-16T12:59:46.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.841+0000 7f6d1e1dc700 1 -- 172.21.15.124:0/3936293520 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d180c5120 con 0x7f6d04004850 2023-10-16T12:59:46.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.841+0000 7f6d1e1dc700 1 -- 172.21.15.124:0/3936293520 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d1806c590 con 0x7f6d04004850 2023-10-16T12:59:46.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.842+0000 7f6d1e1dc700 1 -- 172.21.15.124:0/3936293520 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d1806c7b0 con 0x7f6d04004850 2023-10-16T12:59:46.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.843+0000 7f6d0ffff700 1 -- 172.21.15.124:0/3936293520 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6d00003a00 con 0x7f6d04004850 2023-10-16T12:59:46.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.843+0000 7f6d0ffff700 1 --2- 172.21.15.124:0/3936293520 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6cf806af00 0x7f6cf806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:46.860 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.843+0000 7f6d0ffff700 1 -- 172.21.15.124:0/3936293520 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f6d00088ea0 con 0x7f6d04004850 2023-10-16T12:59:46.860 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.843+0000 7f6d16ffd700 1 --2- 172.21.15.124:0/3936293520 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6cf806af00 0x7f6cf806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:46.860 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.844+0000 7f6d16ffd700 1 --2- 172.21.15.124:0/3936293520 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6cf806af00 0x7f6cf806d3c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6d080090b0 tx=0x7f6d0801f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:46.860 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:46.848+0000 7f6d0ffff700 1 -- 172.21.15.124:0/3936293520 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6d00053cd0 con 0x7f6d04004850 2023-10-16T12:59:47.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.038+0000 7f6d1e1dc700 1 -- 172.21.15.124:0/3936293520 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d1804ebb0 con 0x7f6d04004850 2023-10-16T12:59:47.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.039+0000 7f6d0ffff700 1 -- 172.21.15.124:0/3936293520 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18751 (secure 0 0 0) 0x7f6d00019020 con 0x7f6d04004850 2023-10-16T12:59:47.042 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:47.042 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":26,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:59:34.463212+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2},{"from":7,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:59:47.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.041+0000 7f6d1e1dc700 1 -- 172.21.15.124:0/3936293520 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6cf806af00 msgr2=0x7f6cf806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:47.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.041+0000 7f6d1e1dc700 1 --2- 172.21.15.124:0/3936293520 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6cf806af00 0x7f6cf806d3c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6d080090b0 tx=0x7f6d0801f040 comp rx=0 tx=0).stop 2023-10-16T12:59:47.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.041+0000 7f6d1e1dc700 1 -- 172.21.15.124:0/3936293520 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d04004850 msgr2=0x7f6d180c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:47.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.041+0000 7f6d1e1dc700 1 --2- 172.21.15.124:0/3936293520 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d04004850 0x7f6d180c57d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000e7b0 tx=0x7f6d0000eac0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.041+0000 7f6d1e1dc700 1 -- 172.21.15.124:0/3936293520 shutdown_connections 2023-10-16T12:59:47.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.041+0000 7f6d1e1dc700 1 --2- 172.21.15.124:0/3936293520 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6cf806af00 0x7f6cf806d3c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.041+0000 7f6d1e1dc700 1 --2- 172.21.15.124:0/3936293520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d1806cab0 0x7f6d180c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.046 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.041+0000 7f6d1e1dc700 1 --2- 172.21.15.124:0/3936293520 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6d04004850 0x7f6d180c57d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.046 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.041+0000 7f6d1e1dc700 1 --2- 172.21.15.124:0/3936293520 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d180c9120 0x7f6d181517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.046 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.041+0000 7f6d1e1dc700 1 -- 172.21.15.124:0/3936293520 >> 172.21.15.124:0/3936293520 conn(0x7f6d18070460 msgr2=0x7f6d18070840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:47.046 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.041+0000 7f6d1e1dc700 1 -- 172.21.15.124:0/3936293520 shutdown_connections 2023-10-16T12:59:47.046 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.041+0000 7f6d1e1dc700 1 -- 172.21.15.124:0/3936293520 wait complete. 2023-10-16T12:59:47.056 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T12:58:38.667813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T12:58:49.562073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T12:58:50.011419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T12:58:53.692890+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T12:59:47.057 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T12:59:47.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.178+0000 7f705a4cc700 1 Processor -- start 2023-10-16T12:59:47.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.178+0000 7f705a4cc700 1 -- start start 2023-10-16T12:59:47.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.179+0000 7f705a4cc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f705406b370 0x7f705415dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:47.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.179+0000 7f705a4cc700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f70540cdd30 0x7f70540ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:47.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.179+0000 7f705a4cc700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70540ce6d0 con 0x7f705406a820 2023-10-16T12:59:47.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.179+0000 7f705a4cc700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7054161360 con 0x7f70540cdd30 2023-10-16T12:59:47.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.179+0000 7f705a4cc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705406b750 con 0x7f705406b370 2023-10-16T12:59:47.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.179+0000 7f7058a69700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f70540cdd30 0x7f70540ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:47.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.179+0000 7f70537fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f705406a820 0x7f705406d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43650/0 (socket says 172.21.15.124:43650) 2023-10-16T12:59:47.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.179+0000 7f70537fe700 1 -- 172.21.15.124:0/3599677020 learned_addr learned my addr 172.21.15.124:0/3599677020 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:47.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.179+0000 7f7053fff700 1 --2- 172.21.15.124:0/3599677020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f705406b370 0x7f705415dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:47.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.179+0000 7f7058a69700 1 -- 172.21.15.124:0/3599677020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f705406b370 msgr2=0x7f705415dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:47.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.179+0000 7f7058a69700 1 --2- 172.21.15.124:0/3599677020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f705406b370 0x7f705415dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.179+0000 7f7058a69700 1 -- 172.21.15.124:0/3599677020 >> v1:172.21.15.124:6789/0 conn(0x7f705406a820 legacy=0x7f705406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:47.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.179+0000 7f7058a69700 1 -- 172.21.15.124:0/3599677020 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705406dcc0 con 0x7f70540cdd30 2023-10-16T12:59:47.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.179+0000 7f7052ffd700 1 -- 172.21.15.124:0/3599677020 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629773538 0 0) 0x7f70540ce6d0 con 0x7f705406a820 2023-10-16T12:59:47.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.180+0000 7f7058a69700 1 --2- 172.21.15.124:0/3599677020 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f70540cdd30 0x7f70540ce190 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f704c009d90 tx=0x7f704c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc9b4ea5be2720c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:47.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.180+0000 7f7052ffd700 1 -- 172.21.15.124:0/3599677020 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c00e070 con 0x7f70540cdd30 2023-10-16T12:59:47.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.180+0000 7f7052ffd700 1 -- 172.21.15.124:0/3599677020 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704c00bbd0 con 0x7f70540cdd30 2023-10-16T12:59:47.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.180+0000 7f7052ffd700 1 -- 172.21.15.124:0/3599677020 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c012430 con 0x7f70540cdd30 2023-10-16T12:59:47.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.180+0000 7f705a4cc700 1 -- 172.21.15.124:0/3599677020 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f70540cdd30 msgr2=0x7f70540ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:47.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.180+0000 7f705a4cc700 1 --2- 172.21.15.124:0/3599677020 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f70540cdd30 0x7f70540ce190 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f704c009d90 tx=0x7f704c00b330 comp rx=0 tx=0).stop 2023-10-16T12:59:47.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.180+0000 7f705a4cc700 1 -- 172.21.15.124:0/3599677020 shutdown_connections 2023-10-16T12:59:47.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.180+0000 7f705a4cc700 1 --2- 172.21.15.124:0/3599677020 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f70540cdd30 0x7f70540ce190 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.180+0000 7f705a4cc700 1 --2- 172.21.15.124:0/3599677020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f705406b370 0x7f705415dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.180+0000 7f705a4cc700 1 -- 172.21.15.124:0/3599677020 >> 172.21.15.124:0/3599677020 conn(0x7f70540ccbe0 msgr2=0x7f70540ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:47.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.180+0000 7f705a4cc700 1 -- 172.21.15.124:0/3599677020 shutdown_connections 2023-10-16T12:59:47.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.180+0000 7f705a4cc700 1 -- 172.21.15.124:0/3599677020 wait complete. 2023-10-16T12:59:47.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.181+0000 7f705a4cc700 1 Processor -- start 2023-10-16T12:59:47.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.182+0000 7f705a4cc700 1 -- start start 2023-10-16T12:59:47.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.182+0000 7f705a4cc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f705406a820 0x7f7054149500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:47.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.182+0000 7f705a4cc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f705406b370 0x7f70540ad140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:47.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.182+0000 7f705a4cc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70540cdd30 0x7f70540ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:47.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.182+0000 7f705a4cc700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7054155910 con 0x7f705406a820 2023-10-16T12:59:47.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.182+0000 7f705a4cc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70541e7e70 con 0x7f705406b370 2023-10-16T12:59:47.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.182+0000 7f705a4cc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70541e70b0 con 0x7f70540cdd30 2023-10-16T12:59:47.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.182+0000 7f7053fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f705406a820 0x7f7054149500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:47.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.182+0000 7f7053fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f705406a820 0x7f7054149500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54988/0 (socket says 172.21.15.124:54988) 2023-10-16T12:59:47.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.182+0000 7f7053fff700 1 -- 172.21.15.124:0/918893652 learned_addr learned my addr 172.21.15.124:0/918893652 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:47.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.183+0000 7f7058a69700 1 --2- 172.21.15.124:0/918893652 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70540cdd30 0x7f70540ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:47.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.183+0000 7f70537fe700 1 --2- 172.21.15.124:0/918893652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f705406b370 0x7f70540ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:47.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.183+0000 7f7053fff700 1 -- 172.21.15.124:0/918893652 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70540cdd30 msgr2=0x7f70540ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:47.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.183+0000 7f7053fff700 1 --2- 172.21.15.124:0/918893652 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70540cdd30 0x7f70540ad680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.183+0000 7f7053fff700 1 -- 172.21.15.124:0/918893652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f705406b370 msgr2=0x7f70540ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:47.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.183+0000 7f7053fff700 1 --2- 172.21.15.124:0/918893652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f705406b370 0x7f70540ad140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.183+0000 7f7053fff700 1 -- 172.21.15.124:0/918893652 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704c009a70 con 0x7f705406a820 2023-10-16T12:59:47.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.183+0000 7f7053fff700 1 --2- 172.21.15.124:0/918893652 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f705406a820 0x7f7054149500 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f704800e840 tx=0x7f704800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:47.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.183+0000 7f7050ff9700 1 -- 172.21.15.124:0/918893652 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7048013610 con 0x7f705406a820 2023-10-16T12:59:47.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.183+0000 7f7050ff9700 1 -- 172.21.15.124:0/918893652 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7048013770 con 0x7f705406a820 2023-10-16T12:59:47.197 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.183+0000 7f705a4cc700 1 -- 172.21.15.124:0/918893652 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70541e7390 con 0x7f705406a820 2023-10-16T12:59:47.197 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.183+0000 7f7050ff9700 1 -- 172.21.15.124:0/918893652 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7048013b20 con 0x7f705406a820 2023-10-16T12:59:47.197 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.183+0000 7f705a4cc700 1 -- 172.21.15.124:0/918893652 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70541e7950 con 0x7f705406a820 2023-10-16T12:59:47.197 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.184+0000 7f705a4cc700 1 -- 172.21.15.124:0/918893652 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7054072d10 con 0x7f705406a820 2023-10-16T12:59:47.197 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.184+0000 7f7050ff9700 1 -- 172.21.15.124:0/918893652 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7048013c80 con 0x7f705406a820 2023-10-16T12:59:47.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.185+0000 7f7050ff9700 1 --2- 172.21.15.124:0/918893652 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f704006af00 0x7f704006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:47.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.185+0000 7f7050ff9700 1 -- 172.21.15.124:0/918893652 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f7048089610 con 0x7f705406a820 2023-10-16T12:59:47.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.185+0000 7f70537fe700 1 --2- 172.21.15.124:0/918893652 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f704006af00 0x7f704006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:47.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.185+0000 7f70537fe700 1 --2- 172.21.15.124:0/918893652 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f704006af00 0x7f704006d3c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7054155db0 tx=0x7f7044009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:47.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.189+0000 7f7050ff9700 1 -- 172.21.15.124:0/918893652 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7048054390 con 0x7f705406a820 2023-10-16T12:59:47.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.378+0000 7f705a4cc700 1 -- 172.21.15.124:0/918893652 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f70540cdb50 con 0x7f705406a820 2023-10-16T12:59:47.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.378+0000 7f7050ff9700 1 -- 172.21.15.124:0/918893652 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f70480579b0 con 0x7f705406a820 2023-10-16T12:59:47.381 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-16T12:59:47.383 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.380+0000 7f705a4cc700 1 -- 172.21.15.124:0/918893652 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f704006af00 msgr2=0x7f704006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:47.383 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.380+0000 7f705a4cc700 1 --2- 172.21.15.124:0/918893652 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f704006af00 0x7f704006d3c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7054155db0 tx=0x7f7044009040 comp rx=0 tx=0).stop 2023-10-16T12:59:47.384 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.380+0000 7f705a4cc700 1 -- 172.21.15.124:0/918893652 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f705406a820 msgr2=0x7f7054149500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:47.384 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.380+0000 7f705a4cc700 1 --2- 172.21.15.124:0/918893652 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f705406a820 0x7f7054149500 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f704800e840 tx=0x7f704800ec00 comp rx=0 tx=0).stop 2023-10-16T12:59:47.384 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.380+0000 7f705a4cc700 1 -- 172.21.15.124:0/918893652 shutdown_connections 2023-10-16T12:59:47.384 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.380+0000 7f705a4cc700 1 --2- 172.21.15.124:0/918893652 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f704006af00 0x7f704006d3c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.380+0000 7f705a4cc700 1 --2- 172.21.15.124:0/918893652 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70540cdd30 0x7f70540ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.380+0000 7f705a4cc700 1 --2- 172.21.15.124:0/918893652 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f705406a820 0x7f7054149500 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.380+0000 7f705a4cc700 1 --2- 172.21.15.124:0/918893652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f705406b370 0x7f70540ad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.380+0000 7f705a4cc700 1 -- 172.21.15.124:0/918893652 >> 172.21.15.124:0/918893652 conn(0x7f70540ccbe0 msgr2=0x7f705415eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:47.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.381+0000 7f705a4cc700 1 -- 172.21.15.124:0/918893652 shutdown_connections 2023-10-16T12:59:47.386 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.381+0000 7f705a4cc700 1 -- 172.21.15.124:0/918893652 wait complete. 2023-10-16T12:59:47.395 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T12:59:47.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.518+0000 7f2103e91700 1 Processor -- start 2023-10-16T12:59:47.521 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.518+0000 7f2103e91700 1 -- start start 2023-10-16T12:59:47.522 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.519+0000 7f2103e91700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20fc06fd90 0x7f20fc06eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:47.523 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.519+0000 7f2103e91700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f20fc071840 0x7f20fc06a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:47.523 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.519+0000 7f2103e91700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f20fc06ad60 0x7f20fc1613e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:47.523 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.519+0000 7f2103e91700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20fc15eb20 con 0x7f20fc071840 2023-10-16T12:59:47.523 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.519+0000 7f2103e91700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20fc06b180 con 0x7f20fc06ad60 2023-10-16T12:59:47.523 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.519+0000 7f2103e91700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc070170 con 0x7f20fc06fd90 2023-10-16T12:59:47.524 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.519+0000 7f210142c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f20fc071840 0x7f20fc06a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:47.524 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.519+0000 7f210142c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f20fc071840 0x7f20fc06a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:54998/0 (socket says 172.21.15.124:54998) 2023-10-16T12:59:47.524 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.519+0000 7f210142c700 1 -- 172.21.15.124:0/1781268752 learned_addr learned my addr 172.21.15.124:0/1781268752 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:47.524 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.519+0000 7f2101c2d700 1 --2- 172.21.15.124:0/1781268752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20fc06fd90 0x7f20fc06eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:47.524 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.519+0000 7f210242e700 1 --2- 172.21.15.124:0/1781268752 >> v2:172.21.15.192:3300/0 conn(0x7f20fc06ad60 0x7f20fc1613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:47.525 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.519+0000 7f210142c700 1 -- 172.21.15.124:0/1781268752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20fc06fd90 msgr2=0x7f20fc06eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:47.525 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.519+0000 7f210142c700 1 --2- 172.21.15.124:0/1781268752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20fc06fd90 0x7f20fc06eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.525 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.519+0000 7f210142c700 1 -- 172.21.15.124:0/1781268752 >> v2:172.21.15.192:3300/0 conn(0x7f20fc06ad60 msgr2=0x7f20fc1613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:47.525 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.519+0000 7f210142c700 1 --2- 172.21.15.124:0/1781268752 >> v2:172.21.15.192:3300/0 conn(0x7f20fc06ad60 0x7f20fc1613e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.526 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.519+0000 7f210142c700 1 -- 172.21.15.124:0/1781268752 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20fc15df10 con 0x7f20fc071840 2023-10-16T12:59:47.526 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.519+0000 7f210242e700 1 --2- 172.21.15.124:0/1781268752 >> v2:172.21.15.192:3300/0 conn(0x7f20fc06ad60 0x7f20fc1613e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:47.526 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.519+0000 7f210142c700 1 --2- 172.21.15.124:0/1781268752 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20fc071840 0x7f20fc06a820 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f20fc06b810 tx=0x7f20ec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff711e98b980936 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:47.529 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.521+0000 7f2100c2b700 1 -- 172.21.15.124:0/1781268752 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec011830 con 0x7f20fc071840 2023-10-16T12:59:47.529 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.521+0000 7f2100c2b700 1 -- 172.21.15.124:0/1781268752 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ec011990 con 0x7f20fc071840 2023-10-16T12:59:47.529 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.521+0000 7f2100c2b700 1 -- 172.21.15.124:0/1781268752 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec011d20 con 0x7f20fc071840 2023-10-16T12:59:47.529 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.521+0000 7f2103e91700 1 -- 172.21.15.124:0/1781268752 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20fc071840 msgr2=0x7f20fc06a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:47.529 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.521+0000 7f2103e91700 1 --2- 172.21.15.124:0/1781268752 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20fc071840 0x7f20fc06a820 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f20fc06b810 tx=0x7f20ec009bd0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.530 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.521+0000 7f2103e91700 1 -- 172.21.15.124:0/1781268752 shutdown_connections 2023-10-16T12:59:47.530 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.521+0000 7f2103e91700 1 --2- 172.21.15.124:0/1781268752 >> v2:172.21.15.192:3300/0 conn(0x7f20fc06ad60 0x7f20fc1613e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.530 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.521+0000 7f2103e91700 1 --2- 172.21.15.124:0/1781268752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20fc06fd90 0x7f20fc06eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.530 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.521+0000 7f2103e91700 1 --2- 172.21.15.124:0/1781268752 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20fc071840 0x7f20fc06a820 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.530 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.521+0000 7f2103e91700 1 -- 172.21.15.124:0/1781268752 >> 172.21.15.124:0/1781268752 conn(0x7f20fc0d0250 msgr2=0x7f20fc0d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:47.531 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.521+0000 7f2103e91700 1 -- 172.21.15.124:0/1781268752 shutdown_connections 2023-10-16T12:59:47.531 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.521+0000 7f2103e91700 1 -- 172.21.15.124:0/1781268752 wait complete. 2023-10-16T12:59:47.531 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.523+0000 7f2103e91700 1 Processor -- start 2023-10-16T12:59:47.531 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.523+0000 7f2103e91700 1 -- start start 2023-10-16T12:59:47.531 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.523+0000 7f2103e91700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20fc06ad60 0x7f20fc1f2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:47.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.523+0000 7f2103e91700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20fc06fd90 0x7f20fc0ce070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:47.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.523+0000 7f2103e91700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20fc071840 0x7f20fc159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:47.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.523+0000 7f2103e91700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc1f7350 con 0x7f20fc06fd90 2023-10-16T12:59:47.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.523+0000 7f2103e91700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc1f67d0 con 0x7f20fc071840 2023-10-16T12:59:47.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.523+0000 7f2103e91700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc1f6ab0 con 0x7f20fc06ad60 2023-10-16T12:59:47.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.523+0000 7f210142c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20fc06fd90 0x7f20fc0ce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:47.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.523+0000 7f210142c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20fc06fd90 0x7f20fc0ce070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55004/0 (socket says 172.21.15.124:55004) 2023-10-16T12:59:47.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.523+0000 7f210142c700 1 -- 172.21.15.124:0/3157782028 learned_addr learned my addr 172.21.15.124:0/3157782028 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:47.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.523+0000 7f210242e700 1 --2- 172.21.15.124:0/3157782028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20fc071840 0x7f20fc159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:47.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.524+0000 7f2101c2d700 1 --2- 172.21.15.124:0/3157782028 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20fc06ad60 0x7f20fc1f2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:47.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.524+0000 7f210142c700 1 -- 172.21.15.124:0/3157782028 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20fc06ad60 msgr2=0x7f20fc1f2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:47.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.524+0000 7f210142c700 1 --2- 172.21.15.124:0/3157782028 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20fc06ad60 0x7f20fc1f2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.524+0000 7f210142c700 1 -- 172.21.15.124:0/3157782028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20fc071840 msgr2=0x7f20fc159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:47.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.524+0000 7f210142c700 1 --2- 172.21.15.124:0/3157782028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20fc071840 0x7f20fc159560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.524+0000 7f210142c700 1 -- 172.21.15.124:0/3157782028 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec009550 con 0x7f20fc06fd90 2023-10-16T12:59:47.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.524+0000 7f210142c700 1 --2- 172.21.15.124:0/3157782028 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20fc06fd90 0x7f20fc0ce070 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f20ec000c00 tx=0x7f20ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:47.535 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.526+0000 7f20f27fc700 1 -- 172.21.15.124:0/3157782028 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec004240 con 0x7f20fc06fd90 2023-10-16T12:59:47.535 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.526+0000 7f20f27fc700 1 -- 172.21.15.124:0/3157782028 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ec01f070 con 0x7f20fc06fd90 2023-10-16T12:59:47.535 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.526+0000 7f2103e91700 1 -- 172.21.15.124:0/3157782028 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20fc1f6d90 con 0x7f20fc06fd90 2023-10-16T12:59:47.535 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.526+0000 7f20f27fc700 1 -- 172.21.15.124:0/3157782028 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec0036a0 con 0x7f20fc06fd90 2023-10-16T12:59:47.535 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.526+0000 7f2103e91700 1 -- 172.21.15.124:0/3157782028 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20fc1f3320 con 0x7f20fc06fd90 2023-10-16T12:59:47.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.527+0000 7f2103e91700 1 -- 172.21.15.124:0/3157782028 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20fc0c4d00 con 0x7f20fc06fd90 2023-10-16T12:59:47.536 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.527+0000 7f20f27fc700 1 -- 172.21.15.124:0/3157782028 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f20ec021030 con 0x7f20fc06fd90 2023-10-16T12:59:47.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.528+0000 7f20f27fc700 1 --2- 172.21.15.124:0/3157782028 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f20e006af00 0x7f20e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:47.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.528+0000 7f20f27fc700 1 -- 172.21.15.124:0/3157782028 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f20ec08aba0 con 0x7f20fc06fd90 2023-10-16T12:59:47.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.528+0000 7f2101c2d700 1 --2- 172.21.15.124:0/3157782028 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f20e006af00 0x7f20e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:47.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.528+0000 7f2101c2d700 1 --2- 172.21.15.124:0/3157782028 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f20e006af00 0x7f20e006d3c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f20f8009be0 tx=0x7f20f8009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:47.537 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.532+0000 7f20f27fc700 1 -- 172.21.15.124:0/3157782028 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f20fc0c4d00 con 0x7f20fc06fd90 2023-10-16T12:59:47.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.721+0000 7f2103e91700 1 -- 172.21.15.124:0/3157782028 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f20fc0c4d00 con 0x7f20fc06fd90 2023-10-16T12:59:47.724 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.721+0000 7f20f27fc700 1 -- 172.21.15.124:0/3157782028 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f20fc0c4d00 con 0x7f20fc06fd90 2023-10-16T12:59:47.725 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:47.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.724+0000 7f2103e91700 1 -- 172.21.15.124:0/3157782028 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f20e006af00 msgr2=0x7f20e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:47.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.724+0000 7f2103e91700 1 --2- 172.21.15.124:0/3157782028 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f20e006af00 0x7f20e006d3c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f20f8009be0 tx=0x7f20f8009210 comp rx=0 tx=0).stop 2023-10-16T12:59:47.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.724+0000 7f2103e91700 1 -- 172.21.15.124:0/3157782028 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20fc06fd90 msgr2=0x7f20fc0ce070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:47.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.724+0000 7f2103e91700 1 --2- 172.21.15.124:0/3157782028 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20fc06fd90 0x7f20fc0ce070 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f20ec000c00 tx=0x7f20ec004750 comp rx=0 tx=0).stop 2023-10-16T12:59:47.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.724+0000 7f2103e91700 1 -- 172.21.15.124:0/3157782028 shutdown_connections 2023-10-16T12:59:47.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.724+0000 7f2103e91700 1 --2- 172.21.15.124:0/3157782028 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f20e006af00 0x7f20e006d3c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.724+0000 7f2103e91700 1 --2- 172.21.15.124:0/3157782028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20fc071840 0x7f20fc159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.724+0000 7f2103e91700 1 --2- 172.21.15.124:0/3157782028 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20fc06ad60 0x7f20fc1f2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.724+0000 7f2103e91700 1 --2- 172.21.15.124:0/3157782028 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20fc06fd90 0x7f20fc0ce070 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.724+0000 7f2103e91700 1 -- 172.21.15.124:0/3157782028 >> 172.21.15.124:0/3157782028 conn(0x7f20fc0d0250 msgr2=0x7f20fc0b13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:47.729 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.724+0000 7f2103e91700 1 -- 172.21.15.124:0/3157782028 shutdown_connections 2023-10-16T12:59:47.729 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.724+0000 7f2103e91700 1 -- 172.21.15.124:0/3157782028 wait complete. 2023-10-16T12:59:47.738 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T12:59:47.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.859+0000 7f97b56d5700 1 Processor -- start 2023-10-16T12:59:47.862 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.859+0000 7f97b56d5700 1 -- start start 2023-10-16T12:59:47.864 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.860+0000 7f97b56d5700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f97b00b9060 0x7f97b00ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:47.864 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.860+0000 7f97b56d5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97b006b7e0 0x7f97b006bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:47.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.860+0000 7f97b56d5700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b00ce5e0 con 0x7f97b015d760 2023-10-16T12:59:47.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.860+0000 7f97b56d5700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b006c1b0 con 0x7f97b00b9060 2023-10-16T12:59:47.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.860+0000 7f97b56d5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b00cf420 con 0x7f97b006b7e0 2023-10-16T12:59:47.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.860+0000 7f97ae7fc700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f97b00b9060 0x7f97b00ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:47.865 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.860+0000 7f97aeffd700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f97b015d760 0x7f97b00cf8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43678/0 (socket says 172.21.15.124:43678) 2023-10-16T12:59:47.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.860+0000 7f97aeffd700 1 -- 172.21.15.124:0/508222301 learned_addr learned my addr 172.21.15.124:0/508222301 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:47.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.860+0000 7f97af7fe700 1 --2- 172.21.15.124:0/508222301 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97b006b7e0 0x7f97b006bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:47.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.860+0000 7f97ae7fc700 1 -- 172.21.15.124:0/508222301 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97b006b7e0 msgr2=0x7f97b006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:47.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.860+0000 7f97ae7fc700 1 --2- 172.21.15.124:0/508222301 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97b006b7e0 0x7f97b006bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.866 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.860+0000 7f97ae7fc700 1 -- 172.21.15.124:0/508222301 >> v1:172.21.15.124:6789/0 conn(0x7f97b015d760 legacy=0x7f97b00cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:47.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.860+0000 7f97ae7fc700 1 -- 172.21.15.124:0/508222301 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b00b94c0 con 0x7f97b00b9060 2023-10-16T12:59:47.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.860+0000 7f97adffb700 1 -- 172.21.15.124:0/508222301 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519058795 0 0) 0x7f97b00ce5e0 con 0x7f97b015d760 2023-10-16T12:59:47.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.860+0000 7f97ae7fc700 1 --2- 172.21.15.124:0/508222301 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f97b00b9060 0x7f97b00ce0a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f97a0009840 tx=0x7f97a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a2f350839fe1fc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:47.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.860+0000 7f97adffb700 1 -- 172.21.15.124:0/508222301 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a0011830 con 0x7f97b00b9060 2023-10-16T12:59:47.867 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.861+0000 7f97adffb700 1 -- 172.21.15.124:0/508222301 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a0011990 con 0x7f97b00b9060 2023-10-16T12:59:47.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.861+0000 7f97adffb700 1 -- 172.21.15.124:0/508222301 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a0011d20 con 0x7f97b00b9060 2023-10-16T12:59:47.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.861+0000 7f97b56d5700 1 -- 172.21.15.124:0/508222301 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f97b00b9060 msgr2=0x7f97b00ce0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:47.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.861+0000 7f97b56d5700 1 --2- 172.21.15.124:0/508222301 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f97b00b9060 0x7f97b00ce0a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f97a0009840 tx=0x7f97a0009b50 comp rx=0 tx=0).stop 2023-10-16T12:59:47.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.861+0000 7f97b56d5700 1 -- 172.21.15.124:0/508222301 shutdown_connections 2023-10-16T12:59:47.868 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.861+0000 7f97b56d5700 1 --2- 172.21.15.124:0/508222301 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97b006b7e0 0x7f97b006bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.861+0000 7f97b56d5700 1 --2- 172.21.15.124:0/508222301 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f97b00b9060 0x7f97b00ce0a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.861+0000 7f97b56d5700 1 -- 172.21.15.124:0/508222301 >> 172.21.15.124:0/508222301 conn(0x7f97b0072340 msgr2=0x7f97b0072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:47.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.861+0000 7f97b56d5700 1 -- 172.21.15.124:0/508222301 shutdown_connections 2023-10-16T12:59:47.869 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.861+0000 7f97b56d5700 1 -- 172.21.15.124:0/508222301 wait complete. 2023-10-16T12:59:47.872 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.862+0000 7f97b56d5700 1 Processor -- start 2023-10-16T12:59:47.872 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.862+0000 7f97b56d5700 1 -- start start 2023-10-16T12:59:47.872 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.863+0000 7f97b56d5700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f97b006b7e0 0x7f97b00ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:47.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.863+0000 7f97b56d5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97b00b9060 0x7f97b01f70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:47.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.863+0000 7f97b56d5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97b015d760 0x7f97b00b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:47.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.863+0000 7f97b56d5700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b00cd040 con 0x7f97b006b7e0 2023-10-16T12:59:47.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.863+0000 7f97b56d5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b01f75e0 con 0x7f97b015d760 2023-10-16T12:59:47.873 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.863+0000 7f97b56d5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b00b3e00 con 0x7f97b00b9060 2023-10-16T12:59:47.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.863+0000 7f97aeffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f97b006b7e0 0x7f97b00ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:47.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.863+0000 7f97aeffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f97b006b7e0 0x7f97b00ccb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55016/0 (socket says 172.21.15.124:55016) 2023-10-16T12:59:47.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.863+0000 7f97aeffd700 1 -- 172.21.15.124:0/2013809104 learned_addr learned my addr 172.21.15.124:0/2013809104 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:47.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.864+0000 7f97af7fe700 1 --2- 172.21.15.124:0/2013809104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97b015d760 0x7f97b00b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:47.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.864+0000 7f97ae7fc700 1 --2- 172.21.15.124:0/2013809104 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97b00b9060 0x7f97b01f70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:47.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.864+0000 7f97aeffd700 1 -- 172.21.15.124:0/2013809104 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97b00b9060 msgr2=0x7f97b01f70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:47.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.864+0000 7f97aeffd700 1 --2- 172.21.15.124:0/2013809104 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97b00b9060 0x7f97b01f70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.864+0000 7f97aeffd700 1 -- 172.21.15.124:0/2013809104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97b015d760 msgr2=0x7f97b00b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:47.875 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.864+0000 7f97aeffd700 1 --2- 172.21.15.124:0/2013809104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97b015d760 0x7f97b00b4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:47.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.864+0000 7f97aeffd700 1 -- 172.21.15.124:0/2013809104 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a00094a0 con 0x7f97b006b7e0 2023-10-16T12:59:47.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.864+0000 7f97aeffd700 1 --2- 172.21.15.124:0/2013809104 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f97b006b7e0 0x7f97b00ccb00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f97a400c550 tx=0x7f97a400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:47.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.864+0000 7f97977fe700 1 -- 172.21.15.124:0/2013809104 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a4004c80 con 0x7f97b006b7e0 2023-10-16T12:59:47.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.864+0000 7f97977fe700 1 -- 172.21.15.124:0/2013809104 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a4004e00 con 0x7f97b006b7e0 2023-10-16T12:59:47.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.864+0000 7f97977fe700 1 -- 172.21.15.124:0/2013809104 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a4007310 con 0x7f97b006b7e0 2023-10-16T12:59:47.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.864+0000 7f97b56d5700 1 -- 172.21.15.124:0/2013809104 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b00b44e0 con 0x7f97b006b7e0 2023-10-16T12:59:47.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.864+0000 7f97b56d5700 1 -- 172.21.15.124:0/2013809104 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b00b4aa0 con 0x7f97b006b7e0 2023-10-16T12:59:47.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.865+0000 7f97b56d5700 1 -- 172.21.15.124:0/2013809104 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b006bd70 con 0x7f97b006b7e0 2023-10-16T12:59:47.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.865+0000 7f97977fe700 1 -- 172.21.15.124:0/2013809104 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f97a4007470 con 0x7f97b006b7e0 2023-10-16T12:59:47.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.866+0000 7f97977fe700 1 --2- 172.21.15.124:0/2013809104 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f979c06af00 0x7f979c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:47.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.866+0000 7f97977fe700 1 -- 172.21.15.124:0/2013809104 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f97a40896e0 con 0x7f97b006b7e0 2023-10-16T12:59:47.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.866+0000 7f97ae7fc700 1 --2- 172.21.15.124:0/2013809104 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f979c06af00 0x7f979c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:47.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.866+0000 7f97ae7fc700 1 --2- 172.21.15.124:0/2013809104 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f979c06af00 0x7f979c06d3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f97b00b38e0 tx=0x7f97a0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:47.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:47.870+0000 7f97977fe700 1 -- 172.21.15.124:0/2013809104 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f97a40543d0 con 0x7f97b006b7e0 2023-10-16T12:59:48.059 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.057+0000 7f97b56d5700 1 -- 172.21.15.124:0/2013809104 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f97b00b4c90 con 0x7f97b006b7e0 2023-10-16T12:59:48.060 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.057+0000 7f97977fe700 1 -- 172.21.15.124:0/2013809104 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f97a40579f0 con 0x7f97b006b7e0 2023-10-16T12:59:48.060 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2023-10-16T12:59:48.062 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.059+0000 7f97b56d5700 1 -- 172.21.15.124:0/2013809104 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f979c06af00 msgr2=0x7f979c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:48.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.059+0000 7f97b56d5700 1 --2- 172.21.15.124:0/2013809104 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f979c06af00 0x7f979c06d3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f97b00b38e0 tx=0x7f97a0008030 comp rx=0 tx=0).stop 2023-10-16T12:59:48.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.059+0000 7f97b56d5700 1 -- 172.21.15.124:0/2013809104 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f97b006b7e0 msgr2=0x7f97b00ccb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:48.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.059+0000 7f97b56d5700 1 --2- 172.21.15.124:0/2013809104 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f97b006b7e0 0x7f97b00ccb00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f97a400c550 tx=0x7f97a400c910 comp rx=0 tx=0).stop 2023-10-16T12:59:48.063 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.059+0000 7f97b56d5700 1 -- 172.21.15.124:0/2013809104 shutdown_connections 2023-10-16T12:59:48.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.059+0000 7f97b56d5700 1 --2- 172.21.15.124:0/2013809104 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f979c06af00 0x7f979c06d3c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.059+0000 7f97b56d5700 1 --2- 172.21.15.124:0/2013809104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97b015d760 0x7f97b00b4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.059+0000 7f97b56d5700 1 --2- 172.21.15.124:0/2013809104 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f97b006b7e0 0x7f97b00ccb00 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.059+0000 7f97b56d5700 1 --2- 172.21.15.124:0/2013809104 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97b00b9060 0x7f97b01f70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.064 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.059+0000 7f97b56d5700 1 -- 172.21.15.124:0/2013809104 >> 172.21.15.124:0/2013809104 conn(0x7f97b0072340 msgr2=0x7f97b015e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:48.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.059+0000 7f97b56d5700 1 -- 172.21.15.124:0/2013809104 shutdown_connections 2023-10-16T12:59:48.065 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.060+0000 7f97b56d5700 1 -- 172.21.15.124:0/2013809104 wait complete. 2023-10-16T12:59:48.074 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T12:59:48.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.196+0000 7f13ebadc700 1 Processor -- start 2023-10-16T12:59:48.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.196+0000 7f13ebadc700 1 -- start start 2023-10-16T12:59:48.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.197+0000 7f13ebadc700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f13e415b4e0 0x7f13e406f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:48.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.197+0000 7f13ebadc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f13e40cd770 0x7f13e40b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:48.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.197+0000 7f13ebadc700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e40b3670 con 0x7f13e40b3220 2023-10-16T12:59:48.201 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.197+0000 7f13ebadc700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e4070620 con 0x7f13e415b4e0 2023-10-16T12:59:48.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.197+0000 7f13ebadc700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e4070900 con 0x7f13e40cd770 2023-10-16T12:59:48.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.197+0000 7f13e9878700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f13e415b4e0 0x7f13e406f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:48.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.197+0000 7f13ea079700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f13e40b3220 0x7f13e40cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43694/0 (socket says 172.21.15.124:43694) 2023-10-16T12:59:48.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.197+0000 7f13ea079700 1 -- 172.21.15.124:0/2133394258 learned_addr learned my addr 172.21.15.124:0/2133394258 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:48.202 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.197+0000 7f13e9077700 1 --2- 172.21.15.124:0/2133394258 >> v2:172.21.15.192:3300/0 conn(0x7f13e40cd770 0x7f13e40b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:48.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.197+0000 7f13e9878700 1 -- 172.21.15.124:0/2133394258 >> v2:172.21.15.192:3300/0 conn(0x7f13e40cd770 msgr2=0x7f13e40b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:48.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.197+0000 7f13e9878700 1 --2- 172.21.15.124:0/2133394258 >> v2:172.21.15.192:3300/0 conn(0x7f13e40cd770 0x7f13e40b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.197+0000 7f13e9878700 1 -- 172.21.15.124:0/2133394258 >> v1:172.21.15.124:6789/0 conn(0x7f13e40b3220 legacy=0x7f13e40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:48.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.197+0000 7f13e9878700 1 -- 172.21.15.124:0/2133394258 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e4070be0 con 0x7f13e415b4e0 2023-10-16T12:59:48.203 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.197+0000 7f13e8876700 1 -- 172.21.15.124:0/2133394258 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3608709781 0 0) 0x7f13dc001490 con 0x7f13e40b3220 2023-10-16T12:59:48.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.197+0000 7f13e9878700 1 --2- 172.21.15.124:0/2133394258 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13e415b4e0 0x7f13e406f280 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f13e406f7c0 tx=0x7f13e0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67061ae1e7871d40 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:48.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.197+0000 7f13e8876700 1 -- 172.21.15.124:0/2133394258 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e0011830 con 0x7f13e415b4e0 2023-10-16T12:59:48.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.197+0000 7f13e8876700 1 -- 172.21.15.124:0/2133394258 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e0011990 con 0x7f13e415b4e0 2023-10-16T12:59:48.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.197+0000 7f13e8876700 1 -- 172.21.15.124:0/2133394258 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e0011d20 con 0x7f13e415b4e0 2023-10-16T12:59:48.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.198+0000 7f13ebadc700 1 -- 172.21.15.124:0/2133394258 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13e415b4e0 msgr2=0x7f13e406f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:48.204 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.198+0000 7f13ebadc700 1 --2- 172.21.15.124:0/2133394258 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13e415b4e0 0x7f13e406f280 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f13e406f7c0 tx=0x7f13e0009b20 comp rx=0 tx=0).stop 2023-10-16T12:59:48.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.198+0000 7f13ebadc700 1 -- 172.21.15.124:0/2133394258 shutdown_connections 2023-10-16T12:59:48.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.198+0000 7f13ebadc700 1 --2- 172.21.15.124:0/2133394258 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13e415b4e0 0x7f13e406f280 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.198+0000 7f13ebadc700 1 --2- 172.21.15.124:0/2133394258 >> v2:172.21.15.192:3300/0 conn(0x7f13e40cd770 0x7f13e40b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.198+0000 7f13ebadc700 1 -- 172.21.15.124:0/2133394258 >> 172.21.15.124:0/2133394258 conn(0x7f13e40cdce0 msgr2=0x7f13e40ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:48.205 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.198+0000 7f13ebadc700 1 -- 172.21.15.124:0/2133394258 shutdown_connections 2023-10-16T12:59:48.206 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.198+0000 7f13ebadc700 1 -- 172.21.15.124:0/2133394258 wait complete. 2023-10-16T12:59:48.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.199+0000 7f13ebadc700 1 Processor -- start 2023-10-16T12:59:48.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.199+0000 7f13ebadc700 1 -- start start 2023-10-16T12:59:48.208 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.200+0000 7f13ebadc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13e40b3220 0x7f13e41484d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:48.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.200+0000 7f13ebadc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13e40cd770 0x7f13e40c4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:48.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.200+0000 7f13ebadc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13e415b4e0 0x7f13e40c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:48.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.200+0000 7f13ebadc700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e41e3bf0 con 0x7f13e415b4e0 2023-10-16T12:59:48.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.200+0000 7f13ebadc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e4148d00 con 0x7f13e40b3220 2023-10-16T12:59:48.209 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.200+0000 7f13ebadc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e4148fe0 con 0x7f13e40cd770 2023-10-16T12:59:48.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.200+0000 7f13ea079700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13e415b4e0 0x7f13e40c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:48.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.200+0000 7f13ea079700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13e415b4e0 0x7f13e40c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55032/0 (socket says 172.21.15.124:55032) 2023-10-16T12:59:48.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.200+0000 7f13ea079700 1 -- 172.21.15.124:0/2949494272 learned_addr learned my addr 172.21.15.124:0/2949494272 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:48.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.200+0000 7f13e9878700 1 --2- 172.21.15.124:0/2949494272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13e40b3220 0x7f13e41484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:48.210 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.200+0000 7f13e9077700 1 --2- 172.21.15.124:0/2949494272 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13e40cd770 0x7f13e40c4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:48.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.200+0000 7f13ea079700 1 -- 172.21.15.124:0/2949494272 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13e40cd770 msgr2=0x7f13e40c4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:48.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.200+0000 7f13ea079700 1 --2- 172.21.15.124:0/2949494272 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13e40cd770 0x7f13e40c4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.200+0000 7f13ea079700 1 -- 172.21.15.124:0/2949494272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13e40b3220 msgr2=0x7f13e41484d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:48.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.200+0000 7f13ea079700 1 --2- 172.21.15.124:0/2949494272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13e40b3220 0x7f13e41484d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.211 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.201+0000 7f13ea079700 1 -- 172.21.15.124:0/2949494272 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e00094a0 con 0x7f13e415b4e0 2023-10-16T12:59:48.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.201+0000 7f13e9077700 1 --2- 172.21.15.124:0/2949494272 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13e40cd770 0x7f13e40c4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:48.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.201+0000 7f13ea079700 1 --2- 172.21.15.124:0/2949494272 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13e415b4e0 0x7f13e40c6c10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00cca0 tx=0x7f13dc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:48.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.201+0000 7f13da7fc700 1 -- 172.21.15.124:0/2949494272 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc00cea0 con 0x7f13e415b4e0 2023-10-16T12:59:48.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.201+0000 7f13da7fc700 1 -- 172.21.15.124:0/2949494272 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13dc00ada0 con 0x7f13e415b4e0 2023-10-16T12:59:48.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.201+0000 7f13ebadc700 1 -- 172.21.15.124:0/2949494272 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e41492c0 con 0x7f13e415b4e0 2023-10-16T12:59:48.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.201+0000 7f13da7fc700 1 -- 172.21.15.124:0/2949494272 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc007310 con 0x7f13e415b4e0 2023-10-16T12:59:48.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.201+0000 7f13ebadc700 1 -- 172.21.15.124:0/2949494272 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e4146720 con 0x7f13e415b4e0 2023-10-16T12:59:48.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.202+0000 7f13ebadc700 1 -- 172.21.15.124:0/2949494272 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e4146940 con 0x7f13e415b4e0 2023-10-16T12:59:48.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.202+0000 7f13da7fc700 1 -- 172.21.15.124:0/2949494272 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f13dc007470 con 0x7f13e415b4e0 2023-10-16T12:59:48.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.203+0000 7f13da7fc700 1 --2- 172.21.15.124:0/2949494272 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f13c806af00 0x7f13c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:48.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.203+0000 7f13da7fc700 1 -- 172.21.15.124:0/2949494272 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f13dc089760 con 0x7f13e415b4e0 2023-10-16T12:59:48.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.203+0000 7f13e9878700 1 --2- 172.21.15.124:0/2949494272 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f13c806af00 0x7f13c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:48.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.203+0000 7f13e9878700 1 --2- 172.21.15.124:0/2949494272 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f13c806af00 0x7f13c806d3c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f13e00090b0 tx=0x7f13e001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:48.214 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.207+0000 7f13da7fc700 1 -- 172.21.15.124:0/2949494272 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f13dc054450 con 0x7f13e415b4e0 2023-10-16T12:59:48.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.401+0000 7f13ebadc700 1 -- 172.21.15.124:0/2949494272 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f13e40b3670 con 0x7f13e415b4e0 2023-10-16T12:59:48.404 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.401+0000 7f13da7fc700 1 -- 172.21.15.124:0/2949494272 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f13e40b3670 con 0x7f13e415b4e0 2023-10-16T12:59:48.404 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:48.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.404+0000 7f13ebadc700 1 -- 172.21.15.124:0/2949494272 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f13c806af00 msgr2=0x7f13c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:48.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.404+0000 7f13ebadc700 1 --2- 172.21.15.124:0/2949494272 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f13c806af00 0x7f13c806d3c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f13e00090b0 tx=0x7f13e001c040 comp rx=0 tx=0).stop 2023-10-16T12:59:48.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.404+0000 7f13ebadc700 1 -- 172.21.15.124:0/2949494272 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13e415b4e0 msgr2=0x7f13e40c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:48.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.404+0000 7f13ebadc700 1 --2- 172.21.15.124:0/2949494272 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13e415b4e0 0x7f13e40c6c10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00cca0 tx=0x7f13dc00a340 comp rx=0 tx=0).stop 2023-10-16T12:59:48.407 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.404+0000 7f13ebadc700 1 -- 172.21.15.124:0/2949494272 shutdown_connections 2023-10-16T12:59:48.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.404+0000 7f13ebadc700 1 --2- 172.21.15.124:0/2949494272 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f13c806af00 0x7f13c806d3c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.404+0000 7f13ebadc700 1 --2- 172.21.15.124:0/2949494272 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f13e415b4e0 0x7f13e40c6c10 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.404+0000 7f13ebadc700 1 --2- 172.21.15.124:0/2949494272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13e40b3220 0x7f13e41484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.404+0000 7f13ebadc700 1 --2- 172.21.15.124:0/2949494272 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13e40cd770 0x7f13e40c4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.408 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.404+0000 7f13ebadc700 1 -- 172.21.15.124:0/2949494272 >> 172.21.15.124:0/2949494272 conn(0x7f13e40cdce0 msgr2=0x7f13e40c4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:48.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.404+0000 7f13ebadc700 1 -- 172.21.15.124:0/2949494272 shutdown_connections 2023-10-16T12:59:48.409 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.404+0000 7f13ebadc700 1 -- 172.21.15.124:0/2949494272 wait complete. 2023-10-16T12:59:48.419 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T12:59:48.542 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.539+0000 7f401d524700 1 Processor -- start 2023-10-16T12:59:48.542 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.539+0000 7f401d524700 1 -- start start 2023-10-16T12:59:48.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.540+0000 7f401d524700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f401815b600 0x7f4018164860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:48.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.540+0000 7f401d524700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40180c9d40 con 0x7f40180b1860 2023-10-16T12:59:48.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.540+0000 7f401d524700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40180cd6d0 con 0x7f40180b0c30 2023-10-16T12:59:48.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.540+0000 7f401d524700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40180cd9a0 con 0x7f401815b600 2023-10-16T12:59:48.545 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.540+0000 7f40177fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f401815b600 0x7f4018164860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:48.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.540+0000 7f40167fc700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f40180b1860 0x7f40180ccfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43708/0 (socket says 172.21.15.124:43708) 2023-10-16T12:59:48.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.540+0000 7f40177fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f401815b600 0x7f4018164860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55042/0 (socket says 172.21.15.124:55042) 2023-10-16T12:59:48.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.540+0000 7f40167fc700 1 -- 172.21.15.124:0/3430680552 learned_addr learned my addr 172.21.15.124:0/3430680552 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:48.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.540+0000 7f40177fe700 1 -- 172.21.15.124:0/3430680552 >> v1:172.21.15.192:6789/0 conn(0x7f40180b0c30 legacy=0x7f40180b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:48.546 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.540+0000 7f40177fe700 1 -- 172.21.15.124:0/3430680552 >> v1:172.21.15.124:6789/0 conn(0x7f40180b1860 legacy=0x7f40180ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:48.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.541+0000 7f40177fe700 1 -- 172.21.15.124:0/3430680552 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40180cdc80 con 0x7f401815b600 2023-10-16T12:59:48.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.541+0000 7f4015ffb700 1 -- 172.21.15.124:0/3430680552 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901387228 0 0) 0x7f40180c9d40 con 0x7f40180b1860 2023-10-16T12:59:48.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.541+0000 7f40177fe700 1 --2- 172.21.15.124:0/3430680552 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f401815b600 0x7f4018164860 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4010009d90 tx=0x7f401000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be95e31eca8f54a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:48.547 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.541+0000 7f4015ffb700 1 -- 172.21.15.124:0/3430680552 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401000e070 con 0x7f401815b600 2023-10-16T12:59:48.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.541+0000 7f4015ffb700 1 -- 172.21.15.124:0/3430680552 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401000bbd0 con 0x7f401815b600 2023-10-16T12:59:48.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.541+0000 7f4015ffb700 1 -- 172.21.15.124:0/3430680552 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4010003a20 con 0x7f401815b600 2023-10-16T12:59:48.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.541+0000 7f401d524700 1 -- 172.21.15.124:0/3430680552 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f401815b600 msgr2=0x7f4018164860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:48.548 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.541+0000 7f401d524700 1 --2- 172.21.15.124:0/3430680552 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f401815b600 0x7f4018164860 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4010009d90 tx=0x7f401000b330 comp rx=0 tx=0).stop 2023-10-16T12:59:48.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.541+0000 7f401d524700 1 -- 172.21.15.124:0/3430680552 shutdown_connections 2023-10-16T12:59:48.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.541+0000 7f401d524700 1 --2- 172.21.15.124:0/3430680552 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f401815b600 0x7f4018164860 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.541+0000 7f401d524700 1 -- 172.21.15.124:0/3430680552 >> 172.21.15.124:0/3430680552 conn(0x7f401806c850 msgr2=0x7f401806cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:48.549 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.541+0000 7f401d524700 1 -- 172.21.15.124:0/3430680552 shutdown_connections 2023-10-16T12:59:48.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.541+0000 7f401d524700 1 -- 172.21.15.124:0/3430680552 wait complete. 2023-10-16T12:59:48.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.543+0000 7f401d524700 1 Processor -- start 2023-10-16T12:59:48.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.543+0000 7f401d524700 1 -- start start 2023-10-16T12:59:48.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.544+0000 7f401d524700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40180b0c30 0x7f4018153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:48.552 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.544+0000 7f401d524700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40180b1860 0x7f4018142980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:48.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.544+0000 7f401d524700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f401815b600 0x7f4018140920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:48.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.544+0000 7f401d524700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4018159d40 con 0x7f40180b0c30 2023-10-16T12:59:48.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.544+0000 7f401d524700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40181f3490 con 0x7f401815b600 2023-10-16T12:59:48.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.544+0000 7f401d524700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40181f4010 con 0x7f40180b1860 2023-10-16T12:59:48.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.544+0000 7f4016ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40180b0c30 0x7f4018153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:48.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.544+0000 7f4016ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40180b0c30 0x7f4018153800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55044/0 (socket says 172.21.15.124:55044) 2023-10-16T12:59:48.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.544+0000 7f4016ffd700 1 -- 172.21.15.124:0/1760449451 learned_addr learned my addr 172.21.15.124:0/1760449451 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:48.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.544+0000 7f4016ffd700 1 -- 172.21.15.124:0/1760449451 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40180b1860 msgr2=0x7f4018142980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:48.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.544+0000 7f4016ffd700 1 --2- 172.21.15.124:0/1760449451 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40180b1860 0x7f4018142980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.544+0000 7f4016ffd700 1 -- 172.21.15.124:0/1760449451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f401815b600 msgr2=0x7f4018140920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:48.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.544+0000 7f4016ffd700 1 --2- 172.21.15.124:0/1760449451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f401815b600 0x7f4018140920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.544+0000 7f4016ffd700 1 -- 172.21.15.124:0/1760449451 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4010009a70 con 0x7f40180b0c30 2023-10-16T12:59:48.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.545+0000 7f4016ffd700 1 --2- 172.21.15.124:0/1760449451 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40180b0c30 0x7f4018153800 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f400800e940 tx=0x7f400800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:48.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.545+0000 7f3fff7fe700 1 -- 172.21.15.124:0/1760449451 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40080041d0 con 0x7f40180b0c30 2023-10-16T12:59:48.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.545+0000 7f3fff7fe700 1 -- 172.21.15.124:0/1760449451 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4008004350 con 0x7f40180b0c30 2023-10-16T12:59:48.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.545+0000 7f401d524700 1 -- 172.21.15.124:0/1760449451 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40181f36e0 con 0x7f40180b0c30 2023-10-16T12:59:48.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.545+0000 7f3fff7fe700 1 -- 172.21.15.124:0/1760449451 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40080116b0 con 0x7f40180b0c30 2023-10-16T12:59:48.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.545+0000 7f401d524700 1 -- 172.21.15.124:0/1760449451 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40181f3ca0 con 0x7f40180b0c30 2023-10-16T12:59:48.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.546+0000 7f401d524700 1 -- 172.21.15.124:0/1760449451 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f401804f400 con 0x7f40180b0c30 2023-10-16T12:59:48.556 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.546+0000 7f3fff7fe700 1 -- 172.21.15.124:0/1760449451 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4008011810 con 0x7f40180b0c30 2023-10-16T12:59:48.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.546+0000 7f3fff7fe700 1 --2- 172.21.15.124:0/1760449451 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f400406af00 0x7f400406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:48.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.546+0000 7f3fff7fe700 1 -- 172.21.15.124:0/1760449451 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f400808bdd0 con 0x7f40180b0c30 2023-10-16T12:59:48.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.547+0000 7f40167fc700 1 --2- 172.21.15.124:0/1760449451 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f400406af00 0x7f400406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:48.557 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.547+0000 7f40167fc700 1 --2- 172.21.15.124:0/1760449451 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f400406af00 0x7f400406d3c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f400c0011e0 tx=0x7f400c0079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:48.558 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.551+0000 7f3fff7fe700 1 -- 172.21.15.124:0/1760449451 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4008056b50 con 0x7f40180b0c30 2023-10-16T12:59:48.762 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.759+0000 7f401d524700 1 -- 172.21.15.124:0/1760449451 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f40181f43a0 con 0x7f40180b0c30 2023-10-16T12:59:48.762 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.760+0000 7f3fff7fe700 1 -- 172.21.15.124:0/1760449451 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f400808d020 con 0x7f40180b0c30 2023-10-16T12:59:48.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.762+0000 7f401d524700 1 -- 172.21.15.124:0/1760449451 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f400406af00 msgr2=0x7f400406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:48.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.762+0000 7f401d524700 1 --2- 172.21.15.124:0/1760449451 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f400406af00 0x7f400406d3c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f400c0011e0 tx=0x7f400c0079d0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.762+0000 7f401d524700 1 -- 172.21.15.124:0/1760449451 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40180b0c30 msgr2=0x7f4018153800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:48.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.762+0000 7f401d524700 1 --2- 172.21.15.124:0/1760449451 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40180b0c30 0x7f4018153800 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f400800e940 tx=0x7f400800ed00 comp rx=0 tx=0).stop 2023-10-16T12:59:48.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.762+0000 7f401d524700 1 -- 172.21.15.124:0/1760449451 shutdown_connections 2023-10-16T12:59:48.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.762+0000 7f401d524700 1 --2- 172.21.15.124:0/1760449451 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f400406af00 0x7f400406d3c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.762+0000 7f401d524700 1 --2- 172.21.15.124:0/1760449451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f401815b600 0x7f4018140920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.762+0000 7f401d524700 1 --2- 172.21.15.124:0/1760449451 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40180b0c30 0x7f4018153800 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.762+0000 7f401d524700 1 --2- 172.21.15.124:0/1760449451 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40180b1860 0x7f4018142980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.762+0000 7f401d524700 1 -- 172.21.15.124:0/1760449451 >> 172.21.15.124:0/1760449451 conn(0x7f401806c850 msgr2=0x7f401815a140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:48.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.762+0000 7f401d524700 1 -- 172.21.15.124:0/1760449451 shutdown_connections 2023-10-16T12:59:48.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.762+0000 7f401d524700 1 -- 172.21.15.124:0/1760449451 wait complete. 2023-10-16T12:59:48.768 INFO:teuthology.orchestra.run.smithi124.stderr:listed 0 entries 2023-10-16T12:59:48.776 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-16T12:59:48.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:48.777 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-16T12:59:48.828 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-10-16T12:59:48.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:59:48.829 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-16T12:59:48.847 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-16T12:59:48.848 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T12:59:48.968 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.965+0000 7f90823ef700 1 Processor -- start 2023-10-16T12:59:48.968 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.965+0000 7f90823ef700 1 -- start start 2023-10-16T12:59:48.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.966+0000 7f90823ef700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f907c071850 0x7f907c071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:48.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.966+0000 7f90823ef700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f907c06d100 0x7f907c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:48.971 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.966+0000 7f90823ef700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f907c0721f0 con 0x7f907c15daa0 2023-10-16T12:59:48.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.966+0000 7f90823ef700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f907c15ed10 con 0x7f907c06d100 2023-10-16T12:59:48.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.966+0000 7f90823ef700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907c15de80 con 0x7f907c071850 2023-10-16T12:59:48.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.966+0000 7f907bfff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f907c15daa0 0x7f907c0af020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43720/0 (socket says 172.21.15.124:43720) 2023-10-16T12:59:48.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.966+0000 7f907bfff700 1 -- 172.21.15.124:0/487054924 learned_addr learned my addr 172.21.15.124:0/487054924 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:48.972 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.966+0000 7f908098c700 1 --2- 172.21.15.124:0/487054924 >> v2:172.21.15.124:3300/0 conn(0x7f907c06d100 0x7f907c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:48.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.966+0000 7f907b7fe700 1 --2- 172.21.15.124:0/487054924 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f907c071850 0x7f907c071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:48.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.966+0000 7f907affd700 1 -- 172.21.15.124:0/487054924 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078806762 0 0) 0x7f907c0721f0 con 0x7f907c15daa0 2023-10-16T12:59:48.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.966+0000 7f907affd700 1 -- 172.21.15.124:0/487054924 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90640035b0 con 0x7f907c15daa0 2023-10-16T12:59:48.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.967+0000 7f908098c700 1 -- 172.21.15.124:0/487054924 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f907c071850 msgr2=0x7f907c071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:48.973 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.967+0000 7f908098c700 1 --2- 172.21.15.124:0/487054924 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f907c071850 0x7f907c071cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.967+0000 7f908098c700 1 -- 172.21.15.124:0/487054924 >> v1:172.21.15.124:6789/0 conn(0x7f907c15daa0 legacy=0x7f907c0af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:48.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.967+0000 7f908098c700 1 -- 172.21.15.124:0/487054924 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907c15e100 con 0x7f907c06d100 2023-10-16T12:59:48.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.967+0000 7f908098c700 1 --2- 172.21.15.124:0/487054924 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f907c06d100 0x7f907c06d570 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9074009d90 tx=0x7f907400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601c9264672d27bc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:48.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.967+0000 7f907affd700 1 -- 172.21.15.124:0/487054924 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907400e070 con 0x7f907c06d100 2023-10-16T12:59:48.974 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.967+0000 7f907affd700 1 -- 172.21.15.124:0/487054924 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907400bb20 con 0x7f907c06d100 2023-10-16T12:59:48.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.967+0000 7f907affd700 1 -- 172.21.15.124:0/487054924 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9074012430 con 0x7f907c06d100 2023-10-16T12:59:48.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.967+0000 7f90823ef700 1 -- 172.21.15.124:0/487054924 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f907c06d100 msgr2=0x7f907c06d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:48.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.967+0000 7f90823ef700 1 --2- 172.21.15.124:0/487054924 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f907c06d100 0x7f907c06d570 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9074009d90 tx=0x7f907400b330 comp rx=0 tx=0).stop 2023-10-16T12:59:48.975 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.967+0000 7f90823ef700 1 -- 172.21.15.124:0/487054924 shutdown_connections 2023-10-16T12:59:48.976 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.967+0000 7f90823ef700 1 --2- 172.21.15.124:0/487054924 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f907c06d100 0x7f907c06d570 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.976 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.967+0000 7f90823ef700 1 --2- 172.21.15.124:0/487054924 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f907c071850 0x7f907c071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.976 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.967+0000 7f90823ef700 1 -- 172.21.15.124:0/487054924 >> 172.21.15.124:0/487054924 conn(0x7f907c0d0180 msgr2=0x7f907c0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:48.976 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.968+0000 7f90823ef700 1 -- 172.21.15.124:0/487054924 shutdown_connections 2023-10-16T12:59:48.976 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.968+0000 7f90823ef700 1 -- 172.21.15.124:0/487054924 wait complete. 2023-10-16T12:59:48.976 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.969+0000 7f90823ef700 1 Processor -- start 2023-10-16T12:59:48.977 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.969+0000 7f90823ef700 1 -- start start 2023-10-16T12:59:48.979 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.970+0000 7f90823ef700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f907c06d100 0x7f907c0c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:48.980 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.970+0000 7f90823ef700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f907c071850 0x7f907c1565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:48.980 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.970+0000 7f90823ef700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f907c15daa0 0x7f907c15c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:48.980 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.970+0000 7f90823ef700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907c0c8960 con 0x7f907c06d100 2023-10-16T12:59:48.980 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.970+0000 7f90823ef700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907c0c7d90 con 0x7f907c15daa0 2023-10-16T12:59:48.981 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.970+0000 7f90823ef700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907c0c8030 con 0x7f907c071850 2023-10-16T12:59:48.981 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.970+0000 7f907bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f907c06d100 0x7f907c0c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:48.981 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.970+0000 7f907bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f907c06d100 0x7f907c0c3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55058/0 (socket says 172.21.15.124:55058) 2023-10-16T12:59:48.981 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.970+0000 7f907bfff700 1 -- 172.21.15.124:0/567981030 learned_addr learned my addr 172.21.15.124:0/567981030 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:48.981 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.970+0000 7f907b7fe700 1 --2- 172.21.15.124:0/567981030 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f907c071850 0x7f907c1565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:48.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.970+0000 7f908098c700 1 --2- 172.21.15.124:0/567981030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f907c15daa0 0x7f907c15c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:48.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.970+0000 7f907bfff700 1 -- 172.21.15.124:0/567981030 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f907c071850 msgr2=0x7f907c1565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:48.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.970+0000 7f907bfff700 1 --2- 172.21.15.124:0/567981030 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f907c071850 0x7f907c1565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.970+0000 7f907bfff700 1 -- 172.21.15.124:0/567981030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f907c15daa0 msgr2=0x7f907c15c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:48.982 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.970+0000 7f907bfff700 1 --2- 172.21.15.124:0/567981030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f907c15daa0 0x7f907c15c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:48.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.970+0000 7f907bfff700 1 -- 172.21.15.124:0/567981030 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9074009a70 con 0x7f907c06d100 2023-10-16T12:59:48.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.970+0000 7f907b7fe700 1 --2- 172.21.15.124:0/567981030 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f907c071850 0x7f907c1565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:48.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.970+0000 7f907bfff700 1 --2- 172.21.15.124:0/567981030 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f907c06d100 0x7f907c0c3c90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9070001eb0 tx=0x7f907000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:48.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.970+0000 7f9078ff9700 1 -- 172.21.15.124:0/567981030 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070005d70 con 0x7f907c06d100 2023-10-16T12:59:48.983 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.970+0000 7f9078ff9700 1 -- 172.21.15.124:0/567981030 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90700070d0 con 0x7f907c06d100 2023-10-16T12:59:48.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.970+0000 7f90823ef700 1 -- 172.21.15.124:0/567981030 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907c0c8310 con 0x7f907c06d100 2023-10-16T12:59:48.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.970+0000 7f9078ff9700 1 -- 172.21.15.124:0/567981030 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070007460 con 0x7f907c06d100 2023-10-16T12:59:48.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.970+0000 7f90823ef700 1 -- 172.21.15.124:0/567981030 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f907c0c9f10 con 0x7f907c06d100 2023-10-16T12:59:48.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.971+0000 7f90823ef700 1 -- 172.21.15.124:0/567981030 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f907c0672b0 con 0x7f907c06d100 2023-10-16T12:59:48.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.972+0000 7f9078ff9700 1 -- 172.21.15.124:0/567981030 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f90700075c0 con 0x7f907c06d100 2023-10-16T12:59:48.984 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.972+0000 7f9078ff9700 1 --2- 172.21.15.124:0/567981030 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f906806af00 0x7f906806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:48.985 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.972+0000 7f9078ff9700 1 -- 172.21.15.124:0/567981030 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f9070088eb0 con 0x7f907c06d100 2023-10-16T12:59:48.985 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.972+0000 7f907b7fe700 1 --2- 172.21.15.124:0/567981030 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f906806af00 0x7f906806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:48.985 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.972+0000 7f907b7fe700 1 --2- 172.21.15.124:0/567981030 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f906806af00 0x7f906806d3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f907c0adf30 tx=0x7f906c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:48.985 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:48.976+0000 7f9078ff9700 1 -- 172.21.15.124:0/567981030 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9070053ba0 con 0x7f907c06d100 2023-10-16T12:59:49.212 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.210+0000 7f90823ef700 1 -- 172.21.15.124:0/567981030 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f907c06eb50 con 0x7f907c06d100 2023-10-16T12:59:49.213 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.210+0000 7f9078ff9700 1 -- 172.21.15.124:0/567981030 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4918 (secure 0 0 0) 0x7f9070017090 con 0x7f907c06d100 2023-10-16T12:59:49.213 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:49.213 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1489119886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6833","nonce":1489119886},{"type":"v1","addr":"172.21.15.192:6835","nonce":1489119886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/2221949787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":2221949787},{"type":"v1","addr":"172.21.15.124:6836","nonce":2221949787}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1247092782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":1247092782},{"type":"v1","addr":"172.21.15.124:6837","nonce":1247092782}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T12:58:51.047667+0000","modified":"2023-10-16T12:59:08.133656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6834/621867052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":621867052},{"type":"v1","addr":"172.21.15.192:6834","nonce":621867052}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T12:59:49.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.212+0000 7f90823ef700 1 -- 172.21.15.124:0/567981030 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f906806af00 msgr2=0x7f906806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:49.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.212+0000 7f90823ef700 1 --2- 172.21.15.124:0/567981030 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f906806af00 0x7f906806d3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f907c0adf30 tx=0x7f906c008040 comp rx=0 tx=0).stop 2023-10-16T12:59:49.215 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.212+0000 7f90823ef700 1 -- 172.21.15.124:0/567981030 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f907c06d100 msgr2=0x7f907c0c3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:49.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.212+0000 7f90823ef700 1 --2- 172.21.15.124:0/567981030 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f907c06d100 0x7f907c0c3c90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9070001eb0 tx=0x7f907000c860 comp rx=0 tx=0).stop 2023-10-16T12:59:49.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.212+0000 7f90823ef700 1 -- 172.21.15.124:0/567981030 shutdown_connections 2023-10-16T12:59:49.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.212+0000 7f90823ef700 1 --2- 172.21.15.124:0/567981030 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f906806af00 0x7f906806d3c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:49.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.212+0000 7f90823ef700 1 --2- 172.21.15.124:0/567981030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f907c15daa0 0x7f907c15c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:49.216 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.212+0000 7f90823ef700 1 --2- 172.21.15.124:0/567981030 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f907c06d100 0x7f907c0c3c90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:49.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.212+0000 7f90823ef700 1 --2- 172.21.15.124:0/567981030 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f907c071850 0x7f907c1565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:49.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.212+0000 7f90823ef700 1 -- 172.21.15.124:0/567981030 >> 172.21.15.124:0/567981030 conn(0x7f907c0d0180 msgr2=0x7f907c0aef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:49.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.212+0000 7f90823ef700 1 -- 172.21.15.124:0/567981030 shutdown_connections 2023-10-16T12:59:49.217 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.212+0000 7f90823ef700 1 -- 172.21.15.124:0/567981030 wait complete. 2023-10-16T12:59:49.217 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 9 2023-10-16T12:59:49.227 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:59:49.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.345+0000 7f0fa820e700 1 Processor -- start 2023-10-16T12:59:49.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.345+0000 7f0fa820e700 1 -- start start 2023-10-16T12:59:49.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.346+0000 7f0fa820e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0fa015a240 0x7f0fa00caa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:49.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.346+0000 7f0fa820e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0fa00aefb0 0x7f0fa00af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:49.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.346+0000 7f0fa820e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa015e1b0 con 0x7f0fa00cb400 2023-10-16T12:59:49.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.346+0000 7f0fa820e700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa00af980 con 0x7f0fa00aefb0 2023-10-16T12:59:49.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.346+0000 7f0fa820e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa015de60 con 0x7f0fa015a240 2023-10-16T12:59:49.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.346+0000 7f0fa67ab700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0fa00aefb0 0x7f0fa00af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:49.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.346+0000 7f0fa67ab700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0fa00aefb0 0x7f0fa00af440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55070/0 (socket says 172.21.15.124:55070) 2023-10-16T12:59:49.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.346+0000 7f0fa67ab700 1 -- 172.21.15.124:0/2079313688 learned_addr learned my addr 172.21.15.124:0/2079313688 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:49.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.346+0000 7f0fa5faa700 1 --2- 172.21.15.124:0/2079313688 >> v2:172.21.15.192:3300/0 conn(0x7f0fa015a240 0x7f0fa00caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:49.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.346+0000 7f0fa67ab700 1 -- 172.21.15.124:0/2079313688 >> v2:172.21.15.192:3300/0 conn(0x7f0fa015a240 msgr2=0x7f0fa00caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:49.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.346+0000 7f0fa67ab700 1 --2- 172.21.15.124:0/2079313688 >> v2:172.21.15.192:3300/0 conn(0x7f0fa015a240 0x7f0fa00caa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:49.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.346+0000 7f0fa67ab700 1 -- 172.21.15.124:0/2079313688 >> v1:172.21.15.192:6789/0 conn(0x7f0fa00cb400 legacy=0x7f0fa015e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:49.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.346+0000 7f0fa67ab700 1 -- 172.21.15.124:0/2079313688 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa00cb9c0 con 0x7f0fa00aefb0 2023-10-16T12:59:49.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.347+0000 7f0fa67ab700 1 --2- 172.21.15.124:0/2079313688 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0fa00aefb0 0x7f0fa00af440 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0073e90 tx=0x7f0f9800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31ae81e2a91cb4a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:49.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.347+0000 7f0fa4fa8700 1 -- 172.21.15.124:0/2079313688 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98010070 con 0x7f0fa00aefb0 2023-10-16T12:59:49.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.347+0000 7f0fa4fa8700 1 -- 172.21.15.124:0/2079313688 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9800dd50 con 0x7f0fa00aefb0 2023-10-16T12:59:49.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.347+0000 7f0fa4fa8700 1 -- 172.21.15.124:0/2079313688 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9800b310 con 0x7f0fa00aefb0 2023-10-16T12:59:49.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.347+0000 7f0fa820e700 1 -- 172.21.15.124:0/2079313688 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0fa00aefb0 msgr2=0x7f0fa00af440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:49.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.347+0000 7f0fa820e700 1 --2- 172.21.15.124:0/2079313688 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0fa00aefb0 0x7f0fa00af440 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0073e90 tx=0x7f0f9800d430 comp rx=0 tx=0).stop 2023-10-16T12:59:49.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.347+0000 7f0fa820e700 1 -- 172.21.15.124:0/2079313688 shutdown_connections 2023-10-16T12:59:49.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.347+0000 7f0fa820e700 1 --2- 172.21.15.124:0/2079313688 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0fa00aefb0 0x7f0fa00af440 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:49.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.347+0000 7f0fa820e700 1 --2- 172.21.15.124:0/2079313688 >> v2:172.21.15.192:3300/0 conn(0x7f0fa015a240 0x7f0fa00caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:49.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.347+0000 7f0fa820e700 1 -- 172.21.15.124:0/2079313688 >> 172.21.15.124:0/2079313688 conn(0x7f0fa00ccbd0 msgr2=0x7f0fa00ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:49.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.347+0000 7f0fa820e700 1 -- 172.21.15.124:0/2079313688 shutdown_connections 2023-10-16T12:59:49.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.347+0000 7f0fa820e700 1 -- 172.21.15.124:0/2079313688 wait complete. 2023-10-16T12:59:49.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.349+0000 7f0fa820e700 1 Processor -- start 2023-10-16T12:59:49.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.349+0000 7f0fa820e700 1 -- start start 2023-10-16T12:59:49.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.350+0000 7f0fa820e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0fa00aefb0 0x7f0fa014aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:49.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.350+0000 7f0fa820e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fa00cb400 0x7f0fa01476f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:49.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.350+0000 7f0fa820e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0fa015a240 0x7f0fa015c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:49.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.350+0000 7f0fa820e700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa015cdd0 con 0x7f0fa015a240 2023-10-16T12:59:49.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.350+0000 7f0fa820e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa015d0b0 con 0x7f0fa00cb400 2023-10-16T12:59:49.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.350+0000 7f0fa820e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa015d390 con 0x7f0fa00aefb0 2023-10-16T12:59:49.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.350+0000 7f0fa67ab700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0fa015a240 0x7f0fa015c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:49.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.350+0000 7f0fa67ab700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0fa015a240 0x7f0fa015c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55076/0 (socket says 172.21.15.124:55076) 2023-10-16T12:59:49.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.350+0000 7f0fa67ab700 1 -- 172.21.15.124:0/4078000222 learned_addr learned my addr 172.21.15.124:0/4078000222 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:49.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.350+0000 7f0fa57a9700 1 --2- 172.21.15.124:0/4078000222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fa00cb400 0x7f0fa01476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:49.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.350+0000 7f0fa5faa700 1 --2- 172.21.15.124:0/4078000222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0fa00aefb0 0x7f0fa014aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:49.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.350+0000 7f0fa67ab700 1 -- 172.21.15.124:0/4078000222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0fa00aefb0 msgr2=0x7f0fa014aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:49.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.350+0000 7f0fa67ab700 1 --2- 172.21.15.124:0/4078000222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0fa00aefb0 0x7f0fa014aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:49.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.350+0000 7f0fa67ab700 1 -- 172.21.15.124:0/4078000222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fa00cb400 msgr2=0x7f0fa01476f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:49.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.350+0000 7f0fa67ab700 1 --2- 172.21.15.124:0/4078000222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fa00cb400 0x7f0fa01476f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:49.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.350+0000 7f0fa67ab700 1 -- 172.21.15.124:0/4078000222 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9800bd40 con 0x7f0fa015a240 2023-10-16T12:59:49.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.350+0000 7f0fa67ab700 1 --2- 172.21.15.124:0/4078000222 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0fa015a240 0x7f0fa015c4f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0f98017040 tx=0x7f0f98004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:49.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.350+0000 7f0f967fc700 1 -- 172.21.15.124:0/4078000222 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98009a10 con 0x7f0fa015a240 2023-10-16T12:59:49.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.350+0000 7f0f967fc700 1 -- 172.21.15.124:0/4078000222 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f98009b90 con 0x7f0fa015a240 2023-10-16T12:59:49.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.350+0000 7f0fa820e700 1 -- 172.21.15.124:0/4078000222 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa015d670 con 0x7f0fa015a240 2023-10-16T12:59:49.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.351+0000 7f0f967fc700 1 -- 172.21.15.124:0/4078000222 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9800b4c0 con 0x7f0fa015a240 2023-10-16T12:59:49.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.351+0000 7f0fa820e700 1 -- 172.21.15.124:0/4078000222 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa015a620 con 0x7f0fa015a240 2023-10-16T12:59:49.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.351+0000 7f0fa820e700 1 -- 172.21.15.124:0/4078000222 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa004ebb0 con 0x7f0fa015a240 2023-10-16T12:59:49.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.352+0000 7f0f967fc700 1 -- 172.21.15.124:0/4078000222 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0f98004030 con 0x7f0fa015a240 2023-10-16T12:59:49.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.352+0000 7f0f967fc700 1 --2- 172.21.15.124:0/4078000222 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f0f8406af00 0x7f0f8406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:49.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.352+0000 7f0f967fc700 1 -- 172.21.15.124:0/4078000222 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f0f9808cda0 con 0x7f0fa015a240 2023-10-16T12:59:49.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.352+0000 7f0fa5faa700 1 --2- 172.21.15.124:0/4078000222 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f0f8406af00 0x7f0f8406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:49.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.353+0000 7f0fa5faa700 1 --2- 172.21.15.124:0/4078000222 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f0f8406af00 0x7f0f8406d3c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0f90006b20 tx=0x7f0f90008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:49.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.357+0000 7f0f967fc700 1 -- 172.21.15.124:0/4078000222 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0f98057b20 con 0x7f0fa015a240 2023-10-16T12:59:49.550 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.547+0000 7f0fa820e700 1 -- 172.21.15.124:0/4078000222 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fa00b3a20 con 0x7f0fa015a240 2023-10-16T12:59:49.551 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.548+0000 7f0f967fc700 1 -- 172.21.15.124:0/4078000222 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18751 (secure 0 0 0) 0x7f0f98013390 con 0x7f0fa015a240 2023-10-16T12:59:49.551 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:49.551 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":26,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:59:34.463212+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2},{"from":7,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:59:49.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.550+0000 7f0fa820e700 1 -- 172.21.15.124:0/4078000222 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f0f8406af00 msgr2=0x7f0f8406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:49.553 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.550+0000 7f0fa820e700 1 --2- 172.21.15.124:0/4078000222 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f0f8406af00 0x7f0f8406d3c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0f90006b20 tx=0x7f0f90008040 comp rx=0 tx=0).stop 2023-10-16T12:59:49.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.550+0000 7f0fa820e700 1 -- 172.21.15.124:0/4078000222 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0fa015a240 msgr2=0x7f0fa015c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:49.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.550+0000 7f0fa820e700 1 --2- 172.21.15.124:0/4078000222 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0fa015a240 0x7f0fa015c4f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0f98017040 tx=0x7f0f98004ad0 comp rx=0 tx=0).stop 2023-10-16T12:59:49.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.550+0000 7f0fa820e700 1 -- 172.21.15.124:0/4078000222 shutdown_connections 2023-10-16T12:59:49.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.550+0000 7f0fa820e700 1 --2- 172.21.15.124:0/4078000222 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f0f8406af00 0x7f0f8406d3c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:49.554 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.550+0000 7f0fa820e700 1 --2- 172.21.15.124:0/4078000222 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0fa015a240 0x7f0fa015c4f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:49.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.550+0000 7f0fa820e700 1 --2- 172.21.15.124:0/4078000222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0fa00aefb0 0x7f0fa014aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:49.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.550+0000 7f0fa820e700 1 --2- 172.21.15.124:0/4078000222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fa00cb400 0x7f0fa01476f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:49.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.550+0000 7f0fa820e700 1 -- 172.21.15.124:0/4078000222 >> 172.21.15.124:0/4078000222 conn(0x7f0fa00ccbd0 msgr2=0x7f0fa00acd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:49.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.550+0000 7f0fa820e700 1 -- 172.21.15.124:0/4078000222 shutdown_connections 2023-10-16T12:59:49.555 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.550+0000 7f0fa820e700 1 -- 172.21.15.124:0/4078000222 wait complete. 2023-10-16T12:59:49.565 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T12:58:38.667813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T12:58:49.562073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T12:58:50.011419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T12:58:53.692890+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T12:59:49.566 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T12:59:49.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.686+0000 7f150e6dc700 1 Processor -- start 2023-10-16T12:59:49.689 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.686+0000 7f150e6dc700 1 -- start start 2023-10-16T12:59:49.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.687+0000 7f150e6dc700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f150806a820 0x7f150815dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:49.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.687+0000 7f150e6dc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15080cdd30 0x7f15080ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:49.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.687+0000 7f150e6dc700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1508161360 con 0x7f150806b370 2023-10-16T12:59:49.692 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.687+0000 7f150e6dc700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15080ce720 con 0x7f150806a820 2023-10-16T12:59:49.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.687+0000 7f150e6dc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150806b750 con 0x7f15080cdd30 2023-10-16T12:59:49.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.687+0000 7f15077fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f150806a820 0x7f150815dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:49.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.687+0000 7f15077fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f150806a820 0x7f150815dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55082/0 (socket says 172.21.15.124:55082) 2023-10-16T12:59:49.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.687+0000 7f15077fe700 1 -- 172.21.15.124:0/3586174707 learned_addr learned my addr 172.21.15.124:0/3586174707 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:49.693 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.687+0000 7f150cc79700 1 --2- 172.21.15.124:0/3586174707 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15080cdd30 0x7f15080ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:49.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.688+0000 7f15077fe700 1 -- 172.21.15.124:0/3586174707 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15080cdd30 msgr2=0x7f15080ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:49.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.688+0000 7f15077fe700 1 --2- 172.21.15.124:0/3586174707 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15080cdd30 0x7f15080ce1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:49.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.688+0000 7f15077fe700 1 -- 172.21.15.124:0/3586174707 >> v1:172.21.15.192:6789/0 conn(0x7f150806b370 legacy=0x7f150806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:49.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.688+0000 7f15077fe700 1 -- 172.21.15.124:0/3586174707 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150806dcc0 con 0x7f150806a820 2023-10-16T12:59:49.694 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.688+0000 7f15077fe700 1 --2- 172.21.15.124:0/3586174707 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f150806a820 0x7f150815dcb0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0098f0 tx=0x7f14fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7c553b6791d85c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:49.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.688+0000 7f1506ffd700 1 -- 172.21.15.124:0/3586174707 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc011830 con 0x7f150806a820 2023-10-16T12:59:49.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.688+0000 7f1506ffd700 1 -- 172.21.15.124:0/3586174707 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14fc011990 con 0x7f150806a820 2023-10-16T12:59:49.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.688+0000 7f1506ffd700 1 -- 172.21.15.124:0/3586174707 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc011d20 con 0x7f150806a820 2023-10-16T12:59:49.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.688+0000 7f150e6dc700 1 -- 172.21.15.124:0/3586174707 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f150806a820 msgr2=0x7f150815dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:49.695 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.688+0000 7f150e6dc700 1 --2- 172.21.15.124:0/3586174707 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f150806a820 0x7f150815dcb0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0098f0 tx=0x7f14fc009c00 comp rx=0 tx=0).stop 2023-10-16T12:59:49.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.689+0000 7f150e6dc700 1 -- 172.21.15.124:0/3586174707 shutdown_connections 2023-10-16T12:59:49.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.689+0000 7f150e6dc700 1 --2- 172.21.15.124:0/3586174707 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15080cdd30 0x7f15080ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:49.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.689+0000 7f150e6dc700 1 --2- 172.21.15.124:0/3586174707 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f150806a820 0x7f150815dcb0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:49.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.689+0000 7f150e6dc700 1 -- 172.21.15.124:0/3586174707 >> 172.21.15.124:0/3586174707 conn(0x7f15080ccbe0 msgr2=0x7f15080ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:49.696 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.689+0000 7f150e6dc700 1 -- 172.21.15.124:0/3586174707 shutdown_connections 2023-10-16T12:59:49.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.689+0000 7f150e6dc700 1 -- 172.21.15.124:0/3586174707 wait complete. 2023-10-16T12:59:49.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.690+0000 7f150e6dc700 1 Processor -- start 2023-10-16T12:59:49.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.690+0000 7f150e6dc700 1 -- start start 2023-10-16T12:59:49.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.691+0000 7f150e6dc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f150806a820 0x7f15081f28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:49.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.691+0000 7f150e6dc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f150806b370 0x7f15080b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:49.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.691+0000 7f150e6dc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f15080cdd30 0x7f15080b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:49.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.691+0000 7f150e6dc700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150815a390 con 0x7f15080cdd30 2023-10-16T12:59:49.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.691+0000 7f150e6dc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150815a670 con 0x7f150806a820 2023-10-16T12:59:49.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.691+0000 7f150e6dc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150815a950 con 0x7f150806b370 2023-10-16T12:59:49.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.691+0000 7f150cc79700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f15080cdd30 0x7f15080b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:49.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.691+0000 7f150cc79700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f15080cdd30 0x7f15080b51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55090/0 (socket says 172.21.15.124:55090) 2023-10-16T12:59:49.701 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.691+0000 7f150cc79700 1 -- 172.21.15.124:0/1280617629 learned_addr learned my addr 172.21.15.124:0/1280617629 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:49.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.691+0000 7f15077fe700 1 --2- 172.21.15.124:0/1280617629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f150806b370 0x7f15080b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:49.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.691+0000 7f1507fff700 1 --2- 172.21.15.124:0/1280617629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f150806a820 0x7f15081f28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:49.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.691+0000 7f150cc79700 1 -- 172.21.15.124:0/1280617629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f150806b370 msgr2=0x7f15080b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:49.702 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.691+0000 7f150cc79700 1 --2- 172.21.15.124:0/1280617629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f150806b370 0x7f15080b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:49.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.691+0000 7f150cc79700 1 -- 172.21.15.124:0/1280617629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f150806a820 msgr2=0x7f15081f28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:49.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.691+0000 7f150cc79700 1 --2- 172.21.15.124:0/1280617629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f150806a820 0x7f15081f28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:49.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.691+0000 7f150cc79700 1 -- 172.21.15.124:0/1280617629 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14fc009550 con 0x7f15080cdd30 2023-10-16T12:59:49.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.691+0000 7f150cc79700 1 --2- 172.21.15.124:0/1280617629 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f15080cdd30 0x7f15080b51f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f150000efc0 tx=0x7f150000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:49.703 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.691+0000 7f1504ff9700 1 -- 172.21.15.124:0/1280617629 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1500009ea0 con 0x7f15080cdd30 2023-10-16T12:59:49.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.691+0000 7f1504ff9700 1 -- 172.21.15.124:0/1280617629 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150000f040 con 0x7f15080cdd30 2023-10-16T12:59:49.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.691+0000 7f150e6dc700 1 -- 172.21.15.124:0/1280617629 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150815ac30 con 0x7f15080cdd30 2023-10-16T12:59:49.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.691+0000 7f1504ff9700 1 -- 172.21.15.124:0/1280617629 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150000ced0 con 0x7f15080cdd30 2023-10-16T12:59:49.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.692+0000 7f150e6dc700 1 -- 172.21.15.124:0/1280617629 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15080ad580 con 0x7f15080cdd30 2023-10-16T12:59:49.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.692+0000 7f150e6dc700 1 -- 172.21.15.124:0/1280617629 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1508072d10 con 0x7f15080cdd30 2023-10-16T12:59:49.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.693+0000 7f1504ff9700 1 -- 172.21.15.124:0/1280617629 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1500014480 con 0x7f15080cdd30 2023-10-16T12:59:49.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.693+0000 7f1504ff9700 1 --2- 172.21.15.124:0/1280617629 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f14f406af00 0x7f14f406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:49.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.693+0000 7f1504ff9700 1 -- 172.21.15.124:0/1280617629 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f150008a160 con 0x7f15080cdd30 2023-10-16T12:59:49.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.693+0000 7f1507fff700 1 --2- 172.21.15.124:0/1280617629 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f14f406af00 0x7f14f406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:49.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.694+0000 7f1507fff700 1 --2- 172.21.15.124:0/1280617629 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f14f406af00 0x7f14f406d3c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f14f8007fd0 tx=0x7f14f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:49.706 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.698+0000 7f1504ff9700 1 -- 172.21.15.124:0/1280617629 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1500054e50 con 0x7f15080cdd30 2023-10-16T12:59:49.891 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.889+0000 7f150e6dc700 1 -- 172.21.15.124:0/1280617629 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f150804ebb0 con 0x7f15080cdd30 2023-10-16T12:59:49.892 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.889+0000 7f1504ff9700 1 -- 172.21.15.124:0/1280617629 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1500058470 con 0x7f15080cdd30 2023-10-16T12:59:49.893 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-16T12:59:49.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.891+0000 7f150e6dc700 1 -- 172.21.15.124:0/1280617629 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f14f406af00 msgr2=0x7f14f406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:49.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.891+0000 7f150e6dc700 1 --2- 172.21.15.124:0/1280617629 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f14f406af00 0x7f14f406d3c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f14f8007fd0 tx=0x7f14f8009040 comp rx=0 tx=0).stop 2023-10-16T12:59:49.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.891+0000 7f150e6dc700 1 -- 172.21.15.124:0/1280617629 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f15080cdd30 msgr2=0x7f15080b51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:49.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.891+0000 7f150e6dc700 1 --2- 172.21.15.124:0/1280617629 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f15080cdd30 0x7f15080b51f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f150000efc0 tx=0x7f150000c3a0 comp rx=0 tx=0).stop 2023-10-16T12:59:49.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.891+0000 7f150e6dc700 1 -- 172.21.15.124:0/1280617629 shutdown_connections 2023-10-16T12:59:49.896 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.891+0000 7f150e6dc700 1 --2- 172.21.15.124:0/1280617629 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f14f406af00 0x7f14f406d3c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:49.896 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.891+0000 7f150e6dc700 1 --2- 172.21.15.124:0/1280617629 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f15080cdd30 0x7f15080b51f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:49.896 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.891+0000 7f150e6dc700 1 --2- 172.21.15.124:0/1280617629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f150806a820 0x7f15081f28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:49.896 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.891+0000 7f150e6dc700 1 --2- 172.21.15.124:0/1280617629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f150806b370 0x7f15080b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:49.896 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.891+0000 7f150e6dc700 1 -- 172.21.15.124:0/1280617629 >> 172.21.15.124:0/1280617629 conn(0x7f15080ccbe0 msgr2=0x7f1508160470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:49.896 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.892+0000 7f150e6dc700 1 -- 172.21.15.124:0/1280617629 shutdown_connections 2023-10-16T12:59:49.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:49.892+0000 7f150e6dc700 1 -- 172.21.15.124:0/1280617629 wait complete. 2023-10-16T12:59:49.906 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T12:59:50.029 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.026+0000 7f162f3bd700 1 Processor -- start 2023-10-16T12:59:50.029 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.027+0000 7f162f3bd700 1 -- start start 2023-10-16T12:59:50.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.027+0000 7f162f3bd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f162806bd30 0x7f16280cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:50.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.027+0000 7f162f3bd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16280ce280 0x7f16280ca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:50.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.027+0000 7f162f3bd700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1628159f30 con 0x7f1628159b50 2023-10-16T12:59:50.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.027+0000 7f162f3bd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16280ce710 con 0x7f162806bd30 2023-10-16T12:59:50.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.027+0000 7f162f3bd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162806c1e0 con 0x7f16280ce280 2023-10-16T12:59:50.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.028+0000 7f162d159700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f1628159b50 0x7f162806e310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43762/0 (socket says 172.21.15.124:43762) 2023-10-16T12:59:50.033 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.028+0000 7f162d159700 1 -- 172.21.15.124:0/1537633238 learned_addr learned my addr 172.21.15.124:0/1537633238 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:50.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.028+0000 7f162c958700 1 --2- 172.21.15.124:0/1537633238 >> v2:172.21.15.192:3300/0 conn(0x7f162806bd30 0x7f16280cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:50.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.028+0000 7f162d95a700 1 --2- 172.21.15.124:0/1537633238 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16280ce280 0x7f16280ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:50.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.028+0000 7f161ffff700 1 -- 172.21.15.124:0/1537633238 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250241516 0 0) 0x7f1628159f30 con 0x7f1628159b50 2023-10-16T12:59:50.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.028+0000 7f161ffff700 1 -- 172.21.15.124:0/1537633238 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16140035b0 con 0x7f1628159b50 2023-10-16T12:59:50.034 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.028+0000 7f162c958700 1 -- 172.21.15.124:0/1537633238 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16280ce280 msgr2=0x7f16280ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:50.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.028+0000 7f162c958700 1 --2- 172.21.15.124:0/1537633238 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16280ce280 0x7f16280ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.028+0000 7f162c958700 1 -- 172.21.15.124:0/1537633238 >> v1:172.21.15.124:6789/0 conn(0x7f1628159b50 legacy=0x7f162806e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:50.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.028+0000 7f162c958700 1 -- 172.21.15.124:0/1537633238 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162806ea20 con 0x7f162806bd30 2023-10-16T12:59:50.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.028+0000 7f162d95a700 1 --2- 172.21.15.124:0/1537633238 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16280ce280 0x7f16280ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:59:50.035 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.028+0000 7f162c958700 1 --2- 172.21.15.124:0/1537633238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f162806bd30 0x7f16280cdd40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1624009870 tx=0x7f1624009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b473448b25683ad server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:50.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.028+0000 7f161ffff700 1 -- 172.21.15.124:0/1537633238 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624011830 con 0x7f162806bd30 2023-10-16T12:59:50.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.028+0000 7f161ffff700 1 -- 172.21.15.124:0/1537633238 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1624011990 con 0x7f162806bd30 2023-10-16T12:59:50.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.028+0000 7f161ffff700 1 -- 172.21.15.124:0/1537633238 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624011d20 con 0x7f162806bd30 2023-10-16T12:59:50.036 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.029+0000 7f162f3bd700 1 -- 172.21.15.124:0/1537633238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f162806bd30 msgr2=0x7f16280cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:50.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.029+0000 7f162f3bd700 1 --2- 172.21.15.124:0/1537633238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f162806bd30 0x7f16280cdd40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1624009870 tx=0x7f1624009b80 comp rx=0 tx=0).stop 2023-10-16T12:59:50.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.029+0000 7f162f3bd700 1 -- 172.21.15.124:0/1537633238 shutdown_connections 2023-10-16T12:59:50.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.029+0000 7f162f3bd700 1 --2- 172.21.15.124:0/1537633238 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16280ce280 0x7f16280ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.029+0000 7f162f3bd700 1 --2- 172.21.15.124:0/1537633238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f162806bd30 0x7f16280cdd40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.037 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.029+0000 7f162f3bd700 1 -- 172.21.15.124:0/1537633238 >> 172.21.15.124:0/1537633238 conn(0x7f16280b13e0 msgr2=0x7f16280b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:50.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.029+0000 7f162f3bd700 1 -- 172.21.15.124:0/1537633238 shutdown_connections 2023-10-16T12:59:50.038 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.029+0000 7f162f3bd700 1 -- 172.21.15.124:0/1537633238 wait complete. 2023-10-16T12:59:50.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.030+0000 7f162f3bd700 1 Processor -- start 2023-10-16T12:59:50.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.030+0000 7f162f3bd700 1 -- start start 2023-10-16T12:59:50.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.031+0000 7f162f3bd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f162806bd30 0x7f16281f06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:50.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.031+0000 7f162f3bd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f16280ce280 0x7f16280cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:50.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.031+0000 7f162f3bd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1628159b50 0x7f16280cba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:50.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.031+0000 7f162f3bd700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1628145270 con 0x7f16280ce280 2023-10-16T12:59:50.041 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.031+0000 7f162f3bd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16281f1860 con 0x7f162806bd30 2023-10-16T12:59:50.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.031+0000 7f162f3bd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16281f1cf0 con 0x7f1628159b50 2023-10-16T12:59:50.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.031+0000 7f162c958700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f16280ce280 0x7f16280cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:50.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.031+0000 7f162c958700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f16280ce280 0x7f16280cb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55102/0 (socket says 172.21.15.124:55102) 2023-10-16T12:59:50.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.031+0000 7f162c958700 1 -- 172.21.15.124:0/3647613330 learned_addr learned my addr 172.21.15.124:0/3647613330 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:50.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.031+0000 7f162c958700 1 -- 172.21.15.124:0/3647613330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1628159b50 msgr2=0x7f16280cba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:50.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.031+0000 7f162c958700 1 --2- 172.21.15.124:0/3647613330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1628159b50 0x7f16280cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.031+0000 7f162c958700 1 -- 172.21.15.124:0/3647613330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f162806bd30 msgr2=0x7f16281f06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:50.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.031+0000 7f162c958700 1 --2- 172.21.15.124:0/3647613330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f162806bd30 0x7f16281f06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.031+0000 7f162c958700 1 -- 172.21.15.124:0/3647613330 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1620009a70 con 0x7f16280ce280 2023-10-16T12:59:50.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.031+0000 7f162c958700 1 --2- 172.21.15.124:0/3647613330 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f16280ce280 0x7f16280cb510 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f16240097c0 tx=0x7f1624004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:50.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.032+0000 7f161dffb700 1 -- 172.21.15.124:0/3647613330 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16240036a0 con 0x7f16280ce280 2023-10-16T12:59:50.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.032+0000 7f161dffb700 1 -- 172.21.15.124:0/3647613330 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162401f070 con 0x7f16280ce280 2023-10-16T12:59:50.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.032+0000 7f162f3bd700 1 -- 172.21.15.124:0/3647613330 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16240094a0 con 0x7f16280ce280 2023-10-16T12:59:50.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.032+0000 7f161dffb700 1 -- 172.21.15.124:0/3647613330 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624003a20 con 0x7f16280ce280 2023-10-16T12:59:50.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.032+0000 7f162f3bd700 1 -- 172.21.15.124:0/3647613330 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16281f1210 con 0x7f16280ce280 2023-10-16T12:59:50.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.033+0000 7f162f3bd700 1 -- 172.21.15.124:0/3647613330 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162804ebb0 con 0x7f16280ce280 2023-10-16T12:59:50.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.033+0000 7f161dffb700 1 -- 172.21.15.124:0/3647613330 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1624003b80 con 0x7f16280ce280 2023-10-16T12:59:50.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.034+0000 7f161dffb700 1 --2- 172.21.15.124:0/3647613330 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f160c06af00 0x7f160c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:50.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.034+0000 7f161dffb700 1 -- 172.21.15.124:0/3647613330 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f1624021070 con 0x7f16280ce280 2023-10-16T12:59:50.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.034+0000 7f162d159700 1 --2- 172.21.15.124:0/3647613330 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f160c06af00 0x7f160c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:50.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.034+0000 7f162d159700 1 --2- 172.21.15.124:0/3647613330 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f160c06af00 0x7f160c06d3c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1618001610 tx=0x7f16180079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:50.046 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.038+0000 7f161dffb700 1 -- 172.21.15.124:0/3647613330 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1624055e00 con 0x7f16280ce280 2023-10-16T12:59:50.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.228+0000 7f162f3bd700 1 -- 172.21.15.124:0/3647613330 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16281f19a0 con 0x7f16280ce280 2023-10-16T12:59:50.231 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.228+0000 7f161dffb700 1 -- 172.21.15.124:0/3647613330 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f16240150a0 con 0x7f16280ce280 2023-10-16T12:59:50.232 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:50.233 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.230+0000 7f162f3bd700 1 -- 172.21.15.124:0/3647613330 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f160c06af00 msgr2=0x7f160c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:50.234 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.230+0000 7f162f3bd700 1 --2- 172.21.15.124:0/3647613330 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f160c06af00 0x7f160c06d3c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1618001610 tx=0x7f16180079c0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.234 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.230+0000 7f162f3bd700 1 -- 172.21.15.124:0/3647613330 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f16280ce280 msgr2=0x7f16280cb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:50.234 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.230+0000 7f162f3bd700 1 --2- 172.21.15.124:0/3647613330 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f16280ce280 0x7f16280cb510 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f16240097c0 tx=0x7f1624004750 comp rx=0 tx=0).stop 2023-10-16T12:59:50.234 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.230+0000 7f162f3bd700 1 -- 172.21.15.124:0/3647613330 shutdown_connections 2023-10-16T12:59:50.235 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.230+0000 7f162f3bd700 1 --2- 172.21.15.124:0/3647613330 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f160c06af00 0x7f160c06d3c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.235 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.230+0000 7f162f3bd700 1 --2- 172.21.15.124:0/3647613330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1628159b50 0x7f16280cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.235 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.230+0000 7f162f3bd700 1 --2- 172.21.15.124:0/3647613330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f162806bd30 0x7f16281f06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.235 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.230+0000 7f162f3bd700 1 --2- 172.21.15.124:0/3647613330 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f16280ce280 0x7f16280cb510 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.235 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.230+0000 7f162f3bd700 1 -- 172.21.15.124:0/3647613330 >> 172.21.15.124:0/3647613330 conn(0x7f16280b13e0 msgr2=0x7f16280af470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:50.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.230+0000 7f162f3bd700 1 -- 172.21.15.124:0/3647613330 shutdown_connections 2023-10-16T12:59:50.236 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.230+0000 7f162f3bd700 1 -- 172.21.15.124:0/3647613330 wait complete. 2023-10-16T12:59:50.245 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T12:59:50.258 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:59:50.291 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:59:50.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.369+0000 7f26e67f5700 1 Processor -- start 2023-10-16T12:59:50.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.369+0000 7f26e67f5700 1 -- start start 2023-10-16T12:59:50.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.369+0000 7f26e67f5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26e006b370 0x7f26e015dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:50.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.369+0000 7f26e67f5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f26e006a820 0x7f26e006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:50.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.370+0000 7f26e67f5700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f26e00cdd30 0x7f26e00ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:50.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.370+0000 7f26e67f5700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e00ce6d0 con 0x7f26e00cdd30 2023-10-16T12:59:50.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.370+0000 7f26e67f5700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e0161360 con 0x7f26e006a820 2023-10-16T12:59:50.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.370+0000 7f26e67f5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e006b750 con 0x7f26e006b370 2023-10-16T12:59:50.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.370+0000 7f26e4d92700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f26e00cdd30 0x7f26e00ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:50.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.370+0000 7f26e4d92700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f26e00cdd30 0x7f26e00ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55112/0 (socket says 172.21.15.124:55112) 2023-10-16T12:59:50.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.370+0000 7f26e4d92700 1 -- 172.21.15.124:0/1399964821 learned_addr learned my addr 172.21.15.124:0/1399964821 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:50.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.370+0000 7f26df7fe700 1 --2- 172.21.15.124:0/1399964821 >> v2:172.21.15.192:3300/0 conn(0x7f26e006a820 0x7f26e006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:50.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.370+0000 7f26dffff700 1 --2- 172.21.15.124:0/1399964821 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26e006b370 0x7f26e015dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:50.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.370+0000 7f26e4d92700 1 -- 172.21.15.124:0/1399964821 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26e006b370 msgr2=0x7f26e015dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:50.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.370+0000 7f26e4d92700 1 --2- 172.21.15.124:0/1399964821 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26e006b370 0x7f26e015dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.370+0000 7f26e4d92700 1 -- 172.21.15.124:0/1399964821 >> v2:172.21.15.192:3300/0 conn(0x7f26e006a820 msgr2=0x7f26e006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:50.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.370+0000 7f26e4d92700 1 --2- 172.21.15.124:0/1399964821 >> v2:172.21.15.192:3300/0 conn(0x7f26e006a820 0x7f26e006d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.370+0000 7f26e4d92700 1 -- 172.21.15.124:0/1399964821 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e015e300 con 0x7f26e00cdd30 2023-10-16T12:59:50.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.370+0000 7f26df7fe700 1 --2- 172.21.15.124:0/1399964821 >> v2:172.21.15.192:3300/0 conn(0x7f26e006a820 0x7f26e006d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:50.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.370+0000 7f26e4d92700 1 --2- 172.21.15.124:0/1399964821 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f26e00cdd30 0x7f26e00ce190 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f26e006d480 tx=0x7f26d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b6ff501f8d6fc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:50.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.370+0000 7f26deffd700 1 -- 172.21.15.124:0/1399964821 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d800e070 con 0x7f26e00cdd30 2023-10-16T12:59:50.378 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.370+0000 7f26deffd700 1 -- 172.21.15.124:0/1399964821 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d800b910 con 0x7f26e00cdd30 2023-10-16T12:59:50.379 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.370+0000 7f26deffd700 1 -- 172.21.15.124:0/1399964821 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d800bcc0 con 0x7f26e00cdd30 2023-10-16T12:59:50.379 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.371+0000 7f26e67f5700 1 -- 172.21.15.124:0/1399964821 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f26e00cdd30 msgr2=0x7f26e00ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:50.379 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.371+0000 7f26e67f5700 1 --2- 172.21.15.124:0/1399964821 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f26e00cdd30 0x7f26e00ce190 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f26e006d480 tx=0x7f26d800b330 comp rx=0 tx=0).stop 2023-10-16T12:59:50.379 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.371+0000 7f26e67f5700 1 -- 172.21.15.124:0/1399964821 shutdown_connections 2023-10-16T12:59:50.380 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.371+0000 7f26e67f5700 1 --2- 172.21.15.124:0/1399964821 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f26e00cdd30 0x7f26e00ce190 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.380 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.371+0000 7f26e67f5700 1 --2- 172.21.15.124:0/1399964821 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26e006b370 0x7f26e015dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.380 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.371+0000 7f26e67f5700 1 --2- 172.21.15.124:0/1399964821 >> v2:172.21.15.192:3300/0 conn(0x7f26e006a820 0x7f26e006d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.380 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.371+0000 7f26e67f5700 1 -- 172.21.15.124:0/1399964821 >> 172.21.15.124:0/1399964821 conn(0x7f26e00ccbe0 msgr2=0x7f26e00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:50.380 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.371+0000 7f26e67f5700 1 -- 172.21.15.124:0/1399964821 shutdown_connections 2023-10-16T12:59:50.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.371+0000 7f26e67f5700 1 -- 172.21.15.124:0/1399964821 wait complete. 2023-10-16T12:59:50.385 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.372+0000 7f26e67f5700 1 Processor -- start 2023-10-16T12:59:50.386 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.373+0000 7f26e67f5700 1 -- start start 2023-10-16T12:59:50.386 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.373+0000 7f26e67f5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26e006a820 0x7f26e015d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:50.387 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.373+0000 7f26e67f5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26e006b370 0x7f26e00ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:50.387 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.373+0000 7f26e67f5700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f26e00cdd30 0x7f26e01e7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:50.387 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.373+0000 7f26e67f5700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00b32b0 con 0x7f26e00cdd30 2023-10-16T12:59:50.387 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.374+0000 7f26e67f5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00af760 con 0x7f26e006a820 2023-10-16T12:59:50.387 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.374+0000 7f26e67f5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00ae8f0 con 0x7f26e006b370 2023-10-16T12:59:50.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.374+0000 7f26e4d92700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f26e00cdd30 0x7f26e01e7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:50.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.374+0000 7f26e4d92700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f26e00cdd30 0x7f26e01e7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55118/0 (socket says 172.21.15.124:55118) 2023-10-16T12:59:50.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.374+0000 7f26e4d92700 1 -- 172.21.15.124:0/2313621142 learned_addr learned my addr 172.21.15.124:0/2313621142 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:50.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.374+0000 7f26df7fe700 1 --2- 172.21.15.124:0/2313621142 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26e006b370 0x7f26e00ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:50.388 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.374+0000 7f26dffff700 1 --2- 172.21.15.124:0/2313621142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26e006a820 0x7f26e015d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:50.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.374+0000 7f26e4d92700 1 -- 172.21.15.124:0/2313621142 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26e006b370 msgr2=0x7f26e00ae3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:50.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.374+0000 7f26e4d92700 1 --2- 172.21.15.124:0/2313621142 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26e006b370 0x7f26e00ae3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.374+0000 7f26e4d92700 1 -- 172.21.15.124:0/2313621142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26e006a820 msgr2=0x7f26e015d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:50.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.374+0000 7f26e4d92700 1 --2- 172.21.15.124:0/2313621142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26e006a820 0x7f26e015d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.389 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.374+0000 7f26e4d92700 1 -- 172.21.15.124:0/2313621142 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d8009b30 con 0x7f26e00cdd30 2023-10-16T12:59:50.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.374+0000 7f26e4d92700 1 --2- 172.21.15.124:0/2313621142 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f26e00cdd30 0x7f26e01e7530 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f26e0067ec0 tx=0x7f26d8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:50.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.374+0000 7f26dcff9700 1 -- 172.21.15.124:0/2313621142 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d80099b0 con 0x7f26e00cdd30 2023-10-16T12:59:50.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.374+0000 7f26dcff9700 1 -- 172.21.15.124:0/2313621142 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d8004250 con 0x7f26e00cdd30 2023-10-16T12:59:50.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.374+0000 7f26e67f5700 1 -- 172.21.15.124:0/2313621142 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e00ac960 con 0x7f26e00cdd30 2023-10-16T12:59:50.390 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.374+0000 7f26dcff9700 1 -- 172.21.15.124:0/2313621142 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d8004600 con 0x7f26e00cdd30 2023-10-16T12:59:50.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.374+0000 7f26e67f5700 1 -- 172.21.15.124:0/2313621142 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e00acf20 con 0x7f26e00cdd30 2023-10-16T12:59:50.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.375+0000 7f26e67f5700 1 -- 172.21.15.124:0/2313621142 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e0072d10 con 0x7f26e00cdd30 2023-10-16T12:59:50.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.376+0000 7f26dcff9700 1 -- 172.21.15.124:0/2313621142 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f26d8004760 con 0x7f26e00cdd30 2023-10-16T12:59:50.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.376+0000 7f26dcff9700 1 --2- 172.21.15.124:0/2313621142 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f26cc06af00 0x7f26cc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:50.391 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.376+0000 7f26dcff9700 1 -- 172.21.15.124:0/2313621142 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f26d808ae00 con 0x7f26e00cdd30 2023-10-16T12:59:50.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.376+0000 7f26dffff700 1 --2- 172.21.15.124:0/2313621142 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f26cc06af00 0x7f26cc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:50.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.376+0000 7f26dffff700 1 --2- 172.21.15.124:0/2313621142 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f26cc06af00 0x7f26cc06d3c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f26d0009ad0 tx=0x7f26d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:50.392 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.380+0000 7f26dcff9700 1 -- 172.21.15.124:0/2313621142 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f26d8055b80 con 0x7f26e00cdd30 2023-10-16T12:59:50.572 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.569+0000 7f26e67f5700 1 -- 172.21.15.124:0/2313621142 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f26e004ebb0 con 0x7f26e00cdd30 2023-10-16T12:59:50.572 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.570+0000 7f26dcff9700 1 -- 172.21.15.124:0/2313621142 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f26d8020020 con 0x7f26e00cdd30 2023-10-16T12:59:50.573 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2023-10-16T12:59:50.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.572+0000 7f26e67f5700 1 -- 172.21.15.124:0/2313621142 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f26cc06af00 msgr2=0x7f26cc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:50.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.572+0000 7f26e67f5700 1 --2- 172.21.15.124:0/2313621142 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f26cc06af00 0x7f26cc06d3c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f26d0009ad0 tx=0x7f26d0008040 comp rx=0 tx=0).stop 2023-10-16T12:59:50.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.572+0000 7f26e67f5700 1 -- 172.21.15.124:0/2313621142 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f26e00cdd30 msgr2=0x7f26e01e7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:50.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.572+0000 7f26e67f5700 1 --2- 172.21.15.124:0/2313621142 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f26e00cdd30 0x7f26e01e7530 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f26e0067ec0 tx=0x7f26d8004ad0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.572+0000 7f26e67f5700 1 -- 172.21.15.124:0/2313621142 shutdown_connections 2023-10-16T12:59:50.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.572+0000 7f26e67f5700 1 --2- 172.21.15.124:0/2313621142 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f26cc06af00 0x7f26cc06d3c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.572+0000 7f26e67f5700 1 --2- 172.21.15.124:0/2313621142 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f26e00cdd30 0x7f26e01e7530 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.572+0000 7f26e67f5700 1 --2- 172.21.15.124:0/2313621142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26e006a820 0x7f26e015d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.572+0000 7f26e67f5700 1 --2- 172.21.15.124:0/2313621142 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26e006b370 0x7f26e00ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.572+0000 7f26e67f5700 1 -- 172.21.15.124:0/2313621142 >> 172.21.15.124:0/2313621142 conn(0x7f26e00ccbe0 msgr2=0x7f26e015f230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:50.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.572+0000 7f26e67f5700 1 -- 172.21.15.124:0/2313621142 shutdown_connections 2023-10-16T12:59:50.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.572+0000 7f26e67f5700 1 -- 172.21.15.124:0/2313621142 wait complete. 2023-10-16T12:59:50.587 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T12:59:50.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.749+0000 7fd878a02700 1 Processor -- start 2023-10-16T12:59:50.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.749+0000 7fd878a02700 1 -- start start 2023-10-16T12:59:50.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.750+0000 7fd878a02700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd8740b33f0 0x7fd87406f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:50.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.750+0000 7fd878a02700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd874070620 con 0x7fd8740cd770 2023-10-16T12:59:50.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.750+0000 7fd878a02700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd874070900 con 0x7fd87415b4e0 2023-10-16T12:59:50.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.750+0000 7fd878a02700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd874070be0 con 0x7fd8740b33f0 2023-10-16T12:59:50.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.750+0000 7fd871d9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd8740b33f0 0x7fd87406f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:50.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.750+0000 7fd872d9d700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fd8740cd770 0x7fd8740b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43794/0 (socket says 172.21.15.124:43794) 2023-10-16T12:59:50.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.750+0000 7fd872d9d700 1 -- 172.21.15.124:0/2215066725 learned_addr learned my addr 172.21.15.124:0/2215066725 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:50.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.750+0000 7fd871d9b700 1 -- 172.21.15.124:0/2215066725 >> v1:172.21.15.192:6789/0 conn(0x7fd87415b4e0 legacy=0x7fd8740b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:50.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.750+0000 7fd871d9b700 1 -- 172.21.15.124:0/2215066725 >> v1:172.21.15.124:6789/0 conn(0x7fd8740cd770 legacy=0x7fd8740b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:50.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.750+0000 7fd871d9b700 1 -- 172.21.15.124:0/2215066725 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd874070ec0 con 0x7fd8740b33f0 2023-10-16T12:59:50.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.750+0000 7fd87159a700 1 -- 172.21.15.124:0/2215066725 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342869280 0 0) 0x7fd874070620 con 0x7fd8740cd770 2023-10-16T12:59:50.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.751+0000 7fd871d9b700 1 --2- 172.21.15.124:0/2215066725 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8740b33f0 0x7fd87406f280 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009870 tx=0x7fd85c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac678d6ad35819 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:50.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.751+0000 7fd87159a700 1 -- 172.21.15.124:0/2215066725 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c011830 con 0x7fd8740b33f0 2023-10-16T12:59:50.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.751+0000 7fd87159a700 1 -- 172.21.15.124:0/2215066725 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c011990 con 0x7fd8740b33f0 2023-10-16T12:59:50.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.751+0000 7fd87159a700 1 -- 172.21.15.124:0/2215066725 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c011d20 con 0x7fd8740b33f0 2023-10-16T12:59:50.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.751+0000 7fd878a02700 1 -- 172.21.15.124:0/2215066725 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8740b33f0 msgr2=0x7fd87406f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:50.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.751+0000 7fd878a02700 1 --2- 172.21.15.124:0/2215066725 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8740b33f0 0x7fd87406f280 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009870 tx=0x7fd85c009b80 comp rx=0 tx=0).stop 2023-10-16T12:59:50.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.751+0000 7fd878a02700 1 -- 172.21.15.124:0/2215066725 shutdown_connections 2023-10-16T12:59:50.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.751+0000 7fd878a02700 1 --2- 172.21.15.124:0/2215066725 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8740b33f0 0x7fd87406f280 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.751+0000 7fd878a02700 1 -- 172.21.15.124:0/2215066725 >> 172.21.15.124:0/2215066725 conn(0x7fd8740cdce0 msgr2=0x7fd8740ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:50.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.751+0000 7fd878a02700 1 -- 172.21.15.124:0/2215066725 shutdown_connections 2023-10-16T12:59:50.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.751+0000 7fd878a02700 1 -- 172.21.15.124:0/2215066725 wait complete. 2023-10-16T12:59:50.760 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.753+0000 7fd878a02700 1 Processor -- start 2023-10-16T12:59:50.761 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.753+0000 7fd878a02700 1 -- start start 2023-10-16T12:59:50.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.753+0000 7fd878a02700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8740b33f0 0x7fd8741f0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:50.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.753+0000 7fd878a02700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8740cd770 0x7fd8741e0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:50.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.753+0000 7fd878a02700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd87415b4e0 0x7fd8741e11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:50.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.753+0000 7fd878a02700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8741f26f0 con 0x7fd87415b4e0 2023-10-16T12:59:50.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.753+0000 7fd878a02700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8741f1800 con 0x7fd8740b33f0 2023-10-16T12:59:50.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.753+0000 7fd878a02700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8741f1ae0 con 0x7fd8740cd770 2023-10-16T12:59:50.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.753+0000 7fd872d9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd87415b4e0 0x7fd8741e11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:50.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.754+0000 7fd872d9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd87415b4e0 0x7fd8741e11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55132/0 (socket says 172.21.15.124:55132) 2023-10-16T12:59:50.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.754+0000 7fd872d9d700 1 -- 172.21.15.124:0/296105369 learned_addr learned my addr 172.21.15.124:0/296105369 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:50.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.754+0000 7fd87259c700 1 --2- 172.21.15.124:0/296105369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8740b33f0 0x7fd8741f0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:50.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.754+0000 7fd871d9b700 1 --2- 172.21.15.124:0/296105369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8740cd770 0x7fd8741e0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:50.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.754+0000 7fd872d9d700 1 -- 172.21.15.124:0/296105369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8740cd770 msgr2=0x7fd8741e0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:50.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.754+0000 7fd872d9d700 1 --2- 172.21.15.124:0/296105369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8740cd770 0x7fd8741e0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.754+0000 7fd872d9d700 1 -- 172.21.15.124:0/296105369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8740b33f0 msgr2=0x7fd8741f0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:50.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.754+0000 7fd872d9d700 1 --2- 172.21.15.124:0/296105369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8740b33f0 0x7fd8741f0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.754+0000 7fd872d9d700 1 -- 172.21.15.124:0/296105369 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c0094a0 con 0x7fd87415b4e0 2023-10-16T12:59:50.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.754+0000 7fd871d9b700 1 --2- 172.21.15.124:0/296105369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8740cd770 0x7fd8741e0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:50.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.754+0000 7fd872d9d700 1 --2- 172.21.15.124:0/296105369 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd87415b4e0 0x7fd8741e11b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd86400c4b0 tx=0x7fd86400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:50.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.754+0000 7fd86affd700 1 -- 172.21.15.124:0/296105369 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd864004c80 con 0x7fd87415b4e0 2023-10-16T12:59:50.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.754+0000 7fd86affd700 1 -- 172.21.15.124:0/296105369 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd864004e00 con 0x7fd87415b4e0 2023-10-16T12:59:50.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.754+0000 7fd878a02700 1 -- 172.21.15.124:0/296105369 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8741f1dc0 con 0x7fd87415b4e0 2023-10-16T12:59:50.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.754+0000 7fd86affd700 1 -- 172.21.15.124:0/296105369 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd864007310 con 0x7fd87415b4e0 2023-10-16T12:59:50.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.754+0000 7fd878a02700 1 -- 172.21.15.124:0/296105369 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8741f2380 con 0x7fd87415b4e0 2023-10-16T12:59:50.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.755+0000 7fd878a02700 1 -- 172.21.15.124:0/296105369 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87404ebb0 con 0x7fd87415b4e0 2023-10-16T12:59:50.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.756+0000 7fd86affd700 1 -- 172.21.15.124:0/296105369 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd864007470 con 0x7fd87415b4e0 2023-10-16T12:59:50.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.756+0000 7fd86affd700 1 --2- 172.21.15.124:0/296105369 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd85406af00 0x7fd85406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:50.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.756+0000 7fd86affd700 1 -- 172.21.15.124:0/296105369 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7fd864089630 con 0x7fd87415b4e0 2023-10-16T12:59:50.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.756+0000 7fd87259c700 1 --2- 172.21.15.124:0/296105369 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd85406af00 0x7fd85406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:50.771 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.756+0000 7fd87259c700 1 --2- 172.21.15.124:0/296105369 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd85406af00 0x7fd85406d3c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd86c0012e0 tx=0x7fd86c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:50.772 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.760+0000 7fd86affd700 1 -- 172.21.15.124:0/296105369 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd8640543e0 con 0x7fd87415b4e0 2023-10-16T12:59:50.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.949+0000 7fd878a02700 1 -- 172.21.15.124:0/296105369 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd8740d0bf0 con 0x7fd87415b4e0 2023-10-16T12:59:50.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.950+0000 7fd86affd700 1 -- 172.21.15.124:0/296105369 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd864057a00 con 0x7fd87415b4e0 2023-10-16T12:59:50.953 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T12:59:50.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.952+0000 7fd878a02700 1 -- 172.21.15.124:0/296105369 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd85406af00 msgr2=0x7fd85406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:50.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.952+0000 7fd878a02700 1 --2- 172.21.15.124:0/296105369 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd85406af00 0x7fd85406d3c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd86c0012e0 tx=0x7fd86c009040 comp rx=0 tx=0).stop 2023-10-16T12:59:50.955 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.952+0000 7fd878a02700 1 -- 172.21.15.124:0/296105369 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd87415b4e0 msgr2=0x7fd8741e11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:50.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.952+0000 7fd878a02700 1 --2- 172.21.15.124:0/296105369 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd87415b4e0 0x7fd8741e11b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd86400c4b0 tx=0x7fd86400c7c0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.952+0000 7fd878a02700 1 -- 172.21.15.124:0/296105369 shutdown_connections 2023-10-16T12:59:50.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.952+0000 7fd878a02700 1 --2- 172.21.15.124:0/296105369 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd85406af00 0x7fd85406d3c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.956 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.952+0000 7fd878a02700 1 --2- 172.21.15.124:0/296105369 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd87415b4e0 0x7fd8741e11b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.952+0000 7fd878a02700 1 --2- 172.21.15.124:0/296105369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8740b33f0 0x7fd8741f0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.952+0000 7fd878a02700 1 --2- 172.21.15.124:0/296105369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8740cd770 0x7fd8741e0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:50.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.952+0000 7fd878a02700 1 -- 172.21.15.124:0/296105369 >> 172.21.15.124:0/296105369 conn(0x7fd8740cdce0 msgr2=0x7fd8740b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:50.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.952+0000 7fd878a02700 1 -- 172.21.15.124:0/296105369 shutdown_connections 2023-10-16T12:59:50.957 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:50.952+0000 7fd878a02700 1 -- 172.21.15.124:0/296105369 wait complete. 2023-10-16T12:59:50.967 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T12:59:51.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.084+0000 7fb588e55700 1 Processor -- start 2023-10-16T12:59:51.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.084+0000 7fb588e55700 1 -- start start 2023-10-16T12:59:51.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.085+0000 7fb588e55700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb58406a820 0x7fb5840cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:51.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.085+0000 7fb588e55700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5840cfeb0 con 0x7fb5840ca7d0 2023-10-16T12:59:51.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.085+0000 7fb588e55700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb58415ec50 con 0x7fb58415e7f0 2023-10-16T12:59:51.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.085+0000 7fb588e55700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5840ce410 con 0x7fb58406a820 2023-10-16T12:59:51.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.085+0000 7fb582d9d700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fb5840ca7d0 0x7fb584071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43806/0 (socket says 172.21.15.124:43806) 2023-10-16T12:59:51.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.085+0000 7fb58259c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb58406a820 0x7fb5840cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:51.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.085+0000 7fb582d9d700 1 -- 172.21.15.124:0/759533462 learned_addr learned my addr 172.21.15.124:0/759533462 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:51.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.085+0000 7fb58259c700 1 -- 172.21.15.124:0/759533462 >> v1:172.21.15.192:6789/0 conn(0x7fb58415e7f0 legacy=0x7fb58406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:51.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.085+0000 7fb58259c700 1 -- 172.21.15.124:0/759533462 >> v1:172.21.15.124:6789/0 conn(0x7fb5840ca7d0 legacy=0x7fb584071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:51.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.086+0000 7fb58259c700 1 -- 172.21.15.124:0/759533462 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5840af9d0 con 0x7fb58406a820 2023-10-16T12:59:51.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.085+0000 7fb58159a700 1 -- 172.21.15.124:0/759533462 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122522017 0 0) 0x7fb5840cfeb0 con 0x7fb5840ca7d0 2023-10-16T12:59:51.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.086+0000 7fb58259c700 1 --2- 172.21.15.124:0/759533462 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb58406a820 0x7fb5840cf7d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb578009840 tx=0x7fb578009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d26ad8a98364d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:51.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.086+0000 7fb58159a700 1 -- 172.21.15.124:0/759533462 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578011830 con 0x7fb58406a820 2023-10-16T12:59:51.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.086+0000 7fb58159a700 1 -- 172.21.15.124:0/759533462 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb578011990 con 0x7fb58406a820 2023-10-16T12:59:51.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.086+0000 7fb58159a700 1 -- 172.21.15.124:0/759533462 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578011d20 con 0x7fb58406a820 2023-10-16T12:59:51.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.086+0000 7fb588e55700 1 -- 172.21.15.124:0/759533462 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb58406a820 msgr2=0x7fb5840cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:51.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.086+0000 7fb588e55700 1 --2- 172.21.15.124:0/759533462 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb58406a820 0x7fb5840cf7d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb578009840 tx=0x7fb578009b50 comp rx=0 tx=0).stop 2023-10-16T12:59:51.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.086+0000 7fb588e55700 1 -- 172.21.15.124:0/759533462 shutdown_connections 2023-10-16T12:59:51.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.086+0000 7fb588e55700 1 --2- 172.21.15.124:0/759533462 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb58406a820 0x7fb5840cf7d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:51.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.086+0000 7fb588e55700 1 -- 172.21.15.124:0/759533462 >> 172.21.15.124:0/759533462 conn(0x7fb5840d0180 msgr2=0x7fb5840d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:51.094 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.086+0000 7fb588e55700 1 -- 172.21.15.124:0/759533462 shutdown_connections 2023-10-16T12:59:51.094 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.086+0000 7fb588e55700 1 -- 172.21.15.124:0/759533462 wait complete. 2023-10-16T12:59:51.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.088+0000 7fb588e55700 1 Processor -- start 2023-10-16T12:59:51.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.088+0000 7fb588e55700 1 -- start start 2023-10-16T12:59:51.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.088+0000 7fb588e55700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58406a820 0x7fb5840b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:51.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.088+0000 7fb588e55700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5840ca7d0 0x7fb5841566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:51.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.088+0000 7fb588e55700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb58415e7f0 0x7fb584158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:51.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.088+0000 7fb588e55700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5840c56d0 con 0x7fb58415e7f0 2023-10-16T12:59:51.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.088+0000 7fb588e55700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5840b13c0 con 0x7fb58406a820 2023-10-16T12:59:51.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.088+0000 7fb588e55700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb584156c30 con 0x7fb5840ca7d0 2023-10-16T12:59:51.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.089+0000 7fb582d9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb58415e7f0 0x7fb584158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:51.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.089+0000 7fb582d9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb58415e7f0 0x7fb584158220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55144/0 (socket says 172.21.15.124:55144) 2023-10-16T12:59:51.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.089+0000 7fb582d9d700 1 -- 172.21.15.124:0/4210701087 learned_addr learned my addr 172.21.15.124:0/4210701087 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:51.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.089+0000 7fb58259c700 1 --2- 172.21.15.124:0/4210701087 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58406a820 0x7fb5840b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:51.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.089+0000 7fb581d9b700 1 --2- 172.21.15.124:0/4210701087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5840ca7d0 0x7fb5841566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:51.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.089+0000 7fb582d9d700 1 -- 172.21.15.124:0/4210701087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5840ca7d0 msgr2=0x7fb5841566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:51.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.089+0000 7fb582d9d700 1 --2- 172.21.15.124:0/4210701087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5840ca7d0 0x7fb5841566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:51.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.089+0000 7fb582d9d700 1 -- 172.21.15.124:0/4210701087 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58406a820 msgr2=0x7fb5840b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:51.101 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.089+0000 7fb582d9d700 1 --2- 172.21.15.124:0/4210701087 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58406a820 0x7fb5840b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:51.101 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.089+0000 7fb582d9d700 1 -- 172.21.15.124:0/4210701087 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5780094a0 con 0x7fb58415e7f0 2023-10-16T12:59:51.101 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.089+0000 7fb582d9d700 1 --2- 172.21.15.124:0/4210701087 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb58415e7f0 0x7fb584158220 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00cc00 tx=0x7fb57c00cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:51.101 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.089+0000 7fb572ffd700 1 -- 172.21.15.124:0/4210701087 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c00aa00 con 0x7fb58415e7f0 2023-10-16T12:59:51.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.089+0000 7fb572ffd700 1 -- 172.21.15.124:0/4210701087 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57c00ab80 con 0x7fb58415e7f0 2023-10-16T12:59:51.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.089+0000 7fb588e55700 1 -- 172.21.15.124:0/4210701087 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5840b10e0 con 0x7fb58415e7f0 2023-10-16T12:59:51.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.089+0000 7fb572ffd700 1 -- 172.21.15.124:0/4210701087 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c0070d0 con 0x7fb58415e7f0 2023-10-16T12:59:51.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.089+0000 7fb588e55700 1 -- 172.21.15.124:0/4210701087 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5840c5360 con 0x7fb58415e7f0 2023-10-16T12:59:51.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.090+0000 7fb588e55700 1 -- 172.21.15.124:0/4210701087 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5840c5880 con 0x7fb58415e7f0 2023-10-16T12:59:51.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.091+0000 7fb572ffd700 1 -- 172.21.15.124:0/4210701087 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb57c007230 con 0x7fb58415e7f0 2023-10-16T12:59:51.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.091+0000 7fb572ffd700 1 --2- 172.21.15.124:0/4210701087 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb56406af00 0x7fb56406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:51.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.091+0000 7fb572ffd700 1 -- 172.21.15.124:0/4210701087 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7fb57c089720 con 0x7fb58415e7f0 2023-10-16T12:59:51.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.091+0000 7fb58259c700 1 --2- 172.21.15.124:0/4210701087 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb56406af00 0x7fb56406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:51.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.092+0000 7fb58259c700 1 --2- 172.21.15.124:0/4210701087 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb56406af00 0x7fb56406d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb5780090b0 tx=0x7fb57801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:51.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.096+0000 7fb572ffd700 1 -- 172.21.15.124:0/4210701087 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb5840c5880 con 0x7fb58415e7f0 2023-10-16T12:59:51.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.328+0000 7fb588e55700 1 -- 172.21.15.124:0/4210701087 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5840c5880 con 0x7fb58415e7f0 2023-10-16T12:59:51.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.328+0000 7fb572ffd700 1 -- 172.21.15.124:0/4210701087 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4918 (secure 0 0 0) 0x7fb5840c5880 con 0x7fb58415e7f0 2023-10-16T12:59:51.332 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:51.332 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1489119886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6833","nonce":1489119886},{"type":"v1","addr":"172.21.15.192:6835","nonce":1489119886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/2221949787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":2221949787},{"type":"v1","addr":"172.21.15.124:6836","nonce":2221949787}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1247092782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":1247092782},{"type":"v1","addr":"172.21.15.124:6837","nonce":1247092782}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T12:58:51.047667+0000","modified":"2023-10-16T12:59:08.133656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6834/621867052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":621867052},{"type":"v1","addr":"172.21.15.192:6834","nonce":621867052}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T12:59:51.334 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.330+0000 7fb588e55700 1 -- 172.21.15.124:0/4210701087 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb56406af00 msgr2=0x7fb56406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:51.334 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.330+0000 7fb588e55700 1 --2- 172.21.15.124:0/4210701087 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb56406af00 0x7fb56406d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb5780090b0 tx=0x7fb57801c040 comp rx=0 tx=0).stop 2023-10-16T12:59:51.334 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.330+0000 7fb588e55700 1 -- 172.21.15.124:0/4210701087 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb58415e7f0 msgr2=0x7fb584158220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:51.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.330+0000 7fb588e55700 1 --2- 172.21.15.124:0/4210701087 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb58415e7f0 0x7fb584158220 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00cc00 tx=0x7fb57c00cf10 comp rx=0 tx=0).stop 2023-10-16T12:59:51.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.330+0000 7fb588e55700 1 -- 172.21.15.124:0/4210701087 shutdown_connections 2023-10-16T12:59:51.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.330+0000 7fb588e55700 1 --2- 172.21.15.124:0/4210701087 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb56406af00 0x7fb56406d3c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:51.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.330+0000 7fb588e55700 1 --2- 172.21.15.124:0/4210701087 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb58415e7f0 0x7fb584158220 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:51.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.330+0000 7fb588e55700 1 --2- 172.21.15.124:0/4210701087 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58406a820 0x7fb5840b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:51.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.330+0000 7fb588e55700 1 --2- 172.21.15.124:0/4210701087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5840ca7d0 0x7fb5841566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:51.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.330+0000 7fb588e55700 1 -- 172.21.15.124:0/4210701087 >> 172.21.15.124:0/4210701087 conn(0x7fb5840d0180 msgr2=0x7fb58406d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:51.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.330+0000 7fb588e55700 1 -- 172.21.15.124:0/4210701087 shutdown_connections 2023-10-16T12:59:51.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.330+0000 7fb588e55700 1 -- 172.21.15.124:0/4210701087 wait complete. 2023-10-16T12:59:51.336 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 9 2023-10-16T12:59:51.345 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:59:51.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.462+0000 7efe00deb700 1 Processor -- start 2023-10-16T12:59:51.465 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.462+0000 7efe00deb700 1 -- start start 2023-10-16T12:59:51.472 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.463+0000 7efe00deb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdfc15daa0 0x7efdfc0af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:51.472 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.463+0000 7efe00deb700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efdfc071f60 0x7efdfc06d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:51.472 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.463+0000 7efe00deb700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdfc15ed10 con 0x7efdfc0af560 2023-10-16T12:59:51.472 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.463+0000 7efe00deb700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdfc15de80 con 0x7efdfc071f60 2023-10-16T12:59:51.472 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.463+0000 7efe00deb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc15e100 con 0x7efdfc15daa0 2023-10-16T12:59:51.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.463+0000 7efdf9d9b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7efdfc0af560 0x7efdfc071850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43816/0 (socket says 172.21.15.124:43816) 2023-10-16T12:59:51.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.463+0000 7efdf9d9b700 1 -- 172.21.15.124:0/2989714002 learned_addr learned my addr 172.21.15.124:0/2989714002 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:51.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdfad9d700 1 --2- 172.21.15.124:0/2989714002 >> v2:172.21.15.192:3300/0 conn(0x7efdfc071f60 0x7efdfc06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:51.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdfa59c700 1 --2- 172.21.15.124:0/2989714002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdfc15daa0 0x7efdfc0af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:51.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdf959a700 1 -- 172.21.15.124:0/2989714002 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3352575744 0 0) 0x7efdfc15ed10 con 0x7efdfc0af560 2023-10-16T12:59:51.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdf959a700 1 -- 172.21.15.124:0/2989714002 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efde80035b0 con 0x7efdfc0af560 2023-10-16T12:59:51.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdf959a700 1 -- 172.21.15.124:0/2989714002 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3483278389 0 0) 0x7efde80035b0 con 0x7efdfc0af560 2023-10-16T12:59:51.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdf959a700 1 -- 172.21.15.124:0/2989714002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdfc15daa0 msgr2=0x7efdfc0af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:51.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdf959a700 1 --2- 172.21.15.124:0/2989714002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdfc15daa0 0x7efdfc0af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:51.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdf959a700 1 -- 172.21.15.124:0/2989714002 >> v2:172.21.15.192:3300/0 conn(0x7efdfc071f60 msgr2=0x7efdfc06d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:51.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdf959a700 1 --2- 172.21.15.124:0/2989714002 >> v2:172.21.15.192:3300/0 conn(0x7efdfc071f60 0x7efdfc06d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:51.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdf959a700 1 -- 172.21.15.124:0/2989714002 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc15e3e0 con 0x7efdfc0af560 2023-10-16T12:59:51.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdf959a700 1 -- 172.21.15.124:0/2989714002 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7efdec001670 con 0x7efdfc0af560 2023-10-16T12:59:51.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdf959a700 1 -- 172.21.15.124:0/2989714002 >> v1:172.21.15.124:6789/0 conn(0x7efdfc0af560 legacy=0x7efdfc071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:51.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdf959a700 1 --2- 172.21.15.124:0/2989714002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efde8003a00 0x7efde8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:51.476 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdf959a700 1 --2- 172.21.15.124:0/2989714002 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efde8004850 0x7efde8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:51.476 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdf959a700 1 --2- 172.21.15.124:0/2989714002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdfc15daa0 0x7efde8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:51.476 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdf959a700 1 -- 172.21.15.124:0/2989714002 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc15de80 con 0x7efde8004850 2023-10-16T12:59:51.476 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdf959a700 1 -- 172.21.15.124:0/2989714002 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc15e100 con 0x7efde8003a00 2023-10-16T12:59:51.476 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdf959a700 1 -- 172.21.15.124:0/2989714002 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde800ba10 con 0x7efdfc15daa0 2023-10-16T12:59:51.477 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdfad9d700 1 --2- 172.21.15.124:0/2989714002 >> v2:172.21.15.192:3300/0 conn(0x7efdfc071f60 0x7efdfc06d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:59:51.477 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdf9d9b700 1 --2- 172.21.15.124:0/2989714002 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efde8004850 0x7efde8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:51.477 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdfa59c700 1 --2- 172.21.15.124:0/2989714002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efde8003a00 0x7efde8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:51.477 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdfad9d700 1 --2- 172.21.15.124:0/2989714002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdfc15daa0 0x7efde8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:51.477 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdf9d9b700 1 -- 172.21.15.124:0/2989714002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdfc15daa0 msgr2=0x7efde8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:51.478 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdf9d9b700 1 --2- 172.21.15.124:0/2989714002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdfc15daa0 0x7efde8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:51.478 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdf9d9b700 1 -- 172.21.15.124:0/2989714002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efde8003a00 msgr2=0x7efde8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:51.478 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdf9d9b700 1 --2- 172.21.15.124:0/2989714002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efde8003a00 0x7efde8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:51.478 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdf9d9b700 1 -- 172.21.15.124:0/2989714002 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde80035b0 con 0x7efde8004850 2023-10-16T12:59:51.478 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.464+0000 7efdfa59c700 1 --2- 172.21.15.124:0/2989714002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efde8003a00 0x7efde8003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:51.479 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.465+0000 7efdf9d9b700 1 --2- 172.21.15.124:0/2989714002 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efde8004850 0x7efde8004cd0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7efdec00c320 tx=0x7efde8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6c2b713181191f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:51.479 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.465+0000 7efdf959a700 1 -- 172.21.15.124:0/2989714002 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec00ce60 con 0x7efde8004850 2023-10-16T12:59:51.479 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.465+0000 7efdf959a700 1 -- 172.21.15.124:0/2989714002 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec005960 con 0x7efde8004850 2023-10-16T12:59:51.479 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.465+0000 7efdf959a700 1 -- 172.21.15.124:0/2989714002 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec005cf0 con 0x7efde8004850 2023-10-16T12:59:51.479 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.465+0000 7efe00deb700 1 -- 172.21.15.124:0/2989714002 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efde8004850 msgr2=0x7efde8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:51.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.465+0000 7efe00deb700 1 --2- 172.21.15.124:0/2989714002 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efde8004850 0x7efde8004cd0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7efdec00c320 tx=0x7efde8005880 comp rx=0 tx=0).stop 2023-10-16T12:59:51.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.465+0000 7efdfad9d700 1 -- 172.21.15.124:0/2989714002 reap_dead start 2023-10-16T12:59:51.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.465+0000 7efe00deb700 1 -- 172.21.15.124:0/2989714002 shutdown_connections 2023-10-16T12:59:51.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.465+0000 7efe00deb700 1 -- 172.21.15.124:0/2989714002 >> 172.21.15.124:0/2989714002 conn(0x7efdfc0d0180 msgr2=0x7efdfc0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:51.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.465+0000 7efe00deb700 1 -- 172.21.15.124:0/2989714002 shutdown_connections 2023-10-16T12:59:51.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.465+0000 7efe00deb700 1 -- 172.21.15.124:0/2989714002 wait complete. 2023-10-16T12:59:51.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.467+0000 7efe00deb700 1 Processor -- start 2023-10-16T12:59:51.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.467+0000 7efe00deb700 1 -- start start 2023-10-16T12:59:51.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.467+0000 7efe00deb700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efde8004850 0x7efdfc15c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:51.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.467+0000 7efe00deb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdfc1f0a20 0x7efdfc1586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:51.481 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.467+0000 7efe00deb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdfc0c5790 0x7efdfc0c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:51.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.467+0000 7efe00deb700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc1f0600 con 0x7efde8004850 2023-10-16T12:59:51.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.467+0000 7efe00deb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc1efd30 con 0x7efdfc0c5790 2023-10-16T12:59:51.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.467+0000 7efe00deb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc15c820 con 0x7efdfc1f0a20 2023-10-16T12:59:51.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.467+0000 7efdfa59c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efde8004850 0x7efdfc15c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:51.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.468+0000 7efdfa59c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efde8004850 0x7efdfc15c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55160/0 (socket says 172.21.15.124:55160) 2023-10-16T12:59:51.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.468+0000 7efdfa59c700 1 -- 172.21.15.124:0/897932453 learned_addr learned my addr 172.21.15.124:0/897932453 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:51.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.468+0000 7efdf9d9b700 1 --2- 172.21.15.124:0/897932453 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdfc1f0a20 0x7efdfc1586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:51.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.468+0000 7efdfad9d700 1 --2- 172.21.15.124:0/897932453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdfc0c5790 0x7efdfc0c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:51.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.468+0000 7efdfa59c700 1 -- 172.21.15.124:0/897932453 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdfc1f0a20 msgr2=0x7efdfc1586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:51.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.468+0000 7efdfa59c700 1 --2- 172.21.15.124:0/897932453 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdfc1f0a20 0x7efdfc1586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:51.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.468+0000 7efdfa59c700 1 -- 172.21.15.124:0/897932453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdfc0c5790 msgr2=0x7efdfc0c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:51.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.468+0000 7efdfa59c700 1 --2- 172.21.15.124:0/897932453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdfc0c5790 0x7efdfc0c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:51.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.468+0000 7efdfa59c700 1 -- 172.21.15.124:0/897932453 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc1eff40 con 0x7efde8004850 2023-10-16T12:59:51.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.468+0000 7efdfa59c700 1 --2- 172.21.15.124:0/897932453 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efde8004850 0x7efdfc15c140 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7efde4010850 tx=0x7efde4010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:51.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.468+0000 7efdf2ffd700 1 -- 172.21.15.124:0/897932453 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde4010e50 con 0x7efde8004850 2023-10-16T12:59:51.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.468+0000 7efdf2ffd700 1 -- 172.21.15.124:0/897932453 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde4004020 con 0x7efde8004850 2023-10-16T12:59:51.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.468+0000 7efe00deb700 1 -- 172.21.15.124:0/897932453 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdfc1f0220 con 0x7efde8004850 2023-10-16T12:59:51.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.468+0000 7efdf2ffd700 1 -- 172.21.15.124:0/897932453 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde40043b0 con 0x7efde8004850 2023-10-16T12:59:51.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.468+0000 7efe00deb700 1 -- 172.21.15.124:0/897932453 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdfc15aaf0 con 0x7efde8004850 2023-10-16T12:59:51.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.469+0000 7efe00deb700 1 -- 172.21.15.124:0/897932453 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdfc15e6a0 con 0x7efde8004850 2023-10-16T12:59:51.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.469+0000 7efdf2ffd700 1 -- 172.21.15.124:0/897932453 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efde400e870 con 0x7efde8004850 2023-10-16T12:59:51.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.470+0000 7efdf2ffd700 1 --2- 172.21.15.124:0/897932453 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7efddc06af00 0x7efddc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:51.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.470+0000 7efdf2ffd700 1 -- 172.21.15.124:0/897932453 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7efde4089b20 con 0x7efde8004850 2023-10-16T12:59:51.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.470+0000 7efdf9d9b700 1 --2- 172.21.15.124:0/897932453 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7efddc06af00 0x7efddc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:51.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.470+0000 7efdf9d9b700 1 --2- 172.21.15.124:0/897932453 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7efddc06af00 0x7efddc06d3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efdec008fd0 tx=0x7efdec00a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:51.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.474+0000 7efdf2ffd700 1 -- 172.21.15.124:0/897932453 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efdfc15e6a0 con 0x7efde8004850 2023-10-16T12:59:51.667 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.664+0000 7efe00deb700 1 -- 172.21.15.124:0/897932453 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efdfc15e6a0 con 0x7efde8004850 2023-10-16T12:59:51.668 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.665+0000 7efdf2ffd700 1 -- 172.21.15.124:0/897932453 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18751 (secure 0 0 0) 0x7efdfc15e6a0 con 0x7efde8004850 2023-10-16T12:59:51.669 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:51.669 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":26,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:59:34.463212+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2},{"from":7,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:59:51.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.667+0000 7efe00deb700 1 -- 172.21.15.124:0/897932453 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7efddc06af00 msgr2=0x7efddc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:51.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.668+0000 7efe00deb700 1 --2- 172.21.15.124:0/897932453 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7efddc06af00 0x7efddc06d3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efdec008fd0 tx=0x7efdec00a000 comp rx=0 tx=0).stop 2023-10-16T12:59:51.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.668+0000 7efe00deb700 1 -- 172.21.15.124:0/897932453 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efde8004850 msgr2=0x7efdfc15c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:51.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.668+0000 7efe00deb700 1 --2- 172.21.15.124:0/897932453 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efde8004850 0x7efdfc15c140 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7efde4010850 tx=0x7efde4010c10 comp rx=0 tx=0).stop 2023-10-16T12:59:51.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.668+0000 7efe00deb700 1 -- 172.21.15.124:0/897932453 shutdown_connections 2023-10-16T12:59:51.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.668+0000 7efe00deb700 1 --2- 172.21.15.124:0/897932453 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7efddc06af00 0x7efddc06d3c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:51.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.668+0000 7efe00deb700 1 --2- 172.21.15.124:0/897932453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdfc0c5790 0x7efdfc0c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:51.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.668+0000 7efe00deb700 1 --2- 172.21.15.124:0/897932453 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efde8004850 0x7efdfc15c140 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:51.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.668+0000 7efe00deb700 1 --2- 172.21.15.124:0/897932453 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdfc1f0a20 0x7efdfc1586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:51.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.668+0000 7efe00deb700 1 -- 172.21.15.124:0/897932453 >> 172.21.15.124:0/897932453 conn(0x7efdfc0d0180 msgr2=0x7efdfc0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:51.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.668+0000 7efe00deb700 1 -- 172.21.15.124:0/897932453 shutdown_connections 2023-10-16T12:59:51.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.668+0000 7efe00deb700 1 -- 172.21.15.124:0/897932453 wait complete. 2023-10-16T12:59:51.684 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-16T12:59:51.684 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T12:59:51.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.804+0000 7fcfb2391700 1 Processor -- start 2023-10-16T12:59:51.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.804+0000 7fcfb2391700 1 -- start start 2023-10-16T12:59:51.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.805+0000 7fcfb2391700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfac0cf7d0 0x7fcfac15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:51.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.805+0000 7fcfb2391700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcfac0ca7d0 0x7fcfac071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:51.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.805+0000 7fcfb2391700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfac0cfeb0 con 0x7fcfac06a820 2023-10-16T12:59:51.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.805+0000 7fcfb2391700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfac0ce410 con 0x7fcfac0ca7d0 2023-10-16T12:59:51.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.805+0000 7fcfb2391700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac0cfc30 con 0x7fcfac0cf7d0 2023-10-16T12:59:51.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.805+0000 7fcfb092e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcfac0ca7d0 0x7fcfac071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:51.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.805+0000 7fcfab7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfac0cf7d0 0x7fcfac15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:51.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.805+0000 7fcfb092e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcfac0ca7d0 0x7fcfac071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:35338/0 (socket says 172.21.15.124:35338) 2023-10-16T12:59:51.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.805+0000 7fcfb092e700 1 -- 172.21.15.124:0/3266839350 learned_addr learned my addr 172.21.15.124:0/3266839350 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:51.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.805+0000 7fcfabfff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fcfac06a820 0x7fcfac06ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.124:55832/0 (socket says 172.21.15.124:55832) 2023-10-16T12:59:51.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.805+0000 7fcfb092e700 1 -- 172.21.15.124:0/3266839350 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfac0cf7d0 msgr2=0x7fcfac15e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:51.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.805+0000 7fcfb092e700 1 --2- 172.21.15.124:0/3266839350 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfac0cf7d0 0x7fcfac15e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:51.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.805+0000 7fcfb092e700 1 -- 172.21.15.124:0/3266839350 >> v1:172.21.15.192:6789/0 conn(0x7fcfac06a820 legacy=0x7fcfac06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:51.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.806+0000 7fcfb092e700 1 -- 172.21.15.124:0/3266839350 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac0af9d0 con 0x7fcfac0ca7d0 2023-10-16T12:59:51.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.806+0000 7fcfab7fe700 1 --2- 172.21.15.124:0/3266839350 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfac0cf7d0 0x7fcfac15e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:59:51.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.806+0000 7fcfb092e700 1 --2- 172.21.15.124:0/3266839350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfac0ca7d0 0x7fcfac071ea0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4009e50 tx=0x7fcfa400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f931da068b11a87 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:51.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.806+0000 7fcfaaffd700 1 -- 172.21.15.124:0/3266839350 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa400e070 con 0x7fcfac0ca7d0 2023-10-16T12:59:51.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.806+0000 7fcfaaffd700 1 -- 172.21.15.124:0/3266839350 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa400b910 con 0x7fcfac0ca7d0 2023-10-16T12:59:51.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.806+0000 7fcfaaffd700 1 -- 172.21.15.124:0/3266839350 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa400bcc0 con 0x7fcfac0ca7d0 2023-10-16T12:59:51.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.806+0000 7fcfb2391700 1 -- 172.21.15.124:0/3266839350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfac0ca7d0 msgr2=0x7fcfac071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:51.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.806+0000 7fcfb2391700 1 --2- 172.21.15.124:0/3266839350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfac0ca7d0 0x7fcfac071ea0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4009e50 tx=0x7fcfa400b330 comp rx=0 tx=0).stop 2023-10-16T12:59:51.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.806+0000 7fcfb2391700 1 -- 172.21.15.124:0/3266839350 shutdown_connections 2023-10-16T12:59:51.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.806+0000 7fcfb2391700 1 --2- 172.21.15.124:0/3266839350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfac0ca7d0 0x7fcfac071ea0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:51.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.806+0000 7fcfb2391700 1 --2- 172.21.15.124:0/3266839350 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfac0cf7d0 0x7fcfac15e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:51.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.806+0000 7fcfb2391700 1 -- 172.21.15.124:0/3266839350 >> 172.21.15.124:0/3266839350 conn(0x7fcfac0d0180 msgr2=0x7fcfac0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:51.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.806+0000 7fcfb2391700 1 -- 172.21.15.124:0/3266839350 shutdown_connections 2023-10-16T12:59:51.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.807+0000 7fcfb2391700 1 -- 172.21.15.124:0/3266839350 wait complete. 2023-10-16T12:59:51.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.808+0000 7fcfb2391700 1 Processor -- start 2023-10-16T12:59:51.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.808+0000 7fcfb2391700 1 -- start start 2023-10-16T12:59:51.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.809+0000 7fcfb2391700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfac06a820 0x7fcfac1f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:51.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.809+0000 7fcfb2391700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfac0ca7d0 0x7fcfac0c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:51.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.809+0000 7fcfb2391700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfac0cf7d0 0x7fcfac0c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:51.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.809+0000 7fcfb2391700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac1f2fb0 con 0x7fcfac0ca7d0 2023-10-16T12:59:51.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.809+0000 7fcfb2391700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac0c7f30 con 0x7fcfac0cf7d0 2023-10-16T12:59:51.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.809+0000 7fcfb2391700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac0c8210 con 0x7fcfac06a820 2023-10-16T12:59:51.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.809+0000 7fcfab7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfac0ca7d0 0x7fcfac0c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:51.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.809+0000 7fcfab7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfac0ca7d0 0x7fcfac0c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55176/0 (socket says 172.21.15.124:55176) 2023-10-16T12:59:51.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.809+0000 7fcfab7fe700 1 -- 172.21.15.124:0/750216886 learned_addr learned my addr 172.21.15.124:0/750216886 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:51.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.809+0000 7fcfabfff700 1 --2- 172.21.15.124:0/750216886 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfac06a820 0x7fcfac1f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:51.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.809+0000 7fcfb092e700 1 --2- 172.21.15.124:0/750216886 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfac0cf7d0 0x7fcfac0c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:51.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.809+0000 7fcfab7fe700 1 -- 172.21.15.124:0/750216886 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfac06a820 msgr2=0x7fcfac1f2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:51.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.809+0000 7fcfab7fe700 1 --2- 172.21.15.124:0/750216886 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfac06a820 0x7fcfac1f2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:51.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.809+0000 7fcfab7fe700 1 -- 172.21.15.124:0/750216886 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfac0cf7d0 msgr2=0x7fcfac0c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:51.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.809+0000 7fcfab7fe700 1 --2- 172.21.15.124:0/750216886 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfac0cf7d0 0x7fcfac0c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:51.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.809+0000 7fcfab7fe700 1 -- 172.21.15.124:0/750216886 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa00094a0 con 0x7fcfac0ca7d0 2023-10-16T12:59:51.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.809+0000 7fcfab7fe700 1 --2- 172.21.15.124:0/750216886 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfac0ca7d0 0x7fcfac0c42c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcfa000ebe0 tx=0x7fcfa000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:51.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.809+0000 7fcfa8ff9700 1 -- 172.21.15.124:0/750216886 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0009760 con 0x7fcfac0ca7d0 2023-10-16T12:59:51.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.809+0000 7fcfa8ff9700 1 -- 172.21.15.124:0/750216886 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa000c850 con 0x7fcfac0ca7d0 2023-10-16T12:59:51.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.809+0000 7fcfb2391700 1 -- 172.21.15.124:0/750216886 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa4009b30 con 0x7fcfac0ca7d0 2023-10-16T12:59:51.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.809+0000 7fcfa8ff9700 1 -- 172.21.15.124:0/750216886 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa000cbe0 con 0x7fcfac0ca7d0 2023-10-16T12:59:51.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.809+0000 7fcfb2391700 1 -- 172.21.15.124:0/750216886 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfac0c87d0 con 0x7fcfac0ca7d0 2023-10-16T12:59:51.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.810+0000 7fcfb2391700 1 -- 172.21.15.124:0/750216886 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfac04ebb0 con 0x7fcfac0ca7d0 2023-10-16T12:59:51.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.811+0000 7fcfa8ff9700 1 -- 172.21.15.124:0/750216886 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcfa000cd40 con 0x7fcfac0ca7d0 2023-10-16T12:59:51.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.811+0000 7fcfa8ff9700 1 --2- 172.21.15.124:0/750216886 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fcf9806af00 0x7fcf9806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:51.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.811+0000 7fcfa8ff9700 1 -- 172.21.15.124:0/750216886 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7fcfa00899c0 con 0x7fcfac0ca7d0 2023-10-16T12:59:51.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.811+0000 7fcfabfff700 1 --2- 172.21.15.124:0/750216886 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fcf9806af00 0x7fcf9806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:51.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.812+0000 7fcfabfff700 1 --2- 172.21.15.124:0/750216886 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fcf9806af00 0x7fcf9806d3c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c000f60 tx=0x7fcf9c007ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:51.823 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:51.816+0000 7fcfa8ff9700 1 -- 172.21.15.124:0/750216886 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcfa00546b0 con 0x7fcfac0ca7d0 2023-10-16T12:59:52.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.046+0000 7fcfb2391700 1 -- 172.21.15.124:0/750216886 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcfac0b0600 con 0x7fcfac0ca7d0 2023-10-16T12:59:52.049 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.046+0000 7fcfa8ff9700 1 -- 172.21.15.124:0/750216886 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4918 (secure 0 0 0) 0x7fcfa0057cd0 con 0x7fcfac0ca7d0 2023-10-16T12:59:52.049 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:52.049 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1489119886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6833","nonce":1489119886},{"type":"v1","addr":"172.21.15.192:6835","nonce":1489119886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/2221949787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":2221949787},{"type":"v1","addr":"172.21.15.124:6836","nonce":2221949787}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1247092782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":1247092782},{"type":"v1","addr":"172.21.15.124:6837","nonce":1247092782}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T12:58:51.047667+0000","modified":"2023-10-16T12:59:08.133656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6834/621867052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":621867052},{"type":"v1","addr":"172.21.15.192:6834","nonce":621867052}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T12:59:52.051 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.048+0000 7fcfb2391700 1 -- 172.21.15.124:0/750216886 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fcf9806af00 msgr2=0x7fcf9806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:52.051 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.048+0000 7fcfb2391700 1 --2- 172.21.15.124:0/750216886 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fcf9806af00 0x7fcf9806d3c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c000f60 tx=0x7fcf9c007ed0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.051 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.048+0000 7fcfb2391700 1 -- 172.21.15.124:0/750216886 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfac0ca7d0 msgr2=0x7fcfac0c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:52.051 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.048+0000 7fcfb2391700 1 --2- 172.21.15.124:0/750216886 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfac0ca7d0 0x7fcfac0c42c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcfa000ebe0 tx=0x7fcfa000eef0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.052 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.048+0000 7fcfb2391700 1 -- 172.21.15.124:0/750216886 shutdown_connections 2023-10-16T12:59:52.052 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.048+0000 7fcfb2391700 1 --2- 172.21.15.124:0/750216886 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fcf9806af00 0x7fcf9806d3c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.052 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.048+0000 7fcfb2391700 1 --2- 172.21.15.124:0/750216886 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfac0cf7d0 0x7fcfac0c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.052 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.048+0000 7fcfb2391700 1 --2- 172.21.15.124:0/750216886 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfac06a820 0x7fcfac1f2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.052 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.048+0000 7fcfb2391700 1 --2- 172.21.15.124:0/750216886 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcfac0ca7d0 0x7fcfac0c42c0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.053 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.048+0000 7fcfb2391700 1 -- 172.21.15.124:0/750216886 >> 172.21.15.124:0/750216886 conn(0x7fcfac0d0180 msgr2=0x7fcfac0b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:52.053 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.048+0000 7fcfb2391700 1 -- 172.21.15.124:0/750216886 shutdown_connections 2023-10-16T12:59:52.053 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.048+0000 7fcfb2391700 1 -- 172.21.15.124:0/750216886 wait complete. 2023-10-16T12:59:52.053 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 9 2023-10-16T12:59:52.063 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T12:59:52.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.180+0000 7f39ae5e5700 1 Processor -- start 2023-10-16T12:59:52.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.180+0000 7f39ae5e5700 1 -- start start 2023-10-16T12:59:52.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.181+0000 7f39ae5e5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f39a806a820 0x7f39a80cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:52.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.181+0000 7f39ae5e5700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f39a815e7f0 0x7f39a806ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:52.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.181+0000 7f39ae5e5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39a80ca7d0 0x7f39a8071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:52.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.181+0000 7f39ae5e5700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a80ce410 con 0x7f39a815e7f0 2023-10-16T12:59:52.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.181+0000 7f39ae5e5700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a80cfeb0 con 0x7f39a806a820 2023-10-16T12:59:52.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.181+0000 7f39ae5e5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a815ec50 con 0x7f39a80ca7d0 2023-10-16T12:59:52.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.181+0000 7f39a77fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f39a815e7f0 0x7f39a806ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:52.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.181+0000 7f39a77fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f39a815e7f0 0x7f39a806ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55182/0 (socket says 172.21.15.124:55182) 2023-10-16T12:59:52.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.181+0000 7f39a77fe700 1 -- 172.21.15.124:0/1801607123 learned_addr learned my addr 172.21.15.124:0/1801607123 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:52.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.181+0000 7f39a77fe700 1 -- 172.21.15.124:0/1801607123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39a80ca7d0 msgr2=0x7f39a8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:52.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.181+0000 7f39a77fe700 1 --2- 172.21.15.124:0/1801607123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39a80ca7d0 0x7f39a8071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.181+0000 7f39a7fff700 1 --2- 172.21.15.124:0/1801607123 >> v2:172.21.15.192:3300/0 conn(0x7f39a806a820 0x7f39a80cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:52.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.181+0000 7f39a77fe700 1 -- 172.21.15.124:0/1801607123 >> v2:172.21.15.192:3300/0 conn(0x7f39a806a820 msgr2=0x7f39a80cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:52.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.181+0000 7f39a77fe700 1 --2- 172.21.15.124:0/1801607123 >> v2:172.21.15.192:3300/0 conn(0x7f39a806a820 0x7f39a80cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.181+0000 7f39a77fe700 1 -- 172.21.15.124:0/1801607123 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a80af9d0 con 0x7f39a815e7f0 2023-10-16T12:59:52.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.182+0000 7f39a77fe700 1 --2- 172.21.15.124:0/1801607123 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39a815e7f0 0x7f39a806ac00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f39a8067df0 tx=0x7f399c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18702e00782cbc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:52.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.182+0000 7f39a6ffd700 1 -- 172.21.15.124:0/1801607123 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c00b870 con 0x7f39a815e7f0 2023-10-16T12:59:52.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.182+0000 7f39a6ffd700 1 -- 172.21.15.124:0/1801607123 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399c00b9d0 con 0x7f39a815e7f0 2023-10-16T12:59:52.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.182+0000 7f39a6ffd700 1 -- 172.21.15.124:0/1801607123 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c00bd60 con 0x7f39a815e7f0 2023-10-16T12:59:52.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.182+0000 7f39ae5e5700 1 -- 172.21.15.124:0/1801607123 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39a815e7f0 msgr2=0x7f39a806ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:52.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.182+0000 7f39ae5e5700 1 --2- 172.21.15.124:0/1801607123 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39a815e7f0 0x7f39a806ac00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f39a8067df0 tx=0x7f399c009bd0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.182+0000 7f39ae5e5700 1 -- 172.21.15.124:0/1801607123 shutdown_connections 2023-10-16T12:59:52.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.182+0000 7f39ae5e5700 1 --2- 172.21.15.124:0/1801607123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39a80ca7d0 0x7f39a8071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.182+0000 7f39ae5e5700 1 --2- 172.21.15.124:0/1801607123 >> v2:172.21.15.192:3300/0 conn(0x7f39a806a820 0x7f39a80cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.182+0000 7f39ae5e5700 1 --2- 172.21.15.124:0/1801607123 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39a815e7f0 0x7f39a806ac00 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.182+0000 7f39ae5e5700 1 -- 172.21.15.124:0/1801607123 >> 172.21.15.124:0/1801607123 conn(0x7f39a80d0180 msgr2=0x7f39a80d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:52.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.182+0000 7f39ae5e5700 1 -- 172.21.15.124:0/1801607123 shutdown_connections 2023-10-16T12:59:52.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.182+0000 7f39ae5e5700 1 -- 172.21.15.124:0/1801607123 wait complete. 2023-10-16T12:59:52.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.184+0000 7f39ae5e5700 1 Processor -- start 2023-10-16T12:59:52.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.184+0000 7f39ae5e5700 1 -- start start 2023-10-16T12:59:52.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.184+0000 7f39ae5e5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39a806a820 0x7f39a80acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:52.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.184+0000 7f39ae5e5700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39a80ca7d0 0x7f39a81f2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:52.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.184+0000 7f39ae5e5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39a815e7f0 0x7f39a815bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:52.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.185+0000 7f39ae5e5700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a8152110 con 0x7f39a80ca7d0 2023-10-16T12:59:52.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.185+0000 7f39ae5e5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a80ad330 con 0x7f39a806a820 2023-10-16T12:59:52.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.185+0000 7f39ae5e5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a81f2d90 con 0x7f39a815e7f0 2023-10-16T12:59:52.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.185+0000 7f39a77fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39a80ca7d0 0x7f39a81f2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:52.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.185+0000 7f39a77fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39a80ca7d0 0x7f39a81f2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55188/0 (socket says 172.21.15.124:55188) 2023-10-16T12:59:52.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.185+0000 7f39a77fe700 1 -- 172.21.15.124:0/2334805721 learned_addr learned my addr 172.21.15.124:0/2334805721 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:52.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.185+0000 7f39a7fff700 1 --2- 172.21.15.124:0/2334805721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39a806a820 0x7f39a80acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:52.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.185+0000 7f39acb82700 1 --2- 172.21.15.124:0/2334805721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39a815e7f0 0x7f39a815bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:52.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.185+0000 7f39a77fe700 1 -- 172.21.15.124:0/2334805721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39a815e7f0 msgr2=0x7f39a815bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:52.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.185+0000 7f39a77fe700 1 --2- 172.21.15.124:0/2334805721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39a815e7f0 0x7f39a815bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.185+0000 7f39a77fe700 1 -- 172.21.15.124:0/2334805721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39a806a820 msgr2=0x7f39a80acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:52.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.185+0000 7f39a77fe700 1 --2- 172.21.15.124:0/2334805721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39a806a820 0x7f39a80acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.185+0000 7f39a77fe700 1 -- 172.21.15.124:0/2334805721 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c009550 con 0x7f39a80ca7d0 2023-10-16T12:59:52.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.185+0000 7f39a77fe700 1 --2- 172.21.15.124:0/2334805721 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39a80ca7d0 0x7f39a81f2850 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f39a806c8d0 tx=0x7f399c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:52.197 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.185+0000 7f39a4ff9700 1 -- 172.21.15.124:0/2334805721 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c004250 con 0x7f39a80ca7d0 2023-10-16T12:59:52.197 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.185+0000 7f39a4ff9700 1 -- 172.21.15.124:0/2334805721 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399c01e070 con 0x7f39a80ca7d0 2023-10-16T12:59:52.197 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.185+0000 7f39ae5e5700 1 -- 172.21.15.124:0/2334805721 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a80c8590 con 0x7f39a80ca7d0 2023-10-16T12:59:52.197 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.185+0000 7f39a4ff9700 1 -- 172.21.15.124:0/2334805721 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c0036a0 con 0x7f39a80ca7d0 2023-10-16T12:59:52.197 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.185+0000 7f39ae5e5700 1 -- 172.21.15.124:0/2334805721 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a80c8b50 con 0x7f39a80ca7d0 2023-10-16T12:59:52.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.186+0000 7f39ae5e5700 1 -- 172.21.15.124:0/2334805721 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a804ebb0 con 0x7f39a80ca7d0 2023-10-16T12:59:52.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.187+0000 7f39a4ff9700 1 -- 172.21.15.124:0/2334805721 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f399c020030 con 0x7f39a80ca7d0 2023-10-16T12:59:52.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.187+0000 7f39a4ff9700 1 --2- 172.21.15.124:0/2334805721 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f399406af00 0x7f399406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:52.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.187+0000 7f39a7fff700 1 --2- 172.21.15.124:0/2334805721 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f399406af00 0x7f399406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:52.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.187+0000 7f39a4ff9700 1 -- 172.21.15.124:0/2334805721 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f399c08a950 con 0x7f39a80ca7d0 2023-10-16T12:59:52.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.187+0000 7f39a7fff700 1 --2- 172.21.15.124:0/2334805721 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f399406af00 0x7f399406d3c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f399800ab60 tx=0x7f3998008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:52.199 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.191+0000 7f39a4ff9700 1 -- 172.21.15.124:0/2334805721 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f399c0556d0 con 0x7f39a80ca7d0 2023-10-16T12:59:52.426 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.423+0000 7f39ae5e5700 1 -- 172.21.15.124:0/2334805721 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39a80b6100 con 0x7f39a80ca7d0 2023-10-16T12:59:52.426 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.424+0000 7f39a4ff9700 1 -- 172.21.15.124:0/2334805721 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4918 (secure 0 0 0) 0x7f399c058cf0 con 0x7f39a80ca7d0 2023-10-16T12:59:52.427 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:52.427 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1489119886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6833","nonce":1489119886},{"type":"v1","addr":"172.21.15.192:6835","nonce":1489119886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/2221949787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":2221949787},{"type":"v1","addr":"172.21.15.124:6836","nonce":2221949787}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1247092782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":1247092782},{"type":"v1","addr":"172.21.15.124:6837","nonce":1247092782}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T12:58:51.047667+0000","modified":"2023-10-16T12:59:08.133656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6834/621867052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":621867052},{"type":"v1","addr":"172.21.15.192:6834","nonce":621867052}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T12:59:52.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.426+0000 7f39ae5e5700 1 -- 172.21.15.124:0/2334805721 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f399406af00 msgr2=0x7f399406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:52.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.426+0000 7f39ae5e5700 1 --2- 172.21.15.124:0/2334805721 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f399406af00 0x7f399406d3c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f399800ab60 tx=0x7f3998008040 comp rx=0 tx=0).stop 2023-10-16T12:59:52.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.426+0000 7f39ae5e5700 1 -- 172.21.15.124:0/2334805721 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39a80ca7d0 msgr2=0x7f39a81f2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:52.429 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.426+0000 7f39ae5e5700 1 --2- 172.21.15.124:0/2334805721 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39a80ca7d0 0x7f39a81f2850 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f39a806c8d0 tx=0x7f399c004750 comp rx=0 tx=0).stop 2023-10-16T12:59:52.430 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.426+0000 7f39ae5e5700 1 -- 172.21.15.124:0/2334805721 shutdown_connections 2023-10-16T12:59:52.430 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.426+0000 7f39ae5e5700 1 --2- 172.21.15.124:0/2334805721 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f399406af00 0x7f399406d3c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.430 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.426+0000 7f39ae5e5700 1 --2- 172.21.15.124:0/2334805721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39a815e7f0 0x7f39a815bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.430 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.426+0000 7f39ae5e5700 1 --2- 172.21.15.124:0/2334805721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39a806a820 0x7f39a80acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.430 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.426+0000 7f39ae5e5700 1 --2- 172.21.15.124:0/2334805721 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f39a80ca7d0 0x7f39a81f2850 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.431 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.426+0000 7f39ae5e5700 1 -- 172.21.15.124:0/2334805721 >> 172.21.15.124:0/2334805721 conn(0x7f39a80d0180 msgr2=0x7f39a80cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:52.431 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.426+0000 7f39ae5e5700 1 -- 172.21.15.124:0/2334805721 shutdown_connections 2023-10-16T12:59:52.431 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.426+0000 7f39ae5e5700 1 -- 172.21.15.124:0/2334805721 wait complete. 2023-10-16T12:59:52.431 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 9 2023-10-16T12:59:52.441 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T12:59:52.561 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.558+0000 7f7e89543700 1 Processor -- start 2023-10-16T12:59:52.561 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.558+0000 7f7e89543700 1 -- start start 2023-10-16T12:59:52.564 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.559+0000 7f7e89543700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7e84160b50 0x7f7e840cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:52.565 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.559+0000 7f7e89543700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e840b9000 0x7f7e840b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:52.565 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.559+0000 7f7e89543700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e840d0010 con 0x7f7e840b5530 2023-10-16T12:59:52.565 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.559+0000 7f7e89543700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e840b59c0 con 0x7f7e84160b50 2023-10-16T12:59:52.565 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.559+0000 7f7e89543700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e840d02f0 con 0x7f7e840b9000 2023-10-16T12:59:52.565 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.559+0000 7f7e82ffd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7e84160b50 0x7f7e840cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:52.566 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.559+0000 7f7e827fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e840b9000 0x7f7e840b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:52.566 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.559+0000 7f7e82ffd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7e84160b50 0x7f7e840cf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:35360/0 (socket says 172.21.15.124:35360) 2023-10-16T12:59:52.566 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.559+0000 7f7e82ffd700 1 -- 172.21.15.124:0/2697297507 learned_addr learned my addr 172.21.15.124:0/2697297507 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:52.566 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.559+0000 7f7e837fe700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f7e840b5530 0x7f7e841611f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.124:55862/0 (socket says 172.21.15.124:55862) 2023-10-16T12:59:52.567 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.560+0000 7f7e827fc700 1 -- 172.21.15.124:0/2697297507 >> v2:172.21.15.192:3300/0 conn(0x7f7e84160b50 msgr2=0x7f7e840cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:52.567 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.560+0000 7f7e827fc700 1 --2- 172.21.15.124:0/2697297507 >> v2:172.21.15.192:3300/0 conn(0x7f7e84160b50 0x7f7e840cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.567 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.560+0000 7f7e827fc700 1 -- 172.21.15.124:0/2697297507 >> v1:172.21.15.192:6789/0 conn(0x7f7e840b5530 legacy=0x7f7e841611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:52.567 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.560+0000 7f7e827fc700 1 -- 172.21.15.124:0/2697297507 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e840d05d0 con 0x7f7e840b9000 2023-10-16T12:59:52.567 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.560+0000 7f7e82ffd700 1 --2- 172.21.15.124:0/2697297507 >> v2:172.21.15.192:3300/0 conn(0x7f7e84160b50 0x7f7e840cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:59:52.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.560+0000 7f7e827fc700 1 --2- 172.21.15.124:0/2697297507 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e840b9000 0x7f7e840b4ff0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009840 tx=0x7f7e74009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a95fdb1102d9725 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:52.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.560+0000 7f7e81ffb700 1 -- 172.21.15.124:0/2697297507 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74011830 con 0x7f7e840b9000 2023-10-16T12:59:52.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.560+0000 7f7e81ffb700 1 -- 172.21.15.124:0/2697297507 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e74011990 con 0x7f7e840b9000 2023-10-16T12:59:52.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.560+0000 7f7e81ffb700 1 -- 172.21.15.124:0/2697297507 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74011d20 con 0x7f7e840b9000 2023-10-16T12:59:52.568 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.560+0000 7f7e89543700 1 -- 172.21.15.124:0/2697297507 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e840b9000 msgr2=0x7f7e840b4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:52.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.560+0000 7f7e89543700 1 --2- 172.21.15.124:0/2697297507 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e840b9000 0x7f7e840b4ff0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009840 tx=0x7f7e74009b50 comp rx=0 tx=0).stop 2023-10-16T12:59:52.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.560+0000 7f7e89543700 1 -- 172.21.15.124:0/2697297507 shutdown_connections 2023-10-16T12:59:52.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.560+0000 7f7e89543700 1 --2- 172.21.15.124:0/2697297507 >> v2:172.21.15.192:3300/0 conn(0x7f7e84160b50 0x7f7e840cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.560+0000 7f7e89543700 1 --2- 172.21.15.124:0/2697297507 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e840b9000 0x7f7e840b4ff0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.569 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.560+0000 7f7e89543700 1 -- 172.21.15.124:0/2697297507 >> 172.21.15.124:0/2697297507 conn(0x7f7e8406bc70 msgr2=0x7f7e8406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:52.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.561+0000 7f7e89543700 1 -- 172.21.15.124:0/2697297507 shutdown_connections 2023-10-16T12:59:52.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.561+0000 7f7e89543700 1 -- 172.21.15.124:0/2697297507 wait complete. 2023-10-16T12:59:52.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.562+0000 7f7e89543700 1 Processor -- start 2023-10-16T12:59:52.570 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.562+0000 7f7e89543700 1 -- start start 2023-10-16T12:59:52.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.563+0000 7f7e89543700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e840b5530 0x7f7e840ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:52.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.563+0000 7f7e89543700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e840b9000 0x7f7e840cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:52.573 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.563+0000 7f7e89543700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e84160b50 0x7f7e84150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:52.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.563+0000 7f7e89543700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e840caea0 con 0x7f7e84160b50 2023-10-16T12:59:52.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.563+0000 7f7e89543700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e840cd5f0 con 0x7f7e840b9000 2023-10-16T12:59:52.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.563+0000 7f7e89543700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e841509b0 con 0x7f7e840b5530 2023-10-16T12:59:52.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.563+0000 7f7e837fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e84160b50 0x7f7e84150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:52.574 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.563+0000 7f7e837fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e84160b50 0x7f7e84150470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55204/0 (socket says 172.21.15.124:55204) 2023-10-16T12:59:52.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.563+0000 7f7e837fe700 1 -- 172.21.15.124:0/1470638593 learned_addr learned my addr 172.21.15.124:0/1470638593 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:52.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.563+0000 7f7e827fc700 1 --2- 172.21.15.124:0/1470638593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e840b9000 0x7f7e840cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:52.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.563+0000 7f7e82ffd700 1 --2- 172.21.15.124:0/1470638593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e840b5530 0x7f7e840ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:52.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.563+0000 7f7e837fe700 1 -- 172.21.15.124:0/1470638593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e840b5530 msgr2=0x7f7e840ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:52.575 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.563+0000 7f7e837fe700 1 --2- 172.21.15.124:0/1470638593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e840b5530 0x7f7e840ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.563+0000 7f7e837fe700 1 -- 172.21.15.124:0/1470638593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e840b9000 msgr2=0x7f7e840cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:52.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.563+0000 7f7e837fe700 1 --2- 172.21.15.124:0/1470638593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e840b9000 0x7f7e840cd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.563+0000 7f7e837fe700 1 -- 172.21.15.124:0/1470638593 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e78009550 con 0x7f7e84160b50 2023-10-16T12:59:52.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.563+0000 7f7e837fe700 1 --2- 172.21.15.124:0/1470638593 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e84160b50 0x7f7e84150470 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00cbd0 tx=0x7f7e7c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:52.576 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.563+0000 7f7e6b7fe700 1 -- 172.21.15.124:0/1470638593 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c00aaa0 con 0x7f7e84160b50 2023-10-16T12:59:52.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.563+0000 7f7e6b7fe700 1 -- 172.21.15.124:0/1470638593 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7c00ac00 con 0x7f7e84160b50 2023-10-16T12:59:52.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.563+0000 7f7e89543700 1 -- 172.21.15.124:0/1470638593 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e740094a0 con 0x7f7e84160b50 2023-10-16T12:59:52.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.563+0000 7f7e6b7fe700 1 -- 172.21.15.124:0/1470638593 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c007070 con 0x7f7e84160b50 2023-10-16T12:59:52.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.564+0000 7f7e89543700 1 -- 172.21.15.124:0/1470638593 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e840cdb70 con 0x7f7e84160b50 2023-10-16T12:59:52.577 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.565+0000 7f7e89543700 1 -- 172.21.15.124:0/1470638593 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e8404ebb0 con 0x7f7e84160b50 2023-10-16T12:59:52.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.565+0000 7f7e6b7fe700 1 -- 172.21.15.124:0/1470638593 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7e7c0071d0 con 0x7f7e84160b50 2023-10-16T12:59:52.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.565+0000 7f7e6b7fe700 1 --2- 172.21.15.124:0/1470638593 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f7e7006af00 0x7f7e7006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:52.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.565+0000 7f7e6b7fe700 1 -- 172.21.15.124:0/1470638593 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f7e7c0895c0 con 0x7f7e84160b50 2023-10-16T12:59:52.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.565+0000 7f7e82ffd700 1 --2- 172.21.15.124:0/1470638593 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f7e7006af00 0x7f7e7006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:52.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.566+0000 7f7e82ffd700 1 --2- 172.21.15.124:0/1470638593 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f7e7006af00 0x7f7e7006d3c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7e8415b1b0 tx=0x7f7e780092c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:52.579 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.570+0000 7f7e6b7fe700 1 -- 172.21.15.124:0/1470638593 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7e7c054360 con 0x7f7e84160b50 2023-10-16T12:59:52.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.761+0000 7f7e89543700 1 -- 172.21.15.124:0/1470638593 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e840b52f0 con 0x7f7e84160b50 2023-10-16T12:59:52.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.763+0000 7f7e6b7fe700 1 -- 172.21.15.124:0/1470638593 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18751 (secure 0 0 0) 0x7f7e7c057980 con 0x7f7e84160b50 2023-10-16T12:59:52.766 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:52.766 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":26,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:59:34.463212+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T12:58:49.562073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T12:58:50.011419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T12:58:53.692890+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2},{"from":7,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T12:59:52.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.765+0000 7f7e89543700 1 -- 172.21.15.124:0/1470638593 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f7e7006af00 msgr2=0x7f7e7006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:52.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.765+0000 7f7e89543700 1 --2- 172.21.15.124:0/1470638593 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f7e7006af00 0x7f7e7006d3c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7e8415b1b0 tx=0x7f7e780092c0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.768 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.765+0000 7f7e89543700 1 -- 172.21.15.124:0/1470638593 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e84160b50 msgr2=0x7f7e84150470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:52.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.765+0000 7f7e89543700 1 --2- 172.21.15.124:0/1470638593 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e84160b50 0x7f7e84150470 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00cbd0 tx=0x7f7e7c00cee0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.765+0000 7f7e89543700 1 -- 172.21.15.124:0/1470638593 shutdown_connections 2023-10-16T12:59:52.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.765+0000 7f7e89543700 1 --2- 172.21.15.124:0/1470638593 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f7e7006af00 0x7f7e7006d3c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.765+0000 7f7e89543700 1 --2- 172.21.15.124:0/1470638593 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e84160b50 0x7f7e84150470 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.769 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.765+0000 7f7e89543700 1 --2- 172.21.15.124:0/1470638593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e840b5530 0x7f7e840ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.765+0000 7f7e89543700 1 --2- 172.21.15.124:0/1470638593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e840b9000 0x7f7e840cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.765+0000 7f7e89543700 1 -- 172.21.15.124:0/1470638593 >> 172.21.15.124:0/1470638593 conn(0x7f7e8406bc70 msgr2=0x7f7e840b6350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:52.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.765+0000 7f7e89543700 1 -- 172.21.15.124:0/1470638593 shutdown_connections 2023-10-16T12:59:52.770 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.765+0000 7f7e89543700 1 -- 172.21.15.124:0/1470638593 wait complete. 2023-10-16T12:59:52.780 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-16T12:59:52.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.899+0000 7fafd32aa700 1 Processor -- start 2023-10-16T12:59:52.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.899+0000 7fafd32aa700 1 -- start start 2023-10-16T12:59:52.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.900+0000 7fafd32aa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafcc152470 0x7fafcc0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:52.904 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.900+0000 7fafd32aa700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fafcc0b3410 0x7fafcc0b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:52.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.900+0000 7fafd32aa700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafcc070d70 con 0x7fafcc0cb8d0 2023-10-16T12:59:52.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.900+0000 7fafd32aa700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafcc071200 con 0x7fafcc0b3410 2023-10-16T12:59:52.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.900+0000 7fafd32aa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc070440 con 0x7fafcc152470 2023-10-16T12:59:52.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.900+0000 7fafd1847700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fafcc0b3410 0x7fafcc0b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:52.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.900+0000 7fafd1847700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fafcc0b3410 0x7fafcc0b60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:35376/0 (socket says 172.21.15.124:35376) 2023-10-16T12:59:52.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.900+0000 7fafd1847700 1 -- 172.21.15.124:0/2253685677 learned_addr learned my addr 172.21.15.124:0/2253685677 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:52.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.900+0000 7fafd1046700 1 --2- 172.21.15.124:0/2253685677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafcc152470 0x7fafcc0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:52.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.900+0000 7fafd1847700 1 -- 172.21.15.124:0/2253685677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafcc152470 msgr2=0x7fafcc0cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:52.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.900+0000 7fafd1847700 1 --2- 172.21.15.124:0/2253685677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafcc152470 0x7fafcc0cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.900+0000 7fafd1847700 1 -- 172.21.15.124:0/2253685677 >> v1:172.21.15.192:6789/0 conn(0x7fafcc0cb8d0 legacy=0x7fafcc0b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:52.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.900+0000 7fafd1847700 1 -- 172.21.15.124:0/2253685677 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc070720 con 0x7fafcc0b3410 2023-10-16T12:59:52.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.901+0000 7fafd1847700 1 --2- 172.21.15.124:0/2253685677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafcc0b3410 0x7fafcc0b60f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fafc4009e50 tx=0x7fafc400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e3e6b846f10a4f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:52.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.901+0000 7fafc3fff700 1 -- 172.21.15.124:0/2253685677 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc400e070 con 0x7fafcc0b3410 2023-10-16T12:59:52.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.901+0000 7fafc3fff700 1 -- 172.21.15.124:0/2253685677 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc400b910 con 0x7fafcc0b3410 2023-10-16T12:59:52.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.901+0000 7fafc3fff700 1 -- 172.21.15.124:0/2253685677 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc400bcc0 con 0x7fafcc0b3410 2023-10-16T12:59:52.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.901+0000 7fafd32aa700 1 -- 172.21.15.124:0/2253685677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafcc0b3410 msgr2=0x7fafcc0b60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:52.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.901+0000 7fafd32aa700 1 --2- 172.21.15.124:0/2253685677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafcc0b3410 0x7fafcc0b60f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fafc4009e50 tx=0x7fafc400b330 comp rx=0 tx=0).stop 2023-10-16T12:59:52.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.901+0000 7fafd32aa700 1 -- 172.21.15.124:0/2253685677 shutdown_connections 2023-10-16T12:59:52.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.901+0000 7fafd32aa700 1 --2- 172.21.15.124:0/2253685677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafcc0b3410 0x7fafcc0b60f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.901+0000 7fafd32aa700 1 --2- 172.21.15.124:0/2253685677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafcc152470 0x7fafcc0cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.901+0000 7fafd32aa700 1 -- 172.21.15.124:0/2253685677 >> 172.21.15.124:0/2253685677 conn(0x7fafcc0cdd00 msgr2=0x7fafcc0ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:52.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.901+0000 7fafd32aa700 1 -- 172.21.15.124:0/2253685677 shutdown_connections 2023-10-16T12:59:52.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.901+0000 7fafd32aa700 1 -- 172.21.15.124:0/2253685677 wait complete. 2023-10-16T12:59:52.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.903+0000 7fafd32aa700 1 Processor -- start 2023-10-16T12:59:52.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.903+0000 7fafd32aa700 1 -- start start 2023-10-16T12:59:52.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.903+0000 7fafd32aa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafcc0b3410 0x7fafcc152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:52.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.903+0000 7fafd32aa700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fafcc0cb8d0 0x7fafcc1f03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:52.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.903+0000 7fafd32aa700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafcc152470 0x7fafcc154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:52.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.903+0000 7fafd32aa700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc153250 con 0x7fafcc0cb8d0 2023-10-16T12:59:52.913 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.903+0000 7fafd32aa700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc155e80 con 0x7fafcc152470 2023-10-16T12:59:52.913 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.903+0000 7fafd32aa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc152fa0 con 0x7fafcc0b3410 2023-10-16T12:59:52.913 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.903+0000 7fafd0845700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fafcc0cb8d0 0x7fafcc1f03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:52.913 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.904+0000 7fafd0845700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fafcc0cb8d0 0x7fafcc1f03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55214/0 (socket says 172.21.15.124:55214) 2023-10-16T12:59:52.913 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.904+0000 7fafd0845700 1 -- 172.21.15.124:0/3403130104 learned_addr learned my addr 172.21.15.124:0/3403130104 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:52.914 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.904+0000 7fafd1046700 1 --2- 172.21.15.124:0/3403130104 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafcc0b3410 0x7fafcc152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:52.914 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.904+0000 7fafd1847700 1 --2- 172.21.15.124:0/3403130104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafcc152470 0x7fafcc154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:52.914 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.904+0000 7fafd0845700 1 -- 172.21.15.124:0/3403130104 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafcc0b3410 msgr2=0x7fafcc152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:52.914 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.904+0000 7fafd0845700 1 --2- 172.21.15.124:0/3403130104 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafcc0b3410 0x7fafcc152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.914 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.904+0000 7fafd0845700 1 -- 172.21.15.124:0/3403130104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafcc152470 msgr2=0x7fafcc154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:52.915 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.904+0000 7fafd0845700 1 --2- 172.21.15.124:0/3403130104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafcc152470 0x7fafcc154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:52.915 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.904+0000 7fafd0845700 1 -- 172.21.15.124:0/3403130104 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009b30 con 0x7fafcc0cb8d0 2023-10-16T12:59:52.915 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.904+0000 7fafd0845700 1 --2- 172.21.15.124:0/3403130104 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fafcc0cb8d0 0x7fafcc1f03e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00c4e0 tx=0x7fafbc00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:52.915 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.904+0000 7fafc1ffb700 1 -- 172.21.15.124:0/3403130104 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc0052d0 con 0x7fafcc0cb8d0 2023-10-16T12:59:52.915 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.904+0000 7fafc1ffb700 1 -- 172.21.15.124:0/3403130104 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafbc00ce90 con 0x7fafcc0cb8d0 2023-10-16T12:59:52.915 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.904+0000 7fafd32aa700 1 -- 172.21.15.124:0/3403130104 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafcc1554e0 con 0x7fafcc0cb8d0 2023-10-16T12:59:52.916 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.904+0000 7fafc1ffb700 1 -- 172.21.15.124:0/3403130104 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc003680 con 0x7fafcc0cb8d0 2023-10-16T12:59:52.916 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.904+0000 7fafd32aa700 1 -- 172.21.15.124:0/3403130104 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafcc155aa0 con 0x7fafcc0cb8d0 2023-10-16T12:59:52.916 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.905+0000 7fafd32aa700 1 -- 172.21.15.124:0/3403130104 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafcc0709e0 con 0x7fafcc0cb8d0 2023-10-16T12:59:52.916 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.906+0000 7fafc1ffb700 1 -- 172.21.15.124:0/3403130104 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fafbc0037e0 con 0x7fafcc0cb8d0 2023-10-16T12:59:52.916 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.906+0000 7fafc1ffb700 1 --2- 172.21.15.124:0/3403130104 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fafb006af00 0x7fafb006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:52.917 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.906+0000 7fafc1ffb700 1 -- 172.21.15.124:0/3403130104 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6671+0+0 (secure 0 0 0) 0x7fafbc088c40 con 0x7fafcc0cb8d0 2023-10-16T12:59:52.917 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.906+0000 7fafd1046700 1 --2- 172.21.15.124:0/3403130104 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fafb006af00 0x7fafb006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:52.917 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.907+0000 7fafd1046700 1 --2- 172.21.15.124:0/3403130104 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fafb006af00 0x7fafb006d3c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009be0 tx=0x7fafc8009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:52.917 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:52.910+0000 7fafc1ffb700 1 -- 172.21.15.124:0/3403130104 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fafcc0709e0 con 0x7fafcc0cb8d0 2023-10-16T12:59:53.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.142+0000 7fafd32aa700 1 -- 172.21.15.124:0/3403130104 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fafcc0709b0 con 0x7fafcc0cb8d0 2023-10-16T12:59:53.145 INFO:tasks.ceph.mon.a.smithi124.stderr:2023-10-16T12:59:53.143+0000 7ff8d369b700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-16T12:59:53.146 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.144+0000 7fafc1ffb700 1 -- 172.21.15.124:0/3403130104 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fafbc017090 con 0x7fafcc0cb8d0 2023-10-16T12:59:53.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.147+0000 7fafd32aa700 1 -- 172.21.15.124:0/3403130104 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fafb006af00 msgr2=0x7fafb006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:53.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.147+0000 7fafd32aa700 1 --2- 172.21.15.124:0/3403130104 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fafb006af00 0x7fafb006d3c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009be0 tx=0x7fafc8009210 comp rx=0 tx=0).stop 2023-10-16T12:59:53.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.147+0000 7fafd32aa700 1 -- 172.21.15.124:0/3403130104 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fafcc0cb8d0 msgr2=0x7fafcc1f03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:53.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.147+0000 7fafd32aa700 1 --2- 172.21.15.124:0/3403130104 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fafcc0cb8d0 0x7fafcc1f03e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00c4e0 tx=0x7fafbc00c7f0 comp rx=0 tx=0).stop 2023-10-16T12:59:53.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.147+0000 7fafd32aa700 1 -- 172.21.15.124:0/3403130104 shutdown_connections 2023-10-16T12:59:53.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.147+0000 7fafd32aa700 1 --2- 172.21.15.124:0/3403130104 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fafb006af00 0x7fafb006d3c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:53.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.147+0000 7fafd32aa700 1 --2- 172.21.15.124:0/3403130104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafcc152470 0x7fafcc154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:53.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.147+0000 7fafd32aa700 1 --2- 172.21.15.124:0/3403130104 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafcc0b3410 0x7fafcc152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:53.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.147+0000 7fafd32aa700 1 --2- 172.21.15.124:0/3403130104 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fafcc0cb8d0 0x7fafcc1f03e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:53.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.147+0000 7fafd32aa700 1 -- 172.21.15.124:0/3403130104 >> 172.21.15.124:0/3403130104 conn(0x7fafcc0cdd00 msgr2=0x7fafcc0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:53.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.147+0000 7fafd32aa700 1 -- 172.21.15.124:0/3403130104 shutdown_connections 2023-10-16T12:59:53.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.147+0000 7fafd32aa700 1 -- 172.21.15.124:0/3403130104 wait complete. 2023-10-16T12:59:53.153 INFO:teuthology.orchestra.run.smithi124.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-16T12:59:53.153 INFO:tasks.ceph.mds.b.smithi192.stderr: -5691> 2023-10-16T12:58:55.838+0000 7f36372b3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T12:59:53.162 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-16T12:59:53.185 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-10-16T12:59:53.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.283+0000 7fb7fe00d700 1 Processor -- start 2023-10-16T12:59:53.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.283+0000 7fb7fe00d700 1 -- start start 2023-10-16T12:59:53.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.283+0000 7fb7fe00d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb7f815c770 0x7fb7f815ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:53.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.283+0000 7fb7fe00d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7f80d06d0 0x7fb7f80d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:53.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.284+0000 7fb7fe00d700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f80d1070 con 0x7fb7f80cdbc0 2023-10-16T12:59:53.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.284+0000 7fb7fe00d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f815f1b0 con 0x7fb7f815c770 2023-10-16T12:59:53.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.284+0000 7fb7fe00d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f815f490 con 0x7fb7f80d06d0 2023-10-16T12:59:53.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.284+0000 7fb7f7fff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fb7f80cdbc0 0x7fb7f80ce050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43892/0 (socket says 172.21.15.124:43892) 2023-10-16T12:59:53.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.284+0000 7fb7f7fff700 1 -- 172.21.15.124:0/2089720527 learned_addr learned my addr 172.21.15.124:0/2089720527 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:53.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.284+0000 7fb7f6ffd700 1 --2- 172.21.15.124:0/2089720527 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7f80d06d0 0x7fb7f80d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:53.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.284+0000 7fb7f77fe700 1 --2- 172.21.15.124:0/2089720527 >> v2:172.21.15.192:3300/0 conn(0x7fb7f815c770 0x7fb7f815ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:53.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.284+0000 7fb7f67fc700 1 -- 172.21.15.124:0/2089720527 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226885895 0 0) 0x7fb7f80d1070 con 0x7fb7f80cdbc0 2023-10-16T12:59:53.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.284+0000 7fb7f67fc700 1 -- 172.21.15.124:0/2089720527 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7e00035b0 con 0x7fb7f80cdbc0 2023-10-16T12:59:53.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.284+0000 7fb7f77fe700 1 -- 172.21.15.124:0/2089720527 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7f80d06d0 msgr2=0x7fb7f80d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:53.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.284+0000 7fb7f77fe700 1 --2- 172.21.15.124:0/2089720527 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7f80d06d0 0x7fb7f80d0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:53.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.284+0000 7fb7f77fe700 1 -- 172.21.15.124:0/2089720527 >> v1:172.21.15.124:6789/0 conn(0x7fb7f80cdbc0 legacy=0x7fb7f80ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:53.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.284+0000 7fb7f77fe700 1 -- 172.21.15.124:0/2089720527 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f815f770 con 0x7fb7f815c770 2023-10-16T12:59:53.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.284+0000 7fb7f6ffd700 1 --2- 172.21.15.124:0/2089720527 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7f80d06d0 0x7fb7f80d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:59:53.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.284+0000 7fb7f77fe700 1 --2- 172.21.15.124:0/2089720527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f815c770 0x7fb7f815ba40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8009840 tx=0x7fb7e8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bee6c517c59311f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:53.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.284+0000 7fb7f67fc700 1 -- 172.21.15.124:0/2089720527 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8011830 con 0x7fb7f815c770 2023-10-16T12:59:53.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.284+0000 7fb7f67fc700 1 -- 172.21.15.124:0/2089720527 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e8011990 con 0x7fb7f815c770 2023-10-16T12:59:53.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.284+0000 7fb7f67fc700 1 -- 172.21.15.124:0/2089720527 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8011d20 con 0x7fb7f815c770 2023-10-16T12:59:53.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.285+0000 7fb7fe00d700 1 -- 172.21.15.124:0/2089720527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f815c770 msgr2=0x7fb7f815ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:53.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.285+0000 7fb7fe00d700 1 --2- 172.21.15.124:0/2089720527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f815c770 0x7fb7f815ba40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8009840 tx=0x7fb7e8009b50 comp rx=0 tx=0).stop 2023-10-16T12:59:53.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.285+0000 7fb7fe00d700 1 -- 172.21.15.124:0/2089720527 shutdown_connections 2023-10-16T12:59:53.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.285+0000 7fb7fe00d700 1 --2- 172.21.15.124:0/2089720527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f815c770 0x7fb7f815ba40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:53.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.285+0000 7fb7fe00d700 1 --2- 172.21.15.124:0/2089720527 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7f80d06d0 0x7fb7f80d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:53.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.285+0000 7fb7fe00d700 1 -- 172.21.15.124:0/2089720527 >> 172.21.15.124:0/2089720527 conn(0x7fb7f806a820 msgr2=0x7fb7f806ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:53.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.285+0000 7fb7fe00d700 1 -- 172.21.15.124:0/2089720527 shutdown_connections 2023-10-16T12:59:53.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.285+0000 7fb7fe00d700 1 -- 172.21.15.124:0/2089720527 wait complete. 2023-10-16T12:59:53.296 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.286+0000 7fb7fe00d700 1 Processor -- start 2023-10-16T12:59:53.296 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.286+0000 7fb7fe00d700 1 -- start start 2023-10-16T12:59:53.297 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.287+0000 7fb7fe00d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f80cdbc0 0x7fb7f8153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:53.297 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.287+0000 7fb7fe00d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb7f80d06d0 0x7fb7f80b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:53.297 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.287+0000 7fb7fe00d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7f815c770 0x7fb7f80b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:53.297 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.287+0000 7fb7fe00d700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f80b2160 con 0x7fb7f80d06d0 2023-10-16T12:59:53.297 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.287+0000 7fb7fe00d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f80b2440 con 0x7fb7f80cdbc0 2023-10-16T12:59:53.298 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.287+0000 7fb7fe00d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f80b2720 con 0x7fb7f815c770 2023-10-16T12:59:53.298 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.287+0000 7fb7f6ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb7f80d06d0 0x7fb7f80b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:53.298 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.287+0000 7fb7f6ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb7f80d06d0 0x7fb7f80b16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55228/0 (socket says 172.21.15.124:55228) 2023-10-16T12:59:53.298 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.287+0000 7fb7f6ffd700 1 -- 172.21.15.124:0/1792276252 learned_addr learned my addr 172.21.15.124:0/1792276252 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:53.298 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.287+0000 7fb7f77fe700 1 --2- 172.21.15.124:0/1792276252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f80cdbc0 0x7fb7f8153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:53.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.287+0000 7fb7f7fff700 1 --2- 172.21.15.124:0/1792276252 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7f815c770 0x7fb7f80b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:53.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.287+0000 7fb7f6ffd700 1 -- 172.21.15.124:0/1792276252 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7f815c770 msgr2=0x7fb7f80b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:53.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.287+0000 7fb7f6ffd700 1 --2- 172.21.15.124:0/1792276252 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7f815c770 0x7fb7f80b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:53.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.287+0000 7fb7f6ffd700 1 -- 172.21.15.124:0/1792276252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f80cdbc0 msgr2=0x7fb7f8153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:53.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.287+0000 7fb7f6ffd700 1 --2- 172.21.15.124:0/1792276252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f80cdbc0 0x7fb7f8153ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:53.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.287+0000 7fb7f6ffd700 1 -- 172.21.15.124:0/1792276252 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec0094a0 con 0x7fb7f80d06d0 2023-10-16T12:59:53.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.288+0000 7fb7f77fe700 1 --2- 172.21.15.124:0/1792276252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f80cdbc0 0x7fb7f8153ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:53.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.288+0000 7fb7f6ffd700 1 --2- 172.21.15.124:0/1792276252 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb7f80d06d0 0x7fb7f80b16e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00ebe0 tx=0x7fb7ec009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:53.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.288+0000 7fb7dffff700 1 -- 172.21.15.124:0/1792276252 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec00c910 con 0x7fb7f80d06d0 2023-10-16T12:59:53.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.288+0000 7fb7dffff700 1 -- 172.21.15.124:0/1792276252 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec00ca70 con 0x7fb7f80d06d0 2023-10-16T12:59:53.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.288+0000 7fb7dffff700 1 -- 172.21.15.124:0/1792276252 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec00cde0 con 0x7fb7f80d06d0 2023-10-16T12:59:53.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.288+0000 7fb7fe00d700 1 -- 172.21.15.124:0/1792276252 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e80094a0 con 0x7fb7f80d06d0 2023-10-16T12:59:53.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.288+0000 7fb7fe00d700 1 -- 172.21.15.124:0/1792276252 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f80b2ce0 con 0x7fb7f80d06d0 2023-10-16T12:59:53.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.289+0000 7fb7fe00d700 1 -- 172.21.15.124:0/1792276252 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f804ebb0 con 0x7fb7f80d06d0 2023-10-16T12:59:53.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.289+0000 7fb7dffff700 1 -- 172.21.15.124:0/1792276252 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb7ec013470 con 0x7fb7f80d06d0 2023-10-16T12:59:53.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.290+0000 7fb7dffff700 1 --2- 172.21.15.124:0/1792276252 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb7e406af00 0x7fb7e406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:53.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.290+0000 7fb7dffff700 1 -- 172.21.15.124:0/1792276252 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fb7ec089bd0 con 0x7fb7f80d06d0 2023-10-16T12:59:53.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.290+0000 7fb7f77fe700 1 --2- 172.21.15.124:0/1792276252 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb7e406af00 0x7fb7e406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:53.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.290+0000 7fb7f77fe700 1 --2- 172.21.15.124:0/1792276252 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb7e406af00 0x7fb7e406d3c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8009fd0 tx=0x7fb7e801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:53.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.294+0000 7fb7dffff700 1 -- 172.21.15.124:0/1792276252 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb7ec054870 con 0x7fb7f80d06d0 2023-10-16T12:59:53.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:53.529+0000 7fb7fe00d700 1 -- 172.21.15.124:0/1792276252 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb7f80cd1f0 con 0x7fb7f80d06d0 2023-10-16T12:59:54.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.146+0000 7fb7dffff700 1 -- 172.21.15.124:0/1792276252 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb7ec057e90 con 0x7fb7f80d06d0 2023-10-16T12:59:54.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.149+0000 7fb7fe00d700 1 -- 172.21.15.124:0/1792276252 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb7e406af00 msgr2=0x7fb7e406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:54.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.149+0000 7fb7fe00d700 1 --2- 172.21.15.124:0/1792276252 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb7e406af00 0x7fb7e406d3c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8009fd0 tx=0x7fb7e801c040 comp rx=0 tx=0).stop 2023-10-16T12:59:54.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.149+0000 7fb7fe00d700 1 -- 172.21.15.124:0/1792276252 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb7f80d06d0 msgr2=0x7fb7f80b16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:54.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.149+0000 7fb7fe00d700 1 --2- 172.21.15.124:0/1792276252 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb7f80d06d0 0x7fb7f80b16e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00ebe0 tx=0x7fb7ec009ec0 comp rx=0 tx=0).stop 2023-10-16T12:59:54.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.149+0000 7fb7fe00d700 1 -- 172.21.15.124:0/1792276252 shutdown_connections 2023-10-16T12:59:54.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.149+0000 7fb7fe00d700 1 --2- 172.21.15.124:0/1792276252 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb7e406af00 0x7fb7e406d3c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:54.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.149+0000 7fb7fe00d700 1 --2- 172.21.15.124:0/1792276252 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7f815c770 0x7fb7f80b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:54.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.149+0000 7fb7fe00d700 1 --2- 172.21.15.124:0/1792276252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f80cdbc0 0x7fb7f8153ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:54.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.149+0000 7fb7fe00d700 1 --2- 172.21.15.124:0/1792276252 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb7f80d06d0 0x7fb7f80b16e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:54.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.149+0000 7fb7fe00d700 1 -- 172.21.15.124:0/1792276252 >> 172.21.15.124:0/1792276252 conn(0x7fb7f806a820 msgr2=0x7fb7f80cbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:54.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.149+0000 7fb7fe00d700 1 -- 172.21.15.124:0/1792276252 shutdown_connections 2023-10-16T12:59:54.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.149+0000 7fb7fe00d700 1 -- 172.21.15.124:0/1792276252 wait complete. 2023-10-16T12:59:54.166 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-16T12:59:54.296 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.294+0000 7f44b29e8700 1 Processor -- start 2023-10-16T12:59:54.297 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.294+0000 7f44b29e8700 1 -- start start 2023-10-16T12:59:54.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.295+0000 7f44b29e8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f44ac0b5310 0x7f44ac0b4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:54.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.295+0000 7f44b29e8700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f44ac0cd450 0x7f44ac0cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:54.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.295+0000 7f44b29e8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44ac0cde20 con 0x7f44ac06d080 2023-10-16T12:59:54.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.295+0000 7f44b29e8700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44ac0b57c0 con 0x7f44ac0cd450 2023-10-16T12:59:54.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.295+0000 7f44b29e8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44ac06ecb0 con 0x7f44ac0b5310 2023-10-16T12:59:54.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.295+0000 7f44b0f85700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f44ac0cd450 0x7f44ac0cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:54.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.295+0000 7f44b0f85700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f44ac0cd450 0x7f44ac0cd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55238/0 (socket says 172.21.15.124:55238) 2023-10-16T12:59:54.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.295+0000 7f44b0f85700 1 -- 172.21.15.124:0/3965175277 learned_addr learned my addr 172.21.15.124:0/3965175277 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:54.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.295+0000 7f44ab7fe700 1 --2- 172.21.15.124:0/3965175277 >> v2:172.21.15.192:3300/0 conn(0x7f44ac0b5310 0x7f44ac0b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:54.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.295+0000 7f44b0f85700 1 -- 172.21.15.124:0/3965175277 >> v2:172.21.15.192:3300/0 conn(0x7f44ac0b5310 msgr2=0x7f44ac0b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:54.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.295+0000 7f44b0f85700 1 --2- 172.21.15.124:0/3965175277 >> v2:172.21.15.192:3300/0 conn(0x7f44ac0b5310 0x7f44ac0b4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:54.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.295+0000 7f44b0f85700 1 -- 172.21.15.124:0/3965175277 >> v1:172.21.15.192:6789/0 conn(0x7f44ac06d080 legacy=0x7f44ac06d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:54.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.295+0000 7f44b0f85700 1 -- 172.21.15.124:0/3965175277 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac06ef90 con 0x7f44ac0cd450 2023-10-16T12:59:54.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.295+0000 7f44b0f85700 1 --2- 172.21.15.124:0/3965175277 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44ac0cd450 0x7f44ac0cd8e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0af3c0 tx=0x7f44a400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f5e1fa75b8e84d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:54.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.295+0000 7f44aaffd700 1 -- 172.21.15.124:0/3965175277 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a4010070 con 0x7f44ac0cd450 2023-10-16T12:59:54.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.295+0000 7f44aaffd700 1 -- 172.21.15.124:0/3965175277 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a400dd50 con 0x7f44ac0cd450 2023-10-16T12:59:54.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.295+0000 7f44aaffd700 1 -- 172.21.15.124:0/3965175277 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a400b310 con 0x7f44ac0cd450 2023-10-16T12:59:54.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.296+0000 7f44b29e8700 1 -- 172.21.15.124:0/3965175277 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44ac0cd450 msgr2=0x7f44ac0cd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:54.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.296+0000 7f44b29e8700 1 --2- 172.21.15.124:0/3965175277 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44ac0cd450 0x7f44ac0cd8e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0af3c0 tx=0x7f44a400d430 comp rx=0 tx=0).stop 2023-10-16T12:59:54.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.296+0000 7f44b29e8700 1 -- 172.21.15.124:0/3965175277 shutdown_connections 2023-10-16T12:59:54.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.296+0000 7f44b29e8700 1 --2- 172.21.15.124:0/3965175277 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44ac0cd450 0x7f44ac0cd8e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:54.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.296+0000 7f44b29e8700 1 --2- 172.21.15.124:0/3965175277 >> v2:172.21.15.192:3300/0 conn(0x7f44ac0b5310 0x7f44ac0b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:54.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.296+0000 7f44b29e8700 1 -- 172.21.15.124:0/3965175277 >> 172.21.15.124:0/3965175277 conn(0x7f44ac0b1620 msgr2=0x7f44ac0b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:54.304 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.296+0000 7f44b29e8700 1 -- 172.21.15.124:0/3965175277 shutdown_connections 2023-10-16T12:59:54.304 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.296+0000 7f44b29e8700 1 -- 172.21.15.124:0/3965175277 wait complete. 2023-10-16T12:59:54.307 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.297+0000 7f44b29e8700 1 Processor -- start 2023-10-16T12:59:54.307 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.297+0000 7f44b29e8700 1 -- start start 2023-10-16T12:59:54.307 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.298+0000 7f44b29e8700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44ac06d080 0x7f44ac157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:54.307 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.298+0000 7f44b29e8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44ac0b5310 0x7f44ac154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:54.308 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.298+0000 7f44b29e8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44ac0cd450 0x7f44ac154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:54.308 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.298+0000 7f44b29e8700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac154ad0 con 0x7f44ac06d080 2023-10-16T12:59:54.308 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.298+0000 7f44b29e8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac15cd80 con 0x7f44ac0cd450 2023-10-16T12:59:54.308 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.298+0000 7f44b29e8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac15d060 con 0x7f44ac0b5310 2023-10-16T12:59:54.308 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.298+0000 7f44abfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44ac06d080 0x7f44ac157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:54.308 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.298+0000 7f44abfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44ac06d080 0x7f44ac157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55240/0 (socket says 172.21.15.124:55240) 2023-10-16T12:59:54.309 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.298+0000 7f44abfff700 1 -- 172.21.15.124:0/437513710 learned_addr learned my addr 172.21.15.124:0/437513710 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:54.309 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.298+0000 7f44ab7fe700 1 --2- 172.21.15.124:0/437513710 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44ac0b5310 0x7f44ac154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:54.309 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.298+0000 7f44b0f85700 1 --2- 172.21.15.124:0/437513710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44ac0cd450 0x7f44ac154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:54.309 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.298+0000 7f44abfff700 1 -- 172.21.15.124:0/437513710 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44ac0b5310 msgr2=0x7f44ac154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:54.309 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.298+0000 7f44abfff700 1 --2- 172.21.15.124:0/437513710 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44ac0b5310 0x7f44ac154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:54.310 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.298+0000 7f44abfff700 1 -- 172.21.15.124:0/437513710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44ac0cd450 msgr2=0x7f44ac154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:54.310 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.298+0000 7f44abfff700 1 --2- 172.21.15.124:0/437513710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44ac0cd450 0x7f44ac154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:54.310 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.298+0000 7f44abfff700 1 -- 172.21.15.124:0/437513710 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a400bd40 con 0x7f44ac06d080 2023-10-16T12:59:54.310 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.299+0000 7f44abfff700 1 --2- 172.21.15.124:0/437513710 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44ac06d080 0x7f44ac157410 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f44a000c4a0 tx=0x7f44a000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:54.310 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.299+0000 7f44a8ff9700 1 -- 172.21.15.124:0/437513710 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a00054e0 con 0x7f44ac06d080 2023-10-16T12:59:54.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.299+0000 7f44a8ff9700 1 -- 172.21.15.124:0/437513710 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a0003680 con 0x7f44ac06d080 2023-10-16T12:59:54.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.299+0000 7f44b29e8700 1 -- 172.21.15.124:0/437513710 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44ac15d340 con 0x7f44ac06d080 2023-10-16T12:59:54.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.299+0000 7f44a8ff9700 1 -- 172.21.15.124:0/437513710 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0003a30 con 0x7f44ac06d080 2023-10-16T12:59:54.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.299+0000 7f44b29e8700 1 -- 172.21.15.124:0/437513710 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ac15d900 con 0x7f44ac06d080 2023-10-16T12:59:54.311 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.300+0000 7f44b29e8700 1 -- 172.21.15.124:0/437513710 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ac06df00 con 0x7f44ac06d080 2023-10-16T12:59:54.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.300+0000 7f44a8ff9700 1 -- 172.21.15.124:0/437513710 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f44a0003b90 con 0x7f44ac06d080 2023-10-16T12:59:54.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.301+0000 7f44a8ff9700 1 --2- 172.21.15.124:0/437513710 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f449806af00 0x7f449806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:54.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.301+0000 7f44a8ff9700 1 -- 172.21.15.124:0/437513710 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f44a0088f70 con 0x7f44ac06d080 2023-10-16T12:59:54.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.301+0000 7f44ab7fe700 1 --2- 172.21.15.124:0/437513710 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f449806af00 0x7f449806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:54.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.301+0000 7f44ab7fe700 1 --2- 172.21.15.124:0/437513710 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f449806af00 0x7f449806d3c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0ae5d0 tx=0x7f449c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:54.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.305+0000 7f44a8ff9700 1 -- 172.21.15.124:0/437513710 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f44a0053bf0 con 0x7f44ac06d080 2023-10-16T12:59:54.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:54.494+0000 7f44b29e8700 1 -- 172.21.15.124:0/437513710 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f44ac0b2ad0 con 0x7f44ac06d080 2023-10-16T12:59:55.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.147+0000 7f44a8ff9700 1 -- 172.21.15.124:0/437513710 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f44a0017020 con 0x7f44ac06d080 2023-10-16T12:59:55.155 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.152+0000 7f44b29e8700 1 -- 172.21.15.124:0/437513710 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f449806af00 msgr2=0x7f449806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:55.155 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.152+0000 7f44b29e8700 1 --2- 172.21.15.124:0/437513710 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f449806af00 0x7f449806d3c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0ae5d0 tx=0x7f449c008040 comp rx=0 tx=0).stop 2023-10-16T12:59:55.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.152+0000 7f44b29e8700 1 -- 172.21.15.124:0/437513710 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44ac06d080 msgr2=0x7f44ac157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:55.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.152+0000 7f44b29e8700 1 --2- 172.21.15.124:0/437513710 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44ac06d080 0x7f44ac157410 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f44a000c4a0 tx=0x7f44a000c860 comp rx=0 tx=0).stop 2023-10-16T12:59:55.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.152+0000 7f44b29e8700 1 -- 172.21.15.124:0/437513710 shutdown_connections 2023-10-16T12:59:55.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.152+0000 7f44b29e8700 1 --2- 172.21.15.124:0/437513710 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f449806af00 0x7f449806d3c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:55.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.152+0000 7f44b29e8700 1 --2- 172.21.15.124:0/437513710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44ac0cd450 0x7f44ac154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:55.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.152+0000 7f44b29e8700 1 --2- 172.21.15.124:0/437513710 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f44ac06d080 0x7f44ac157410 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:55.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.152+0000 7f44b29e8700 1 --2- 172.21.15.124:0/437513710 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44ac0b5310 0x7f44ac154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:55.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.152+0000 7f44b29e8700 1 -- 172.21.15.124:0/437513710 >> 172.21.15.124:0/437513710 conn(0x7f44ac0b1620 msgr2=0x7f44ac070ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:55.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.153+0000 7f44b29e8700 1 -- 172.21.15.124:0/437513710 shutdown_connections 2023-10-16T12:59:55.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.153+0000 7f44b29e8700 1 -- 172.21.15.124:0/437513710 wait complete. 2023-10-16T12:59:55.158 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_metadata' removed 2023-10-16T12:59:55.171 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-16T12:59:55.297 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.295+0000 7f46a5ca8700 1 Processor -- start 2023-10-16T12:59:55.298 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.295+0000 7f46a5ca8700 1 -- start start 2023-10-16T12:59:55.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.295+0000 7f46a5ca8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f46a006af30 0x7f46a01613e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:55.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.295+0000 7f46a5ca8700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a015eb20 con 0x7f46a006eed0 2023-10-16T12:59:55.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.295+0000 7f46a5ca8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a0070170 con 0x7f46a006fd90 2023-10-16T12:59:55.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.295+0000 7f46a5ca8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a006f380 con 0x7f46a006af30 2023-10-16T12:59:55.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.296+0000 7f469effd700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f46a006eed0 0x7f46a006a820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43918/0 (socket says 172.21.15.124:43918) 2023-10-16T12:59:55.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.296+0000 7f469effd700 1 -- 172.21.15.124:0/2171494899 learned_addr learned my addr 172.21.15.124:0/2171494899 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:55.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.296+0000 7f469ffff700 1 --2- 172.21.15.124:0/2171494899 >> v2:172.21.15.192:3300/0 conn(0x7f46a006af30 0x7f46a01613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:55.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.296+0000 7f469e7fc700 1 -- 172.21.15.124:0/2171494899 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3402798431 0 0) 0x7f46a015eb20 con 0x7f46a006eed0 2023-10-16T12:59:55.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.296+0000 7f469e7fc700 1 -- 172.21.15.124:0/2171494899 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46880035b0 con 0x7f46a006eed0 2023-10-16T12:59:55.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.296+0000 7f469e7fc700 1 -- 172.21.15.124:0/2171494899 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 106350363 0 0) 0x7f46880035b0 con 0x7f46a006eed0 2023-10-16T12:59:55.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.296+0000 7f469e7fc700 1 -- 172.21.15.124:0/2171494899 >> v2:172.21.15.192:3300/0 conn(0x7f46a006af30 msgr2=0x7f46a01613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:55.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.296+0000 7f469e7fc700 1 --2- 172.21.15.124:0/2171494899 >> v2:172.21.15.192:3300/0 conn(0x7f46a006af30 0x7f46a01613e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:55.304 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.296+0000 7f469e7fc700 1 -- 172.21.15.124:0/2171494899 >> v1:172.21.15.192:6789/0 conn(0x7f46a006fd90 legacy=0x7f46a0071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:55.304 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.296+0000 7f469e7fc700 1 -- 172.21.15.124:0/2171494899 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a015df10 con 0x7f46a006eed0 2023-10-16T12:59:55.304 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.296+0000 7f469e7fc700 1 -- 172.21.15.124:0/2171494899 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f4694001670 con 0x7f46a006eed0 2023-10-16T12:59:55.304 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.296+0000 7f469e7fc700 1 -- 172.21.15.124:0/2171494899 >> v1:172.21.15.124:6789/0 conn(0x7f46a006eed0 legacy=0x7f46a006a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:55.304 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.296+0000 7f469e7fc700 1 --2- 172.21.15.124:0/2171494899 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4688003a00 0x7f4688003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:55.305 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.296+0000 7f469e7fc700 1 --2- 172.21.15.124:0/2171494899 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4688004850 0x7f4688004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:55.305 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.296+0000 7f469e7fc700 1 --2- 172.21.15.124:0/2171494899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4688005210 0x7f468800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:55.305 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.296+0000 7f469e7fc700 1 -- 172.21.15.124:0/2171494899 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a006f380 con 0x7f4688003a00 2023-10-16T12:59:55.305 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.296+0000 7f469e7fc700 1 -- 172.21.15.124:0/2171494899 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468800c0b0 con 0x7f4688005210 2023-10-16T12:59:55.305 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.296+0000 7f469e7fc700 1 -- 172.21.15.124:0/2171494899 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468800c270 con 0x7f4688004850 2023-10-16T12:59:55.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.296+0000 7f469f7fe700 1 --2- 172.21.15.124:0/2171494899 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4688003a00 0x7f4688003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:55.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.296+0000 7f469ffff700 1 --2- 172.21.15.124:0/2171494899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4688005210 0x7f468800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:55.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.296+0000 7f469effd700 1 --2- 172.21.15.124:0/2171494899 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4688004850 0x7f4688004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:55.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.297+0000 7f469f7fe700 1 -- 172.21.15.124:0/2171494899 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4688004850 msgr2=0x7f4688004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:55.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.297+0000 7f469f7fe700 1 --2- 172.21.15.124:0/2171494899 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4688004850 0x7f4688004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:55.307 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.297+0000 7f469f7fe700 1 -- 172.21.15.124:0/2171494899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4688005210 msgr2=0x7f468800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:55.307 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.297+0000 7f469f7fe700 1 --2- 172.21.15.124:0/2171494899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4688005210 0x7f468800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:55.307 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.297+0000 7f469f7fe700 1 -- 172.21.15.124:0/2171494899 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46880035b0 con 0x7f4688003a00 2023-10-16T12:59:55.307 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.297+0000 7f469ffff700 1 --2- 172.21.15.124:0/2171494899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4688005210 0x7f468800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:55.307 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.297+0000 7f469ffff700 1 -- 172.21.15.124:0/2171494899 reap_dead start 2023-10-16T12:59:55.308 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.297+0000 7f469f7fe700 1 --2- 172.21.15.124:0/2171494899 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4688003a00 0x7f4688003e20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f46900017c0 tx=0x7f4688005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83bf359aedb5e0d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:55.308 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.297+0000 7f469e7fc700 1 -- 172.21.15.124:0/2171494899 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46900052d0 con 0x7f4688003a00 2023-10-16T12:59:55.308 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.297+0000 7f469e7fc700 1 -- 172.21.15.124:0/2171494899 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4690005430 con 0x7f4688003a00 2023-10-16T12:59:55.308 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.297+0000 7f469e7fc700 1 -- 172.21.15.124:0/2171494899 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46900038c0 con 0x7f4688003a00 2023-10-16T12:59:55.308 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.297+0000 7f46a5ca8700 1 -- 172.21.15.124:0/2171494899 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4688003a00 msgr2=0x7f4688003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:55.308 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.297+0000 7f46a5ca8700 1 --2- 172.21.15.124:0/2171494899 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4688003a00 0x7f4688003e20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f46900017c0 tx=0x7f4688005880 comp rx=0 tx=0).stop 2023-10-16T12:59:55.309 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.297+0000 7f46a5ca8700 1 -- 172.21.15.124:0/2171494899 shutdown_connections 2023-10-16T12:59:55.309 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.297+0000 7f46a5ca8700 1 --2- 172.21.15.124:0/2171494899 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4688003a00 0x7f4688003e20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:55.309 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.297+0000 7f46a5ca8700 1 -- 172.21.15.124:0/2171494899 >> 172.21.15.124:0/2171494899 conn(0x7f46a00d0250 msgr2=0x7f46a00d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:55.309 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.297+0000 7f46a5ca8700 1 -- 172.21.15.124:0/2171494899 shutdown_connections 2023-10-16T12:59:55.309 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.297+0000 7f46a5ca8700 1 -- 172.21.15.124:0/2171494899 wait complete. 2023-10-16T12:59:55.310 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.299+0000 7f46a5ca8700 1 Processor -- start 2023-10-16T12:59:55.310 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.299+0000 7f46a5ca8700 1 -- start start 2023-10-16T12:59:55.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.299+0000 7f46a5ca8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4688003a00 0x7f46a0158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:55.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.299+0000 7f46a5ca8700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46a015a050 0x7f46a0156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:55.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.299+0000 7f46a5ca8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46a015a4b0 0x7f46a0156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:55.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.299+0000 7f46a5ca8700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a00af800 con 0x7f46a015a050 2023-10-16T12:59:55.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.299+0000 7f46a5ca8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a0157aa0 con 0x7f4688003a00 2023-10-16T12:59:55.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.299+0000 7f46a5ca8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a015c900 con 0x7f46a015a4b0 2023-10-16T12:59:55.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.300+0000 7f469effd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46a015a050 0x7f46a0156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:55.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.300+0000 7f469effd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46a015a050 0x7f46a0156650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55264/0 (socket says 172.21.15.124:55264) 2023-10-16T12:59:55.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.300+0000 7f469effd700 1 -- 172.21.15.124:0/3156127304 learned_addr learned my addr 172.21.15.124:0/3156127304 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:55.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.300+0000 7f469f7fe700 1 --2- 172.21.15.124:0/3156127304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4688003a00 0x7f46a0158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:55.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.300+0000 7f469ffff700 1 --2- 172.21.15.124:0/3156127304 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46a015a4b0 0x7f46a0156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:55.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.300+0000 7f469effd700 1 -- 172.21.15.124:0/3156127304 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46a015a4b0 msgr2=0x7f46a0156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:55.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.300+0000 7f469effd700 1 --2- 172.21.15.124:0/3156127304 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46a015a4b0 0x7f46a0156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:55.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.300+0000 7f469effd700 1 -- 172.21.15.124:0/3156127304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4688003a00 msgr2=0x7f46a0158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:55.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.300+0000 7f469effd700 1 --2- 172.21.15.124:0/3156127304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4688003a00 0x7f46a0158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:55.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.300+0000 7f469effd700 1 -- 172.21.15.124:0/3156127304 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a0158750 con 0x7f46a015a050 2023-10-16T12:59:55.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.300+0000 7f469effd700 1 --2- 172.21.15.124:0/3156127304 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46a015a050 0x7f46a0156650 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f469400e800 tx=0x7f469400eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:55.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.300+0000 7f4687fff700 1 -- 172.21.15.124:0/3156127304 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4694012590 con 0x7f46a015a050 2023-10-16T12:59:55.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.300+0000 7f4687fff700 1 -- 172.21.15.124:0/3156127304 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4694012710 con 0x7f46a015a050 2023-10-16T12:59:55.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.300+0000 7f46a5ca8700 1 -- 172.21.15.124:0/3156127304 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a00af520 con 0x7f46a015a050 2023-10-16T12:59:55.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.300+0000 7f4687fff700 1 -- 172.21.15.124:0/3156127304 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4694012ac0 con 0x7f46a015a050 2023-10-16T12:59:55.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.300+0000 7f46a5ca8700 1 -- 172.21.15.124:0/3156127304 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a015ce80 con 0x7f46a015a050 2023-10-16T12:59:55.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.301+0000 7f46a5ca8700 1 -- 172.21.15.124:0/3156127304 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a015d0a0 con 0x7f46a015a050 2023-10-16T12:59:55.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.302+0000 7f4687fff700 1 -- 172.21.15.124:0/3156127304 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4694012c20 con 0x7f46a015a050 2023-10-16T12:59:55.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.302+0000 7f4687fff700 1 --2- 172.21.15.124:0/3156127304 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f468c06af30 0x7f468c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:55.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.302+0000 7f4687fff700 1 -- 172.21.15.124:0/3156127304 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6319+0+0 (secure 0 0 0) 0x7f4694089460 con 0x7f46a015a050 2023-10-16T12:59:55.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.302+0000 7f469f7fe700 1 --2- 172.21.15.124:0/3156127304 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f468c06af30 0x7f468c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:55.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.302+0000 7f469f7fe700 1 --2- 172.21.15.124:0/3156127304 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f468c06af30 0x7f468c06d3f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4690000c00 tx=0x7f4690009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:55.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.306+0000 7f4687fff700 1 -- 172.21.15.124:0/3156127304 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f46940542b0 con 0x7f46a015a050 2023-10-16T12:59:55.504 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:55.501+0000 7f46a5ca8700 1 -- 172.21.15.124:0/3156127304 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f46a004ebb0 con 0x7f46a015a050 2023-10-16T12:59:56.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.149+0000 7f4687fff700 1 -- 172.21.15.124:0/3156127304 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4694012ed0 con 0x7f46a015a050 2023-10-16T12:59:56.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.153+0000 7f46a5ca8700 1 -- 172.21.15.124:0/3156127304 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f468c06af30 msgr2=0x7f468c06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:56.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.153+0000 7f46a5ca8700 1 --2- 172.21.15.124:0/3156127304 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f468c06af30 0x7f468c06d3f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4690000c00 tx=0x7f4690009030 comp rx=0 tx=0).stop 2023-10-16T12:59:56.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.153+0000 7f46a5ca8700 1 -- 172.21.15.124:0/3156127304 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46a015a050 msgr2=0x7f46a0156650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:56.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.153+0000 7f46a5ca8700 1 --2- 172.21.15.124:0/3156127304 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46a015a050 0x7f46a0156650 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f469400e800 tx=0x7f469400eb10 comp rx=0 tx=0).stop 2023-10-16T12:59:56.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.153+0000 7f46a5ca8700 1 -- 172.21.15.124:0/3156127304 shutdown_connections 2023-10-16T12:59:56.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.153+0000 7f46a5ca8700 1 --2- 172.21.15.124:0/3156127304 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f468c06af30 0x7f468c06d3f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:56.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.153+0000 7f46a5ca8700 1 --2- 172.21.15.124:0/3156127304 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46a015a4b0 0x7f46a0156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:56.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.153+0000 7f46a5ca8700 1 --2- 172.21.15.124:0/3156127304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4688003a00 0x7f46a0158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:56.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.153+0000 7f46a5ca8700 1 --2- 172.21.15.124:0/3156127304 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f46a015a050 0x7f46a0156650 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:56.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.153+0000 7f46a5ca8700 1 -- 172.21.15.124:0/3156127304 >> 172.21.15.124:0/3156127304 conn(0x7f46a00d0250 msgr2=0x7f46a0072490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:56.158 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.153+0000 7f46a5ca8700 1 -- 172.21.15.124:0/3156127304 shutdown_connections 2023-10-16T12:59:56.158 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.153+0000 7f46a5ca8700 1 -- 172.21.15.124:0/3156127304 wait complete. 2023-10-16T12:59:56.158 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_data' removed 2023-10-16T12:59:56.174 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-16T12:59:56.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.299+0000 7f36785b2700 1 Processor -- start 2023-10-16T12:59:56.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.299+0000 7f36785b2700 1 -- start start 2023-10-16T12:59:56.304 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.300+0000 7f36785b2700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f367006b370 0x7f367015dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:56.304 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.300+0000 7f36785b2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36700cdd30 0x7f36700ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:56.305 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.300+0000 7f36785b2700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3670161360 con 0x7f367006a820 2023-10-16T12:59:56.305 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.300+0000 7f36785b2700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36700ce720 con 0x7f367006b370 2023-10-16T12:59:56.305 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.300+0000 7f36785b2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367006b750 con 0x7f36700cdd30 2023-10-16T12:59:56.305 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.300+0000 7f367634e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f367006b370 0x7f367015dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:56.305 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.300+0000 7f3675b4d700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f367006a820 0x7f367006d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43936/0 (socket says 172.21.15.124:43936) 2023-10-16T12:59:56.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.300+0000 7f3675b4d700 1 -- 172.21.15.124:0/991483884 learned_addr learned my addr 172.21.15.124:0/991483884 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:56.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.300+0000 7f367634e700 1 -- 172.21.15.124:0/991483884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36700cdd30 msgr2=0x7f36700ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:56.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.300+0000 7f367634e700 1 --2- 172.21.15.124:0/991483884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36700cdd30 0x7f36700ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:56.306 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.300+0000 7f367634e700 1 -- 172.21.15.124:0/991483884 >> v1:172.21.15.124:6789/0 conn(0x7f367006a820 legacy=0x7f367006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:56.307 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.300+0000 7f367634e700 1 -- 172.21.15.124:0/991483884 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367006dcc0 con 0x7f367006b370 2023-10-16T12:59:56.307 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.300+0000 7f367534c700 1 -- 172.21.15.124:0/991483884 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673341982 0 0) 0x7f3670161360 con 0x7f367006a820 2023-10-16T12:59:56.307 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.300+0000 7f367634e700 1 --2- 172.21.15.124:0/991483884 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f367006b370 0x7f367015dcb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f366c009840 tx=0x7f366c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cda33d81f9b35be server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:56.307 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.300+0000 7f367534c700 1 -- 172.21.15.124:0/991483884 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366c011830 con 0x7f367006b370 2023-10-16T12:59:56.307 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.301+0000 7f367534c700 1 -- 172.21.15.124:0/991483884 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366c011990 con 0x7f367006b370 2023-10-16T12:59:56.308 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.301+0000 7f367534c700 1 -- 172.21.15.124:0/991483884 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366c011d20 con 0x7f367006b370 2023-10-16T12:59:56.308 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.301+0000 7f36785b2700 1 -- 172.21.15.124:0/991483884 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f367006b370 msgr2=0x7f367015dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:56.308 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.301+0000 7f36785b2700 1 --2- 172.21.15.124:0/991483884 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f367006b370 0x7f367015dcb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f366c009840 tx=0x7f366c009b50 comp rx=0 tx=0).stop 2023-10-16T12:59:56.308 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.301+0000 7f36785b2700 1 -- 172.21.15.124:0/991483884 shutdown_connections 2023-10-16T12:59:56.308 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.301+0000 7f36785b2700 1 --2- 172.21.15.124:0/991483884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36700cdd30 0x7f36700ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:56.308 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.301+0000 7f36785b2700 1 --2- 172.21.15.124:0/991483884 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f367006b370 0x7f367015dcb0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:56.309 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.301+0000 7f36785b2700 1 -- 172.21.15.124:0/991483884 >> 172.21.15.124:0/991483884 conn(0x7f36700ccbe0 msgr2=0x7f36700ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:56.309 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.301+0000 7f36785b2700 1 -- 172.21.15.124:0/991483884 shutdown_connections 2023-10-16T12:59:56.309 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.301+0000 7f36785b2700 1 -- 172.21.15.124:0/991483884 wait complete. 2023-10-16T12:59:56.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.302+0000 7f36785b2700 1 Processor -- start 2023-10-16T12:59:56.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.302+0000 7f36785b2700 1 -- start start 2023-10-16T12:59:56.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.303+0000 7f36785b2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f367006a820 0x7f3670156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:56.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.303+0000 7f36785b2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f367006b370 0x7f36700b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:56.312 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.303+0000 7f36785b2700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36700cdd30 0x7f367015a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:56.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.303+0000 7f36785b2700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36700b2da0 con 0x7f36700cdd30 2023-10-16T12:59:56.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.303+0000 7f36785b2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3670156750 con 0x7f367006b370 2023-10-16T12:59:56.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.303+0000 7f36785b2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36700b2ff0 con 0x7f367006a820 2023-10-16T12:59:56.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.303+0000 7f3676b4f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36700cdd30 0x7f367015a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:56.313 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.303+0000 7f3676b4f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36700cdd30 0x7f367015a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55278/0 (socket says 172.21.15.124:55278) 2023-10-16T12:59:56.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.303+0000 7f3676b4f700 1 -- 172.21.15.124:0/2238812784 learned_addr learned my addr 172.21.15.124:0/2238812784 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:56.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.303+0000 7f367634e700 1 --2- 172.21.15.124:0/2238812784 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f367006a820 0x7f3670156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:56.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.303+0000 7f3676b4f700 1 -- 172.21.15.124:0/2238812784 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f367006a820 msgr2=0x7f3670156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:56.314 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.303+0000 7f3676b4f700 1 --2- 172.21.15.124:0/2238812784 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f367006a820 0x7f3670156210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:56.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.303+0000 7f3676b4f700 1 -- 172.21.15.124:0/2238812784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f367006b370 msgr2=0x7f36700b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:56.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.303+0000 7f3676b4f700 1 --2- 172.21.15.124:0/2238812784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f367006b370 0x7f36700b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:56.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.303+0000 7f3676b4f700 1 -- 172.21.15.124:0/2238812784 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366c0094a0 con 0x7f36700cdd30 2023-10-16T12:59:56.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.304+0000 7f3676b4f700 1 --2- 172.21.15.124:0/2238812784 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36700cdd30 0x7f367015a530 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f366800b970 tx=0x7f366800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:56.315 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.304+0000 7f3666ffd700 1 -- 172.21.15.124:0/2238812784 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366800c9b0 con 0x7f36700cdd30 2023-10-16T12:59:56.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.304+0000 7f3666ffd700 1 -- 172.21.15.124:0/2238812784 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366800cb30 con 0x7f36700cdd30 2023-10-16T12:59:56.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.304+0000 7f36785b2700 1 -- 172.21.15.124:0/2238812784 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36700b32d0 con 0x7f36700cdd30 2023-10-16T12:59:56.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.304+0000 7f3666ffd700 1 -- 172.21.15.124:0/2238812784 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668014440 con 0x7f36700cdd30 2023-10-16T12:59:56.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.304+0000 7f36785b2700 1 -- 172.21.15.124:0/2238812784 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36700b3890 con 0x7f36700cdd30 2023-10-16T12:59:56.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.305+0000 7f36785b2700 1 -- 172.21.15.124:0/2238812784 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3670072d10 con 0x7f36700cdd30 2023-10-16T12:59:56.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.305+0000 7f3666ffd700 1 -- 172.21.15.124:0/2238812784 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f366801d3b0 con 0x7f36700cdd30 2023-10-16T12:59:56.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.306+0000 7f3666ffd700 1 --2- 172.21.15.124:0/2238812784 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f365406af00 0x7f365406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:56.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.306+0000 7f367634e700 1 --2- 172.21.15.124:0/2238812784 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f365406af00 0x7f365406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:56.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.306+0000 7f3666ffd700 1 -- 172.21.15.124:0/2238812784 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f3668006e40 con 0x7f36700cdd30 2023-10-16T12:59:56.317 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.306+0000 7f367634e700 1 --2- 172.21.15.124:0/2238812784 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f365406af00 0x7f365406d3c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3670071960 tx=0x7f366c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:56.318 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.310+0000 7f3666ffd700 1 -- 172.21.15.124:0/2238812784 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3668054430 con 0x7f36700cdd30 2023-10-16T12:59:56.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:56.509+0000 7f36785b2700 1 -- 172.21.15.124:0/2238812784 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f367004ebb0 con 0x7f36700cdd30 2023-10-16T12:59:57.453 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.450+0000 7f3666ffd700 1 -- 172.21.15.124:0/2238812784 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7f3668057a50 con 0x7f36700cdd30 2023-10-16T12:59:57.460 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.458+0000 7f36785b2700 1 -- 172.21.15.124:0/2238812784 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f365406af00 msgr2=0x7f365406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:57.461 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.458+0000 7f36785b2700 1 --2- 172.21.15.124:0/2238812784 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f365406af00 0x7f365406d3c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3670071960 tx=0x7f366c008030 comp rx=0 tx=0).stop 2023-10-16T12:59:57.461 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.458+0000 7f36785b2700 1 -- 172.21.15.124:0/2238812784 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36700cdd30 msgr2=0x7f367015a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:57.461 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.458+0000 7f36785b2700 1 --2- 172.21.15.124:0/2238812784 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36700cdd30 0x7f367015a530 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f366800b970 tx=0x7f366800bd30 comp rx=0 tx=0).stop 2023-10-16T12:59:57.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.458+0000 7f36785b2700 1 -- 172.21.15.124:0/2238812784 shutdown_connections 2023-10-16T12:59:57.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.458+0000 7f36785b2700 1 --2- 172.21.15.124:0/2238812784 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f365406af00 0x7f365406d3c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:57.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.458+0000 7f36785b2700 1 --2- 172.21.15.124:0/2238812784 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f36700cdd30 0x7f367015a530 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:57.462 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.458+0000 7f36785b2700 1 --2- 172.21.15.124:0/2238812784 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f367006a820 0x7f3670156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:57.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.458+0000 7f36785b2700 1 --2- 172.21.15.124:0/2238812784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f367006b370 0x7f36700b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:57.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.458+0000 7f36785b2700 1 -- 172.21.15.124:0/2238812784 >> 172.21.15.124:0/2238812784 conn(0x7f36700ccbe0 msgr2=0x7f367015efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:57.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.459+0000 7f36785b2700 1 -- 172.21.15.124:0/2238812784 shutdown_connections 2023-10-16T12:59:57.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.459+0000 7f36785b2700 1 -- 172.21.15.124:0/2238812784 wait complete. 2023-10-16T12:59:57.464 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_data_ec' removed 2023-10-16T12:59:57.479 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-16T12:59:57.479 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-16T12:59:57.480 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-16T12:59:57.480 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T12:59:57.480 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-16T12:59:57.481 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-16T12:59:57.481 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-16T12:59:57.481 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T12:59:57.481 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-16T12:59:57.482 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-16T12:59:57.482 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-16T12:59:57.482 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T12:59:57.483 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-16T12:59:57.483 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-16T12:59:57.483 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-16T12:59:57.483 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T12:59:57.490 INFO:tasks.ceph.mds.a:Stopped 2023-10-16T12:59:57.490 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-16T12:59:57.491 INFO:tasks.ceph.mds.c:Stopped 2023-10-16T12:59:57.492 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-16T12:59:57.493 INFO:tasks.ceph.mds.b:Stopped 2023-10-16T12:59:57.493 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-16T12:59:57.494 INFO:tasks.ceph.mds.d:Stopped 2023-10-16T12:59:57.494 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-16T12:59:57.533 INFO:tasks.ceph.mds.a:Started 2023-10-16T12:59:57.533 DEBUG:teuthology.parallel:result is None 2023-10-16T12:59:57.534 INFO:tasks.ceph.mds.c:Started 2023-10-16T12:59:57.534 DEBUG:teuthology.parallel:result is None 2023-10-16T12:59:57.536 INFO:tasks.ceph.mds.b:Started 2023-10-16T12:59:57.537 DEBUG:teuthology.parallel:result is None 2023-10-16T12:59:57.538 INFO:tasks.ceph.mds.d:Started 2023-10-16T12:59:57.538 DEBUG:teuthology.parallel:result is None 2023-10-16T12:59:57.539 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-16T12:59:57.615 INFO:tasks.ceph.mds.a.smithi124.stdout:starting mds.a at 2023-10-16T12:59:57.616 INFO:tasks.ceph.mds.c.smithi124.stdout:starting mds.c at 2023-10-16T12:59:57.623 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-10-16T12:59:57.623 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-10-16T12:59:57.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.667+0000 7fe2404fb700 1 Processor -- start 2023-10-16T12:59:57.670 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.667+0000 7fe2404fb700 1 -- start start 2023-10-16T12:59:57.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.668+0000 7fe2404fb700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe23815daa0 0x7fe2380af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:57.672 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.668+0000 7fe2404fb700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe238071f60 0x7fe23806d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:57.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.668+0000 7fe2404fb700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe23815ed10 con 0x7fe2380af560 2023-10-16T12:59:57.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.668+0000 7fe2404fb700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe23815de80 con 0x7fe23815daa0 2023-10-16T12:59:57.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.668+0000 7fe2404fb700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe23815e100 con 0x7fe238071f60 2023-10-16T12:59:57.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.668+0000 7fe23e297700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe23815daa0 0x7fe2380af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:57.673 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.668+0000 7fe23e297700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe23815daa0 0x7fe2380af020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55306/0 (socket says 172.21.15.124:55306) 2023-10-16T12:59:57.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.668+0000 7fe23e297700 1 -- 172.21.15.124:0/1777842126 learned_addr learned my addr 172.21.15.124:0/1777842126 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:57.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.669+0000 7fe23ea98700 1 --2- 172.21.15.124:0/1777842126 >> v2:172.21.15.192:3300/0 conn(0x7fe238071f60 0x7fe23806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:57.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.669+0000 7fe23e297700 1 -- 172.21.15.124:0/1777842126 >> v2:172.21.15.192:3300/0 conn(0x7fe238071f60 msgr2=0x7fe23806d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:57.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.669+0000 7fe23e297700 1 --2- 172.21.15.124:0/1777842126 >> v2:172.21.15.192:3300/0 conn(0x7fe238071f60 0x7fe23806d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:57.674 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.669+0000 7fe23e297700 1 -- 172.21.15.124:0/1777842126 >> v1:172.21.15.192:6789/0 conn(0x7fe2380af560 legacy=0x7fe238071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:57.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.669+0000 7fe23e297700 1 -- 172.21.15.124:0/1777842126 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23815e3e0 con 0x7fe23815daa0 2023-10-16T12:59:57.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.669+0000 7fe23e297700 1 --2- 172.21.15.124:0/1777842126 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe23815daa0 0x7fe2380af020 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe2380b2d50 tx=0x7fe23000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f013e57994df28 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:57.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.669+0000 7fe23d295700 1 -- 172.21.15.124:0/1777842126 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe230010070 con 0x7fe23815daa0 2023-10-16T12:59:57.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.669+0000 7fe23d295700 1 -- 172.21.15.124:0/1777842126 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23000dd50 con 0x7fe23815daa0 2023-10-16T12:59:57.675 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.669+0000 7fe23d295700 1 -- 172.21.15.124:0/1777842126 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23000b310 con 0x7fe23815daa0 2023-10-16T12:59:57.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.669+0000 7fe2404fb700 1 -- 172.21.15.124:0/1777842126 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe23815daa0 msgr2=0x7fe2380af020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:57.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.669+0000 7fe2404fb700 1 --2- 172.21.15.124:0/1777842126 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe23815daa0 0x7fe2380af020 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe2380b2d50 tx=0x7fe23000d430 comp rx=0 tx=0).stop 2023-10-16T12:59:57.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.670+0000 7fe2404fb700 1 -- 172.21.15.124:0/1777842126 shutdown_connections 2023-10-16T12:59:57.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.670+0000 7fe2404fb700 1 --2- 172.21.15.124:0/1777842126 >> v2:172.21.15.192:3300/0 conn(0x7fe238071f60 0x7fe23806d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:57.676 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.670+0000 7fe2404fb700 1 --2- 172.21.15.124:0/1777842126 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe23815daa0 0x7fe2380af020 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:57.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.670+0000 7fe2404fb700 1 -- 172.21.15.124:0/1777842126 >> 172.21.15.124:0/1777842126 conn(0x7fe2380d0180 msgr2=0x7fe2380d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:57.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.670+0000 7fe2404fb700 1 -- 172.21.15.124:0/1777842126 shutdown_connections 2023-10-16T12:59:57.677 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.670+0000 7fe2404fb700 1 -- 172.21.15.124:0/1777842126 wait complete. 2023-10-16T12:59:57.679 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.671+0000 7fe2404fb700 1 Processor -- start 2023-10-16T12:59:57.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.671+0000 7fe2404fb700 1 -- start start 2023-10-16T12:59:57.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.671+0000 7fe2404fb700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe238071f60 0x7fe2381f3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:57.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.672+0000 7fe2404fb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2380af560 0x7fe23814f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:57.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.672+0000 7fe2404fb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe23815daa0 0x7fe2380c4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:57.680 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.672+0000 7fe2404fb700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2380c7010 con 0x7fe238071f60 2023-10-16T12:59:57.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.672+0000 7fe2404fb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2380c6d30 con 0x7fe2380af560 2023-10-16T12:59:57.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.672+0000 7fe2404fb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2380c8ad0 con 0x7fe23815daa0 2023-10-16T12:59:57.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.672+0000 7fe23e297700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe238071f60 0x7fe2381f3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:57.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.672+0000 7fe23e297700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe238071f60 0x7fe2381f3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55312/0 (socket says 172.21.15.124:55312) 2023-10-16T12:59:57.681 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.672+0000 7fe23e297700 1 -- 172.21.15.124:0/1824627416 learned_addr learned my addr 172.21.15.124:0/1824627416 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:57.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.672+0000 7fe23ea98700 1 --2- 172.21.15.124:0/1824627416 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe23815daa0 0x7fe2380c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:57.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.672+0000 7fe23da96700 1 --2- 172.21.15.124:0/1824627416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2380af560 0x7fe23814f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:57.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.672+0000 7fe23e297700 1 -- 172.21.15.124:0/1824627416 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe23815daa0 msgr2=0x7fe2380c4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:57.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.672+0000 7fe23e297700 1 --2- 172.21.15.124:0/1824627416 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe23815daa0 0x7fe2380c4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:57.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.672+0000 7fe23e297700 1 -- 172.21.15.124:0/1824627416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2380af560 msgr2=0x7fe23814f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:57.682 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.672+0000 7fe23e297700 1 --2- 172.21.15.124:0/1824627416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2380af560 0x7fe23814f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:57.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.672+0000 7fe23e297700 1 -- 172.21.15.124:0/1824627416 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23000bd40 con 0x7fe238071f60 2023-10-16T12:59:57.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.672+0000 7fe23e297700 1 --2- 172.21.15.124:0/1824627416 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe238071f60 0x7fe2381f3420 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe230000f80 tx=0x7fe230004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:57.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.672+0000 7fe22effd700 1 -- 172.21.15.124:0/1824627416 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe230009a10 con 0x7fe238071f60 2023-10-16T12:59:57.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.672+0000 7fe22effd700 1 -- 172.21.15.124:0/1824627416 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe230009b70 con 0x7fe238071f60 2023-10-16T12:59:57.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.672+0000 7fe2404fb700 1 -- 172.21.15.124:0/1824627416 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2380c8db0 con 0x7fe238071f60 2023-10-16T12:59:57.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.672+0000 7fe22effd700 1 -- 172.21.15.124:0/1824627416 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23000b720 con 0x7fe238071f60 2023-10-16T12:59:57.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.672+0000 7fe2404fb700 1 -- 172.21.15.124:0/1824627416 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2381f3960 con 0x7fe238071f60 2023-10-16T12:59:57.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.673+0000 7fe2404fb700 1 -- 172.21.15.124:0/1824627416 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2380c8930 con 0x7fe238071f60 2023-10-16T12:59:57.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.674+0000 7fe22effd700 1 -- 172.21.15.124:0/1824627416 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe23001b070 con 0x7fe238071f60 2023-10-16T12:59:57.684 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.674+0000 7fe22effd700 1 --2- 172.21.15.124:0/1824627416 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe21c06af00 0x7fe21c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:57.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.674+0000 7fe22effd700 1 -- 172.21.15.124:0/1824627416 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fe23008a320 con 0x7fe238071f60 2023-10-16T12:59:57.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.674+0000 7fe23da96700 1 --2- 172.21.15.124:0/1824627416 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe21c06af00 0x7fe21c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:57.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.675+0000 7fe23da96700 1 --2- 172.21.15.124:0/1824627416 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe21c06af00 0x7fe21c06d3c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe238159350 tx=0x7fe228007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:57.685 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.679+0000 7fe22effd700 1 -- 172.21.15.124:0/1824627416 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe2380c8930 con 0x7fe238071f60 2023-10-16T12:59:57.889 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:57.887+0000 7fe2404fb700 1 -- 172.21.15.124:0/1824627416 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe2380c8930 con 0x7fe238071f60 2023-10-16T12:59:58.469 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.466+0000 7fe22effd700 1 -- 172.21.15.124:0/1824627416 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe2380c8930 con 0x7fe238071f60 2023-10-16T12:59:58.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.470+0000 7fe2404fb700 1 -- 172.21.15.124:0/1824627416 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe21c06af00 msgr2=0x7fe21c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:58.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.470+0000 7fe2404fb700 1 --2- 172.21.15.124:0/1824627416 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe21c06af00 0x7fe21c06d3c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe238159350 tx=0x7fe228007ec0 comp rx=0 tx=0).stop 2023-10-16T12:59:58.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.470+0000 7fe2404fb700 1 -- 172.21.15.124:0/1824627416 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe238071f60 msgr2=0x7fe2381f3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:58.473 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.470+0000 7fe2404fb700 1 --2- 172.21.15.124:0/1824627416 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe238071f60 0x7fe2381f3420 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe230000f80 tx=0x7fe230004ad0 comp rx=0 tx=0).stop 2023-10-16T12:59:58.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.470+0000 7fe2404fb700 1 -- 172.21.15.124:0/1824627416 shutdown_connections 2023-10-16T12:59:58.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.470+0000 7fe2404fb700 1 --2- 172.21.15.124:0/1824627416 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe21c06af00 0x7fe21c06d3c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:58.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.470+0000 7fe2404fb700 1 --2- 172.21.15.124:0/1824627416 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe23815daa0 0x7fe2380c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:58.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.470+0000 7fe2404fb700 1 --2- 172.21.15.124:0/1824627416 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe238071f60 0x7fe2381f3420 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:58.474 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.470+0000 7fe2404fb700 1 --2- 172.21.15.124:0/1824627416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2380af560 0x7fe23814f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:58.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.470+0000 7fe2404fb700 1 -- 172.21.15.124:0/1824627416 >> 172.21.15.124:0/1824627416 conn(0x7fe2380d0180 msgr2=0x7fe2380cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:58.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.470+0000 7fe2404fb700 1 -- 172.21.15.124:0/1824627416 shutdown_connections 2023-10-16T12:59:58.475 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.470+0000 7fe2404fb700 1 -- 172.21.15.124:0/1824627416 wait complete. 2023-10-16T12:59:58.475 INFO:teuthology.orchestra.run.smithi124.stderr: removed all blocklist entries 2023-10-16T12:59:58.490 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-16T12:59:58.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.614+0000 7efda709c700 1 Processor -- start 2023-10-16T12:59:58.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.614+0000 7efda709c700 1 -- start start 2023-10-16T12:59:58.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.615+0000 7efda709c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efda0071850 0x7efda0071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:58.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.615+0000 7efda709c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7efda006d100 0x7efda006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:58.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.615+0000 7efda709c700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda00721f0 con 0x7efda015daa0 2023-10-16T12:59:58.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.615+0000 7efda709c700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda015ed10 con 0x7efda006d100 2023-10-16T12:59:58.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.615+0000 7efda709c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda015de80 con 0x7efda0071850 2023-10-16T12:59:58.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.615+0000 7efda5639700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7efda006d100 0x7efda006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:58.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.616+0000 7efda4e38700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7efda015daa0 0x7efda00af020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:43990/0 (socket says 172.21.15.124:43990) 2023-10-16T12:59:58.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.616+0000 7efda4e38700 1 -- 172.21.15.124:0/2893480079 learned_addr learned my addr 172.21.15.124:0/2893480079 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:58.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.616+0000 7efd9ffff700 1 --2- 172.21.15.124:0/2893480079 >> v2:172.21.15.192:3300/0 conn(0x7efda0071850 0x7efda0071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:58.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.616+0000 7efda5639700 1 -- 172.21.15.124:0/2893480079 >> v2:172.21.15.192:3300/0 conn(0x7efda0071850 msgr2=0x7efda0071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:58.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.616+0000 7efda5639700 1 --2- 172.21.15.124:0/2893480079 >> v2:172.21.15.192:3300/0 conn(0x7efda0071850 0x7efda0071cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:58.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.616+0000 7efda5639700 1 -- 172.21.15.124:0/2893480079 >> v1:172.21.15.124:6789/0 conn(0x7efda015daa0 legacy=0x7efda00af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:58.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.616+0000 7efda5639700 1 -- 172.21.15.124:0/2893480079 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda015e100 con 0x7efda006d100 2023-10-16T12:59:58.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.616+0000 7efd9ffff700 1 --2- 172.21.15.124:0/2893480079 >> v2:172.21.15.192:3300/0 conn(0x7efda0071850 0x7efda0071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:58.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.616+0000 7efd9f7fe700 1 -- 172.21.15.124:0/2893480079 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3995215724 0 0) 0x7efda00721f0 con 0x7efda015daa0 2023-10-16T12:59:58.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.616+0000 7efda5639700 1 --2- 172.21.15.124:0/2893480079 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efda006d100 0x7efda006d510 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7efda0072660 tx=0x7efd9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a9e0aefd16d22f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:58.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.616+0000 7efd9f7fe700 1 -- 172.21.15.124:0/2893480079 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9800e070 con 0x7efda006d100 2023-10-16T12:59:58.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.616+0000 7efd9f7fe700 1 -- 172.21.15.124:0/2893480079 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9800bbd0 con 0x7efda006d100 2023-10-16T12:59:58.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.616+0000 7efd9f7fe700 1 -- 172.21.15.124:0/2893480079 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd98012430 con 0x7efda006d100 2023-10-16T12:59:58.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.617+0000 7efda709c700 1 -- 172.21.15.124:0/2893480079 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efda006d100 msgr2=0x7efda006d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:58.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.617+0000 7efda709c700 1 --2- 172.21.15.124:0/2893480079 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efda006d100 0x7efda006d510 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7efda0072660 tx=0x7efd9800b330 comp rx=0 tx=0).stop 2023-10-16T12:59:58.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.617+0000 7efda709c700 1 -- 172.21.15.124:0/2893480079 shutdown_connections 2023-10-16T12:59:58.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.617+0000 7efda709c700 1 --2- 172.21.15.124:0/2893480079 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efda006d100 0x7efda006d510 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:58.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.617+0000 7efda709c700 1 --2- 172.21.15.124:0/2893480079 >> v2:172.21.15.192:3300/0 conn(0x7efda0071850 0x7efda0071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:58.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.617+0000 7efda709c700 1 -- 172.21.15.124:0/2893480079 >> 172.21.15.124:0/2893480079 conn(0x7efda00d0180 msgr2=0x7efda00d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:58.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.617+0000 7efda709c700 1 -- 172.21.15.124:0/2893480079 shutdown_connections 2023-10-16T12:59:58.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.617+0000 7efda709c700 1 -- 172.21.15.124:0/2893480079 wait complete. 2023-10-16T12:59:58.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.618+0000 7efda709c700 1 Processor -- start 2023-10-16T12:59:58.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.618+0000 7efda709c700 1 -- start start 2023-10-16T12:59:58.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.619+0000 7efda709c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efda006d100 0x7efda015ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:58.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.619+0000 7efda709c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efda0071850 0x7efda015b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:58.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.619+0000 7efda709c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efda015daa0 0x7efda01efca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:58.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.619+0000 7efda709c700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda0156f60 con 0x7efda015daa0 2023-10-16T12:59:58.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.619+0000 7efda709c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda00c3d00 con 0x7efda0071850 2023-10-16T12:59:58.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.619+0000 7efda709c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda01f0eb0 con 0x7efda006d100 2023-10-16T12:59:58.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.619+0000 7efda5639700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efda015daa0 0x7efda01efca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:58.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.619+0000 7efda5639700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efda015daa0 0x7efda01efca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55332/0 (socket says 172.21.15.124:55332) 2023-10-16T12:59:58.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.619+0000 7efda5639700 1 -- 172.21.15.124:0/1769683858 learned_addr learned my addr 172.21.15.124:0/1769683858 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:58.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.620+0000 7efd9ffff700 1 --2- 172.21.15.124:0/1769683858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efda0071850 0x7efda015b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:58.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.620+0000 7efda4e38700 1 --2- 172.21.15.124:0/1769683858 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efda006d100 0x7efda015ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:58.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.620+0000 7efda5639700 1 -- 172.21.15.124:0/1769683858 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efda006d100 msgr2=0x7efda015ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:58.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.620+0000 7efda5639700 1 --2- 172.21.15.124:0/1769683858 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efda006d100 0x7efda015ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:58.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.620+0000 7efda5639700 1 -- 172.21.15.124:0/1769683858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efda0071850 msgr2=0x7efda015b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:58.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.620+0000 7efda5639700 1 --2- 172.21.15.124:0/1769683858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efda0071850 0x7efda015b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:58.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.620+0000 7efda5639700 1 -- 172.21.15.124:0/1769683858 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd98009a70 con 0x7efda015daa0 2023-10-16T12:59:58.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.620+0000 7efd9ffff700 1 --2- 172.21.15.124:0/1769683858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efda0071850 0x7efda015b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T12:59:58.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.620+0000 7efda5639700 1 --2- 172.21.15.124:0/1769683858 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efda015daa0 0x7efda01efca0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efd98014040 tx=0x7efd98004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:58.632 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.620+0000 7efd9d7fa700 1 -- 172.21.15.124:0/1769683858 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd98012430 con 0x7efda015daa0 2023-10-16T12:59:58.632 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.620+0000 7efd9d7fa700 1 -- 172.21.15.124:0/1769683858 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd98020070 con 0x7efda015daa0 2023-10-16T12:59:58.632 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.620+0000 7efda709c700 1 -- 172.21.15.124:0/1769683858 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda01f1750 con 0x7efda015daa0 2023-10-16T12:59:58.632 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.620+0000 7efd9d7fa700 1 -- 172.21.15.124:0/1769683858 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd98004280 con 0x7efda015daa0 2023-10-16T12:59:58.632 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.620+0000 7efda709c700 1 -- 172.21.15.124:0/1769683858 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda01f1100 con 0x7efda015daa0 2023-10-16T12:59:58.633 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.621+0000 7efda709c700 1 -- 172.21.15.124:0/1769683858 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda01f18e0 con 0x7efda015daa0 2023-10-16T12:59:58.633 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.621+0000 7efd9d7fa700 1 -- 172.21.15.124:0/1769683858 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efd980043e0 con 0x7efda015daa0 2023-10-16T12:59:58.633 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.622+0000 7efd9d7fa700 1 --2- 172.21.15.124:0/1769683858 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7efd8406af00 0x7efd8406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:58.633 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.622+0000 7efda4e38700 1 --2- 172.21.15.124:0/1769683858 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7efd8406af00 0x7efd8406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:58.633 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.622+0000 7efd9d7fa700 1 -- 172.21.15.124:0/1769683858 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7efd98022070 con 0x7efda015daa0 2023-10-16T12:59:58.633 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.622+0000 7efda4e38700 1 --2- 172.21.15.124:0/1769683858 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7efd8406af00 0x7efd8406d3c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efd94000f60 tx=0x7efd94009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:58.634 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.627+0000 7efd9d7fa700 1 -- 172.21.15.124:0/1769683858 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efd98056790 con 0x7efda015daa0 2023-10-16T12:59:58.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.897+0000 7efda709c700 1 -- 172.21.15.124:0/1769683858 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7efda004ebb0 con 0x7efda015daa0 2023-10-16T12:59:58.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.897+0000 7efd9d7fa700 1 -- 172.21.15.124:0/1769683858 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7efd98059db0 con 0x7efda015daa0 2023-10-16T12:59:58.901 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T12:59:58.901 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2023-10-16T12:59:58.902 INFO:teuthology.orchestra.run.smithi124.stdout: "auth_dump": [ 2023-10-16T12:59:58.902 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.902 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "mds.a", 2023-10-16T12:59:58.902 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBQMy1lun9zLhAAFvlm7Mqwljyq3Rfijz3hxg==", 2023-10-16T12:59:58.903 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.903 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2023-10-16T12:59:58.903 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow *", 2023-10-16T12:59:58.903 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow *", 2023-10-16T12:59:58.903 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-16T12:59:58.904 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.904 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:58.904 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.904 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "mds.b", 2023-10-16T12:59:58.904 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBQMy1lPJU9OxAAQvRj59LE+jUH7UsJnwSUow==", 2023-10-16T12:59:58.904 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.905 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2023-10-16T12:59:58.905 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow *", 2023-10-16T12:59:58.905 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow *", 2023-10-16T12:59:58.905 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-16T12:59:58.905 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.906 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:58.906 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.906 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "mds.c", 2023-10-16T12:59:58.906 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBQMy1lLaq8NRAAy51ell+YFYMSSlam7didKQ==", 2023-10-16T12:59:58.906 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.907 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2023-10-16T12:59:58.907 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow *", 2023-10-16T12:59:58.907 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow *", 2023-10-16T12:59:58.907 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-16T12:59:58.907 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.908 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:58.908 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.908 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "mds.d", 2023-10-16T12:59:58.908 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBRMy1l97EpBxAAONJvOSLdBKd0pfwl0fWY/w==", 2023-10-16T12:59:58.908 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.909 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2023-10-16T12:59:58.909 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow *", 2023-10-16T12:59:58.909 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow *", 2023-10-16T12:59:58.909 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-16T12:59:58.909 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.910 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:58.910 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.910 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.0", 2023-10-16T12:59:58.910 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBUMy1l80SKKBAAAOJ0QOOlHlfs7nQBeg17lQ==", 2023-10-16T12:59:58.910 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.911 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2023-10-16T12:59:58.911 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2023-10-16T12:59:58.911 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-16T12:59:58.911 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.911 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:58.911 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.912 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.1", 2023-10-16T12:59:58.912 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBXMy1lkGp8KBAAT0t+9k0eFGUOL7eCCqs0Ag==", 2023-10-16T12:59:58.912 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.912 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2023-10-16T12:59:58.912 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2023-10-16T12:59:58.913 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-16T12:59:58.913 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.913 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:58.913 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.913 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.2", 2023-10-16T12:59:58.914 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBaMy1lZucMKBAAfdh6BU0ZMJ4M2AOPCKvPqg==", 2023-10-16T12:59:58.914 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.914 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2023-10-16T12:59:58.914 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2023-10-16T12:59:58.914 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-16T12:59:58.915 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.915 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:58.915 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.915 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.3", 2023-10-16T12:59:58.915 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBdMy1l1Vy8JxAAk3Sjvx9JV5dKltHVPjoaMg==", 2023-10-16T12:59:58.916 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.916 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2023-10-16T12:59:58.916 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2023-10-16T12:59:58.916 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-16T12:59:58.916 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.916 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:58.917 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.917 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.4", 2023-10-16T12:59:58.917 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBjMy1lZ/QlKxAAlh2gYAXnAN7YaOEKgMHoDA==", 2023-10-16T12:59:58.917 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.917 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2023-10-16T12:59:58.918 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2023-10-16T12:59:58.918 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-16T12:59:58.918 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.918 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:58.918 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.919 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.5", 2023-10-16T12:59:58.919 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBmMy1l9fmTKhAARk1j0LLTBOp73x6nB2kytw==", 2023-10-16T12:59:58.919 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.919 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2023-10-16T12:59:58.919 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2023-10-16T12:59:58.920 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-16T12:59:58.920 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.920 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:58.920 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.920 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.6", 2023-10-16T12:59:58.921 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBpMy1lbxm3KRAA8wVFPuYlH3vJe/zC0451Sg==", 2023-10-16T12:59:58.921 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.921 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2023-10-16T12:59:58.921 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2023-10-16T12:59:58.921 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-16T12:59:58.921 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.922 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:58.922 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.922 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "osd.7", 2023-10-16T12:59:58.922 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBsMy1lgHoTKRAAFtnzctn06ZpOyt4yEhWhjw==", 2023-10-16T12:59:58.922 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.923 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow profile osd", 2023-10-16T12:59:58.923 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile osd", 2023-10-16T12:59:58.923 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-16T12:59:58.923 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.923 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:58.924 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.924 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.0", 2023-10-16T12:59:58.924 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBRMy1lwsZ6CxAAIfzwHgkpk89tbUgo7jfrhw==", 2023-10-16T12:59:58.924 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.924 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2023-10-16T12:59:58.925 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow r", 2023-10-16T12:59:58.925 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow rw", 2023-10-16T12:59:58.925 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow rwx" 2023-10-16T12:59:58.925 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.925 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:58.925 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.926 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.1", 2023-10-16T12:59:58.926 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBRMy1ltpJ9FBAAOBWvead5CoT052W7b1QpMQ==", 2023-10-16T12:59:58.926 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.926 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2023-10-16T12:59:58.926 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow r", 2023-10-16T12:59:58.927 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow rw", 2023-10-16T12:59:58.927 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow rwx" 2023-10-16T12:59:58.927 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.927 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:58.927 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.928 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.2", 2023-10-16T12:59:58.928 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBRMy1lcdIrERAArcCknGCSJUctxtpnP0UIwQ==", 2023-10-16T12:59:58.928 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.928 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2023-10-16T12:59:58.928 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow r", 2023-10-16T12:59:58.929 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow rw", 2023-10-16T12:59:58.929 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow rwx" 2023-10-16T12:59:58.929 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.929 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:58.929 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.929 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.3", 2023-10-16T12:59:58.930 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBRMy1laH5xHRAARZA1CZlXbImpeitk1mZPZA==", 2023-10-16T12:59:58.930 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.930 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow", 2023-10-16T12:59:58.930 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow r", 2023-10-16T12:59:58.930 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow rw", 2023-10-16T12:59:58.931 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow rwx" 2023-10-16T12:59:58.931 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.931 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:58.931 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.931 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.admin", 2023-10-16T12:59:58.932 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg==", 2023-10-16T12:59:58.932 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.932 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow *", 2023-10-16T12:59:58.932 INFO:teuthology.orchestra.run.smithi124.stdout: "mgr": "allow *", 2023-10-16T12:59:58.932 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow *", 2023-10-16T12:59:58.933 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-16T12:59:58.933 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.933 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:58.933 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.933 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.bootstrap-mds", 2023-10-16T12:59:58.934 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQByMy1lNjqOJxAAY8lOAYmKsBJgyHYxLcfdJw==", 2023-10-16T12:59:58.934 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.934 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile bootstrap-mds" 2023-10-16T12:59:58.934 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.934 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:58.935 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.935 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.bootstrap-mgr", 2023-10-16T12:59:58.935 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQByMy1lqkOOJxAAu+5d9i0LPCAOQDgiA9Zv7A==", 2023-10-16T12:59:58.935 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.935 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-16T12:59:58.936 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.936 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:58.936 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.936 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.bootstrap-osd", 2023-10-16T12:59:58.936 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQByMy1lw0qOJxAAhmpw9O3CX8h3fimRUlst+g==", 2023-10-16T12:59:58.936 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.937 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile bootstrap-osd" 2023-10-16T12:59:58.937 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.937 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:58.937 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.937 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.bootstrap-rbd", 2023-10-16T12:59:58.938 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQByMy1lgFGOJxAASWTDV0StuyhN3Jdf1P5deg==", 2023-10-16T12:59:58.938 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.938 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-16T12:59:58.938 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.938 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:58.939 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.939 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-16T12:59:58.939 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQByMy1llliOJxAA8E4dmsXxAED/4EQWqfd4OA==", 2023-10-16T12:59:58.939 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.939 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-16T12:59:58.940 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.940 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:58.940 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.940 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "client.bootstrap-rgw", 2023-10-16T12:59:58.940 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQByMy1lxF+OJxAAxmNWYItWI6+maw5hyMPUVg==", 2023-10-16T12:59:58.940 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.941 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-16T12:59:58.941 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.941 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:58.941 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.941 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "mgr.x", 2023-10-16T12:59:58.942 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBQMy1l1YQQKxAAN8TiRvcxQqwPyZYhrlW0FA==", 2023-10-16T12:59:58.942 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.942 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow *", 2023-10-16T12:59:58.942 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile mgr", 2023-10-16T12:59:58.942 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-16T12:59:58.943 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.943 INFO:teuthology.orchestra.run.smithi124.stdout: }, 2023-10-16T12:59:58.943 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T12:59:58.943 INFO:teuthology.orchestra.run.smithi124.stdout: "entity": "mgr.y", 2023-10-16T12:59:58.943 INFO:teuthology.orchestra.run.smithi124.stdout: "key": "AQBQMy1lo8zhIRAAUQPIcrzYRE+e0c+p873jhQ==", 2023-10-16T12:59:58.944 INFO:teuthology.orchestra.run.smithi124.stdout: "caps": { 2023-10-16T12:59:58.944 INFO:teuthology.orchestra.run.smithi124.stdout: "mds": "allow *", 2023-10-16T12:59:58.944 INFO:teuthology.orchestra.run.smithi124.stdout: "mon": "allow profile mgr", 2023-10-16T12:59:58.944 INFO:teuthology.orchestra.run.smithi124.stdout: "osd": "allow *" 2023-10-16T12:59:58.944 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.945 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T12:59:58.945 INFO:teuthology.orchestra.run.smithi124.stdout: ] 2023-10-16T12:59:58.945 INFO:teuthology.orchestra.run.smithi124.stdout:} 2023-10-16T12:59:58.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.899+0000 7efda709c700 1 -- 172.21.15.124:0/1769683858 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7efd8406af00 msgr2=0x7efd8406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:58.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.899+0000 7efda709c700 1 --2- 172.21.15.124:0/1769683858 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7efd8406af00 0x7efd8406d3c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efd94000f60 tx=0x7efd94009040 comp rx=0 tx=0).stop 2023-10-16T12:59:58.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.899+0000 7efda709c700 1 -- 172.21.15.124:0/1769683858 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efda015daa0 msgr2=0x7efda01efca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:58.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.899+0000 7efda709c700 1 --2- 172.21.15.124:0/1769683858 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efda015daa0 0x7efda01efca0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efd98014040 tx=0x7efd98004b20 comp rx=0 tx=0).stop 2023-10-16T12:59:58.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.900+0000 7efda709c700 1 -- 172.21.15.124:0/1769683858 shutdown_connections 2023-10-16T12:59:58.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.900+0000 7efda709c700 1 --2- 172.21.15.124:0/1769683858 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7efd8406af00 0x7efd8406d3c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:58.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.900+0000 7efda709c700 1 --2- 172.21.15.124:0/1769683858 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efda015daa0 0x7efda01efca0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:58.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.900+0000 7efda709c700 1 --2- 172.21.15.124:0/1769683858 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efda006d100 0x7efda015ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:58.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.900+0000 7efda709c700 1 --2- 172.21.15.124:0/1769683858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efda0071850 0x7efda015b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:58.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.900+0000 7efda709c700 1 -- 172.21.15.124:0/1769683858 >> 172.21.15.124:0/1769683858 conn(0x7efda00d0180 msgr2=0x7efda00cb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:58.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.900+0000 7efda709c700 1 -- 172.21.15.124:0/1769683858 shutdown_connections 2023-10-16T12:59:58.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:58.900+0000 7efda709c700 1 -- 172.21.15.124:0/1769683858 wait complete. 2023-10-16T12:59:58.949 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-16T12:59:59.071 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.069+0000 7ffaab7f3700 1 Processor -- start 2023-10-16T12:59:59.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.069+0000 7ffaab7f3700 1 -- start start 2023-10-16T12:59:59.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.070+0000 7ffaab7f3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffaa40cf7d0 0x7ffaa415e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:59.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.070+0000 7ffaab7f3700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa40cfeb0 con 0x7ffaa40ca7d0 2023-10-16T12:59:59.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.070+0000 7ffaab7f3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa40cfc30 con 0x7ffaa406a820 2023-10-16T12:59:59.076 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.070+0000 7ffaab7f3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa40ce410 con 0x7ffaa40cf7d0 2023-10-16T12:59:59.076 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.070+0000 7ffaa9d90700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7ffaa40ca7d0 0x7ffaa4071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:44008/0 (socket says 172.21.15.124:44008) 2023-10-16T12:59:59.076 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.070+0000 7ffaa9d90700 1 -- 172.21.15.124:0/4283482253 learned_addr learned my addr 172.21.15.124:0/4283482253 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:59.076 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.070+0000 7ffa9bfff700 1 -- 172.21.15.124:0/4283482253 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716150502 0 0) 0x7ffaa40cfeb0 con 0x7ffaa40ca7d0 2023-10-16T12:59:59.076 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.070+0000 7ffaa8d8e700 1 --2- 172.21.15.124:0/4283482253 >> v2:172.21.15.192:3300/0 conn(0x7ffaa40cf7d0 0x7ffaa415e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:59.077 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.070+0000 7ffa9bfff700 1 -- 172.21.15.124:0/4283482253 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa900035b0 con 0x7ffaa40ca7d0 2023-10-16T12:59:59.077 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.070+0000 7ffa9bfff700 1 -- 172.21.15.124:0/4283482253 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 695393800 0 0) 0x7ffa900035b0 con 0x7ffaa40ca7d0 2023-10-16T12:59:59.077 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.070+0000 7ffa9bfff700 1 -- 172.21.15.124:0/4283482253 >> v2:172.21.15.192:3300/0 conn(0x7ffaa40cf7d0 msgr2=0x7ffaa415e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:59.077 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.070+0000 7ffa9bfff700 1 --2- 172.21.15.124:0/4283482253 >> v2:172.21.15.192:3300/0 conn(0x7ffaa40cf7d0 0x7ffaa415e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.077 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.070+0000 7ffa9bfff700 1 -- 172.21.15.124:0/4283482253 >> v1:172.21.15.192:6789/0 conn(0x7ffaa406a820 legacy=0x7ffaa406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:59.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.070+0000 7ffa9bfff700 1 -- 172.21.15.124:0/4283482253 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa40af9d0 con 0x7ffaa40ca7d0 2023-10-16T12:59:59.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.070+0000 7ffa9bfff700 1 -- 172.21.15.124:0/4283482253 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7ffa9c001a40 con 0x7ffaa40ca7d0 2023-10-16T12:59:59.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.070+0000 7ffa9bfff700 1 -- 172.21.15.124:0/4283482253 >> v1:172.21.15.124:6789/0 conn(0x7ffaa40ca7d0 legacy=0x7ffaa4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:59.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.070+0000 7ffa9bfff700 1 --2- 172.21.15.124:0/4283482253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa90003a00 0x7ffa90003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:59.078 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.070+0000 7ffa9bfff700 1 --2- 172.21.15.124:0/4283482253 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffa90004850 0x7ffa90004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:59.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.070+0000 7ffa9bfff700 1 --2- 172.21.15.124:0/4283482253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa90005210 0x7ffa9000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:59.079 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.070+0000 7ffa9bfff700 1 -- 172.21.15.124:0/4283482253 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa40ce410 con 0x7ffa90004850 2023-10-16T12:59:59.081 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.070+0000 7ffa9bfff700 1 -- 172.21.15.124:0/4283482253 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9000c1b0 con 0x7ffa90003a00 2023-10-16T12:59:59.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.070+0000 7ffa9bfff700 1 -- 172.21.15.124:0/4283482253 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9000c370 con 0x7ffa90005210 2023-10-16T12:59:59.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.071+0000 7ffaa8d8e700 1 --2- 172.21.15.124:0/4283482253 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffa90004850 0x7ffa90004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:59.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.071+0000 7ffaa958f700 1 --2- 172.21.15.124:0/4283482253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa90003a00 0x7ffa90003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:59.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.071+0000 7ffaa9d90700 1 --2- 172.21.15.124:0/4283482253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa90005210 0x7ffa9000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:59.082 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.071+0000 7ffaa8d8e700 1 -- 172.21.15.124:0/4283482253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa90005210 msgr2=0x7ffa9000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:59.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.071+0000 7ffaa8d8e700 1 --2- 172.21.15.124:0/4283482253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa90005210 0x7ffa9000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.071+0000 7ffaa8d8e700 1 -- 172.21.15.124:0/4283482253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa90003a00 msgr2=0x7ffa90003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:59.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.071+0000 7ffaa8d8e700 1 --2- 172.21.15.124:0/4283482253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa90003a00 0x7ffa90003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.071+0000 7ffaa9d90700 1 -- 172.21.15.124:0/4283482253 reap_dead start 2023-10-16T12:59:59.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.071+0000 7ffaa8d8e700 1 -- 172.21.15.124:0/4283482253 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa900035b0 con 0x7ffa90004850 2023-10-16T12:59:59.083 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.071+0000 7ffaa8d8e700 1 --2- 172.21.15.124:0/4283482253 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffa90004850 0x7ffa90004cd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009b60 tx=0x7ffa90005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd38ed3153efcf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:59.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.071+0000 7ffa9bfff700 1 -- 172.21.15.124:0/4283482253 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9400e6c0 con 0x7ffa90004850 2023-10-16T12:59:59.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.071+0000 7ffa9bfff700 1 -- 172.21.15.124:0/4283482253 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9400e820 con 0x7ffa90004850 2023-10-16T12:59:59.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.071+0000 7ffa9bfff700 1 -- 172.21.15.124:0/4283482253 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9400ebb0 con 0x7ffa90004850 2023-10-16T12:59:59.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.072+0000 7ffaab7f3700 1 -- 172.21.15.124:0/4283482253 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffa90004850 msgr2=0x7ffa90004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:59.084 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.072+0000 7ffaab7f3700 1 --2- 172.21.15.124:0/4283482253 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffa90004850 0x7ffa90004cd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009b60 tx=0x7ffa90005880 comp rx=0 tx=0).stop 2023-10-16T12:59:59.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.072+0000 7ffaab7f3700 1 -- 172.21.15.124:0/4283482253 shutdown_connections 2023-10-16T12:59:59.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.072+0000 7ffaab7f3700 1 --2- 172.21.15.124:0/4283482253 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffa90004850 0x7ffa90004cd0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.072+0000 7ffaab7f3700 1 -- 172.21.15.124:0/4283482253 >> 172.21.15.124:0/4283482253 conn(0x7ffaa40d0180 msgr2=0x7ffaa40d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:59.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.072+0000 7ffaab7f3700 1 -- 172.21.15.124:0/4283482253 shutdown_connections 2023-10-16T12:59:59.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.072+0000 7ffaab7f3700 1 -- 172.21.15.124:0/4283482253 wait complete. 2023-10-16T12:59:59.088 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.073+0000 7ffaab7f3700 1 Processor -- start 2023-10-16T12:59:59.088 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.073+0000 7ffaab7f3700 1 -- start start 2023-10-16T12:59:59.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.074+0000 7ffaab7f3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa90004850 0x7ffaa41f28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:59.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.074+0000 7ffaab7f3700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffaa40aee70 0x7ffaa415ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:59.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.074+0000 7ffaab7f3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffaa40ae510 0x7ffaa4160460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:59.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.074+0000 7ffaab7f3700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa40acdf0 con 0x7ffaa40aee70 2023-10-16T12:59:59.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.074+0000 7ffaab7f3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa40adbe0 con 0x7ffa90004850 2023-10-16T12:59:59.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.074+0000 7ffaab7f3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa40c5670 con 0x7ffaa40ae510 2023-10-16T12:59:59.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.074+0000 7ffaa8d8e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffaa40aee70 0x7ffaa415ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:59.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.074+0000 7ffaa8d8e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffaa40aee70 0x7ffaa415ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55348/0 (socket says 172.21.15.124:55348) 2023-10-16T12:59:59.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.074+0000 7ffaa8d8e700 1 -- 172.21.15.124:0/3924543478 learned_addr learned my addr 172.21.15.124:0/3924543478 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:59.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.074+0000 7ffaa958f700 1 --2- 172.21.15.124:0/3924543478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa90004850 0x7ffaa41f28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:59.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.074+0000 7ffaa9d90700 1 --2- 172.21.15.124:0/3924543478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffaa40ae510 0x7ffaa4160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:59.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.075+0000 7ffaa8d8e700 1 -- 172.21.15.124:0/3924543478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffaa40ae510 msgr2=0x7ffaa4160460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:59.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.075+0000 7ffaa8d8e700 1 --2- 172.21.15.124:0/3924543478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffaa40ae510 0x7ffaa4160460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.075+0000 7ffaa8d8e700 1 -- 172.21.15.124:0/3924543478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa90004850 msgr2=0x7ffaa41f28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:59.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.075+0000 7ffaa8d8e700 1 --2- 172.21.15.124:0/3924543478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa90004850 0x7ffaa41f28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.075+0000 7ffaa8d8e700 1 -- 172.21.15.124:0/3924543478 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa40acfd0 con 0x7ffaa40aee70 2023-10-16T12:59:59.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.075+0000 7ffaa8d8e700 1 --2- 172.21.15.124:0/3924543478 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffaa40aee70 0x7ffaa415ff20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ffa940090b0 tx=0x7ffa940047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:59.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.075+0000 7ffa99ffb700 1 -- 172.21.15.124:0/3924543478 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9400e6c0 con 0x7ffaa40aee70 2023-10-16T12:59:59.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.075+0000 7ffa99ffb700 1 -- 172.21.15.124:0/3924543478 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa94003ad0 con 0x7ffaa40aee70 2023-10-16T12:59:59.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.075+0000 7ffa99ffb700 1 -- 172.21.15.124:0/3924543478 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa940045d0 con 0x7ffaa40aee70 2023-10-16T12:59:59.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.075+0000 7ffaab7f3700 1 -- 172.21.15.124:0/3924543478 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa40ad2b0 con 0x7ffaa40aee70 2023-10-16T12:59:59.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.075+0000 7ffaab7f3700 1 -- 172.21.15.124:0/3924543478 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa40ad870 con 0x7ffaa40aee70 2023-10-16T12:59:59.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.076+0000 7ffaab7f3700 1 -- 172.21.15.124:0/3924543478 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa404ebb0 con 0x7ffaa40aee70 2023-10-16T12:59:59.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.076+0000 7ffa99ffb700 1 -- 172.21.15.124:0/3924543478 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffa94013470 con 0x7ffaa40aee70 2023-10-16T12:59:59.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.077+0000 7ffa99ffb700 1 --2- 172.21.15.124:0/3924543478 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ffa8806af00 0x7ffa8806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:59.094 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.077+0000 7ffa99ffb700 1 -- 172.21.15.124:0/3924543478 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ffa9408ab30 con 0x7ffaa40aee70 2023-10-16T12:59:59.094 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.077+0000 7ffaa958f700 1 --2- 172.21.15.124:0/3924543478 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ffa8806af00 0x7ffa8806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:59.094 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.077+0000 7ffaa958f700 1 --2- 172.21.15.124:0/3924543478 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ffa8806af00 0x7ffa8806d3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffaa415ce70 tx=0x7ffaa0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:59.094 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.081+0000 7ffa99ffb700 1 -- 172.21.15.124:0/3924543478 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffa94055fa0 con 0x7ffaa40aee70 2023-10-16T12:59:59.353 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.351+0000 7ffaab7f3700 1 -- 172.21.15.124:0/3924543478 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7ffaa406b490 con 0x7ffaa40aee70 2023-10-16T12:59:59.355 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.353+0000 7ffa99ffb700 1 -- 172.21.15.124:0/3924543478 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7ffa940170a0 con 0x7ffaa40aee70 2023-10-16T12:59:59.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.355+0000 7ffaab7f3700 1 -- 172.21.15.124:0/3924543478 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ffa8806af00 msgr2=0x7ffa8806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:59.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.355+0000 7ffaab7f3700 1 --2- 172.21.15.124:0/3924543478 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ffa8806af00 0x7ffa8806d3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffaa415ce70 tx=0x7ffaa0009040 comp rx=0 tx=0).stop 2023-10-16T12:59:59.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.355+0000 7ffaab7f3700 1 -- 172.21.15.124:0/3924543478 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffaa40aee70 msgr2=0x7ffaa415ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:59.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.355+0000 7ffaab7f3700 1 --2- 172.21.15.124:0/3924543478 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffaa40aee70 0x7ffaa415ff20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ffa940090b0 tx=0x7ffa940047c0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.355+0000 7ffaab7f3700 1 -- 172.21.15.124:0/3924543478 shutdown_connections 2023-10-16T12:59:59.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.355+0000 7ffaab7f3700 1 --2- 172.21.15.124:0/3924543478 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ffa8806af00 0x7ffa8806d3c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.355+0000 7ffaab7f3700 1 --2- 172.21.15.124:0/3924543478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffaa40ae510 0x7ffaa4160460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.355+0000 7ffaab7f3700 1 --2- 172.21.15.124:0/3924543478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa90004850 0x7ffaa41f28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.355+0000 7ffaab7f3700 1 --2- 172.21.15.124:0/3924543478 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffaa40aee70 0x7ffaa415ff20 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.355+0000 7ffaab7f3700 1 -- 172.21.15.124:0/3924543478 >> 172.21.15.124:0/3924543478 conn(0x7ffaa40d0180 msgr2=0x7ffaa4071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:59.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.355+0000 7ffaab7f3700 1 -- 172.21.15.124:0/3924543478 shutdown_connections 2023-10-16T12:59:59.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.355+0000 7ffaab7f3700 1 -- 172.21.15.124:0/3924543478 wait complete. 2023-10-16T12:59:59.370 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-16T12:59:59.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.493+0000 7f0774bde700 1 Processor -- start 2023-10-16T12:59:59.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.493+0000 7f0774bde700 1 -- start start 2023-10-16T12:59:59.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.494+0000 7f0774bde700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f07700ca710 0x7f07700af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:59.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.494+0000 7f0774bde700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f077006ade0 0x7f077006b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:59.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.494+0000 7f0774bde700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077006a950 con 0x7f077015d6c0 2023-10-16T12:59:59.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.494+0000 7f0774bde700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07700cf500 con 0x7f07700ca710 2023-10-16T12:59:59.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.494+0000 7f0774bde700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07700af8d0 con 0x7f077006ade0 2023-10-16T12:59:59.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.495+0000 7f076dd9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f07700ca710 0x7f07700af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:59.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.495+0000 7f076dd9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f07700ca710 0x7f07700af390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55358/0 (socket says 172.21.15.124:55358) 2023-10-16T12:59:59.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.495+0000 7f076dd9b700 1 -- 172.21.15.124:0/2597324485 learned_addr learned my addr 172.21.15.124:0/2597324485 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:59.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.495+0000 7f076e59c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f077015d6c0 0x7f07700cdc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:44026/0 (socket says 172.21.15.124:44026) 2023-10-16T12:59:59.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.495+0000 7f076ed9d700 1 --2- 172.21.15.124:0/2597324485 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f077006ade0 0x7f077006b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:59.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.495+0000 7f076dd9b700 1 -- 172.21.15.124:0/2597324485 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f077006ade0 msgr2=0x7f077006b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:59.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.495+0000 7f076dd9b700 1 --2- 172.21.15.124:0/2597324485 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f077006ade0 0x7f077006b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.495+0000 7f076dd9b700 1 -- 172.21.15.124:0/2597324485 >> v1:172.21.15.124:6789/0 conn(0x7f077015d6c0 legacy=0x7f07700cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:59.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.495+0000 7f076dd9b700 1 -- 172.21.15.124:0/2597324485 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07700cc9d0 con 0x7f07700ca710 2023-10-16T12:59:59.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.495+0000 7f076d59a700 1 -- 172.21.15.124:0/2597324485 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3796437885 0 0) 0x7f077006a950 con 0x7f077015d6c0 2023-10-16T12:59:59.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.495+0000 7f076dd9b700 1 --2- 172.21.15.124:0/2597324485 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07700ca710 0x7f07700af390 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0760009920 tx=0x7f0760009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eca3361dec06ec0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:59.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.495+0000 7f076d59a700 1 -- 172.21.15.124:0/2597324485 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076000ba20 con 0x7f07700ca710 2023-10-16T12:59:59.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.495+0000 7f076d59a700 1 -- 172.21.15.124:0/2597324485 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076000bb80 con 0x7f07700ca710 2023-10-16T12:59:59.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.495+0000 7f076d59a700 1 -- 172.21.15.124:0/2597324485 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0760009e70 con 0x7f07700ca710 2023-10-16T12:59:59.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.496+0000 7f0774bde700 1 -- 172.21.15.124:0/2597324485 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07700ca710 msgr2=0x7f07700af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:59.503 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.496+0000 7f0774bde700 1 --2- 172.21.15.124:0/2597324485 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07700ca710 0x7f07700af390 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0760009920 tx=0x7f0760009c30 comp rx=0 tx=0).stop 2023-10-16T12:59:59.503 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.496+0000 7f0774bde700 1 -- 172.21.15.124:0/2597324485 shutdown_connections 2023-10-16T12:59:59.503 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.496+0000 7f0774bde700 1 --2- 172.21.15.124:0/2597324485 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f077006ade0 0x7f077006b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.503 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.496+0000 7f0774bde700 1 --2- 172.21.15.124:0/2597324485 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07700ca710 0x7f07700af390 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.503 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.496+0000 7f0774bde700 1 -- 172.21.15.124:0/2597324485 >> 172.21.15.124:0/2597324485 conn(0x7f07700ccbd0 msgr2=0x7f07700ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:59.503 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.496+0000 7f0774bde700 1 -- 172.21.15.124:0/2597324485 shutdown_connections 2023-10-16T12:59:59.504 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.496+0000 7f0774bde700 1 -- 172.21.15.124:0/2597324485 wait complete. 2023-10-16T12:59:59.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.497+0000 7f0774bde700 1 Processor -- start 2023-10-16T12:59:59.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.497+0000 7f0774bde700 1 -- start start 2023-10-16T12:59:59.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.498+0000 7f0774bde700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f077006ade0 0x7f07700ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:59.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.498+0000 7f0774bde700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07700ca710 0x7f07700c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:59.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.498+0000 7f0774bde700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f077015d6c0 0x7f07700b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:59.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.498+0000 7f0774bde700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07700b4550 con 0x7f077015d6c0 2023-10-16T12:59:59.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.498+0000 7f0774bde700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07700b47c0 con 0x7f07700ca710 2023-10-16T12:59:59.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.498+0000 7f0774bde700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07700b4aa0 con 0x7f077006ade0 2023-10-16T12:59:59.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.498+0000 7f076ed9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f077015d6c0 0x7f07700b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:59.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.498+0000 7f076ed9d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f077015d6c0 0x7f07700b5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55366/0 (socket says 172.21.15.124:55366) 2023-10-16T12:59:59.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.498+0000 7f076ed9d700 1 -- 172.21.15.124:0/1011251508 learned_addr learned my addr 172.21.15.124:0/1011251508 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:59.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.498+0000 7f076e59c700 1 --2- 172.21.15.124:0/1011251508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f077006ade0 0x7f07700ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:59.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.498+0000 7f076dd9b700 1 --2- 172.21.15.124:0/1011251508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07700ca710 0x7f07700c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:59.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.498+0000 7f076ed9d700 1 -- 172.21.15.124:0/1011251508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f077006ade0 msgr2=0x7f07700ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:59.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.498+0000 7f076ed9d700 1 --2- 172.21.15.124:0/1011251508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f077006ade0 0x7f07700ad850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.498+0000 7f076ed9d700 1 -- 172.21.15.124:0/1011251508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07700ca710 msgr2=0x7f07700c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:59.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.498+0000 7f076ed9d700 1 --2- 172.21.15.124:0/1011251508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07700ca710 0x7f07700c7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.510 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.498+0000 7f076ed9d700 1 -- 172.21.15.124:0/1011251508 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0760009550 con 0x7f077015d6c0 2023-10-16T12:59:59.510 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.499+0000 7f076ed9d700 1 --2- 172.21.15.124:0/1011251508 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f077015d6c0 0x7f07700b5580 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0768007d90 tx=0x7f076800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:59.510 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.499+0000 7f075effd700 1 -- 172.21.15.124:0/1011251508 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076800ede0 con 0x7f077015d6c0 2023-10-16T12:59:59.510 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.499+0000 7f075effd700 1 -- 172.21.15.124:0/1011251508 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0768014420 con 0x7f077015d6c0 2023-10-16T12:59:59.510 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.499+0000 7f075effd700 1 -- 172.21.15.124:0/1011251508 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07680147d0 con 0x7f077015d6c0 2023-10-16T12:59:59.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.499+0000 7f0774bde700 1 -- 172.21.15.124:0/1011251508 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07700b4d80 con 0x7f077015d6c0 2023-10-16T12:59:59.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.499+0000 7f0774bde700 1 -- 172.21.15.124:0/1011251508 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07700add90 con 0x7f077015d6c0 2023-10-16T12:59:59.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.500+0000 7f0774bde700 1 -- 172.21.15.124:0/1011251508 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07700adf50 con 0x7f077015d6c0 2023-10-16T12:59:59.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.500+0000 7f075effd700 1 -- 172.21.15.124:0/1011251508 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0768014930 con 0x7f077015d6c0 2023-10-16T12:59:59.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.500+0000 7f075effd700 1 --2- 172.21.15.124:0/1011251508 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f075006af00 0x7f075006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:59.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.500+0000 7f075effd700 1 -- 172.21.15.124:0/1011251508 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0768089a40 con 0x7f077015d6c0 2023-10-16T12:59:59.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.500+0000 7f076e59c700 1 --2- 172.21.15.124:0/1011251508 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f075006af00 0x7f075006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:59.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.501+0000 7f076e59c700 1 --2- 172.21.15.124:0/1011251508 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f075006af00 0x7f075006d3c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0764000f60 tx=0x7f0764009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:59.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.505+0000 7f075effd700 1 -- 172.21.15.124:0/1011251508 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f076808be60 con 0x7f077015d6c0 2023-10-16T12:59:59.775 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.772+0000 7f0774bde700 1 -- 172.21.15.124:0/1011251508 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f07700b52a0 con 0x7f077015d6c0 2023-10-16T12:59:59.777 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.774+0000 7f075effd700 1 -- 172.21.15.124:0/1011251508 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0768058820 con 0x7f077015d6c0 2023-10-16T12:59:59.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.777+0000 7f0774bde700 1 -- 172.21.15.124:0/1011251508 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f075006af00 msgr2=0x7f075006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:59.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.777+0000 7f0774bde700 1 --2- 172.21.15.124:0/1011251508 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f075006af00 0x7f075006d3c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0764000f60 tx=0x7f0764009040 comp rx=0 tx=0).stop 2023-10-16T12:59:59.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.777+0000 7f0774bde700 1 -- 172.21.15.124:0/1011251508 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f077015d6c0 msgr2=0x7f07700b5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:59.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.777+0000 7f0774bde700 1 --2- 172.21.15.124:0/1011251508 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f077015d6c0 0x7f07700b5580 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0768007d90 tx=0x7f076800e3c0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.777+0000 7f0774bde700 1 -- 172.21.15.124:0/1011251508 shutdown_connections 2023-10-16T12:59:59.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.777+0000 7f0774bde700 1 --2- 172.21.15.124:0/1011251508 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f075006af00 0x7f075006d3c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.777+0000 7f0774bde700 1 --2- 172.21.15.124:0/1011251508 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f077015d6c0 0x7f07700b5580 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.777+0000 7f0774bde700 1 --2- 172.21.15.124:0/1011251508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f077006ade0 0x7f07700ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.777+0000 7f0774bde700 1 --2- 172.21.15.124:0/1011251508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07700ca710 0x7f07700c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.777+0000 7f0774bde700 1 -- 172.21.15.124:0/1011251508 >> 172.21.15.124:0/1011251508 conn(0x7f07700ccbd0 msgr2=0x7f07700cfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:59.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.777+0000 7f0774bde700 1 -- 172.21.15.124:0/1011251508 shutdown_connections 2023-10-16T12:59:59.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.777+0000 7f0774bde700 1 -- 172.21.15.124:0/1011251508 wait complete. 2023-10-16T12:59:59.792 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-16T12:59:59.912 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.910+0000 7fd5e640a700 1 Processor -- start 2023-10-16T12:59:59.913 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.910+0000 7fd5e640a700 1 -- start start 2023-10-16T12:59:59.919 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.911+0000 7fd5e640a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5e00ce1d0 0x7fd5e00cef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:59.919 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.911+0000 7fd5e640a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd5e00cf460 0x7fd5e00d1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:59.919 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.911+0000 7fd5e640a700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e006b930 con 0x7fd5e00d1780 2023-10-16T12:59:59.919 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.911+0000 7fd5e640a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e00cf8e0 con 0x7fd5e00cf460 2023-10-16T12:59:59.919 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.911+0000 7fd5e640a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e006c1d0 con 0x7fd5e00ce1d0 2023-10-16T12:59:59.920 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.911+0000 7fd5e49a7700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fd5e00d1780 0x7fd5e0161140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:44042/0 (socket says 172.21.15.124:44042) 2023-10-16T12:59:59.920 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.911+0000 7fd5e49a7700 1 -- 172.21.15.124:0/422586741 learned_addr learned my addr 172.21.15.124:0/422586741 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T12:59:59.920 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.911+0000 7fd5df7fe700 1 --2- 172.21.15.124:0/422586741 >> v2:172.21.15.192:3300/0 conn(0x7fd5e00cf460 0x7fd5e00d1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:59.920 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.911+0000 7fd5dffff700 1 --2- 172.21.15.124:0/422586741 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5e00ce1d0 0x7fd5e00cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:59.921 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.911+0000 7fd5deffd700 1 -- 172.21.15.124:0/422586741 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984339053 0 0) 0x7fd5e006b930 con 0x7fd5e00d1780 2023-10-16T12:59:59.921 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.911+0000 7fd5deffd700 1 -- 172.21.15.124:0/422586741 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5c80035b0 con 0x7fd5e00d1780 2023-10-16T12:59:59.921 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.911+0000 7fd5deffd700 1 -- 172.21.15.124:0/422586741 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3926351361 0 0) 0x7fd5c80035b0 con 0x7fd5e00d1780 2023-10-16T12:59:59.921 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.911+0000 7fd5deffd700 1 -- 172.21.15.124:0/422586741 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5e00ce1d0 msgr2=0x7fd5e00cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:59.921 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.911+0000 7fd5deffd700 1 --2- 172.21.15.124:0/422586741 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5e00ce1d0 0x7fd5e00cef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.922 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.911+0000 7fd5deffd700 1 -- 172.21.15.124:0/422586741 >> v2:172.21.15.192:3300/0 conn(0x7fd5e00cf460 msgr2=0x7fd5e00d1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:59.922 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.911+0000 7fd5deffd700 1 --2- 172.21.15.124:0/422586741 >> v2:172.21.15.192:3300/0 conn(0x7fd5e00cf460 0x7fd5e00d1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.922 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.911+0000 7fd5deffd700 1 -- 172.21.15.124:0/422586741 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e00d1fe0 con 0x7fd5e00d1780 2023-10-16T12:59:59.922 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.911+0000 7fd5deffd700 1 -- 172.21.15.124:0/422586741 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7fd5d8001a40 con 0x7fd5e00d1780 2023-10-16T12:59:59.922 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.911+0000 7fd5df7fe700 1 --2- 172.21.15.124:0/422586741 >> v2:172.21.15.192:3300/0 conn(0x7fd5e00cf460 0x7fd5e00d1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T12:59:59.923 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.911+0000 7fd5deffd700 1 -- 172.21.15.124:0/422586741 >> v1:172.21.15.124:6789/0 conn(0x7fd5e00d1780 legacy=0x7fd5e0161140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:59.923 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.911+0000 7fd5deffd700 1 --2- 172.21.15.124:0/422586741 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5e00ce1d0 0x7fd5c8003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:59.923 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.911+0000 7fd5deffd700 1 --2- 172.21.15.124:0/422586741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5c8003f80 0x7fd5c8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:59.923 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.912+0000 7fd5deffd700 1 --2- 172.21.15.124:0/422586741 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5c8004d90 0x7fd5c8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:59.923 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.912+0000 7fd5deffd700 1 -- 172.21.15.124:0/422586741 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e00cf8e0 con 0x7fd5c8004d90 2023-10-16T12:59:59.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.912+0000 7fd5deffd700 1 -- 172.21.15.124:0/422586741 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e006c1d0 con 0x7fd5c8003f80 2023-10-16T12:59:59.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.912+0000 7fd5deffd700 1 -- 172.21.15.124:0/422586741 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c800ba10 con 0x7fd5e00ce1d0 2023-10-16T12:59:59.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.912+0000 7fd5e49a7700 1 --2- 172.21.15.124:0/422586741 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5c8004d90 0x7fd5c8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:59.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.912+0000 7fd5df7fe700 1 --2- 172.21.15.124:0/422586741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5c8003f80 0x7fd5c8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:59.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.912+0000 7fd5dffff700 1 --2- 172.21.15.124:0/422586741 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5e00ce1d0 0x7fd5c8003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:59.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.912+0000 7fd5e49a7700 1 -- 172.21.15.124:0/422586741 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5e00ce1d0 msgr2=0x7fd5c8003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:59.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.912+0000 7fd5e49a7700 1 --2- 172.21.15.124:0/422586741 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5e00ce1d0 0x7fd5c8003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.912+0000 7fd5e49a7700 1 -- 172.21.15.124:0/422586741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5c8003f80 msgr2=0x7fd5c8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T12:59:59.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.912+0000 7fd5e49a7700 1 --2- 172.21.15.124:0/422586741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5c8003f80 0x7fd5c8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.912+0000 7fd5e49a7700 1 -- 172.21.15.124:0/422586741 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c80035b0 con 0x7fd5c8004d90 2023-10-16T12:59:59.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.912+0000 7fd5dffff700 1 --2- 172.21.15.124:0/422586741 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5e00ce1d0 0x7fd5c8003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T12:59:59.926 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.912+0000 7fd5e49a7700 1 --2- 172.21.15.124:0/422586741 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5c8004d90 0x7fd5c8005210 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800a7f0 tx=0x7fd5c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f2a0de8e76bc0a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:59.926 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.912+0000 7fd5deffd700 1 -- 172.21.15.124:0/422586741 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d800a2b0 con 0x7fd5c8004d90 2023-10-16T12:59:59.926 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.912+0000 7fd5deffd700 1 -- 172.21.15.124:0/422586741 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d8012620 con 0x7fd5c8004d90 2023-10-16T12:59:59.926 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.912+0000 7fd5deffd700 1 -- 172.21.15.124:0/422586741 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d80129d0 con 0x7fd5c8004d90 2023-10-16T12:59:59.926 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.913+0000 7fd5e640a700 1 -- 172.21.15.124:0/422586741 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5c8004d90 msgr2=0x7fd5c8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:59.927 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.913+0000 7fd5e640a700 1 --2- 172.21.15.124:0/422586741 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5c8004d90 0x7fd5c8005210 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800a7f0 tx=0x7fd5c8005880 comp rx=0 tx=0).stop 2023-10-16T12:59:59.927 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.913+0000 7fd5e49a7700 1 -- 172.21.15.124:0/422586741 reap_dead start 2023-10-16T12:59:59.927 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.913+0000 7fd5e640a700 1 -- 172.21.15.124:0/422586741 shutdown_connections 2023-10-16T12:59:59.927 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.913+0000 7fd5e640a700 1 -- 172.21.15.124:0/422586741 >> 172.21.15.124:0/422586741 conn(0x7fd5e0070460 msgr2=0x7fd5e0070840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T12:59:59.927 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.913+0000 7fd5e640a700 1 -- 172.21.15.124:0/422586741 shutdown_connections 2023-10-16T12:59:59.928 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.913+0000 7fd5e640a700 1 -- 172.21.15.124:0/422586741 wait complete. 2023-10-16T12:59:59.928 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.914+0000 7fd5e640a700 1 Processor -- start 2023-10-16T12:59:59.928 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.914+0000 7fd5e640a700 1 -- start start 2023-10-16T12:59:59.928 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.915+0000 7fd5e640a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5e01f6790 0x7fd5e00cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:59.928 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.915+0000 7fd5e640a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5e01f6b70 0x7fd5e00c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:59.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.915+0000 7fd5e640a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5e00c73f0 0x7fd5e00c7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:59.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.915+0000 7fd5e640a700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e00c9880 con 0x7fd5e01f6790 2023-10-16T12:59:59.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.915+0000 7fd5e640a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e00c8c70 con 0x7fd5e00c73f0 2023-10-16T12:59:59.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.915+0000 7fd5e640a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e00c8f50 con 0x7fd5e01f6b70 2023-10-16T12:59:59.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.915+0000 7fd5dffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5e01f6790 0x7fd5e00cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:59.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.915+0000 7fd5dffff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5e01f6790 0x7fd5e00cac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55382/0 (socket says 172.21.15.124:55382) 2023-10-16T12:59:59.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.915+0000 7fd5dffff700 1 -- 172.21.15.124:0/118159123 learned_addr learned my addr 172.21.15.124:0/118159123 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T12:59:59.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.915+0000 7fd5df7fe700 1 --2- 172.21.15.124:0/118159123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5e01f6b70 0x7fd5e00c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:59.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.915+0000 7fd5e49a7700 1 --2- 172.21.15.124:0/118159123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5e00c73f0 0x7fd5e00c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:59.930 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.915+0000 7fd5dffff700 1 -- 172.21.15.124:0/118159123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5e01f6b70 msgr2=0x7fd5e00c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:59.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.915+0000 7fd5dffff700 1 --2- 172.21.15.124:0/118159123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5e01f6b70 0x7fd5e00c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.915+0000 7fd5dffff700 1 -- 172.21.15.124:0/118159123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5e00c73f0 msgr2=0x7fd5e00c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T12:59:59.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.915+0000 7fd5dffff700 1 --2- 172.21.15.124:0/118159123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5e00c73f0 0x7fd5e00c7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T12:59:59.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.915+0000 7fd5dffff700 1 -- 172.21.15.124:0/118159123 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e00c9230 con 0x7fd5e01f6790 2023-10-16T12:59:59.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.915+0000 7fd5dffff700 1 --2- 172.21.15.124:0/118159123 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5e01f6790 0x7fd5e00cac90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4010930 tx=0x7fd5d4010cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:59.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.915+0000 7fd5dcff9700 1 -- 172.21.15.124:0/118159123 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4004020 con 0x7fd5e01f6790 2023-10-16T12:59:59.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.915+0000 7fd5dcff9700 1 -- 172.21.15.124:0/118159123 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d4004180 con 0x7fd5e01f6790 2023-10-16T12:59:59.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.915+0000 7fd5e640a700 1 -- 172.21.15.124:0/118159123 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e00c9510 con 0x7fd5e01f6790 2023-10-16T12:59:59.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.915+0000 7fd5dcff9700 1 -- 172.21.15.124:0/118159123 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4004530 con 0x7fd5e01f6790 2023-10-16T12:59:59.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.915+0000 7fd5e640a700 1 -- 172.21.15.124:0/118159123 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e00c8960 con 0x7fd5e01f6790 2023-10-16T12:59:59.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.916+0000 7fd5e640a700 1 -- 172.21.15.124:0/118159123 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e004ebb0 con 0x7fd5e01f6790 2023-10-16T12:59:59.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.917+0000 7fd5dcff9700 1 -- 172.21.15.124:0/118159123 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd5d400e870 con 0x7fd5e01f6790 2023-10-16T12:59:59.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.917+0000 7fd5dcff9700 1 --2- 172.21.15.124:0/118159123 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd5cc06af00 0x7fd5cc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T12:59:59.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.917+0000 7fd5dcff9700 1 -- 172.21.15.124:0/118159123 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fd5d4089b10 con 0x7fd5e01f6790 2023-10-16T12:59:59.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.917+0000 7fd5df7fe700 1 --2- 172.21.15.124:0/118159123 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd5cc06af00 0x7fd5cc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T12:59:59.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.918+0000 7fd5df7fe700 1 --2- 172.21.15.124:0/118159123 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd5cc06af00 0x7fd5cc06d3c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0160ca0 tx=0x7fd5d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T12:59:59.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T12:59:59.922+0000 7fd5dcff9700 1 -- 172.21.15.124:0/118159123 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd5d4054dd0 con 0x7fd5e01f6790 2023-10-16T13:00:00.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.188+0000 7fd5e640a700 1 -- 172.21.15.124:0/118159123 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fd5e00b3770 con 0x7fd5e01f6790 2023-10-16T13:00:00.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.191+0000 7fd5dcff9700 1 -- 172.21.15.124:0/118159123 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd5d40230a0 con 0x7fd5e01f6790 2023-10-16T13:00:00.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.193+0000 7fd5e640a700 1 -- 172.21.15.124:0/118159123 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd5cc06af00 msgr2=0x7fd5cc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:00.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.193+0000 7fd5e640a700 1 --2- 172.21.15.124:0/118159123 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd5cc06af00 0x7fd5cc06d3c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0160ca0 tx=0x7fd5d0008040 comp rx=0 tx=0).stop 2023-10-16T13:00:00.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.193+0000 7fd5e640a700 1 -- 172.21.15.124:0/118159123 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5e01f6790 msgr2=0x7fd5e00cac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:00.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.193+0000 7fd5e640a700 1 --2- 172.21.15.124:0/118159123 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5e01f6790 0x7fd5e00cac90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4010930 tx=0x7fd5d4010cf0 comp rx=0 tx=0).stop 2023-10-16T13:00:00.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.193+0000 7fd5e640a700 1 -- 172.21.15.124:0/118159123 shutdown_connections 2023-10-16T13:00:00.197 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.193+0000 7fd5e640a700 1 --2- 172.21.15.124:0/118159123 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fd5cc06af00 0x7fd5cc06d3c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:00.197 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.193+0000 7fd5e640a700 1 --2- 172.21.15.124:0/118159123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5e00c73f0 0x7fd5e00c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:00.197 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.193+0000 7fd5e640a700 1 --2- 172.21.15.124:0/118159123 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5e01f6790 0x7fd5e00cac90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:00.197 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.193+0000 7fd5e640a700 1 --2- 172.21.15.124:0/118159123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5e01f6b70 0x7fd5e00c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:00.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.193+0000 7fd5e640a700 1 -- 172.21.15.124:0/118159123 >> 172.21.15.124:0/118159123 conn(0x7fd5e0070460 msgr2=0x7fd5e015f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:00.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.193+0000 7fd5e640a700 1 -- 172.21.15.124:0/118159123 shutdown_connections 2023-10-16T13:00:00.198 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.193+0000 7fd5e640a700 1 -- 172.21.15.124:0/118159123 wait complete. 2023-10-16T13:00:00.207 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-16T13:00:00.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.327+0000 7f1aa61ab700 1 Processor -- start 2023-10-16T13:00:00.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.327+0000 7f1aa61ab700 1 -- start start 2023-10-16T13:00:00.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.328+0000 7f1aa61ab700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1aa0143c50 0x7f1aa00ca650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:00.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.328+0000 7f1aa61ab700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1aa00c5730 0x7f1aa00cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:00.334 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.328+0000 7f1aa61ab700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa00ccb90 con 0x7f1aa015ec60 2023-10-16T13:00:00.334 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.328+0000 7f1aa61ab700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa00cce70 con 0x7f1aa0143c50 2023-10-16T13:00:00.334 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.328+0000 7f1aa61ab700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa00cb0c0 con 0x7f1aa00c5730 2023-10-16T13:00:00.334 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.329+0000 7f1a9ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1aa00c5730 0x7f1aa00cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:00.334 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.329+0000 7f1a9f7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1aa0143c50 0x7f1aa00ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:00.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.329+0000 7f1a9f7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1aa0143c50 0x7f1aa00ca650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:35556/0 (socket says 172.21.15.124:35556) 2023-10-16T13:00:00.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.329+0000 7f1a9f7fe700 1 -- 172.21.15.124:0/807307826 learned_addr learned my addr 172.21.15.124:0/807307826 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:00.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.329+0000 7f1a9f7fe700 1 -- 172.21.15.124:0/807307826 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1aa00c5730 msgr2=0x7f1aa00cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:00.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.329+0000 7f1a9f7fe700 1 --2- 172.21.15.124:0/807307826 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1aa00c5730 0x7f1aa00cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:00.335 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.329+0000 7f1a9f7fe700 1 -- 172.21.15.124:0/807307826 >> v1:172.21.15.192:6789/0 conn(0x7f1aa015ec60 legacy=0x7f1aa00c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:00.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.329+0000 7f1a9f7fe700 1 -- 172.21.15.124:0/807307826 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa00cb3a0 con 0x7f1aa0143c50 2023-10-16T13:00:00.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.329+0000 7f1a9e7fc700 1 -- 172.21.15.124:0/807307826 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 7232050 0 0) 0x7f1aa00ccb90 con 0x7f1aa015ec60 2023-10-16T13:00:00.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.329+0000 7f1a9ffff700 1 --2- 172.21.15.124:0/807307826 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1aa00c5730 0x7f1aa00cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:00:00.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.329+0000 7f1a9f7fe700 1 --2- 172.21.15.124:0/807307826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1aa0143c50 0x7f1aa00ca650 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1a940098f0 tx=0x7f1a94009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f02ec6e55d63b16 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:00.336 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.329+0000 7f1a9e7fc700 1 -- 172.21.15.124:0/807307826 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a94011830 con 0x7f1aa0143c50 2023-10-16T13:00:00.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.329+0000 7f1a9e7fc700 1 -- 172.21.15.124:0/807307826 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a94011990 con 0x7f1aa0143c50 2023-10-16T13:00:00.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.329+0000 7f1a9e7fc700 1 -- 172.21.15.124:0/807307826 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a94011d20 con 0x7f1aa0143c50 2023-10-16T13:00:00.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.330+0000 7f1aa61ab700 1 -- 172.21.15.124:0/807307826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1aa0143c50 msgr2=0x7f1aa00ca650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:00.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.330+0000 7f1aa61ab700 1 --2- 172.21.15.124:0/807307826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1aa0143c50 0x7f1aa00ca650 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1a940098f0 tx=0x7f1a94009c00 comp rx=0 tx=0).stop 2023-10-16T13:00:00.337 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.330+0000 7f1aa61ab700 1 -- 172.21.15.124:0/807307826 shutdown_connections 2023-10-16T13:00:00.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.330+0000 7f1aa61ab700 1 --2- 172.21.15.124:0/807307826 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1aa00c5730 0x7f1aa00cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:00.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.330+0000 7f1aa61ab700 1 --2- 172.21.15.124:0/807307826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1aa0143c50 0x7f1aa00ca650 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:00.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.330+0000 7f1aa61ab700 1 -- 172.21.15.124:0/807307826 >> 172.21.15.124:0/807307826 conn(0x7f1aa006c850 msgr2=0x7f1aa006cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:00.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.330+0000 7f1aa61ab700 1 -- 172.21.15.124:0/807307826 shutdown_connections 2023-10-16T13:00:00.338 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.330+0000 7f1aa61ab700 1 -- 172.21.15.124:0/807307826 wait complete. 2023-10-16T13:00:00.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.331+0000 7f1aa61ab700 1 Processor -- start 2023-10-16T13:00:00.341 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.331+0000 7f1aa61ab700 1 -- start start 2023-10-16T13:00:00.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.332+0000 7f1aa61ab700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1aa00c5730 0x7f1aa01347b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:00.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.332+0000 7f1aa61ab700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1aa0143c50 0x7f1aa00c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:00.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.332+0000 7f1aa61ab700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1aa015ec60 0x7f1aa0136640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:00.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.332+0000 7f1aa61ab700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa00c65d0 con 0x7f1aa00c5730 2023-10-16T13:00:00.342 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.332+0000 7f1aa61ab700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa0134120 con 0x7f1aa015ec60 2023-10-16T13:00:00.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.332+0000 7f1aa61ab700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa00c7db0 con 0x7f1aa0143c50 2023-10-16T13:00:00.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.332+0000 7f1a9f7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1aa00c5730 0x7f1aa01347b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:00.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.332+0000 7f1a9f7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1aa00c5730 0x7f1aa01347b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55396/0 (socket says 172.21.15.124:55396) 2023-10-16T13:00:00.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.332+0000 7f1a9f7fe700 1 -- 172.21.15.124:0/852180166 learned_addr learned my addr 172.21.15.124:0/852180166 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:00.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.332+0000 7f1a9effd700 1 --2- 172.21.15.124:0/852180166 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1aa0143c50 0x7f1aa00c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:00.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.332+0000 7f1a9ffff700 1 --2- 172.21.15.124:0/852180166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1aa015ec60 0x7f1aa0136640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:00.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.333+0000 7f1a9f7fe700 1 -- 172.21.15.124:0/852180166 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1aa0143c50 msgr2=0x7f1aa00c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:00.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.333+0000 7f1a9f7fe700 1 --2- 172.21.15.124:0/852180166 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1aa0143c50 0x7f1aa00c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:00.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.333+0000 7f1a9f7fe700 1 -- 172.21.15.124:0/852180166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1aa015ec60 msgr2=0x7f1aa0136640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:00.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.333+0000 7f1a9f7fe700 1 --2- 172.21.15.124:0/852180166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1aa015ec60 0x7f1aa0136640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:00.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.333+0000 7f1a9f7fe700 1 -- 172.21.15.124:0/852180166 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9800bc80 con 0x7f1aa00c5730 2023-10-16T13:00:00.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.333+0000 7f1a9ffff700 1 --2- 172.21.15.124:0/852180166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1aa015ec60 0x7f1aa0136640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:00:00.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.333+0000 7f1a9f7fe700 1 --2- 172.21.15.124:0/852180166 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1aa00c5730 0x7f1aa01347b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1a94009c40 tx=0x7f1a94004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:00.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.333+0000 7f1a87fff700 1 -- 172.21.15.124:0/852180166 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a940044b0 con 0x7f1aa00c5730 2023-10-16T13:00:00.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.333+0000 7f1a87fff700 1 -- 172.21.15.124:0/852180166 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9401f070 con 0x7f1aa00c5730 2023-10-16T13:00:00.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.333+0000 7f1aa61ab700 1 -- 172.21.15.124:0/852180166 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a94009550 con 0x7f1aa00c5730 2023-10-16T13:00:00.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.333+0000 7f1a87fff700 1 -- 172.21.15.124:0/852180166 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a940038e0 con 0x7f1aa00c5730 2023-10-16T13:00:00.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.333+0000 7f1aa61ab700 1 -- 172.21.15.124:0/852180166 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa00c8370 con 0x7f1aa00c5730 2023-10-16T13:00:00.346 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.334+0000 7f1aa61ab700 1 -- 172.21.15.124:0/852180166 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa004f400 con 0x7f1aa00c5730 2023-10-16T13:00:00.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.334+0000 7f1a87fff700 1 -- 172.21.15.124:0/852180166 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1a94021030 con 0x7f1aa00c5730 2023-10-16T13:00:00.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.335+0000 7f1a87fff700 1 --2- 172.21.15.124:0/852180166 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1a8c06af00 0x7f1a8c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:00.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.335+0000 7f1a87fff700 1 -- 172.21.15.124:0/852180166 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f1a9408a7d0 con 0x7f1aa00c5730 2023-10-16T13:00:00.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.335+0000 7f1a9effd700 1 --2- 172.21.15.124:0/852180166 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1a8c06af00 0x7f1a8c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:00.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.335+0000 7f1a9effd700 1 --2- 172.21.15.124:0/852180166 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1a8c06af00 0x7f1a8c06d3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00c4890 tx=0x7f1a90009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:00.348 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.339+0000 7f1a87fff700 1 -- 172.21.15.124:0/852180166 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a94055c40 con 0x7f1aa00c5730 2023-10-16T13:00:00.607 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.605+0000 7f1aa61ab700 1 -- 172.21.15.124:0/852180166 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f1aa004ebb0 con 0x7f1aa00c5730 2023-10-16T13:00:00.609 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.607+0000 7f1a87fff700 1 -- 172.21.15.124:0/852180166 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1a94015020 con 0x7f1aa00c5730 2023-10-16T13:00:00.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.610+0000 7f1aa61ab700 1 -- 172.21.15.124:0/852180166 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1a8c06af00 msgr2=0x7f1a8c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:00.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.610+0000 7f1aa61ab700 1 --2- 172.21.15.124:0/852180166 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1a8c06af00 0x7f1a8c06d3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00c4890 tx=0x7f1a90009040 comp rx=0 tx=0).stop 2023-10-16T13:00:00.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.610+0000 7f1aa61ab700 1 -- 172.21.15.124:0/852180166 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1aa00c5730 msgr2=0x7f1aa01347b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:00.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.610+0000 7f1aa61ab700 1 --2- 172.21.15.124:0/852180166 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1aa00c5730 0x7f1aa01347b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1a94009c40 tx=0x7f1a94004750 comp rx=0 tx=0).stop 2023-10-16T13:00:00.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.610+0000 7f1aa61ab700 1 -- 172.21.15.124:0/852180166 shutdown_connections 2023-10-16T13:00:00.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.610+0000 7f1aa61ab700 1 --2- 172.21.15.124:0/852180166 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1a8c06af00 0x7f1a8c06d3c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:00.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.610+0000 7f1aa61ab700 1 --2- 172.21.15.124:0/852180166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1aa015ec60 0x7f1aa0136640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:00.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.610+0000 7f1aa61ab700 1 --2- 172.21.15.124:0/852180166 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1aa00c5730 0x7f1aa01347b0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:00.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.610+0000 7f1aa61ab700 1 --2- 172.21.15.124:0/852180166 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1aa0143c50 0x7f1aa00c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:00.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.610+0000 7f1aa61ab700 1 -- 172.21.15.124:0/852180166 >> 172.21.15.124:0/852180166 conn(0x7f1aa006c850 msgr2=0x7f1aa015c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:00.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.610+0000 7f1aa61ab700 1 -- 172.21.15.124:0/852180166 shutdown_connections 2023-10-16T13:00:00.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.610+0000 7f1aa61ab700 1 -- 172.21.15.124:0/852180166 wait complete. 2023-10-16T13:00:00.624 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-16T13:00:00.746 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.744+0000 7f6cc13ad700 1 Processor -- start 2023-10-16T13:00:00.747 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.744+0000 7f6cc13ad700 1 -- start start 2023-10-16T13:00:00.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cc13ad700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6cbc160b50 0x7f6cbc0cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:00.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cc13ad700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6cbc0b5700 0x7f6cbc0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:00.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cc13ad700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cbc0b94b0 con 0x7f6cbc0b9000 2023-10-16T13:00:00.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cc13ad700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cbc0d0010 con 0x7f6cbc160b50 2023-10-16T13:00:00.751 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cc13ad700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc0d02f0 con 0x7f6cbc0b5700 2023-10-16T13:00:00.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cba7fc700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f6cbc0b9000 0x7f6cbc0b4ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:44072/0 (socket says 172.21.15.124:44072) 2023-10-16T13:00:00.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cba7fc700 1 -- 172.21.15.124:0/2158644797 learned_addr learned my addr 172.21.15.124:0/2158644797 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T13:00:00.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cb9ffb700 1 -- 172.21.15.124:0/2158644797 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553323806 0 0) 0x7f6cbc0b94b0 con 0x7f6cbc0b9000 2023-10-16T13:00:00.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cb9ffb700 1 -- 172.21.15.124:0/2158644797 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ca40035b0 con 0x7f6cbc0b9000 2023-10-16T13:00:00.752 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cbb7fe700 1 --2- 172.21.15.124:0/2158644797 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6cbc0b5700 0x7f6cbc0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:00.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cbaffd700 1 --2- 172.21.15.124:0/2158644797 >> v2:172.21.15.192:3300/0 conn(0x7f6cbc160b50 0x7f6cbc0cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:00.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cb9ffb700 1 -- 172.21.15.124:0/2158644797 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3987369756 0 0) 0x7f6ca40035b0 con 0x7f6cbc0b9000 2023-10-16T13:00:00.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cb9ffb700 1 -- 172.21.15.124:0/2158644797 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6cbc0b5700 msgr2=0x7f6cbc0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:00.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cb9ffb700 1 --2- 172.21.15.124:0/2158644797 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6cbc0b5700 0x7f6cbc0ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:00.753 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cb9ffb700 1 -- 172.21.15.124:0/2158644797 >> v2:172.21.15.192:3300/0 conn(0x7f6cbc160b50 msgr2=0x7f6cbc0cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:00.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cb9ffb700 1 --2- 172.21.15.124:0/2158644797 >> v2:172.21.15.192:3300/0 conn(0x7f6cbc160b50 0x7f6cbc0cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:00.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cb9ffb700 1 -- 172.21.15.124:0/2158644797 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc0d05d0 con 0x7f6cbc0b9000 2023-10-16T13:00:00.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cb9ffb700 1 -- 172.21.15.124:0/2158644797 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f6cb0001670 con 0x7f6cbc0b9000 2023-10-16T13:00:00.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cb9ffb700 1 -- 172.21.15.124:0/2158644797 >> v1:172.21.15.124:6789/0 conn(0x7f6cbc0b9000 legacy=0x7f6cbc0b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:00.754 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cb9ffb700 1 --2- 172.21.15.124:0/2158644797 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6cbc0b5700 0x7f6ca4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:00.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cb9ffb700 1 --2- 172.21.15.124:0/2158644797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ca4004030 0x7f6ca4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:00.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cb9ffb700 1 --2- 172.21.15.124:0/2158644797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6ca4004d90 0x7f6ca4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:00.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cb9ffb700 1 -- 172.21.15.124:0/2158644797 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc0d0010 con 0x7f6ca4004d90 2023-10-16T13:00:00.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cb9ffb700 1 -- 172.21.15.124:0/2158644797 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc0d02f0 con 0x7f6ca4004030 2023-10-16T13:00:00.755 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cb9ffb700 1 -- 172.21.15.124:0/2158644797 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca400bba0 con 0x7f6cbc0b5700 2023-10-16T13:00:00.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.745+0000 7f6cbb7fe700 1 --2- 172.21.15.124:0/2158644797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6ca4004d90 0x7f6ca4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:00.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.746+0000 7f6cbaffd700 1 --2- 172.21.15.124:0/2158644797 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6cbc0b5700 0x7f6ca4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:00.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.746+0000 7f6cba7fc700 1 --2- 172.21.15.124:0/2158644797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ca4004030 0x7f6ca4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:00.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.746+0000 7f6cbb7fe700 1 -- 172.21.15.124:0/2158644797 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6cbc0b5700 msgr2=0x7f6ca4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:00.756 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.746+0000 7f6cbb7fe700 1 --2- 172.21.15.124:0/2158644797 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6cbc0b5700 0x7f6ca4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:00.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.746+0000 7f6cbb7fe700 1 -- 172.21.15.124:0/2158644797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ca4004030 msgr2=0x7f6ca4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:00.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.746+0000 7f6cbb7fe700 1 --2- 172.21.15.124:0/2158644797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ca4004030 0x7f6ca4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:00.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.746+0000 7f6cbb7fe700 1 -- 172.21.15.124:0/2158644797 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca40035b0 con 0x7f6ca4004d90 2023-10-16T13:00:00.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.746+0000 7f6cbb7fe700 1 --2- 172.21.15.124:0/2158644797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6ca4004d90 0x7f6ca4005210 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc08c2e0 tx=0x7f6ca4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b839c274d0fed2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:00.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.746+0000 7f6cb9ffb700 1 -- 172.21.15.124:0/2158644797 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb4007e20 con 0x7f6ca4004d90 2023-10-16T13:00:00.757 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.746+0000 7f6cb9ffb700 1 -- 172.21.15.124:0/2158644797 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb4014400 con 0x7f6ca4004d90 2023-10-16T13:00:00.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.746+0000 7f6cb9ffb700 1 -- 172.21.15.124:0/2158644797 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb40147b0 con 0x7f6ca4004d90 2023-10-16T13:00:00.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.746+0000 7f6cc13ad700 1 -- 172.21.15.124:0/2158644797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6ca4004d90 msgr2=0x7f6ca4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:00.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.746+0000 7f6cc13ad700 1 --2- 172.21.15.124:0/2158644797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6ca4004d90 0x7f6ca4005210 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc08c2e0 tx=0x7f6ca4005880 comp rx=0 tx=0).stop 2023-10-16T13:00:00.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.747+0000 7f6cbb7fe700 1 -- 172.21.15.124:0/2158644797 reap_dead start 2023-10-16T13:00:00.758 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.747+0000 7f6cc13ad700 1 -- 172.21.15.124:0/2158644797 shutdown_connections 2023-10-16T13:00:00.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.747+0000 7f6cc13ad700 1 -- 172.21.15.124:0/2158644797 >> 172.21.15.124:0/2158644797 conn(0x7f6cbc06bc70 msgr2=0x7f6cbc06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:00.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.747+0000 7f6cc13ad700 1 -- 172.21.15.124:0/2158644797 shutdown_connections 2023-10-16T13:00:00.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.747+0000 7f6cc13ad700 1 -- 172.21.15.124:0/2158644797 wait complete. 2023-10-16T13:00:00.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.748+0000 7f6cc13ad700 1 Processor -- start 2023-10-16T13:00:00.759 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.748+0000 7f6cc13ad700 1 -- start start 2023-10-16T13:00:00.762 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.749+0000 7f6cc13ad700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cbc15ee50 0x7f6cbc1568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:00.762 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.749+0000 7f6cc13ad700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6cbc1583e0 0x7f6cbc0c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:00.762 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.749+0000 7f6cc13ad700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6cbc15f230 0x7f6cbc0c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:00.763 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.749+0000 7f6cc13ad700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc0cbd60 con 0x7f6cbc1583e0 2023-10-16T13:00:00.763 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.749+0000 7f6cc13ad700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc156df0 con 0x7f6cbc15ee50 2023-10-16T13:00:00.763 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.749+0000 7f6cc13ad700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc0cbfb0 con 0x7f6cbc15f230 2023-10-16T13:00:00.763 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.749+0000 7f6cba7fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6cbc1583e0 0x7f6cbc0c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:00.763 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.749+0000 7f6cba7fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6cbc1583e0 0x7f6cbc0c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55418/0 (socket says 172.21.15.124:55418) 2023-10-16T13:00:00.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.749+0000 7f6cba7fc700 1 -- 172.21.15.124:0/3931197424 learned_addr learned my addr 172.21.15.124:0/3931197424 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:00.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.749+0000 7f6cbaffd700 1 --2- 172.21.15.124:0/3931197424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cbc15ee50 0x7f6cbc1568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:00.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.749+0000 7f6cbb7fe700 1 --2- 172.21.15.124:0/3931197424 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6cbc15f230 0x7f6cbc0c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:00.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.749+0000 7f6cba7fc700 1 -- 172.21.15.124:0/3931197424 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6cbc15f230 msgr2=0x7f6cbc0c91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:00.764 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.749+0000 7f6cba7fc700 1 --2- 172.21.15.124:0/3931197424 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6cbc15f230 0x7f6cbc0c91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:00.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.749+0000 7f6cba7fc700 1 -- 172.21.15.124:0/3931197424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cbc15ee50 msgr2=0x7f6cbc1568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:00.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.749+0000 7f6cba7fc700 1 --2- 172.21.15.124:0/3931197424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cbc15ee50 0x7f6cbc1568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:00.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.749+0000 7f6cba7fc700 1 -- 172.21.15.124:0/3931197424 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc0cc290 con 0x7f6cbc1583e0 2023-10-16T13:00:00.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.749+0000 7f6cba7fc700 1 --2- 172.21.15.124:0/3931197424 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6cbc1583e0 0x7f6cbc0c8ca0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000eb20 tx=0x7f6cb000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:00.765 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.749+0000 7f6ca37fe700 1 -- 172.21.15.124:0/3931197424 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0001610 con 0x7f6cbc1583e0 2023-10-16T13:00:00.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.749+0000 7f6ca37fe700 1 -- 172.21.15.124:0/3931197424 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb000c7e0 con 0x7f6cbc1583e0 2023-10-16T13:00:00.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.749+0000 7f6cc13ad700 1 -- 172.21.15.124:0/3931197424 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cbc0cc570 con 0x7f6cbc1583e0 2023-10-16T13:00:00.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.749+0000 7f6ca37fe700 1 -- 172.21.15.124:0/3931197424 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb000cb90 con 0x7f6cbc1583e0 2023-10-16T13:00:00.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.749+0000 7f6cc13ad700 1 -- 172.21.15.124:0/3931197424 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cbc0ccb30 con 0x7f6cbc1583e0 2023-10-16T13:00:00.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.750+0000 7f6cc13ad700 1 -- 172.21.15.124:0/3931197424 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cbc04ebb0 con 0x7f6cbc1583e0 2023-10-16T13:00:00.766 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.751+0000 7f6ca37fe700 1 -- 172.21.15.124:0/3931197424 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6cb000ccf0 con 0x7f6cbc1583e0 2023-10-16T13:00:00.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.751+0000 7f6ca37fe700 1 --2- 172.21.15.124:0/3931197424 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6ca806af00 0x7f6ca806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:00.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.752+0000 7f6ca37fe700 1 -- 172.21.15.124:0/3931197424 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6cb0089d90 con 0x7f6cbc1583e0 2023-10-16T13:00:00.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.752+0000 7f6cbaffd700 1 --2- 172.21.15.124:0/3931197424 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6ca806af00 0x7f6ca806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:00.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.752+0000 7f6cbaffd700 1 --2- 172.21.15.124:0/3931197424 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6ca806af00 0x7f6ca806d3c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0099d0 tx=0x7f6cac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:00.767 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:00.755+0000 7f6ca37fe700 1 -- 172.21.15.124:0/3931197424 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6cb0058b50 con 0x7f6cbc1583e0 2023-10-16T13:00:01.025 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.022+0000 7f6cc13ad700 1 -- 172.21.15.124:0/3931197424 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f6cbc0c9ed0 con 0x7f6cbc1583e0 2023-10-16T13:00:01.027 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.024+0000 7f6ca37fe700 1 -- 172.21.15.124:0/3931197424 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6cb00586e0 con 0x7f6cbc1583e0 2023-10-16T13:00:01.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.027+0000 7f6cc13ad700 1 -- 172.21.15.124:0/3931197424 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6ca806af00 msgr2=0x7f6ca806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:01.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.027+0000 7f6cc13ad700 1 --2- 172.21.15.124:0/3931197424 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6ca806af00 0x7f6ca806d3c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0099d0 tx=0x7f6cac008040 comp rx=0 tx=0).stop 2023-10-16T13:00:01.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.027+0000 7f6cc13ad700 1 -- 172.21.15.124:0/3931197424 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6cbc1583e0 msgr2=0x7f6cbc0c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:01.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.027+0000 7f6cc13ad700 1 --2- 172.21.15.124:0/3931197424 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6cbc1583e0 0x7f6cbc0c8ca0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000eb20 tx=0x7f6cb000eee0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.030 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.027+0000 7f6cc13ad700 1 -- 172.21.15.124:0/3931197424 shutdown_connections 2023-10-16T13:00:01.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.027+0000 7f6cc13ad700 1 --2- 172.21.15.124:0/3931197424 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f6ca806af00 0x7f6ca806d3c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.027+0000 7f6cc13ad700 1 --2- 172.21.15.124:0/3931197424 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6cbc15f230 0x7f6cbc0c91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.027+0000 7f6cc13ad700 1 --2- 172.21.15.124:0/3931197424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cbc15ee50 0x7f6cbc1568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.027+0000 7f6cc13ad700 1 --2- 172.21.15.124:0/3931197424 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6cbc1583e0 0x7f6cbc0c8ca0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.031 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.027+0000 7f6cc13ad700 1 -- 172.21.15.124:0/3931197424 >> 172.21.15.124:0/3931197424 conn(0x7f6cbc06bc70 msgr2=0x7f6cbc15ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:01.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.027+0000 7f6cc13ad700 1 -- 172.21.15.124:0/3931197424 shutdown_connections 2023-10-16T13:00:01.032 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.027+0000 7f6cc13ad700 1 -- 172.21.15.124:0/3931197424 wait complete. 2023-10-16T13:00:01.041 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-16T13:00:01.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.160+0000 7f4275fd9700 1 Processor -- start 2023-10-16T13:00:01.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.160+0000 7f4275fd9700 1 -- start start 2023-10-16T13:00:01.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.161+0000 7f4275fd9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f42700b3410 0x7f42700cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:01.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.161+0000 7f4275fd9700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f42700cf4e0 0x7f427006bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:01.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.161+0000 7f4275fd9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4270161180 con 0x7f427015b300 2023-10-16T13:00:01.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.161+0000 7f4275fd9700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42700cf970 con 0x7f42700cf4e0 2023-10-16T13:00:01.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.161+0000 7f4275fd9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4270161460 con 0x7f42700b3410 2023-10-16T13:00:01.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.161+0000 7f426ffff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f42700cf4e0 0x7f427006bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:01.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.161+0000 7f426ffff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f42700cf4e0 0x7f427006bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55428/0 (socket says 172.21.15.124:55428) 2023-10-16T13:00:01.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.161+0000 7f426ffff700 1 -- 172.21.15.124:0/71955534 learned_addr learned my addr 172.21.15.124:0/71955534 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:01.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.162+0000 7f426ffff700 1 -- 172.21.15.124:0/71955534 >> v2:172.21.15.192:3300/0 conn(0x7f42700b3410 msgr2=0x7f42700cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:01.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.162+0000 7f426ffff700 1 --2- 172.21.15.124:0/71955534 >> v2:172.21.15.192:3300/0 conn(0x7f42700b3410 0x7f42700cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.162+0000 7f426ffff700 1 -- 172.21.15.124:0/71955534 >> v1:172.21.15.192:6789/0 conn(0x7f427015b300 legacy=0x7f42700b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:01.167 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.162+0000 7f426ffff700 1 -- 172.21.15.124:0/71955534 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4270161740 con 0x7f42700cf4e0 2023-10-16T13:00:01.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.162+0000 7f426ffff700 1 --2- 172.21.15.124:0/71955534 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42700cf4e0 0x7f427006bbd0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f42700d2380 tx=0x7f426800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c260919b9a75e74 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:01.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.162+0000 7f426e7fc700 1 -- 172.21.15.124:0/71955534 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426800e070 con 0x7f42700cf4e0 2023-10-16T13:00:01.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.162+0000 7f426e7fc700 1 -- 172.21.15.124:0/71955534 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4268003a20 con 0x7f42700cf4e0 2023-10-16T13:00:01.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.162+0000 7f426e7fc700 1 -- 172.21.15.124:0/71955534 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268003dd0 con 0x7f42700cf4e0 2023-10-16T13:00:01.168 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.162+0000 7f4275fd9700 1 -- 172.21.15.124:0/71955534 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42700cf4e0 msgr2=0x7f427006bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:01.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.162+0000 7f4275fd9700 1 --2- 172.21.15.124:0/71955534 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42700cf4e0 0x7f427006bbd0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f42700d2380 tx=0x7f426800b330 comp rx=0 tx=0).stop 2023-10-16T13:00:01.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.162+0000 7f4275fd9700 1 -- 172.21.15.124:0/71955534 shutdown_connections 2023-10-16T13:00:01.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.162+0000 7f4275fd9700 1 --2- 172.21.15.124:0/71955534 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42700cf4e0 0x7f427006bbd0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.162+0000 7f4275fd9700 1 --2- 172.21.15.124:0/71955534 >> v2:172.21.15.192:3300/0 conn(0x7f42700b3410 0x7f42700cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.169 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.162+0000 7f4275fd9700 1 -- 172.21.15.124:0/71955534 >> 172.21.15.124:0/71955534 conn(0x7f42700cdd00 msgr2=0x7f42700ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:01.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.163+0000 7f4275fd9700 1 -- 172.21.15.124:0/71955534 shutdown_connections 2023-10-16T13:00:01.170 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.163+0000 7f4275fd9700 1 -- 172.21.15.124:0/71955534 wait complete. 2023-10-16T13:00:01.172 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.164+0000 7f4275fd9700 1 Processor -- start 2023-10-16T13:00:01.172 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.164+0000 7f4275fd9700 1 -- start start 2023-10-16T13:00:01.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.164+0000 7f4275fd9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42700b3410 0x7f42700b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:01.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.165+0000 7f4275fd9700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42700cf4e0 0x7f42700b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:01.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.165+0000 7f4275fd9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f427015b300 0x7f42700b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:01.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.165+0000 7f4275fd9700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42700b0ce0 con 0x7f42700cf4e0 2023-10-16T13:00:01.173 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.165+0000 7f4275fd9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4270158a20 con 0x7f42700b3410 2023-10-16T13:00:01.174 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.165+0000 7f4275fd9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42700b6c20 con 0x7f427015b300 2023-10-16T13:00:01.174 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.165+0000 7f426effd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42700cf4e0 0x7f42700b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:01.174 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.165+0000 7f426effd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42700cf4e0 0x7f42700b61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55432/0 (socket says 172.21.15.124:55432) 2023-10-16T13:00:01.174 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.165+0000 7f426effd700 1 -- 172.21.15.124:0/3594370212 learned_addr learned my addr 172.21.15.124:0/3594370212 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:01.174 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.165+0000 7f426ffff700 1 --2- 172.21.15.124:0/3594370212 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f427015b300 0x7f42700b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:01.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.165+0000 7f426f7fe700 1 --2- 172.21.15.124:0/3594370212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42700b3410 0x7f42700b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:01.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.165+0000 7f426effd700 1 -- 172.21.15.124:0/3594370212 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f427015b300 msgr2=0x7f42700b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:01.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.165+0000 7f426effd700 1 --2- 172.21.15.124:0/3594370212 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f427015b300 0x7f42700b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.165+0000 7f426effd700 1 -- 172.21.15.124:0/3594370212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42700b3410 msgr2=0x7f42700b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:01.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.165+0000 7f426effd700 1 --2- 172.21.15.124:0/3594370212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42700b3410 0x7f42700b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.165+0000 7f426effd700 1 -- 172.21.15.124:0/3594370212 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4268009b30 con 0x7f42700cf4e0 2023-10-16T13:00:01.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.165+0000 7f426effd700 1 --2- 172.21.15.124:0/3594370212 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42700cf4e0 0x7f42700b61a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f426000b530 tx=0x7f426000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:01.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.165+0000 7f4257fff700 1 -- 172.21.15.124:0/3594370212 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4260011830 con 0x7f42700cf4e0 2023-10-16T13:00:01.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.165+0000 7f4257fff700 1 -- 172.21.15.124:0/3594370212 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4260011990 con 0x7f42700cf4e0 2023-10-16T13:00:01.176 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.165+0000 7f4275fd9700 1 -- 172.21.15.124:0/3594370212 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42701f3fe0 con 0x7f42700cf4e0 2023-10-16T13:00:01.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.165+0000 7f4257fff700 1 -- 172.21.15.124:0/3594370212 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4260011d40 con 0x7f42700cf4e0 2023-10-16T13:00:01.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.165+0000 7f4275fd9700 1 -- 172.21.15.124:0/3594370212 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42701f3a20 con 0x7f42700cf4e0 2023-10-16T13:00:01.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.166+0000 7f4275fd9700 1 -- 172.21.15.124:0/3594370212 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427004ebb0 con 0x7f42700cf4e0 2023-10-16T13:00:01.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.167+0000 7f4257fff700 1 -- 172.21.15.124:0/3594370212 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f426001a400 con 0x7f42700cf4e0 2023-10-16T13:00:01.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.167+0000 7f4257fff700 1 --2- 172.21.15.124:0/3594370212 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f425c06af00 0x7f425c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:01.177 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.167+0000 7f4257fff700 1 -- 172.21.15.124:0/3594370212 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f4260089310 con 0x7f42700cf4e0 2023-10-16T13:00:01.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.167+0000 7f426f7fe700 1 --2- 172.21.15.124:0/3594370212 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f425c06af00 0x7f425c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:01.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.167+0000 7f426f7fe700 1 --2- 172.21.15.124:0/3594370212 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f425c06af00 0x7f425c06d3c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4264009960 tx=0x7f42640090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:01.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.172+0000 7f4257fff700 1 -- 172.21.15.124:0/3594370212 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4260054690 con 0x7f42700cf4e0 2023-10-16T13:00:01.441 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.439+0000 7f4275fd9700 1 -- 172.21.15.124:0/3594370212 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f42700d0060 con 0x7f42700cf4e0 2023-10-16T13:00:01.443 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.441+0000 7f4257fff700 1 -- 172.21.15.124:0/3594370212 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4260057cb0 con 0x7f42700cf4e0 2023-10-16T13:00:01.445 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.443+0000 7f4275fd9700 1 -- 172.21.15.124:0/3594370212 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f425c06af00 msgr2=0x7f425c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:01.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.443+0000 7f4275fd9700 1 --2- 172.21.15.124:0/3594370212 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f425c06af00 0x7f425c06d3c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4264009960 tx=0x7f42640090e0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.443+0000 7f4275fd9700 1 -- 172.21.15.124:0/3594370212 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42700cf4e0 msgr2=0x7f42700b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:01.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.443+0000 7f4275fd9700 1 --2- 172.21.15.124:0/3594370212 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42700cf4e0 0x7f42700b61a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f426000b530 tx=0x7f426000b840 comp rx=0 tx=0).stop 2023-10-16T13:00:01.446 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.443+0000 7f4275fd9700 1 -- 172.21.15.124:0/3594370212 shutdown_connections 2023-10-16T13:00:01.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.443+0000 7f4275fd9700 1 --2- 172.21.15.124:0/3594370212 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f425c06af00 0x7f425c06d3c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.443+0000 7f4275fd9700 1 --2- 172.21.15.124:0/3594370212 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f427015b300 0x7f42700b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.443+0000 7f4275fd9700 1 --2- 172.21.15.124:0/3594370212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42700b3410 0x7f42700b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.443+0000 7f4275fd9700 1 --2- 172.21.15.124:0/3594370212 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42700cf4e0 0x7f42700b61a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.447 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.443+0000 7f4275fd9700 1 -- 172.21.15.124:0/3594370212 >> 172.21.15.124:0/3594370212 conn(0x7f42700cdd00 msgr2=0x7f427006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:01.448 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.443+0000 7f4275fd9700 1 -- 172.21.15.124:0/3594370212 shutdown_connections 2023-10-16T13:00:01.448 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.443+0000 7f4275fd9700 1 -- 172.21.15.124:0/3594370212 wait complete. 2023-10-16T13:00:01.458 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:00:01.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.575+0000 7f40dc9af700 1 Processor -- start 2023-10-16T13:00:01.578 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.576+0000 7f40dc9af700 1 -- start start 2023-10-16T13:00:01.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.576+0000 7f40dc9af700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f40d815a240 0x7f40d815de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:01.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.576+0000 7f40dc9af700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f40d815e390 0x7f40d80724a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:01.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.576+0000 7f40dc9af700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d815e830 con 0x7f40d80729e0 2023-10-16T13:00:01.581 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.576+0000 7f40dc9af700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d815edf0 con 0x7f40d815e390 2023-10-16T13:00:01.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.576+0000 7f40dc9af700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d815eb10 con 0x7f40d815a240 2023-10-16T13:00:01.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.577+0000 7f40d5d9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f40d815e390 0x7f40d80724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:01.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.577+0000 7f40d5d9b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f40d815e390 0x7f40d80724a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55438/0 (socket says 172.21.15.124:55438) 2023-10-16T13:00:01.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.577+0000 7f40d5d9b700 1 -- 172.21.15.124:0/3045384391 learned_addr learned my addr 172.21.15.124:0/3045384391 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:01.582 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.577+0000 7f40d659c700 1 --2- 172.21.15.124:0/3045384391 >> v2:172.21.15.192:3300/0 conn(0x7f40d815a240 0x7f40d815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:01.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.577+0000 7f40d5d9b700 1 -- 172.21.15.124:0/3045384391 >> v2:172.21.15.192:3300/0 conn(0x7f40d815a240 msgr2=0x7f40d815de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:01.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.577+0000 7f40d5d9b700 1 --2- 172.21.15.124:0/3045384391 >> v2:172.21.15.192:3300/0 conn(0x7f40d815a240 0x7f40d815de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.577+0000 7f40d5d9b700 1 -- 172.21.15.124:0/3045384391 >> v1:172.21.15.192:6789/0 conn(0x7f40d80729e0 legacy=0x7f40d80b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:01.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.577+0000 7f40d5d9b700 1 -- 172.21.15.124:0/3045384391 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d8071ca0 con 0x7f40d815e390 2023-10-16T13:00:01.583 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.577+0000 7f40d5d9b700 1 --2- 172.21.15.124:0/3045384391 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40d815e390 0x7f40d80724a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f40d806e750 tx=0x7f40c0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f8dc4770aba1ce server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:01.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.577+0000 7f40d559a700 1 -- 172.21.15.124:0/3045384391 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c0004230 con 0x7f40d815e390 2023-10-16T13:00:01.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.577+0000 7f40d559a700 1 -- 172.21.15.124:0/3045384391 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c0004390 con 0x7f40d815e390 2023-10-16T13:00:01.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.577+0000 7f40d559a700 1 -- 172.21.15.124:0/3045384391 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c00036a0 con 0x7f40d815e390 2023-10-16T13:00:01.584 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.578+0000 7f40dc9af700 1 -- 172.21.15.124:0/3045384391 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40d815e390 msgr2=0x7f40d80724a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:01.585 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.578+0000 7f40dc9af700 1 --2- 172.21.15.124:0/3045384391 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40d815e390 0x7f40d80724a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f40d806e750 tx=0x7f40c0009bd0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.586 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.578+0000 7f40dc9af700 1 -- 172.21.15.124:0/3045384391 shutdown_connections 2023-10-16T13:00:01.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.578+0000 7f40dc9af700 1 --2- 172.21.15.124:0/3045384391 >> v2:172.21.15.192:3300/0 conn(0x7f40d815a240 0x7f40d815de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.578+0000 7f40dc9af700 1 --2- 172.21.15.124:0/3045384391 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40d815e390 0x7f40d80724a0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.578+0000 7f40dc9af700 1 -- 172.21.15.124:0/3045384391 >> 172.21.15.124:0/3045384391 conn(0x7f40d806bd50 msgr2=0x7f40d806c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:01.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.578+0000 7f40dc9af700 1 -- 172.21.15.124:0/3045384391 shutdown_connections 2023-10-16T13:00:01.587 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.578+0000 7f40dc9af700 1 -- 172.21.15.124:0/3045384391 wait complete. 2023-10-16T13:00:01.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.579+0000 7f40dc9af700 1 Processor -- start 2023-10-16T13:00:01.590 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.579+0000 7f40dc9af700 1 -- start start 2023-10-16T13:00:01.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.580+0000 7f40dc9af700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40d80729e0 0x7f40d81456b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:01.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.580+0000 7f40dc9af700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40d815a240 0x7f40d80c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:01.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.580+0000 7f40dc9af700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40d815e390 0x7f40d80c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:01.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.580+0000 7f40dc9af700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d8146290 con 0x7f40d815a240 2023-10-16T13:00:01.591 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.580+0000 7f40dc9af700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d80c6110 con 0x7f40d80729e0 2023-10-16T13:00:01.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.580+0000 7f40dc9af700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d80c63f0 con 0x7f40d815e390 2023-10-16T13:00:01.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.580+0000 7f40d5d9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40d815a240 0x7f40d80c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:01.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.580+0000 7f40d5d9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40d815a240 0x7f40d80c5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55446/0 (socket says 172.21.15.124:55446) 2023-10-16T13:00:01.592 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.580+0000 7f40d5d9b700 1 -- 172.21.15.124:0/4036399310 learned_addr learned my addr 172.21.15.124:0/4036399310 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:01.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.580+0000 7f40d659c700 1 --2- 172.21.15.124:0/4036399310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40d80729e0 0x7f40d81456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:01.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.580+0000 7f40d5d9b700 1 -- 172.21.15.124:0/4036399310 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40d815e390 msgr2=0x7f40d80c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:01.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.580+0000 7f40d6d9d700 1 --2- 172.21.15.124:0/4036399310 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40d815e390 0x7f40d80c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:01.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.580+0000 7f40d5d9b700 1 --2- 172.21.15.124:0/4036399310 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40d815e390 0x7f40d80c99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.593 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.580+0000 7f40d5d9b700 1 -- 172.21.15.124:0/4036399310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40d80729e0 msgr2=0x7f40d81456b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:01.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.580+0000 7f40d5d9b700 1 --2- 172.21.15.124:0/4036399310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40d80729e0 0x7f40d81456b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.580+0000 7f40d5d9b700 1 -- 172.21.15.124:0/4036399310 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c0009550 con 0x7f40d815a240 2023-10-16T13:00:01.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.580+0000 7f40d5d9b700 1 --2- 172.21.15.124:0/4036399310 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40d815a240 0x7f40d80c5600 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009c10 tx=0x7f40c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:01.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.580+0000 7f40ceffd700 1 -- 172.21.15.124:0/4036399310 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c0011630 con 0x7f40d815a240 2023-10-16T13:00:01.594 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.581+0000 7f40ceffd700 1 -- 172.21.15.124:0/4036399310 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c0011790 con 0x7f40d815a240 2023-10-16T13:00:01.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.581+0000 7f40dc9af700 1 -- 172.21.15.124:0/4036399310 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d8145eb0 con 0x7f40d815a240 2023-10-16T13:00:01.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.581+0000 7f40ceffd700 1 -- 172.21.15.124:0/4036399310 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c0011b40 con 0x7f40d815a240 2023-10-16T13:00:01.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.581+0000 7f40dc9af700 1 -- 172.21.15.124:0/4036399310 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d80c5b40 con 0x7f40d815a240 2023-10-16T13:00:01.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.582+0000 7f40dc9af700 1 -- 172.21.15.124:0/4036399310 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d8145d10 con 0x7f40d815a240 2023-10-16T13:00:01.595 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.582+0000 7f40ceffd700 1 -- 172.21.15.124:0/4036399310 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f40c0011ca0 con 0x7f40d815a240 2023-10-16T13:00:01.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.582+0000 7f40ceffd700 1 --2- 172.21.15.124:0/4036399310 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f40b806af00 0x7f40b806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:01.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.582+0000 7f40ceffd700 1 -- 172.21.15.124:0/4036399310 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f40c008a8b0 con 0x7f40d815a240 2023-10-16T13:00:01.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.583+0000 7f40d659c700 1 --2- 172.21.15.124:0/4036399310 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f40b806af00 0x7f40b806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:01.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.583+0000 7f40d659c700 1 --2- 172.21.15.124:0/4036399310 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f40b806af00 0x7f40b806d3c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f40c8009950 tx=0x7f40c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:01.596 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.587+0000 7f40ceffd700 1 -- 172.21.15.124:0/4036399310 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f40d8145d10 con 0x7f40d815a240 2023-10-16T13:00:01.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.779+0000 7f40dc9af700 1 -- 172.21.15.124:0/4036399310 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40d81463d0 con 0x7f40d815a240 2023-10-16T13:00:01.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.780+0000 7f40ceffd700 1 -- 172.21.15.124:0/4036399310 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+13062 (secure 0 0 0) 0x7f40d81463d0 con 0x7f40d815a240 2023-10-16T13:00:01.782 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:00:01.783 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":34,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T12:59:58.479829+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:00:01.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.782+0000 7f40dc9af700 1 -- 172.21.15.124:0/4036399310 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f40b806af00 msgr2=0x7f40b806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:01.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.782+0000 7f40dc9af700 1 --2- 172.21.15.124:0/4036399310 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f40b806af00 0x7f40b806d3c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f40c8009950 tx=0x7f40c8008040 comp rx=0 tx=0).stop 2023-10-16T13:00:01.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.782+0000 7f40dc9af700 1 -- 172.21.15.124:0/4036399310 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40d815a240 msgr2=0x7f40d80c5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:01.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.782+0000 7f40dc9af700 1 --2- 172.21.15.124:0/4036399310 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40d815a240 0x7f40d80c5600 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009c10 tx=0x7f40c0004750 comp rx=0 tx=0).stop 2023-10-16T13:00:01.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.782+0000 7f40dc9af700 1 -- 172.21.15.124:0/4036399310 shutdown_connections 2023-10-16T13:00:01.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.782+0000 7f40dc9af700 1 --2- 172.21.15.124:0/4036399310 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f40b806af00 0x7f40b806d3c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.782+0000 7f40dc9af700 1 --2- 172.21.15.124:0/4036399310 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40d815e390 0x7f40d80c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.782+0000 7f40dc9af700 1 --2- 172.21.15.124:0/4036399310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40d80729e0 0x7f40d81456b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.782+0000 7f40dc9af700 1 --2- 172.21.15.124:0/4036399310 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f40d815a240 0x7f40d80c5600 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.782+0000 7f40dc9af700 1 -- 172.21.15.124:0/4036399310 >> 172.21.15.124:0/4036399310 conn(0x7f40d806bd50 msgr2=0x7f40d806c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:01.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.782+0000 7f40dc9af700 1 -- 172.21.15.124:0/4036399310 shutdown_connections 2023-10-16T13:00:01.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.782+0000 7f40dc9af700 1 -- 172.21.15.124:0/4036399310 wait complete. 2023-10-16T13:00:01.796 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T12:58:38.667813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T13:00:01.797 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T13:00:01.921 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.918+0000 7f9523521700 1 Processor -- start 2023-10-16T13:00:01.921 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.919+0000 7f9523521700 1 -- start start 2023-10-16T13:00:01.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.919+0000 7f9523521700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f951c0d1b90 0x7f951c0ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:01.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.919+0000 7f9523521700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f951c0cb8d0 0x7f951c15c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:01.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.919+0000 7f9523521700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f951c0cee50 0x7f951c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:01.924 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.919+0000 7f9523521700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f951c0b37e0 con 0x7f951c0cee50 2023-10-16T13:00:01.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.919+0000 7f9523521700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f951c0cf7d0 con 0x7f951c0cb8d0 2023-10-16T13:00:01.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.919+0000 7f9523521700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951c0cd590 con 0x7f951c0d1b90 2023-10-16T13:00:01.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.920+0000 7f9521abe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f951c0cee50 0x7f951c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:01.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.920+0000 7f9521abe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f951c0cee50 0x7f951c0cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55454/0 (socket says 172.21.15.124:55454) 2023-10-16T13:00:01.925 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.920+0000 7f9521abe700 1 -- 172.21.15.124:0/2533807347 learned_addr learned my addr 172.21.15.124:0/2533807347 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:01.926 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.920+0000 7f95212bd700 1 --2- 172.21.15.124:0/2533807347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f951c0d1b90 0x7f951c0ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:01.926 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.920+0000 7f9520abc700 1 --2- 172.21.15.124:0/2533807347 >> v2:172.21.15.192:3300/0 conn(0x7f951c0cb8d0 0x7f951c15c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:01.926 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.920+0000 7f9521abe700 1 -- 172.21.15.124:0/2533807347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f951c0d1b90 msgr2=0x7f951c0ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:01.926 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.920+0000 7f9521abe700 1 --2- 172.21.15.124:0/2533807347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f951c0d1b90 0x7f951c0ce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.926 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.920+0000 7f9521abe700 1 -- 172.21.15.124:0/2533807347 >> v2:172.21.15.192:3300/0 conn(0x7f951c0cb8d0 msgr2=0x7f951c15c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:01.927 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.920+0000 7f9521abe700 1 --2- 172.21.15.124:0/2533807347 >> v2:172.21.15.192:3300/0 conn(0x7f951c0cb8d0 0x7f951c15c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.927 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.920+0000 7f9521abe700 1 -- 172.21.15.124:0/2533807347 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c0cc150 con 0x7f951c0cee50 2023-10-16T13:00:01.927 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.920+0000 7f9521abe700 1 --2- 172.21.15.124:0/2533807347 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f951c0cee50 0x7f951c0cf290 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f951c071470 tx=0x7f951400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6307f28a316a67b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:01.927 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.920+0000 7f9513fff700 1 -- 172.21.15.124:0/2533807347 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951400e070 con 0x7f951c0cee50 2023-10-16T13:00:01.927 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.920+0000 7f9513fff700 1 -- 172.21.15.124:0/2533807347 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951400b9c0 con 0x7f951c0cee50 2023-10-16T13:00:01.928 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.920+0000 7f9513fff700 1 -- 172.21.15.124:0/2533807347 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951400bd70 con 0x7f951c0cee50 2023-10-16T13:00:01.928 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.921+0000 7f9523521700 1 -- 172.21.15.124:0/2533807347 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f951c0cee50 msgr2=0x7f951c0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:01.928 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.921+0000 7f9523521700 1 --2- 172.21.15.124:0/2533807347 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f951c0cee50 0x7f951c0cf290 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f951c071470 tx=0x7f951400b330 comp rx=0 tx=0).stop 2023-10-16T13:00:01.928 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.921+0000 7f9523521700 1 -- 172.21.15.124:0/2533807347 shutdown_connections 2023-10-16T13:00:01.928 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.921+0000 7f9523521700 1 --2- 172.21.15.124:0/2533807347 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f951c0cee50 0x7f951c0cf290 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.921+0000 7f9523521700 1 --2- 172.21.15.124:0/2533807347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f951c0d1b90 0x7f951c0ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.921+0000 7f9523521700 1 --2- 172.21.15.124:0/2533807347 >> v2:172.21.15.192:3300/0 conn(0x7f951c0cb8d0 0x7f951c15c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.921+0000 7f9523521700 1 -- 172.21.15.124:0/2533807347 >> 172.21.15.124:0/2533807347 conn(0x7f951c06a820 msgr2=0x7f951c06ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:01.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.921+0000 7f9523521700 1 -- 172.21.15.124:0/2533807347 shutdown_connections 2023-10-16T13:00:01.929 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.921+0000 7f9523521700 1 -- 172.21.15.124:0/2533807347 wait complete. 2023-10-16T13:00:01.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.922+0000 7f9523521700 1 Processor -- start 2023-10-16T13:00:01.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.922+0000 7f9523521700 1 -- start start 2023-10-16T13:00:01.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.923+0000 7f9523521700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f951c0cb8d0 0x7f951c0cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:01.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.923+0000 7f9523521700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f951c0cee50 0x7f951c1f0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:01.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.923+0000 7f9523521700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f951c0d1b90 0x7f951c0c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:01.933 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.923+0000 7f9523521700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c0c4b20 con 0x7f951c0cb8d0 2023-10-16T13:00:01.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.923+0000 7f9523521700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c1e5090 con 0x7f951c0cee50 2023-10-16T13:00:01.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.923+0000 7f9523521700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951c1e4760 con 0x7f951c0d1b90 2023-10-16T13:00:01.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.923+0000 7f95212bd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f951c0cb8d0 0x7f951c0cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:01.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.923+0000 7f95212bd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f951c0cb8d0 0x7f951c0cb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55456/0 (socket says 172.21.15.124:55456) 2023-10-16T13:00:01.934 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.923+0000 7f95212bd700 1 -- 172.21.15.124:0/3265979260 learned_addr learned my addr 172.21.15.124:0/3265979260 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:01.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.923+0000 7f9520abc700 1 --2- 172.21.15.124:0/3265979260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f951c0cee50 0x7f951c1f0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:01.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.923+0000 7f9521abe700 1 --2- 172.21.15.124:0/3265979260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f951c0d1b90 0x7f951c0c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:01.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.923+0000 7f95212bd700 1 -- 172.21.15.124:0/3265979260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f951c0d1b90 msgr2=0x7f951c0c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:01.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.923+0000 7f95212bd700 1 --2- 172.21.15.124:0/3265979260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f951c0d1b90 0x7f951c0c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.923+0000 7f95212bd700 1 -- 172.21.15.124:0/3265979260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f951c0cee50 msgr2=0x7f951c1f0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:01.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.923+0000 7f95212bd700 1 --2- 172.21.15.124:0/3265979260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f951c0cee50 0x7f951c1f0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:01.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.923+0000 7f95212bd700 1 -- 172.21.15.124:0/3265979260 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9514009b30 con 0x7f951c0cb8d0 2023-10-16T13:00:01.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.923+0000 7f9520abc700 1 --2- 172.21.15.124:0/3265979260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f951c0cee50 0x7f951c1f0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:00:01.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.923+0000 7f9521abe700 1 --2- 172.21.15.124:0/3265979260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f951c0d1b90 0x7f951c0c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:00:01.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.923+0000 7f95212bd700 1 --2- 172.21.15.124:0/3265979260 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f951c0cb8d0 0x7f951c0cb0d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f950c00e840 tx=0x7f950c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:01.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.923+0000 7f9511ffb700 1 -- 172.21.15.124:0/3265979260 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c013610 con 0x7f951c0cb8d0 2023-10-16T13:00:01.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.923+0000 7f9511ffb700 1 -- 172.21.15.124:0/3265979260 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950c013770 con 0x7f951c0cb8d0 2023-10-16T13:00:01.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.923+0000 7f9523521700 1 -- 172.21.15.124:0/3265979260 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f951c1e4a40 con 0x7f951c0cb8d0 2023-10-16T13:00:01.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.923+0000 7f9511ffb700 1 -- 172.21.15.124:0/3265979260 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c013b20 con 0x7f951c0cb8d0 2023-10-16T13:00:01.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.924+0000 7f9523521700 1 -- 172.21.15.124:0/3265979260 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f951c1e5520 con 0x7f951c0cb8d0 2023-10-16T13:00:01.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.925+0000 7f9523521700 1 -- 172.21.15.124:0/3265979260 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f951c1e5370 con 0x7f951c0cb8d0 2023-10-16T13:00:01.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.925+0000 7f9511ffb700 1 -- 172.21.15.124:0/3265979260 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f950c013c80 con 0x7f951c0cb8d0 2023-10-16T13:00:01.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.925+0000 7f9511ffb700 1 --2- 172.21.15.124:0/3265979260 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f950006af00 0x7f950006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:01.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.925+0000 7f9511ffb700 1 -- 172.21.15.124:0/3265979260 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f950c0890c0 con 0x7f951c0cb8d0 2023-10-16T13:00:01.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.925+0000 7f9520abc700 1 --2- 172.21.15.124:0/3265979260 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f950006af00 0x7f950006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:01.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.926+0000 7f9520abc700 1 --2- 172.21.15.124:0/3265979260 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f950006af00 0x7f950006d3c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f951c0b07a0 tx=0x7f9518008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:01.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:01.930+0000 7f9511ffb700 1 -- 172.21.15.124:0/3265979260 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f950c054380 con 0x7f951c0cb8d0 2023-10-16T13:00:02.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.119+0000 7f9523521700 1 -- 172.21.15.124:0/3265979260 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f951c04ebb0 con 0x7f951c0cb8d0 2023-10-16T13:00:02.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.119+0000 7f9511ffb700 1 -- 172.21.15.124:0/3265979260 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f950c0579a0 con 0x7f951c0cb8d0 2023-10-16T13:00:02.122 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-16T13:00:02.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.121+0000 7f9523521700 1 -- 172.21.15.124:0/3265979260 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f950006af00 msgr2=0x7f950006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:02.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.121+0000 7f9523521700 1 --2- 172.21.15.124:0/3265979260 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f950006af00 0x7f950006d3c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f951c0b07a0 tx=0x7f9518008040 comp rx=0 tx=0).stop 2023-10-16T13:00:02.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.121+0000 7f9523521700 1 -- 172.21.15.124:0/3265979260 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f951c0cb8d0 msgr2=0x7f951c0cb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:02.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.121+0000 7f9523521700 1 --2- 172.21.15.124:0/3265979260 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f951c0cb8d0 0x7f951c0cb0d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f950c00e840 tx=0x7f950c00ec00 comp rx=0 tx=0).stop 2023-10-16T13:00:02.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.121+0000 7f9523521700 1 -- 172.21.15.124:0/3265979260 shutdown_connections 2023-10-16T13:00:02.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.121+0000 7f9523521700 1 --2- 172.21.15.124:0/3265979260 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f950006af00 0x7f950006d3c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:02.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.121+0000 7f9523521700 1 --2- 172.21.15.124:0/3265979260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f951c0d1b90 0x7f951c0c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:02.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.121+0000 7f9523521700 1 --2- 172.21.15.124:0/3265979260 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f951c0cb8d0 0x7f951c0cb0d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:02.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.121+0000 7f9523521700 1 --2- 172.21.15.124:0/3265979260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f951c0cee50 0x7f951c1f0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:02.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.121+0000 7f9523521700 1 -- 172.21.15.124:0/3265979260 >> 172.21.15.124:0/3265979260 conn(0x7f951c06a820 msgr2=0x7f951c15d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:02.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.121+0000 7f9523521700 1 -- 172.21.15.124:0/3265979260 shutdown_connections 2023-10-16T13:00:02.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.121+0000 7f9523521700 1 -- 172.21.15.124:0/3265979260 wait complete. 2023-10-16T13:00:02.136 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-16T13:00:02.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.253+0000 7f1d8ed42700 1 Processor -- start 2023-10-16T13:00:02.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.253+0000 7f1d8ed42700 1 -- start start 2023-10-16T13:00:02.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.254+0000 7f1d8ed42700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1d880cf7d0 0x7f1d8815e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:02.260 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.254+0000 7f1d8ed42700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d880cfeb0 con 0x7f1d8806a820 2023-10-16T13:00:02.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.254+0000 7f1d8ed42700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d880cfc30 con 0x7f1d880ca7d0 2023-10-16T13:00:02.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.254+0000 7f1d8ed42700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d880ce410 con 0x7f1d880cf7d0 2023-10-16T13:00:02.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.254+0000 7f1d8cade700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f1d8806a820 0x7f1d8806ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:44132/0 (socket says 172.21.15.124:44132) 2023-10-16T13:00:02.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.254+0000 7f1d8cade700 1 -- 172.21.15.124:0/3231754326 learned_addr learned my addr 172.21.15.124:0/3231754326 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T13:00:02.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.255+0000 7f1d87fff700 1 --2- 172.21.15.124:0/3231754326 >> v2:172.21.15.192:3300/0 conn(0x7f1d880cf7d0 0x7f1d8815e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:02.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.255+0000 7f1d877fe700 1 -- 172.21.15.124:0/3231754326 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945851674 0 0) 0x7f1d880cfeb0 con 0x7f1d8806a820 2023-10-16T13:00:02.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.255+0000 7f1d877fe700 1 -- 172.21.15.124:0/3231754326 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d780035b0 con 0x7f1d8806a820 2023-10-16T13:00:02.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.255+0000 7f1d877fe700 1 -- 172.21.15.124:0/3231754326 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2081092105 0 0) 0x7f1d780035b0 con 0x7f1d8806a820 2023-10-16T13:00:02.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.255+0000 7f1d877fe700 1 -- 172.21.15.124:0/3231754326 >> v2:172.21.15.192:3300/0 conn(0x7f1d880cf7d0 msgr2=0x7f1d8815e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:02.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.255+0000 7f1d877fe700 1 --2- 172.21.15.124:0/3231754326 >> v2:172.21.15.192:3300/0 conn(0x7f1d880cf7d0 0x7f1d8815e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:02.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.255+0000 7f1d877fe700 1 -- 172.21.15.124:0/3231754326 >> v1:172.21.15.192:6789/0 conn(0x7f1d880ca7d0 legacy=0x7f1d88071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:02.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.255+0000 7f1d877fe700 1 -- 172.21.15.124:0/3231754326 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d880af9d0 con 0x7f1d8806a820 2023-10-16T13:00:02.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.255+0000 7f1d877fe700 1 -- 172.21.15.124:0/3231754326 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f1d7c001670 con 0x7f1d8806a820 2023-10-16T13:00:02.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.255+0000 7f1d877fe700 1 -- 172.21.15.124:0/3231754326 >> v1:172.21.15.124:6789/0 conn(0x7f1d8806a820 legacy=0x7f1d8806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:02.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.255+0000 7f1d877fe700 1 --2- 172.21.15.124:0/3231754326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d78003a00 0x7f1d78003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:02.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.255+0000 7f1d877fe700 1 --2- 172.21.15.124:0/3231754326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d78004850 0x7f1d78004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:02.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.255+0000 7f1d877fe700 1 --2- 172.21.15.124:0/3231754326 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1d78005210 0x7f1d7800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:02.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.255+0000 7f1d877fe700 1 -- 172.21.15.124:0/3231754326 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d880ce410 con 0x7f1d78005210 2023-10-16T13:00:02.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.255+0000 7f1d877fe700 1 -- 172.21.15.124:0/3231754326 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7800c1b0 con 0x7f1d78003a00 2023-10-16T13:00:02.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.255+0000 7f1d877fe700 1 -- 172.21.15.124:0/3231754326 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7800c370 con 0x7f1d78004850 2023-10-16T13:00:02.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.255+0000 7f1d8d2df700 1 --2- 172.21.15.124:0/3231754326 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1d78005210 0x7f1d7800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:02.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.255+0000 7f1d8cade700 1 --2- 172.21.15.124:0/3231754326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d78003a00 0x7f1d78003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:02.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.255+0000 7f1d87fff700 1 --2- 172.21.15.124:0/3231754326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d78004850 0x7f1d78004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:02.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.255+0000 7f1d8d2df700 1 -- 172.21.15.124:0/3231754326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d78004850 msgr2=0x7f1d78004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:02.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.255+0000 7f1d8d2df700 1 --2- 172.21.15.124:0/3231754326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d78004850 0x7f1d78004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:02.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.255+0000 7f1d8d2df700 1 -- 172.21.15.124:0/3231754326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d78003a00 msgr2=0x7f1d78003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:02.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.255+0000 7f1d8d2df700 1 --2- 172.21.15.124:0/3231754326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d78003a00 0x7f1d78003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:02.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.255+0000 7f1d8d2df700 1 -- 172.21.15.124:0/3231754326 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d780035b0 con 0x7f1d78005210 2023-10-16T13:00:02.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.256+0000 7f1d8d2df700 1 -- 172.21.15.124:0/3231754326 reap_dead start 2023-10-16T13:00:02.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.256+0000 7f1d8d2df700 1 --2- 172.21.15.124:0/3231754326 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1d78005210 0x7f1d7800ba10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000c190 tx=0x7f1d78005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8757a892fa9c49dd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:02.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.256+0000 7f1d877fe700 1 -- 172.21.15.124:0/3231754326 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80001de0 con 0x7f1d78005210 2023-10-16T13:00:02.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.256+0000 7f1d877fe700 1 -- 172.21.15.124:0/3231754326 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8000cd30 con 0x7f1d78005210 2023-10-16T13:00:02.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.256+0000 7f1d877fe700 1 -- 172.21.15.124:0/3231754326 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8000cea0 con 0x7f1d78005210 2023-10-16T13:00:02.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.256+0000 7f1d8ed42700 1 -- 172.21.15.124:0/3231754326 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1d78005210 msgr2=0x7f1d7800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:02.267 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.256+0000 7f1d8ed42700 1 --2- 172.21.15.124:0/3231754326 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1d78005210 0x7f1d7800ba10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000c190 tx=0x7f1d78005880 comp rx=0 tx=0).stop 2023-10-16T13:00:02.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.256+0000 7f1d8ed42700 1 -- 172.21.15.124:0/3231754326 shutdown_connections 2023-10-16T13:00:02.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.256+0000 7f1d8ed42700 1 --2- 172.21.15.124:0/3231754326 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1d78005210 0x7f1d7800ba10 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:02.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.256+0000 7f1d8ed42700 1 -- 172.21.15.124:0/3231754326 >> 172.21.15.124:0/3231754326 conn(0x7f1d880d0180 msgr2=0x7f1d880d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:02.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.256+0000 7f1d8ed42700 1 -- 172.21.15.124:0/3231754326 shutdown_connections 2023-10-16T13:00:02.268 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.256+0000 7f1d8ed42700 1 -- 172.21.15.124:0/3231754326 wait complete. 2023-10-16T13:00:02.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.257+0000 7f1d8ed42700 1 Processor -- start 2023-10-16T13:00:02.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.257+0000 7f1d8ed42700 1 -- start start 2023-10-16T13:00:02.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.258+0000 7f1d8ed42700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d78005210 0x7f1d88156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:02.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.258+0000 7f1d8ed42700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d880ada00 0x7f1d880ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:02.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.258+0000 7f1d8ed42700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1d880c7a80 0x7f1d880c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:02.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.258+0000 7f1d8ed42700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d88157c00 con 0x7f1d880c7a80 2023-10-16T13:00:02.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.258+0000 7f1d8ed42700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d880ae3c0 con 0x7f1d78005210 2023-10-16T13:00:02.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.258+0000 7f1d8ed42700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8815beb0 con 0x7f1d880ada00 2023-10-16T13:00:02.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.258+0000 7f1d8d2df700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1d880c7a80 0x7f1d880c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:02.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.258+0000 7f1d8d2df700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1d880c7a80 0x7f1d880c7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55478/0 (socket says 172.21.15.124:55478) 2023-10-16T13:00:02.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.258+0000 7f1d8d2df700 1 -- 172.21.15.124:0/3094016938 learned_addr learned my addr 172.21.15.124:0/3094016938 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:02.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.259+0000 7f1d8cade700 1 --2- 172.21.15.124:0/3094016938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d78005210 0x7f1d88156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:02.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.259+0000 7f1d87fff700 1 --2- 172.21.15.124:0/3094016938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d880ada00 0x7f1d880ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:02.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.259+0000 7f1d8d2df700 1 -- 172.21.15.124:0/3094016938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d880ada00 msgr2=0x7f1d880ade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:02.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.259+0000 7f1d8d2df700 1 --2- 172.21.15.124:0/3094016938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d880ada00 0x7f1d880ade80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:02.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.259+0000 7f1d8d2df700 1 -- 172.21.15.124:0/3094016938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d78005210 msgr2=0x7f1d88156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:02.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.259+0000 7f1d8d2df700 1 --2- 172.21.15.124:0/3094016938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d78005210 0x7f1d88156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:02.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.259+0000 7f1d8d2df700 1 -- 172.21.15.124:0/3094016938 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8815c190 con 0x7f1d880c7a80 2023-10-16T13:00:02.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.259+0000 7f1d8cade700 1 --2- 172.21.15.124:0/3094016938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d78005210 0x7f1d88156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:00:02.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.259+0000 7f1d8d2df700 1 --2- 172.21.15.124:0/3094016938 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1d880c7a80 0x7f1d880c7f00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1d88074a40 tx=0x7f1d800014f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:02.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.259+0000 7f1d857fa700 1 -- 172.21.15.124:0/3094016938 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8000cea0 con 0x7f1d880c7a80 2023-10-16T13:00:02.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.259+0000 7f1d857fa700 1 -- 172.21.15.124:0/3094016938 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d800012a0 con 0x7f1d880c7a80 2023-10-16T13:00:02.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.259+0000 7f1d8ed42700 1 -- 172.21.15.124:0/3094016938 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8815c470 con 0x7f1d880c7a80 2023-10-16T13:00:02.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.259+0000 7f1d857fa700 1 -- 172.21.15.124:0/3094016938 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80005500 con 0x7f1d880c7a80 2023-10-16T13:00:02.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.259+0000 7f1d8ed42700 1 -- 172.21.15.124:0/3094016938 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8815ca30 con 0x7f1d880c7a80 2023-10-16T13:00:02.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.260+0000 7f1d8ed42700 1 -- 172.21.15.124:0/3094016938 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8804ebb0 con 0x7f1d880c7a80 2023-10-16T13:00:02.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.260+0000 7f1d857fa700 1 -- 172.21.15.124:0/3094016938 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1d80005660 con 0x7f1d880c7a80 2023-10-16T13:00:02.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.261+0000 7f1d857fa700 1 --2- 172.21.15.124:0/3094016938 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1d6c06af30 0x7f1d6c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:02.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.261+0000 7f1d857fa700 1 -- 172.21.15.124:0/3094016938 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f1d8008a100 con 0x7f1d880c7a80 2023-10-16T13:00:02.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.261+0000 7f1d8cade700 1 --2- 172.21.15.124:0/3094016938 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1d6c06af30 0x7f1d6c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:02.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.261+0000 7f1d8cade700 1 --2- 172.21.15.124:0/3094016938 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1d6c06af30 0x7f1d6c06d3f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c007cf0 tx=0x7f1d7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:02.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.265+0000 7f1d857fa700 1 -- 172.21.15.124:0/3094016938 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1d80055450 con 0x7f1d880c7a80 2023-10-16T13:00:02.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.460+0000 7f1d8ed42700 1 -- 172.21.15.124:0/3094016938 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1d8806b490 con 0x7f1d880c7a80 2023-10-16T13:00:02.463 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.460+0000 7f1d857fa700 1 -- 172.21.15.124:0/3094016938 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1d80005910 con 0x7f1d880c7a80 2023-10-16T13:00:02.463 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:00:02.464 INFO:teuthology.orchestra.run.smithi124.stdout:[ 2023-10-16T13:00:02.464 INFO:teuthology.orchestra.run.smithi124.stdout: { 2023-10-16T13:00:02.464 INFO:teuthology.orchestra.run.smithi124.stdout: "poolnum": 1, 2023-10-16T13:00:02.464 INFO:teuthology.orchestra.run.smithi124.stdout: "poolname": ".mgr" 2023-10-16T13:00:02.464 INFO:teuthology.orchestra.run.smithi124.stdout: } 2023-10-16T13:00:02.465 INFO:teuthology.orchestra.run.smithi124.stdout:] 2023-10-16T13:00:02.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.462+0000 7f1d8ed42700 1 -- 172.21.15.124:0/3094016938 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1d6c06af30 msgr2=0x7f1d6c06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:02.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.462+0000 7f1d8ed42700 1 --2- 172.21.15.124:0/3094016938 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1d6c06af30 0x7f1d6c06d3f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c007cf0 tx=0x7f1d7c009040 comp rx=0 tx=0).stop 2023-10-16T13:00:02.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.462+0000 7f1d8ed42700 1 -- 172.21.15.124:0/3094016938 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1d880c7a80 msgr2=0x7f1d880c7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:02.466 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.462+0000 7f1d8ed42700 1 --2- 172.21.15.124:0/3094016938 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1d880c7a80 0x7f1d880c7f00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1d88074a40 tx=0x7f1d800014f0 comp rx=0 tx=0).stop 2023-10-16T13:00:02.467 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.462+0000 7f1d8ed42700 1 -- 172.21.15.124:0/3094016938 shutdown_connections 2023-10-16T13:00:02.467 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.462+0000 7f1d8ed42700 1 --2- 172.21.15.124:0/3094016938 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f1d6c06af30 0x7f1d6c06d3f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:02.467 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.462+0000 7f1d8ed42700 1 --2- 172.21.15.124:0/3094016938 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1d880c7a80 0x7f1d880c7f00 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:02.467 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.462+0000 7f1d8ed42700 1 --2- 172.21.15.124:0/3094016938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d78005210 0x7f1d88156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:02.467 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.462+0000 7f1d8ed42700 1 --2- 172.21.15.124:0/3094016938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d880ada00 0x7f1d880ade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:02.468 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.462+0000 7f1d8ed42700 1 -- 172.21.15.124:0/3094016938 >> 172.21.15.124:0/3094016938 conn(0x7f1d880d0180 msgr2=0x7f1d880cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:02.468 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.462+0000 7f1d8ed42700 1 -- 172.21.15.124:0/3094016938 shutdown_connections 2023-10-16T13:00:02.468 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.462+0000 7f1d8ed42700 1 -- 172.21.15.124:0/3094016938 wait complete. 2023-10-16T13:00:02.477 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-16T13:00:02.477 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-16T13:00:02.610 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.600+0000 7f89adbe6700 1 Processor -- start 2023-10-16T13:00:02.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.600+0000 7f89adbe6700 1 -- start start 2023-10-16T13:00:02.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.601+0000 7f89adbe6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89a806b370 0x7f89a815dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:02.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.601+0000 7f89adbe6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f89a806a820 0x7f89a806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:02.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.601+0000 7f89adbe6700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a8161360 con 0x7f89a80cdd30 2023-10-16T13:00:02.611 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.601+0000 7f89adbe6700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a806b750 con 0x7f89a806a820 2023-10-16T13:00:02.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.601+0000 7f89adbe6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a815e300 con 0x7f89a806b370 2023-10-16T13:00:02.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.601+0000 7f89a7fff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f89a80cdd30 0x7f89a81617f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:44156/0 (socket says 172.21.15.124:44156) 2023-10-16T13:00:02.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.601+0000 7f89a7fff700 1 -- 172.21.15.124:0/4075545386 learned_addr learned my addr 172.21.15.124:0/4075545386 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T13:00:02.612 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.601+0000 7f89a77fe700 1 --2- 172.21.15.124:0/4075545386 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89a806b370 0x7f89a815dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:02.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.601+0000 7f89a67fc700 1 -- 172.21.15.124:0/4075545386 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889946891 0 0) 0x7f89a8161360 con 0x7f89a80cdd30 2023-10-16T13:00:02.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a67fc700 1 -- 172.21.15.124:0/4075545386 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89940035b0 con 0x7f89a80cdd30 2023-10-16T13:00:02.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a6ffd700 1 --2- 172.21.15.124:0/4075545386 >> v2:172.21.15.192:3300/0 conn(0x7f89a806a820 0x7f89a806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:02.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a67fc700 1 -- 172.21.15.124:0/4075545386 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 190085955 0 0) 0x7f89940035b0 con 0x7f89a80cdd30 2023-10-16T13:00:02.613 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a67fc700 1 -- 172.21.15.124:0/4075545386 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89a806b370 msgr2=0x7f89a815dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:02.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a67fc700 1 --2- 172.21.15.124:0/4075545386 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89a806b370 0x7f89a815dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:02.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a67fc700 1 -- 172.21.15.124:0/4075545386 >> v2:172.21.15.192:3300/0 conn(0x7f89a806a820 msgr2=0x7f89a806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:02.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a67fc700 1 --2- 172.21.15.124:0/4075545386 >> v2:172.21.15.192:3300/0 conn(0x7f89a806a820 0x7f89a806d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:02.614 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a67fc700 1 -- 172.21.15.124:0/4075545386 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a815e5e0 con 0x7f89a80cdd30 2023-10-16T13:00:02.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a67fc700 1 -- 172.21.15.124:0/4075545386 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f89a00019f0 con 0x7f89a80cdd30 2023-10-16T13:00:02.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a67fc700 1 -- 172.21.15.124:0/4075545386 >> v1:172.21.15.124:6789/0 conn(0x7f89a80cdd30 legacy=0x7f89a81617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:02.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a67fc700 1 --2- 172.21.15.124:0/4075545386 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89a806b370 0x7f8994003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:02.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a67fc700 1 --2- 172.21.15.124:0/4075545386 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8994003f80 0x7f8994004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:02.615 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a67fc700 1 --2- 172.21.15.124:0/4075545386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8994004d90 0x7f8994005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:02.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a67fc700 1 -- 172.21.15.124:0/4075545386 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a806b750 con 0x7f8994003f80 2023-10-16T13:00:02.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a67fc700 1 -- 172.21.15.124:0/4075545386 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a815e300 con 0x7f8994004d90 2023-10-16T13:00:02.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a67fc700 1 -- 172.21.15.124:0/4075545386 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899400ba10 con 0x7f89a806b370 2023-10-16T13:00:02.616 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a6ffd700 1 --2- 172.21.15.124:0/4075545386 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8994003f80 0x7f8994004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:02.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a77fe700 1 --2- 172.21.15.124:0/4075545386 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89a806b370 0x7f8994003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:02.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a7fff700 1 --2- 172.21.15.124:0/4075545386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8994004d90 0x7f8994005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:02.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a6ffd700 1 -- 172.21.15.124:0/4075545386 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89a806b370 msgr2=0x7f8994003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:02.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a6ffd700 1 --2- 172.21.15.124:0/4075545386 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89a806b370 0x7f8994003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:02.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a6ffd700 1 -- 172.21.15.124:0/4075545386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8994004d90 msgr2=0x7f8994005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:02.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a6ffd700 1 --2- 172.21.15.124:0/4075545386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8994004d90 0x7f8994005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:02.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a6ffd700 1 -- 172.21.15.124:0/4075545386 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89940035b0 con 0x7f8994003f80 2023-10-16T13:00:02.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a77fe700 1 --2- 172.21.15.124:0/4075545386 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89a806b370 0x7f8994003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:00:02.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a6ffd700 1 --2- 172.21.15.124:0/4075545386 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8994003f80 0x7f8994004850 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8998009b60 tx=0x7f8994005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809f375627595056 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:02.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.602+0000 7f89a67fc700 1 -- 172.21.15.124:0/4075545386 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899800e660 con 0x7f8994003f80 2023-10-16T13:00:02.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.603+0000 7f89a67fc700 1 -- 172.21.15.124:0/4075545386 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899800e7c0 con 0x7f8994003f80 2023-10-16T13:00:02.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.603+0000 7f89a67fc700 1 -- 172.21.15.124:0/4075545386 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899800eb30 con 0x7f8994003f80 2023-10-16T13:00:02.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.603+0000 7f89adbe6700 1 -- 172.21.15.124:0/4075545386 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8994003f80 msgr2=0x7f8994004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:02.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.603+0000 7f89adbe6700 1 --2- 172.21.15.124:0/4075545386 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8994003f80 0x7f8994004850 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8998009b60 tx=0x7f8994005880 comp rx=0 tx=0).stop 2023-10-16T13:00:02.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.603+0000 7f89a7fff700 1 -- 172.21.15.124:0/4075545386 reap_dead start 2023-10-16T13:00:02.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.603+0000 7f89adbe6700 1 -- 172.21.15.124:0/4075545386 shutdown_connections 2023-10-16T13:00:02.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.603+0000 7f89adbe6700 1 -- 172.21.15.124:0/4075545386 >> 172.21.15.124:0/4075545386 conn(0x7f89a80ccbe0 msgr2=0x7f89a80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:02.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.603+0000 7f89adbe6700 1 -- 172.21.15.124:0/4075545386 shutdown_connections 2023-10-16T13:00:02.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.603+0000 7f89adbe6700 1 -- 172.21.15.124:0/4075545386 wait complete. 2023-10-16T13:00:02.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.604+0000 7f89adbe6700 1 Processor -- start 2023-10-16T13:00:02.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.605+0000 7f89adbe6700 1 -- start start 2023-10-16T13:00:02.621 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.605+0000 7f89adbe6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8994003f80 0x7f89a806e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:02.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.605+0000 7f89adbe6700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89a8156410 0x7f89a80acd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:02.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.605+0000 7f89adbe6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89a80ad2d0 0x7f89a81e64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:02.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.605+0000 7f89adbe6700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a80ad780 con 0x7f89a8156410 2023-10-16T13:00:02.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.605+0000 7f89adbe6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a80b57f0 con 0x7f89a80ad2d0 2023-10-16T13:00:02.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.605+0000 7f89adbe6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a80aea00 con 0x7f8994003f80 2023-10-16T13:00:02.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.605+0000 7f89a6ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89a8156410 0x7f89a80acd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:02.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.605+0000 7f89a6ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89a8156410 0x7f89a80acd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55498/0 (socket says 172.21.15.124:55498) 2023-10-16T13:00:02.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.605+0000 7f89a6ffd700 1 -- 172.21.15.124:0/1044943593 learned_addr learned my addr 172.21.15.124:0/1044943593 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:02.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.606+0000 7f89a77fe700 1 --2- 172.21.15.124:0/1044943593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8994003f80 0x7f89a806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:02.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.606+0000 7f89a7fff700 1 --2- 172.21.15.124:0/1044943593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89a80ad2d0 0x7f89a81e64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:02.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.606+0000 7f89a6ffd700 1 -- 172.21.15.124:0/1044943593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8994003f80 msgr2=0x7f89a806e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:02.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.606+0000 7f89a6ffd700 1 --2- 172.21.15.124:0/1044943593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8994003f80 0x7f89a806e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:02.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.606+0000 7f89a6ffd700 1 -- 172.21.15.124:0/1044943593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89a80ad2d0 msgr2=0x7f89a81e64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:02.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.606+0000 7f89a6ffd700 1 --2- 172.21.15.124:0/1044943593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89a80ad2d0 0x7f89a81e64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:02.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.606+0000 7f89a6ffd700 1 -- 172.21.15.124:0/1044943593 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a80aece0 con 0x7f89a8156410 2023-10-16T13:00:02.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.606+0000 7f89a6ffd700 1 --2- 172.21.15.124:0/1044943593 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89a8156410 0x7f89a80acd90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f89980090b0 tx=0x7f89980047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:02.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.606+0000 7f899ffff700 1 -- 172.21.15.124:0/1044943593 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8998021070 con 0x7f89a8156410 2023-10-16T13:00:02.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.606+0000 7f899ffff700 1 -- 172.21.15.124:0/1044943593 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89980036a0 con 0x7f89a8156410 2023-10-16T13:00:02.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.606+0000 7f89adbe6700 1 -- 172.21.15.124:0/1044943593 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a80aefc0 con 0x7f89a8156410 2023-10-16T13:00:02.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.606+0000 7f899ffff700 1 -- 172.21.15.124:0/1044943593 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899800e660 con 0x7f89a8156410 2023-10-16T13:00:02.626 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.606+0000 7f89adbe6700 1 -- 172.21.15.124:0/1044943593 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a80adac0 con 0x7f89a8156410 2023-10-16T13:00:02.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.607+0000 7f89adbe6700 1 -- 172.21.15.124:0/1044943593 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a80adc50 con 0x7f89a8156410 2023-10-16T13:00:02.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.607+0000 7f899ffff700 1 -- 172.21.15.124:0/1044943593 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8998025070 con 0x7f89a8156410 2023-10-16T13:00:02.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.608+0000 7f899ffff700 1 --2- 172.21.15.124:0/1044943593 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f898806af00 0x7f898806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:02.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.608+0000 7f89a77fe700 1 --2- 172.21.15.124:0/1044943593 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f898806af00 0x7f898806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:02.627 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.608+0000 7f899ffff700 1 -- 172.21.15.124:0/1044943593 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f899808a8e0 con 0x7f89a8156410 2023-10-16T13:00:02.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.608+0000 7f89a77fe700 1 --2- 172.21.15.124:0/1044943593 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f898806af00 0x7f898806d3c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8990009a50 tx=0x7f8990008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:02.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.612+0000 7f899ffff700 1 -- 172.21.15.124:0/1044943593 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f89980597e0 con 0x7f89a8156410 2023-10-16T13:00:02.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:02.806+0000 7f89adbe6700 1 -- 172.21.15.124:0/1044943593 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f89a8072d10 con 0x7f89a8156410 2023-10-16T13:00:03.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.620+0000 7f899ffff700 1 -- 172.21.15.124:0/1044943593 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8998059370 con 0x7f89a8156410 2023-10-16T13:00:03.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.625+0000 7f89adbe6700 1 -- 172.21.15.124:0/1044943593 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f898806af00 msgr2=0x7f898806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:03.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.625+0000 7f89adbe6700 1 --2- 172.21.15.124:0/1044943593 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f898806af00 0x7f898806d3c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8990009a50 tx=0x7f8990008040 comp rx=0 tx=0).stop 2023-10-16T13:00:03.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.625+0000 7f89adbe6700 1 -- 172.21.15.124:0/1044943593 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89a8156410 msgr2=0x7f89a80acd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:03.628 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.625+0000 7f89adbe6700 1 --2- 172.21.15.124:0/1044943593 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89a8156410 0x7f89a80acd90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f89980090b0 tx=0x7f89980047c0 comp rx=0 tx=0).stop 2023-10-16T13:00:03.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.626+0000 7f89adbe6700 1 -- 172.21.15.124:0/1044943593 shutdown_connections 2023-10-16T13:00:03.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.626+0000 7f89adbe6700 1 --2- 172.21.15.124:0/1044943593 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f898806af00 0x7f898806d3c0 secure :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8990009a50 tx=0x7f8990008040 comp rx=0 tx=0).stop 2023-10-16T13:00:03.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.626+0000 7f89adbe6700 1 --2- 172.21.15.124:0/1044943593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89a80ad2d0 0x7f89a81e64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:03.629 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.626+0000 7f89adbe6700 1 --2- 172.21.15.124:0/1044943593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8994003f80 0x7f89a806e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:03.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.626+0000 7f89adbe6700 1 --2- 172.21.15.124:0/1044943593 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f89a8156410 0x7f89a80acd90 secure :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f89980090b0 tx=0x7f89980047c0 comp rx=0 tx=0).stop 2023-10-16T13:00:03.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.626+0000 7f89adbe6700 1 -- 172.21.15.124:0/1044943593 >> 172.21.15.124:0/1044943593 conn(0x7f89a80ccbe0 msgr2=0x7f89a81572d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:03.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.626+0000 7f89adbe6700 1 -- 172.21.15.124:0/1044943593 shutdown_connections 2023-10-16T13:00:03.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.627+0000 7f89adbe6700 1 -- 172.21.15.124:0/1044943593 wait complete. 2023-10-16T13:00:03.631 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_metadata' created 2023-10-16T13:00:03.645 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-16T13:00:03.779 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.776+0000 7f790f110700 1 Processor -- start 2023-10-16T13:00:03.779 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.776+0000 7f790f110700 1 -- start start 2023-10-16T13:00:03.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.777+0000 7f790f110700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7908066890 0x7f79080cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:03.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.777+0000 7f790f110700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f790815b920 con 0x7f790815efd0 2023-10-16T13:00:03.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.777+0000 7f790f110700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f790806bfe0 con 0x7f79081447f0 2023-10-16T13:00:03.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.777+0000 7f790f110700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f790815fac0 con 0x7f7908066890 2023-10-16T13:00:03.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.777+0000 7f790ceac700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f790815efd0 0x7f790815f3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:44172/0 (socket says 172.21.15.124:44172) 2023-10-16T13:00:03.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.777+0000 7f790ceac700 1 -- 172.21.15.124:0/1114306870 learned_addr learned my addr 172.21.15.124:0/1114306870 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T13:00:03.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.777+0000 7f79077fe700 1 -- 172.21.15.124:0/1114306870 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447932556 0 0) 0x7f790815b920 con 0x7f790815efd0 2023-10-16T13:00:03.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.777+0000 7f79077fe700 1 -- 172.21.15.124:0/1114306870 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78f80035b0 con 0x7f790815efd0 2023-10-16T13:00:03.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.777+0000 7f790d6ad700 1 --2- 172.21.15.124:0/1114306870 >> v2:172.21.15.192:3300/0 conn(0x7f7908066890 0x7f79080cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:03.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f79077fe700 1 -- 172.21.15.124:0/1114306870 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 537354676 0 0) 0x7f78f80035b0 con 0x7f790815efd0 2023-10-16T13:00:03.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f79077fe700 1 -- 172.21.15.124:0/1114306870 >> v2:172.21.15.192:3300/0 conn(0x7f7908066890 msgr2=0x7f79080cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:03.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f79077fe700 1 --2- 172.21.15.124:0/1114306870 >> v2:172.21.15.192:3300/0 conn(0x7f7908066890 0x7f79080cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:03.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f79077fe700 1 -- 172.21.15.124:0/1114306870 >> v1:172.21.15.192:6789/0 conn(0x7f79081447f0 legacy=0x7f79080cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:03.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f79077fe700 1 -- 172.21.15.124:0/1114306870 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790815fca0 con 0x7f790815efd0 2023-10-16T13:00:03.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f79077fe700 1 -- 172.21.15.124:0/1114306870 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f78fc001670 con 0x7f790815efd0 2023-10-16T13:00:03.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f79077fe700 1 -- 172.21.15.124:0/1114306870 >> v1:172.21.15.124:6789/0 conn(0x7f790815efd0 legacy=0x7f790815f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:03.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f79077fe700 1 --2- 172.21.15.124:0/1114306870 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f78f8003a00 0x7f78f8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:03.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f79077fe700 1 --2- 172.21.15.124:0/1114306870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78f8004850 0x7f78f8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:03.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f79077fe700 1 --2- 172.21.15.124:0/1114306870 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78f8005210 0x7f78f800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:03.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f79077fe700 1 -- 172.21.15.124:0/1114306870 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790815fac0 con 0x7f78f8003a00 2023-10-16T13:00:03.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f79077fe700 1 -- 172.21.15.124:0/1114306870 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f800c140 con 0x7f78f8004850 2023-10-16T13:00:03.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f79077fe700 1 -- 172.21.15.124:0/1114306870 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f800c300 con 0x7f78f8005210 2023-10-16T13:00:03.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f790ceac700 1 --2- 172.21.15.124:0/1114306870 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f78f8003a00 0x7f78f8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:03.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f7907fff700 1 --2- 172.21.15.124:0/1114306870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78f8004850 0x7f78f8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:03.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f790d6ad700 1 --2- 172.21.15.124:0/1114306870 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78f8005210 0x7f78f800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:03.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f790ceac700 1 -- 172.21.15.124:0/1114306870 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78f8005210 msgr2=0x7f78f800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:03.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f790ceac700 1 --2- 172.21.15.124:0/1114306870 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78f8005210 0x7f78f800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:03.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f790ceac700 1 -- 172.21.15.124:0/1114306870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78f8004850 msgr2=0x7f78f8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:03.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f790ceac700 1 --2- 172.21.15.124:0/1114306870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78f8004850 0x7f78f8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:03.788 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f790d6ad700 1 -- 172.21.15.124:0/1114306870 reap_dead start 2023-10-16T13:00:03.788 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f790ceac700 1 -- 172.21.15.124:0/1114306870 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f80035b0 con 0x7f78f8003a00 2023-10-16T13:00:03.788 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f7907fff700 1 --2- 172.21.15.124:0/1114306870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78f8004850 0x7f78f8004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:00:03.788 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f790ceac700 1 --2- 172.21.15.124:0/1114306870 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f78f8003a00 0x7f78f8003e00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f78fc001eb0 tx=0x7f78f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e67d466cbb67864 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:03.788 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f79077fe700 1 -- 172.21.15.124:0/1114306870 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc00cd80 con 0x7f78f8003a00 2023-10-16T13:00:03.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f79077fe700 1 -- 172.21.15.124:0/1114306870 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78fc005960 con 0x7f78f8003a00 2023-10-16T13:00:03.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.778+0000 7f79077fe700 1 -- 172.21.15.124:0/1114306870 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc005cf0 con 0x7f78f8003a00 2023-10-16T13:00:03.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.779+0000 7f790f110700 1 -- 172.21.15.124:0/1114306870 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f78f8003a00 msgr2=0x7f78f8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:03.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.779+0000 7f790f110700 1 --2- 172.21.15.124:0/1114306870 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f78f8003a00 0x7f78f8003e00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f78fc001eb0 tx=0x7f78f8005880 comp rx=0 tx=0).stop 2023-10-16T13:00:03.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.779+0000 7f790f110700 1 -- 172.21.15.124:0/1114306870 shutdown_connections 2023-10-16T13:00:03.789 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.779+0000 7f790f110700 1 --2- 172.21.15.124:0/1114306870 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f78f8003a00 0x7f78f8003e00 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:03.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.779+0000 7f790f110700 1 -- 172.21.15.124:0/1114306870 >> 172.21.15.124:0/1114306870 conn(0x7f79080b13e0 msgr2=0x7f79080b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:03.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.779+0000 7f790f110700 1 -- 172.21.15.124:0/1114306870 shutdown_connections 2023-10-16T13:00:03.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.779+0000 7f790f110700 1 -- 172.21.15.124:0/1114306870 wait complete. 2023-10-16T13:00:03.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.780+0000 7f790f110700 1 Processor -- start 2023-10-16T13:00:03.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.781+0000 7f790f110700 1 -- start start 2023-10-16T13:00:03.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.782+0000 7f790f110700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78f8003a00 0x7f790815a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:03.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.782+0000 7f790f110700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f79080c4dc0 0x7f790815d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:03.794 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.782+0000 7f790f110700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79080c5240 0x7f790815d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:03.794 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.782+0000 7f790f110700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790815ac00 con 0x7f79080c4dc0 2023-10-16T13:00:03.794 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.782+0000 7f790f110700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79080b3c60 con 0x7f79080c5240 2023-10-16T13:00:03.794 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.782+0000 7f790f110700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79080b3f40 con 0x7f78f8003a00 2023-10-16T13:00:03.794 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.782+0000 7f7907fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f79080c4dc0 0x7f790815d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:03.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.782+0000 7f7907fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f79080c4dc0 0x7f790815d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55518/0 (socket says 172.21.15.124:55518) 2023-10-16T13:00:03.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.782+0000 7f7907fff700 1 -- 172.21.15.124:0/4288217915 learned_addr learned my addr 172.21.15.124:0/4288217915 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:03.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.782+0000 7f790d6ad700 1 --2- 172.21.15.124:0/4288217915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79080c5240 0x7f790815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:03.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.782+0000 7f790ceac700 1 --2- 172.21.15.124:0/4288217915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78f8003a00 0x7f790815a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:03.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.782+0000 7f7907fff700 1 -- 172.21.15.124:0/4288217915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78f8003a00 msgr2=0x7f790815a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:03.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.782+0000 7f7907fff700 1 --2- 172.21.15.124:0/4288217915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78f8003a00 0x7f790815a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:03.796 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.782+0000 7f7907fff700 1 -- 172.21.15.124:0/4288217915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79080c5240 msgr2=0x7f790815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:03.796 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.782+0000 7f7907fff700 1 --2- 172.21.15.124:0/4288217915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79080c5240 0x7f790815d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:03.796 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.782+0000 7f7907fff700 1 -- 172.21.15.124:0/4288217915 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79080b25b0 con 0x7f79080c4dc0 2023-10-16T13:00:03.796 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.782+0000 7f790ceac700 1 --2- 172.21.15.124:0/4288217915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78f8003a00 0x7f790815a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:00:03.796 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.782+0000 7f7907fff700 1 --2- 172.21.15.124:0/4288217915 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f79080c4dc0 0x7f790815d420 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f78f400e440 tx=0x7f78f400e800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:03.797 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.782+0000 7f79057fa700 1 -- 172.21.15.124:0/4288217915 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f4005030 con 0x7f79080c4dc0 2023-10-16T13:00:03.797 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.782+0000 7f79057fa700 1 -- 172.21.15.124:0/4288217915 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f4005190 con 0x7f79080c4dc0 2023-10-16T13:00:03.797 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.782+0000 7f790f110700 1 -- 172.21.15.124:0/4288217915 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79080b2890 con 0x7f79080c4dc0 2023-10-16T13:00:03.797 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.782+0000 7f79057fa700 1 -- 172.21.15.124:0/4288217915 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f4005540 con 0x7f79080c4dc0 2023-10-16T13:00:03.797 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.782+0000 7f790f110700 1 -- 172.21.15.124:0/4288217915 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79080c3420 con 0x7f79080c4dc0 2023-10-16T13:00:03.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.783+0000 7f790f110700 1 -- 172.21.15.124:0/4288217915 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79080b2ab0 con 0x7f79080c4dc0 2023-10-16T13:00:03.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.784+0000 7f79057fa700 1 -- 172.21.15.124:0/4288217915 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f78f4006860 con 0x7f79080c4dc0 2023-10-16T13:00:03.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.784+0000 7f79057fa700 1 --2- 172.21.15.124:0/4288217915 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f78ec06af00 0x7f78ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:03.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.784+0000 7f79057fa700 1 -- 172.21.15.124:0/4288217915 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f78f4089090 con 0x7f79080c4dc0 2023-10-16T13:00:03.798 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.784+0000 7f790ceac700 1 --2- 172.21.15.124:0/4288217915 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f78ec06af00 0x7f78ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:03.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.785+0000 7f790ceac700 1 --2- 172.21.15.124:0/4288217915 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f78ec06af00 0x7f78ec06d3c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f78fc015040 tx=0x7f78fc007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:03.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.789+0000 7f79057fa700 1 -- 172.21.15.124:0/4288217915 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f78f40541d0 con 0x7f79080c4dc0 2023-10-16T13:00:03.981 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:03.978+0000 7f790f110700 1 -- 172.21.15.124:0/4288217915 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f790804ebb0 con 0x7f79080c4dc0 2023-10-16T13:00:04.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.623+0000 7f79057fa700 1 -- 172.21.15.124:0/4288217915 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) v1 ==== 170+0+0 (secure 0 0 0) 0x7f78f4003890 con 0x7f79080c4dc0 2023-10-16T13:00:04.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.627+0000 7f790f110700 1 -- 172.21.15.124:0/4288217915 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f78ec06af00 msgr2=0x7f78ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:04.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.627+0000 7f790f110700 1 --2- 172.21.15.124:0/4288217915 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f78ec06af00 0x7f78ec06d3c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f78fc015040 tx=0x7f78fc007000 comp rx=0 tx=0).stop 2023-10-16T13:00:04.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.627+0000 7f790f110700 1 -- 172.21.15.124:0/4288217915 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f79080c4dc0 msgr2=0x7f790815d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:04.630 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.627+0000 7f790f110700 1 --2- 172.21.15.124:0/4288217915 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f79080c4dc0 0x7f790815d420 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f78f400e440 tx=0x7f78f400e800 comp rx=0 tx=0).stop 2023-10-16T13:00:04.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.627+0000 7f790f110700 1 -- 172.21.15.124:0/4288217915 shutdown_connections 2023-10-16T13:00:04.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.627+0000 7f790f110700 1 --2- 172.21.15.124:0/4288217915 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f78ec06af00 0x7f78ec06d3c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:04.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.627+0000 7f790f110700 1 --2- 172.21.15.124:0/4288217915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79080c5240 0x7f790815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:04.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.627+0000 7f790f110700 1 --2- 172.21.15.124:0/4288217915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78f8003a00 0x7f790815a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:04.631 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.627+0000 7f790f110700 1 --2- 172.21.15.124:0/4288217915 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f79080c4dc0 0x7f790815d420 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:04.632 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.627+0000 7f790f110700 1 -- 172.21.15.124:0/4288217915 >> 172.21.15.124:0/4288217915 conn(0x7f79080b13e0 msgr2=0x7f790806a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:04.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.632+0000 7f790f110700 1 -- 172.21.15.124:0/4288217915 shutdown_connections 2023-10-16T13:00:04.635 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.632+0000 7f790f110700 1 -- 172.21.15.124:0/4288217915 wait complete. 2023-10-16T13:00:04.639 INFO:teuthology.orchestra.run.smithi124.stderr:pool 'cephfs_data' created 2023-10-16T13:00:04.656 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-16T13:00:04.780 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.777+0000 7f7c251bf700 1 Processor -- start 2023-10-16T13:00:04.781 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.777+0000 7f7c251bf700 1 -- start start 2023-10-16T13:00:04.782 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.778+0000 7f7c251bf700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7c2006a820 0x7f7c2015dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:04.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.778+0000 7f7c251bf700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7c200cdd30 0x7f7c200ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:04.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.778+0000 7f7c251bf700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c20161360 con 0x7f7c2006b370 2023-10-16T13:00:04.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.778+0000 7f7c251bf700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c200ce720 con 0x7f7c200cdd30 2023-10-16T13:00:04.783 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.778+0000 7f7c251bf700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2006b750 con 0x7f7c2006a820 2023-10-16T13:00:04.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.778+0000 7f7c1f59e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7c200cdd30 0x7f7c200ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:04.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.778+0000 7f7c1f59e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7c200cdd30 0x7f7c200ce1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55528/0 (socket says 172.21.15.124:55528) 2023-10-16T13:00:04.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.778+0000 7f7c1f59e700 1 -- 172.21.15.124:0/2554550425 learned_addr learned my addr 172.21.15.124:0/2554550425 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:04.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.779+0000 7f7c1e59c700 1 --2- 172.21.15.124:0/2554550425 >> v2:172.21.15.192:3300/0 conn(0x7f7c2006a820 0x7f7c2015dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:04.784 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.779+0000 7f7c1f59e700 1 -- 172.21.15.124:0/2554550425 >> v2:172.21.15.192:3300/0 conn(0x7f7c2006a820 msgr2=0x7f7c2015dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:04.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.779+0000 7f7c1f59e700 1 --2- 172.21.15.124:0/2554550425 >> v2:172.21.15.192:3300/0 conn(0x7f7c2006a820 0x7f7c2015dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:04.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.779+0000 7f7c1f59e700 1 -- 172.21.15.124:0/2554550425 >> v1:172.21.15.192:6789/0 conn(0x7f7c2006b370 legacy=0x7f7c2006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:04.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.779+0000 7f7c1f59e700 1 -- 172.21.15.124:0/2554550425 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2006dcc0 con 0x7f7c200cdd30 2023-10-16T13:00:04.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.779+0000 7f7c1f59e700 1 --2- 172.21.15.124:0/2554550425 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c200cdd30 0x7f7c200ce1e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7c20070360 tx=0x7f7c1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e3ce1e0e545179 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:04.785 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.779+0000 7f7c1dd9b700 1 -- 172.21.15.124:0/2554550425 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1800e070 con 0x7f7c200cdd30 2023-10-16T13:00:04.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.779+0000 7f7c1dd9b700 1 -- 172.21.15.124:0/2554550425 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c18003a20 con 0x7f7c200cdd30 2023-10-16T13:00:04.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.779+0000 7f7c1dd9b700 1 -- 172.21.15.124:0/2554550425 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c18003dd0 con 0x7f7c200cdd30 2023-10-16T13:00:04.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.780+0000 7f7c251bf700 1 -- 172.21.15.124:0/2554550425 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c200cdd30 msgr2=0x7f7c200ce1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:04.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.780+0000 7f7c251bf700 1 --2- 172.21.15.124:0/2554550425 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c200cdd30 0x7f7c200ce1e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7c20070360 tx=0x7f7c1800b330 comp rx=0 tx=0).stop 2023-10-16T13:00:04.786 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.780+0000 7f7c251bf700 1 -- 172.21.15.124:0/2554550425 shutdown_connections 2023-10-16T13:00:04.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.780+0000 7f7c251bf700 1 --2- 172.21.15.124:0/2554550425 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c200cdd30 0x7f7c200ce1e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:04.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.780+0000 7f7c251bf700 1 --2- 172.21.15.124:0/2554550425 >> v2:172.21.15.192:3300/0 conn(0x7f7c2006a820 0x7f7c2015dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:04.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.780+0000 7f7c251bf700 1 -- 172.21.15.124:0/2554550425 >> 172.21.15.124:0/2554550425 conn(0x7f7c200ccbe0 msgr2=0x7f7c200ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:04.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.780+0000 7f7c251bf700 1 -- 172.21.15.124:0/2554550425 shutdown_connections 2023-10-16T13:00:04.787 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.780+0000 7f7c251bf700 1 -- 172.21.15.124:0/2554550425 wait complete. 2023-10-16T13:00:04.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.781+0000 7f7c251bf700 1 Processor -- start 2023-10-16T13:00:04.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.781+0000 7f7c251bf700 1 -- start start 2023-10-16T13:00:04.790 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.782+0000 7f7c251bf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c2006a820 0x7f7c200c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:04.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.782+0000 7f7c251bf700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c2006b370 0x7f7c200ae770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:04.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.782+0000 7f7c251bf700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c200cdd30 0x7f7c200b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:04.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.782+0000 7f7c251bf700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c200c6fd0 con 0x7f7c2006b370 2023-10-16T13:00:04.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.782+0000 7f7c251bf700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c201f6a10 con 0x7f7c200cdd30 2023-10-16T13:00:04.791 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.782+0000 7f7c251bf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c201f6cf0 con 0x7f7c2006a820 2023-10-16T13:00:04.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.782+0000 7f7c1e59c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c2006b370 0x7f7c200ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:04.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.782+0000 7f7c1e59c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c2006b370 0x7f7c200ae770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55532/0 (socket says 172.21.15.124:55532) 2023-10-16T13:00:04.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.782+0000 7f7c1e59c700 1 -- 172.21.15.124:0/1457643403 learned_addr learned my addr 172.21.15.124:0/1457643403 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:04.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.782+0000 7f7c1f59e700 1 --2- 172.21.15.124:0/1457643403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c200cdd30 0x7f7c200b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:04.792 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.782+0000 7f7c1ed9d700 1 --2- 172.21.15.124:0/1457643403 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c2006a820 0x7f7c200c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:04.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.782+0000 7f7c1e59c700 1 -- 172.21.15.124:0/1457643403 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c2006a820 msgr2=0x7f7c200c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:04.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.782+0000 7f7c1e59c700 1 --2- 172.21.15.124:0/1457643403 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c2006a820 0x7f7c200c6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:04.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.782+0000 7f7c1e59c700 1 -- 172.21.15.124:0/1457643403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c200cdd30 msgr2=0x7f7c200b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:04.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.782+0000 7f7c1e59c700 1 --2- 172.21.15.124:0/1457643403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c200cdd30 0x7f7c200b4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:04.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.782+0000 7f7c1e59c700 1 -- 172.21.15.124:0/1457643403 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c18009b30 con 0x7f7c2006b370 2023-10-16T13:00:04.794 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.782+0000 7f7c1e59c700 1 --2- 172.21.15.124:0/1457643403 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c2006b370 0x7f7c200ae770 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000d7d0 tx=0x7f7c1000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:04.794 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.783+0000 7f7c077fe700 1 -- 172.21.15.124:0/1457643403 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c100125f0 con 0x7f7c2006b370 2023-10-16T13:00:04.794 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.783+0000 7f7c077fe700 1 -- 172.21.15.124:0/1457643403 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c10012750 con 0x7f7c2006b370 2023-10-16T13:00:04.794 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.783+0000 7f7c251bf700 1 -- 172.21.15.124:0/1457643403 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c201f6fd0 con 0x7f7c2006b370 2023-10-16T13:00:04.794 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.783+0000 7f7c077fe700 1 -- 172.21.15.124:0/1457643403 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c10012ae0 con 0x7f7c2006b370 2023-10-16T13:00:04.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.783+0000 7f7c251bf700 1 -- 172.21.15.124:0/1457643403 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c200b2da0 con 0x7f7c2006b370 2023-10-16T13:00:04.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.784+0000 7f7c251bf700 1 -- 172.21.15.124:0/1457643403 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c20072d10 con 0x7f7c2006b370 2023-10-16T13:00:04.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.784+0000 7f7c077fe700 1 -- 172.21.15.124:0/1457643403 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7c10012c40 con 0x7f7c2006b370 2023-10-16T13:00:04.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.784+0000 7f7c077fe700 1 --2- 172.21.15.124:0/1457643403 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f7c0c06af00 0x7f7c0c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:04.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.785+0000 7f7c077fe700 1 -- 172.21.15.124:0/1457643403 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f7c10089750 con 0x7f7c2006b370 2023-10-16T13:00:04.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.785+0000 7f7c1ed9d700 1 --2- 172.21.15.124:0/1457643403 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f7c0c06af00 0x7f7c0c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:04.796 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.785+0000 7f7c1ed9d700 1 --2- 172.21.15.124:0/1457643403 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f7c0c06af00 0x7f7c0c06d3c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7c14004f30 tx=0x7f7c14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:04.796 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:04.789+0000 7f7c077fe700 1 -- 172.21.15.124:0/1457643403 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7c10054720 con 0x7f7c2006b370 2023-10-16T13:00:05.024 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.021+0000 7f7c251bf700 1 -- 172.21.15.124:0/1457643403 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7c20067350 con 0x7f7c2006b370 2023-10-16T13:00:05.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.652+0000 7f7c077fe700 1 -- 172.21.15.124:0/1457643403 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7c10057d40 con 0x7f7c2006b370 2023-10-16T13:00:05.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.656+0000 7f7c251bf700 1 -- 172.21.15.124:0/1457643403 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f7c0c06af00 msgr2=0x7f7c0c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:05.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.656+0000 7f7c251bf700 1 --2- 172.21.15.124:0/1457643403 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f7c0c06af00 0x7f7c0c06d3c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7c14004f30 tx=0x7f7c14009040 comp rx=0 tx=0).stop 2023-10-16T13:00:05.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.656+0000 7f7c251bf700 1 -- 172.21.15.124:0/1457643403 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c2006b370 msgr2=0x7f7c200ae770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:05.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.656+0000 7f7c251bf700 1 --2- 172.21.15.124:0/1457643403 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c2006b370 0x7f7c200ae770 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000d7d0 tx=0x7f7c1000dae0 comp rx=0 tx=0).stop 2023-10-16T13:00:05.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.656+0000 7f7c251bf700 1 -- 172.21.15.124:0/1457643403 shutdown_connections 2023-10-16T13:00:05.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.656+0000 7f7c251bf700 1 --2- 172.21.15.124:0/1457643403 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f7c0c06af00 0x7f7c0c06d3c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:05.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.656+0000 7f7c251bf700 1 --2- 172.21.15.124:0/1457643403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c200cdd30 0x7f7c200b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:05.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.656+0000 7f7c251bf700 1 --2- 172.21.15.124:0/1457643403 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c2006a820 0x7f7c200c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:05.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.656+0000 7f7c251bf700 1 --2- 172.21.15.124:0/1457643403 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7c2006b370 0x7f7c200ae770 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:05.661 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.656+0000 7f7c251bf700 1 -- 172.21.15.124:0/1457643403 >> 172.21.15.124:0/1457643403 conn(0x7f7c200ccbe0 msgr2=0x7f7c200ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:05.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.658+0000 7f7c251bf700 1 -- 172.21.15.124:0/1457643403 shutdown_connections 2023-10-16T13:00:05.662 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.658+0000 7f7c251bf700 1 -- 172.21.15.124:0/1457643403 wait complete. 2023-10-16T13:00:05.665 INFO:teuthology.orchestra.run.smithi124.stderr:new fs with metadata pool 5 and data pool 6 2023-10-16T13:00:05.680 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:00:05.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.797+0000 7ff4f6cae700 1 Processor -- start 2023-10-16T13:00:05.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.797+0000 7ff4f6cae700 1 -- start start 2023-10-16T13:00:05.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.798+0000 7ff4f6cae700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff4f006a820 0x7ff4f00cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:05.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.798+0000 7ff4f6cae700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff4f00ca7d0 0x7ff4f0071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:05.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.798+0000 7ff4f6cae700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f00cfeb0 con 0x7ff4f015e7f0 2023-10-16T13:00:05.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.798+0000 7ff4f6cae700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f00ce410 con 0x7ff4f00ca7d0 2023-10-16T13:00:05.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.798+0000 7ff4f6cae700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f015ec50 con 0x7ff4f006a820 2023-10-16T13:00:05.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.798+0000 7ff4f524b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff4f00ca7d0 0x7ff4f0071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:05.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.798+0000 7ff4effff700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7ff4f015e7f0 0x7ff4f006ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:44206/0 (socket says 172.21.15.124:44206) 2023-10-16T13:00:05.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.798+0000 7ff4effff700 1 -- 172.21.15.124:0/3670325913 learned_addr learned my addr 172.21.15.124:0/3670325913 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T13:00:05.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.798+0000 7ff4f524b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff4f00ca7d0 0x7ff4f0071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55542/0 (socket says 172.21.15.124:55542) 2023-10-16T13:00:05.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.799+0000 7ff4f524b700 1 -- 172.21.15.124:0/3670325913 >> v2:172.21.15.192:3300/0 conn(0x7ff4f006a820 msgr2=0x7ff4f00cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:05.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.799+0000 7ff4f4a4a700 1 --2- 172.21.15.124:0/3670325913 >> v2:172.21.15.192:3300/0 conn(0x7ff4f006a820 0x7ff4f00cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:05.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.799+0000 7ff4ef7fe700 1 -- 172.21.15.124:0/3670325913 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603680299 0 0) 0x7ff4f00cfeb0 con 0x7ff4f015e7f0 2023-10-16T13:00:05.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.799+0000 7ff4f524b700 1 --2- 172.21.15.124:0/3670325913 >> v2:172.21.15.192:3300/0 conn(0x7ff4f006a820 0x7ff4f00cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:05.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.799+0000 7ff4f524b700 1 -- 172.21.15.124:0/3670325913 >> v1:172.21.15.124:6789/0 conn(0x7ff4f015e7f0 legacy=0x7ff4f006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:05.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.799+0000 7ff4f524b700 1 -- 172.21.15.124:0/3670325913 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f00af9d0 con 0x7ff4f00ca7d0 2023-10-16T13:00:05.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.799+0000 7ff4f524b700 1 --2- 172.21.15.124:0/3670325913 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f00ca7d0 0x7ff4f0071ea0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0067df0 tx=0x7ff4e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49af1cc0e85664f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:05.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.799+0000 7ff4ef7fe700 1 -- 172.21.15.124:0/3670325913 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e800e070 con 0x7ff4f00ca7d0 2023-10-16T13:00:05.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.799+0000 7ff4ef7fe700 1 -- 172.21.15.124:0/3670325913 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e800bbd0 con 0x7ff4f00ca7d0 2023-10-16T13:00:05.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.799+0000 7ff4ef7fe700 1 -- 172.21.15.124:0/3670325913 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8012430 con 0x7ff4f00ca7d0 2023-10-16T13:00:05.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.799+0000 7ff4f6cae700 1 -- 172.21.15.124:0/3670325913 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f00ca7d0 msgr2=0x7ff4f0071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:05.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.799+0000 7ff4f6cae700 1 --2- 172.21.15.124:0/3670325913 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f00ca7d0 0x7ff4f0071ea0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0067df0 tx=0x7ff4e800b330 comp rx=0 tx=0).stop 2023-10-16T13:00:05.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.799+0000 7ff4f6cae700 1 -- 172.21.15.124:0/3670325913 shutdown_connections 2023-10-16T13:00:05.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.799+0000 7ff4f6cae700 1 --2- 172.21.15.124:0/3670325913 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f00ca7d0 0x7ff4f0071ea0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:05.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.799+0000 7ff4f6cae700 1 --2- 172.21.15.124:0/3670325913 >> v2:172.21.15.192:3300/0 conn(0x7ff4f006a820 0x7ff4f00cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:05.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.799+0000 7ff4f6cae700 1 -- 172.21.15.124:0/3670325913 >> 172.21.15.124:0/3670325913 conn(0x7ff4f00d0180 msgr2=0x7ff4f00d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:05.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.800+0000 7ff4f6cae700 1 -- 172.21.15.124:0/3670325913 shutdown_connections 2023-10-16T13:00:05.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.800+0000 7ff4f6cae700 1 -- 172.21.15.124:0/3670325913 wait complete. 2023-10-16T13:00:05.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.801+0000 7ff4f6cae700 1 Processor -- start 2023-10-16T13:00:05.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.801+0000 7ff4f6cae700 1 -- start start 2023-10-16T13:00:05.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.801+0000 7ff4f6cae700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f006a820 0x7ff4f015bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:05.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.801+0000 7ff4f6cae700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4f00ca7d0 0x7ff4f014af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:05.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.802+0000 7ff4f6cae700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4f015e7f0 0x7ff4f014b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:05.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.802+0000 7ff4f6cae700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f006e690 con 0x7ff4f006a820 2023-10-16T13:00:05.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.802+0000 7ff4f6cae700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f006db10 con 0x7ff4f015e7f0 2023-10-16T13:00:05.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.802+0000 7ff4f6cae700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f006dd60 con 0x7ff4f00ca7d0 2023-10-16T13:00:05.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.802+0000 7ff4f4a4a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f006a820 0x7ff4f015bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:05.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.802+0000 7ff4f4a4a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f006a820 0x7ff4f015bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55544/0 (socket says 172.21.15.124:55544) 2023-10-16T13:00:05.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.802+0000 7ff4f4a4a700 1 -- 172.21.15.124:0/65977581 learned_addr learned my addr 172.21.15.124:0/65977581 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:05.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.802+0000 7ff4f524b700 1 --2- 172.21.15.124:0/65977581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4f015e7f0 0x7ff4f014b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:05.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.802+0000 7ff4effff700 1 --2- 172.21.15.124:0/65977581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4f00ca7d0 0x7ff4f014af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:05.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.802+0000 7ff4f4a4a700 1 -- 172.21.15.124:0/65977581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4f00ca7d0 msgr2=0x7ff4f014af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:05.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.802+0000 7ff4f4a4a700 1 --2- 172.21.15.124:0/65977581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4f00ca7d0 0x7ff4f014af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:05.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.802+0000 7ff4f4a4a700 1 -- 172.21.15.124:0/65977581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4f015e7f0 msgr2=0x7ff4f014b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:05.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.802+0000 7ff4f4a4a700 1 --2- 172.21.15.124:0/65977581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4f015e7f0 0x7ff4f014b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:05.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.802+0000 7ff4f4a4a700 1 -- 172.21.15.124:0/65977581 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e8009a70 con 0x7ff4f006a820 2023-10-16T13:00:05.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.802+0000 7ff4f4a4a700 1 --2- 172.21.15.124:0/65977581 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f006a820 0x7ff4f015bc70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400c7f0 tx=0x7ff4e400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:05.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.802+0000 7ff4ed7fa700 1 -- 172.21.15.124:0/65977581 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4004220 con 0x7ff4f006a820 2023-10-16T13:00:05.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.802+0000 7ff4ed7fa700 1 -- 172.21.15.124:0/65977581 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e4004380 con 0x7ff4f006a820 2023-10-16T13:00:05.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.802+0000 7ff4f6cae700 1 -- 172.21.15.124:0/65977581 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f006e040 con 0x7ff4f006a820 2023-10-16T13:00:05.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.802+0000 7ff4ed7fa700 1 -- 172.21.15.124:0/65977581 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e40036a0 con 0x7ff4f006a820 2023-10-16T13:00:05.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.802+0000 7ff4f6cae700 1 -- 172.21.15.124:0/65977581 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f014b990 con 0x7ff4f006a820 2023-10-16T13:00:05.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.803+0000 7ff4f6cae700 1 -- 172.21.15.124:0/65977581 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f004ebb0 con 0x7ff4f006a820 2023-10-16T13:00:05.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.804+0000 7ff4ed7fa700 1 -- 172.21.15.124:0/65977581 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff4e4003800 con 0x7ff4f006a820 2023-10-16T13:00:05.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.804+0000 7ff4ed7fa700 1 --2- 172.21.15.124:0/65977581 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff4d406af00 0x7ff4d406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:05.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.804+0000 7ff4ed7fa700 1 -- 172.21.15.124:0/65977581 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff4e40891f0 con 0x7ff4f006a820 2023-10-16T13:00:05.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.804+0000 7ff4effff700 1 --2- 172.21.15.124:0/65977581 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff4d406af00 0x7ff4d406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:05.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.805+0000 7ff4effff700 1 --2- 172.21.15.124:0/65977581 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff4d406af00 0x7ff4d406d3c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff4f015cb60 tx=0x7ff4dc007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:05.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:05.809+0000 7ff4ed7fa700 1 -- 172.21.15.124:0/65977581 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff4e4054160 con 0x7ff4f006a820 2023-10-16T13:00:06.002 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.000+0000 7ff4f6cae700 1 -- 172.21.15.124:0/65977581 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4f00af6c0 con 0x7ff4f006a820 2023-10-16T13:00:06.004 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.001+0000 7ff4ed7fa700 1 -- 172.21.15.124:0/65977581 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16787 (secure 0 0 0) 0x7ff4e4057780 con 0x7ff4f006a820 2023-10-16T13:00:06.004 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:00:06.005 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":37,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T13:00:05.023378+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:00:02.825330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-16T13:00:03.997396+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:00:06.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.004+0000 7ff4f6cae700 1 -- 172.21.15.124:0/65977581 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff4d406af00 msgr2=0x7ff4d406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:06.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.004+0000 7ff4f6cae700 1 --2- 172.21.15.124:0/65977581 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff4d406af00 0x7ff4d406d3c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff4f015cb60 tx=0x7ff4dc007e70 comp rx=0 tx=0).stop 2023-10-16T13:00:06.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.004+0000 7ff4f6cae700 1 -- 172.21.15.124:0/65977581 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f006a820 msgr2=0x7ff4f015bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:06.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.004+0000 7ff4f6cae700 1 --2- 172.21.15.124:0/65977581 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f006a820 0x7ff4f015bc70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400c7f0 tx=0x7ff4e400cb00 comp rx=0 tx=0).stop 2023-10-16T13:00:06.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.004+0000 7ff4f6cae700 1 -- 172.21.15.124:0/65977581 shutdown_connections 2023-10-16T13:00:06.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.004+0000 7ff4f6cae700 1 --2- 172.21.15.124:0/65977581 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7ff4d406af00 0x7ff4d406d3c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:06.007 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.004+0000 7ff4f6cae700 1 --2- 172.21.15.124:0/65977581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4f015e7f0 0x7ff4f014b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:06.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.004+0000 7ff4f6cae700 1 --2- 172.21.15.124:0/65977581 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f006a820 0x7ff4f015bc70 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:06.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.004+0000 7ff4f6cae700 1 --2- 172.21.15.124:0/65977581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4f00ca7d0 0x7ff4f014af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:06.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.004+0000 7ff4f6cae700 1 -- 172.21.15.124:0/65977581 >> 172.21.15.124:0/65977581 conn(0x7ff4f00d0180 msgr2=0x7ff4f00cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:06.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.004+0000 7ff4f6cae700 1 -- 172.21.15.124:0/65977581 shutdown_connections 2023-10-16T13:00:06.008 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.004+0000 7ff4f6cae700 1 -- 172.21.15.124:0/65977581 wait complete. 2023-10-16T13:00:06.018 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:00:06.138 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.136+0000 7fda84f04700 1 Processor -- start 2023-10-16T13:00:06.139 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.136+0000 7fda84f04700 1 -- start start 2023-10-16T13:00:06.141 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.137+0000 7fda84f04700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fda800b5700 0x7fda800cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:06.141 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.137+0000 7fda84f04700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fda800b9000 0x7fda800ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:06.141 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.137+0000 7fda84f04700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda800d0010 con 0x7fda80160b50 2023-10-16T13:00:06.142 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.137+0000 7fda84f04700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda800d02f0 con 0x7fda800b9000 2023-10-16T13:00:06.142 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.137+0000 7fda84f04700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda800d05d0 con 0x7fda800b5700 2023-10-16T13:00:06.142 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.137+0000 7fda7ed9d700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fda800b9000 0x7fda800ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:06.142 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.137+0000 7fda7e59c700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fda80160b50 0x7fda800b4ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:44220/0 (socket says 172.21.15.124:44220) 2023-10-16T13:00:06.142 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.137+0000 7fda7e59c700 1 -- 172.21.15.124:0/57898115 learned_addr learned my addr 172.21.15.124:0/57898115 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T13:00:06.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.137+0000 7fda7ed9d700 1 -- 172.21.15.124:0/57898115 >> v2:172.21.15.192:3300/0 conn(0x7fda800b5700 msgr2=0x7fda800cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:06.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.137+0000 7fda7ed9d700 1 --2- 172.21.15.124:0/57898115 >> v2:172.21.15.192:3300/0 conn(0x7fda800b5700 0x7fda800cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:06.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.137+0000 7fda7ed9d700 1 -- 172.21.15.124:0/57898115 >> v1:172.21.15.124:6789/0 conn(0x7fda80160b50 legacy=0x7fda800b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:06.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.137+0000 7fda7d59a700 1 -- 172.21.15.124:0/57898115 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2908790010 0 0) 0x7fda800d0010 con 0x7fda80160b50 2023-10-16T13:00:06.143 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.137+0000 7fda7ed9d700 1 -- 172.21.15.124:0/57898115 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda800ce160 con 0x7fda800b9000 2023-10-16T13:00:06.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.138+0000 7fda7ed9d700 1 --2- 172.21.15.124:0/57898115 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda800b9000 0x7fda800ce680 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fda80162290 tx=0x7fda70009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45a59ccbe1556fb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:06.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.138+0000 7fda7d59a700 1 -- 172.21.15.124:0/57898115 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda70011830 con 0x7fda800b9000 2023-10-16T13:00:06.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.138+0000 7fda7d59a700 1 -- 172.21.15.124:0/57898115 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda70011990 con 0x7fda800b9000 2023-10-16T13:00:06.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.138+0000 7fda7d59a700 1 -- 172.21.15.124:0/57898115 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda70011d20 con 0x7fda800b9000 2023-10-16T13:00:06.144 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.138+0000 7fda84f04700 1 -- 172.21.15.124:0/57898115 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda800b9000 msgr2=0x7fda800ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:06.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.138+0000 7fda84f04700 1 --2- 172.21.15.124:0/57898115 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda800b9000 0x7fda800ce680 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fda80162290 tx=0x7fda70009b20 comp rx=0 tx=0).stop 2023-10-16T13:00:06.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.138+0000 7fda84f04700 1 -- 172.21.15.124:0/57898115 shutdown_connections 2023-10-16T13:00:06.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.138+0000 7fda84f04700 1 --2- 172.21.15.124:0/57898115 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda800b9000 0x7fda800ce680 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:06.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.138+0000 7fda84f04700 1 --2- 172.21.15.124:0/57898115 >> v2:172.21.15.192:3300/0 conn(0x7fda800b5700 0x7fda800cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:06.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.138+0000 7fda84f04700 1 -- 172.21.15.124:0/57898115 >> 172.21.15.124:0/57898115 conn(0x7fda8006bc70 msgr2=0x7fda8006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:06.145 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.138+0000 7fda84f04700 1 -- 172.21.15.124:0/57898115 shutdown_connections 2023-10-16T13:00:06.146 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.138+0000 7fda84f04700 1 -- 172.21.15.124:0/57898115 wait complete. 2023-10-16T13:00:06.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.140+0000 7fda84f04700 1 Processor -- start 2023-10-16T13:00:06.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.140+0000 7fda84f04700 1 -- start start 2023-10-16T13:00:06.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.140+0000 7fda84f04700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda800b5700 0x7fda800c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:06.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.140+0000 7fda84f04700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda800b9000 0x7fda8015bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:06.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.140+0000 7fda84f04700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda80160b50 0x7fda8015c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:06.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.140+0000 7fda84f04700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda801f7250 con 0x7fda800b9000 2023-10-16T13:00:06.149 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.140+0000 7fda84f04700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda800cc8a0 con 0x7fda80160b50 2023-10-16T13:00:06.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.140+0000 7fda84f04700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda800ccb80 con 0x7fda800b5700 2023-10-16T13:00:06.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.140+0000 7fda7dd9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda800b9000 0x7fda8015bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:06.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.140+0000 7fda7dd9b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda800b9000 0x7fda8015bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55560/0 (socket says 172.21.15.124:55560) 2023-10-16T13:00:06.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.140+0000 7fda7dd9b700 1 -- 172.21.15.124:0/655901966 learned_addr learned my addr 172.21.15.124:0/655901966 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:06.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.141+0000 7fda7e59c700 1 --2- 172.21.15.124:0/655901966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda800b5700 0x7fda800c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:06.150 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.141+0000 7fda7ed9d700 1 --2- 172.21.15.124:0/655901966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda80160b50 0x7fda8015c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:06.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.141+0000 7fda7dd9b700 1 -- 172.21.15.124:0/655901966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda800b5700 msgr2=0x7fda800c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:06.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.141+0000 7fda7dd9b700 1 --2- 172.21.15.124:0/655901966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda800b5700 0x7fda800c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:06.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.141+0000 7fda7dd9b700 1 -- 172.21.15.124:0/655901966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda80160b50 msgr2=0x7fda8015c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:06.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.141+0000 7fda7dd9b700 1 --2- 172.21.15.124:0/655901966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda80160b50 0x7fda8015c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:06.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.141+0000 7fda7dd9b700 1 -- 172.21.15.124:0/655901966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda700094a0 con 0x7fda800b9000 2023-10-16T13:00:06.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.141+0000 7fda7ed9d700 1 --2- 172.21.15.124:0/655901966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda80160b50 0x7fda8015c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:00:06.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.141+0000 7fda7dd9b700 1 --2- 172.21.15.124:0/655901966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda800b9000 0x7fda8015bd40 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fda6800b4a0 tx=0x7fda6800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:06.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.141+0000 7fda76ffd700 1 -- 172.21.15.124:0/655901966 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68011830 con 0x7fda800b9000 2023-10-16T13:00:06.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.141+0000 7fda76ffd700 1 -- 172.21.15.124:0/655901966 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda68011990 con 0x7fda800b9000 2023-10-16T13:00:06.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.141+0000 7fda76ffd700 1 -- 172.21.15.124:0/655901966 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68011d40 con 0x7fda800b9000 2023-10-16T13:00:06.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.141+0000 7fda84f04700 1 -- 172.21.15.124:0/655901966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda800cce60 con 0x7fda800b9000 2023-10-16T13:00:06.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.141+0000 7fda84f04700 1 -- 172.21.15.124:0/655901966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda800cd380 con 0x7fda800b9000 2023-10-16T13:00:06.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.142+0000 7fda84f04700 1 -- 172.21.15.124:0/655901966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda800cd5a0 con 0x7fda800b9000 2023-10-16T13:00:06.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.143+0000 7fda76ffd700 1 -- 172.21.15.124:0/655901966 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fda6801a400 con 0x7fda800b9000 2023-10-16T13:00:06.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.143+0000 7fda76ffd700 1 --2- 172.21.15.124:0/655901966 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fda6006af00 0x7fda6006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:06.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.143+0000 7fda7e59c700 1 --2- 172.21.15.124:0/655901966 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fda6006af00 0x7fda6006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:06.154 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.143+0000 7fda76ffd700 1 -- 172.21.15.124:0/655901966 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fda680896c0 con 0x7fda800b9000 2023-10-16T13:00:06.154 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.143+0000 7fda7e59c700 1 --2- 172.21.15.124:0/655901966 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fda6006af00 0x7fda6006d3c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fda780012e0 tx=0x7fda78001b70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:06.154 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.148+0000 7fda76ffd700 1 -- 172.21.15.124:0/655901966 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fda68054640 con 0x7fda800b9000 2023-10-16T13:00:06.339 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.337+0000 7fda84f04700 1 -- 172.21.15.124:0/655901966 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda8004ebb0 con 0x7fda800b9000 2023-10-16T13:00:06.340 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.338+0000 7fda76ffd700 1 -- 172.21.15.124:0/655901966 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16787 (secure 0 0 0) 0x7fda68057c60 con 0x7fda800b9000 2023-10-16T13:00:06.341 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:00:06.341 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":37,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T13:00:05.023378+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:00:02.825330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-16T13:00:03.997396+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:00:06.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.340+0000 7fda84f04700 1 -- 172.21.15.124:0/655901966 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fda6006af00 msgr2=0x7fda6006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:06.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.340+0000 7fda84f04700 1 --2- 172.21.15.124:0/655901966 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fda6006af00 0x7fda6006d3c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fda780012e0 tx=0x7fda78001b70 comp rx=0 tx=0).stop 2023-10-16T13:00:06.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.340+0000 7fda84f04700 1 -- 172.21.15.124:0/655901966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda800b9000 msgr2=0x7fda8015bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:06.343 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.340+0000 7fda84f04700 1 --2- 172.21.15.124:0/655901966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda800b9000 0x7fda8015bd40 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fda6800b4a0 tx=0x7fda6800b7b0 comp rx=0 tx=0).stop 2023-10-16T13:00:06.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.340+0000 7fda84f04700 1 -- 172.21.15.124:0/655901966 shutdown_connections 2023-10-16T13:00:06.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.340+0000 7fda84f04700 1 --2- 172.21.15.124:0/655901966 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fda6006af00 0x7fda6006d3c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:06.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.340+0000 7fda84f04700 1 --2- 172.21.15.124:0/655901966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda80160b50 0x7fda8015c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:06.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.340+0000 7fda84f04700 1 --2- 172.21.15.124:0/655901966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda800b5700 0x7fda800c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:06.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.340+0000 7fda84f04700 1 --2- 172.21.15.124:0/655901966 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda800b9000 0x7fda8015bd40 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:06.344 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.340+0000 7fda84f04700 1 -- 172.21.15.124:0/655901966 >> 172.21.15.124:0/655901966 conn(0x7fda8006bc70 msgr2=0x7fda800cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:06.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.340+0000 7fda84f04700 1 -- 172.21.15.124:0/655901966 shutdown_connections 2023-10-16T13:00:06.345 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.340+0000 7fda84f04700 1 -- 172.21.15.124:0/655901966 wait complete. 2023-10-16T13:00:06.355 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-16T13:00:06.479 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.477+0000 7fa5e560a700 1 Processor -- start 2023-10-16T13:00:06.480 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.477+0000 7fa5e560a700 1 -- start start 2023-10-16T13:00:06.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.478+0000 7fa5e560a700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa5e015d860 0x7fa5e00cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:06.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.478+0000 7fa5e560a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa5e0161ec0 0x7fa5e00ce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:06.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.478+0000 7fa5e560a700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e006b230 con 0x7fa5e00c6e90 2023-10-16T13:00:06.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.478+0000 7fa5e560a700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e006b760 con 0x7fa5e015d860 2023-10-16T13:00:06.482 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.478+0000 7fa5e560a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e006b480 con 0x7fa5e0161ec0 2023-10-16T13:00:06.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.478+0000 7fa5deffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa5e015d860 0x7fa5e00cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:06.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.478+0000 7fa5de7fc700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fa5e00c6e90 0x7fa5e0071810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:44236/0 (socket says 172.21.15.124:44236) 2023-10-16T13:00:06.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.478+0000 7fa5de7fc700 1 -- 172.21.15.124:0/2875114215 learned_addr learned my addr 172.21.15.124:0/2875114215 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T13:00:06.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.478+0000 7fa5df7fe700 1 --2- 172.21.15.124:0/2875114215 >> v2:172.21.15.192:3300/0 conn(0x7fa5e0161ec0 0x7fa5e00ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:06.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.478+0000 7fa5deffd700 1 -- 172.21.15.124:0/2875114215 >> v2:172.21.15.192:3300/0 conn(0x7fa5e0161ec0 msgr2=0x7fa5e00ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:06.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.478+0000 7fa5deffd700 1 --2- 172.21.15.124:0/2875114215 >> v2:172.21.15.192:3300/0 conn(0x7fa5e0161ec0 0x7fa5e00ce320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:06.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.478+0000 7fa5deffd700 1 -- 172.21.15.124:0/2875114215 >> v1:172.21.15.124:6789/0 conn(0x7fa5e00c6e90 legacy=0x7fa5e0071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:06.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.478+0000 7fa5deffd700 1 -- 172.21.15.124:0/2875114215 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e01613e0 con 0x7fa5e015d860 2023-10-16T13:00:06.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.478+0000 7fa5ddffb700 1 -- 172.21.15.124:0/2875114215 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283594370 0 0) 0x7fa5e006b230 con 0x7fa5e00c6e90 2023-10-16T13:00:06.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.478+0000 7fa5deffd700 1 --2- 172.21.15.124:0/2875114215 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa5e015d860 0x7fa5e00cdde0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa5e00717a0 tx=0x7fa5d0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=552230149a7dc159 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:06.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.478+0000 7fa5ddffb700 1 -- 172.21.15.124:0/2875114215 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0011830 con 0x7fa5e015d860 2023-10-16T13:00:06.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.478+0000 7fa5ddffb700 1 -- 172.21.15.124:0/2875114215 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d0011990 con 0x7fa5e015d860 2023-10-16T13:00:06.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.478+0000 7fa5ddffb700 1 -- 172.21.15.124:0/2875114215 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0011d20 con 0x7fa5e015d860 2023-10-16T13:00:06.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.479+0000 7fa5e560a700 1 -- 172.21.15.124:0/2875114215 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa5e015d860 msgr2=0x7fa5e00cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:06.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.479+0000 7fa5e560a700 1 --2- 172.21.15.124:0/2875114215 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa5e015d860 0x7fa5e00cdde0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa5e00717a0 tx=0x7fa5d0009b20 comp rx=0 tx=0).stop 2023-10-16T13:00:06.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.479+0000 7fa5e560a700 1 -- 172.21.15.124:0/2875114215 shutdown_connections 2023-10-16T13:00:06.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.479+0000 7fa5e560a700 1 --2- 172.21.15.124:0/2875114215 >> v2:172.21.15.192:3300/0 conn(0x7fa5e0161ec0 0x7fa5e00ce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:06.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.479+0000 7fa5e560a700 1 --2- 172.21.15.124:0/2875114215 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa5e015d860 0x7fa5e00cdde0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:06.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.479+0000 7fa5e560a700 1 -- 172.21.15.124:0/2875114215 >> 172.21.15.124:0/2875114215 conn(0x7fa5e00ccc90 msgr2=0x7fa5e00cd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:06.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.479+0000 7fa5e560a700 1 -- 172.21.15.124:0/2875114215 shutdown_connections 2023-10-16T13:00:06.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.479+0000 7fa5e560a700 1 -- 172.21.15.124:0/2875114215 wait complete. 2023-10-16T13:00:06.489 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.480+0000 7fa5e560a700 1 Processor -- start 2023-10-16T13:00:06.489 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.480+0000 7fa5e560a700 1 -- start start 2023-10-16T13:00:06.489 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.481+0000 7fa5e560a700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa5e00c6e90 0x7fa5e00b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:06.489 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.481+0000 7fa5e560a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5e015d860 0x7fa5e00b5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:06.490 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.481+0000 7fa5e560a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5e0161ec0 0x7fa5e01f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:06.490 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.481+0000 7fa5e560a700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e01f2cf0 con 0x7fa5e00c6e90 2023-10-16T13:00:06.490 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.481+0000 7fa5e560a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e00b4520 con 0x7fa5e015d860 2023-10-16T13:00:06.490 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.481+0000 7fa5e560a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e00b4800 con 0x7fa5e0161ec0 2023-10-16T13:00:06.490 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.481+0000 7fa5deffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa5e00c6e90 0x7fa5e00b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:06.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.481+0000 7fa5deffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa5e00c6e90 0x7fa5e00b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55572/0 (socket says 172.21.15.124:55572) 2023-10-16T13:00:06.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.481+0000 7fa5deffd700 1 -- 172.21.15.124:0/2086722390 learned_addr learned my addr 172.21.15.124:0/2086722390 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:06.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.481+0000 7fa5deffd700 1 -- 172.21.15.124:0/2086722390 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5e0161ec0 msgr2=0x7fa5e01f27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:06.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.481+0000 7fa5deffd700 1 --2- 172.21.15.124:0/2086722390 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5e0161ec0 0x7fa5e01f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:06.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.481+0000 7fa5deffd700 1 -- 172.21.15.124:0/2086722390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5e015d860 msgr2=0x7fa5e00b5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:06.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.481+0000 7fa5deffd700 1 --2- 172.21.15.124:0/2086722390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5e015d860 0x7fa5e00b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:06.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.481+0000 7fa5deffd700 1 -- 172.21.15.124:0/2086722390 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d00094a0 con 0x7fa5e00c6e90 2023-10-16T13:00:06.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.481+0000 7fa5deffd700 1 --2- 172.21.15.124:0/2086722390 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa5e00c6e90 0x7fa5e00b3e90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa5d00090b0 tx=0x7fa5d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:06.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.482+0000 7fa5c77fe700 1 -- 172.21.15.124:0/2086722390 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d00038a0 con 0x7fa5e00c6e90 2023-10-16T13:00:06.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.482+0000 7fa5c77fe700 1 -- 172.21.15.124:0/2086722390 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d001f070 con 0x7fa5e00c6e90 2023-10-16T13:00:06.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.482+0000 7fa5c77fe700 1 -- 172.21.15.124:0/2086722390 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0003c20 con 0x7fa5e00c6e90 2023-10-16T13:00:06.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.482+0000 7fa5e560a700 1 -- 172.21.15.124:0/2086722390 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e00b4ae0 con 0x7fa5e00c6e90 2023-10-16T13:00:06.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.482+0000 7fa5e560a700 1 -- 172.21.15.124:0/2086722390 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e00b50a0 con 0x7fa5e00c6e90 2023-10-16T13:00:06.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.483+0000 7fa5e560a700 1 -- 172.21.15.124:0/2086722390 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e004ebb0 con 0x7fa5e00c6e90 2023-10-16T13:00:06.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.483+0000 7fa5c77fe700 1 -- 172.21.15.124:0/2086722390 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa5d001a430 con 0x7fa5e00c6e90 2023-10-16T13:00:06.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.484+0000 7fa5c77fe700 1 --2- 172.21.15.124:0/2086722390 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa5cc06af00 0x7fa5cc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:06.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.484+0000 7fa5c77fe700 1 -- 172.21.15.124:0/2086722390 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa5d0021070 con 0x7fa5e00c6e90 2023-10-16T13:00:06.494 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.484+0000 7fa5de7fc700 1 --2- 172.21.15.124:0/2086722390 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa5cc06af00 0x7fa5cc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:06.494 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.484+0000 7fa5de7fc700 1 --2- 172.21.15.124:0/2086722390 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa5cc06af00 0x7fa5cc06d3c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa5d40011e0 tx=0x7fa5d40079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:06.494 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.488+0000 7fa5c77fe700 1 -- 172.21.15.124:0/2086722390 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa5d0056440 con 0x7fa5e00c6e90 2023-10-16T13:00:06.729 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:06.727+0000 7fa5e560a700 1 -- 172.21.15.124:0/2086722390 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa5e00b6190 con 0x7fa5e00c6e90 2023-10-16T13:00:07.646 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.644+0000 7fa5c77fe700 1 -- 172.21.15.124:0/2086722390 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa5d0059a60 con 0x7fa5e00c6e90 2023-10-16T13:00:07.649 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.647+0000 7fa5e560a700 1 -- 172.21.15.124:0/2086722390 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa5cc06af00 msgr2=0x7fa5cc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:07.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.647+0000 7fa5e560a700 1 --2- 172.21.15.124:0/2086722390 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa5cc06af00 0x7fa5cc06d3c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa5d40011e0 tx=0x7fa5d40079b0 comp rx=0 tx=0).stop 2023-10-16T13:00:07.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.647+0000 7fa5e560a700 1 -- 172.21.15.124:0/2086722390 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa5e00c6e90 msgr2=0x7fa5e00b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:07.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.647+0000 7fa5e560a700 1 --2- 172.21.15.124:0/2086722390 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa5e00c6e90 0x7fa5e00b3e90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa5d00090b0 tx=0x7fa5d0004750 comp rx=0 tx=0).stop 2023-10-16T13:00:07.650 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.647+0000 7fa5e560a700 1 -- 172.21.15.124:0/2086722390 shutdown_connections 2023-10-16T13:00:07.651 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.647+0000 7fa5e560a700 1 --2- 172.21.15.124:0/2086722390 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa5cc06af00 0x7fa5cc06d3c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:07.651 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.647+0000 7fa5e560a700 1 --2- 172.21.15.124:0/2086722390 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5e0161ec0 0x7fa5e01f27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:07.651 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.647+0000 7fa5e560a700 1 --2- 172.21.15.124:0/2086722390 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa5e00c6e90 0x7fa5e00b3e90 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:07.651 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.647+0000 7fa5e560a700 1 --2- 172.21.15.124:0/2086722390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5e015d860 0x7fa5e00b5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:07.651 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.647+0000 7fa5e560a700 1 -- 172.21.15.124:0/2086722390 >> 172.21.15.124:0/2086722390 conn(0x7fa5e00ccc90 msgr2=0x7fa5e00cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:07.652 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.647+0000 7fa5e560a700 1 -- 172.21.15.124:0/2086722390 shutdown_connections 2023-10-16T13:00:07.652 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.647+0000 7fa5e560a700 1 -- 172.21.15.124:0/2086722390 wait complete. 2023-10-16T13:00:07.666 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-16T13:00:07.667 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-16T13:00:07.795 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.793+0000 7f74ad443700 1 Processor -- start 2023-10-16T13:00:07.796 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.793+0000 7f74ad443700 1 -- start start 2023-10-16T13:00:07.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.794+0000 7f74ad443700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f74a80b27b0 0x7f74a80c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:07.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.794+0000 7f74ad443700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a80ca880 con 0x7f74a80ca450 2023-10-16T13:00:07.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.794+0000 7f74ad443700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a8161880 con 0x7f74a815dd10 2023-10-16T13:00:07.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.794+0000 7f74ad443700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a8162500 con 0x7f74a80b27b0 2023-10-16T13:00:07.799 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.794+0000 7f74a77fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f74a80ca450 0x7f74a806a9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:44252/0 (socket says 172.21.15.124:44252) 2023-10-16T13:00:07.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.794+0000 7f74a77fe700 1 -- 172.21.15.124:0/3325920793 learned_addr learned my addr 172.21.15.124:0/3325920793 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T13:00:07.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.794+0000 7f74a5ffb700 1 -- 172.21.15.124:0/3325920793 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122391712 0 0) 0x7f74a80ca880 con 0x7f74a80ca450 2023-10-16T13:00:07.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.794+0000 7f74a67fc700 1 --2- 172.21.15.124:0/3325920793 >> v2:172.21.15.192:3300/0 conn(0x7f74a80b27b0 0x7f74a80c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:07.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.794+0000 7f74a5ffb700 1 -- 172.21.15.124:0/3325920793 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74900035b0 con 0x7f74a80ca450 2023-10-16T13:00:07.800 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.794+0000 7f74a5ffb700 1 -- 172.21.15.124:0/3325920793 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 744582455 0 0) 0x7f74900035b0 con 0x7f74a80ca450 2023-10-16T13:00:07.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.794+0000 7f74a5ffb700 1 -- 172.21.15.124:0/3325920793 >> v2:172.21.15.192:3300/0 conn(0x7f74a80b27b0 msgr2=0x7f74a80c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:07.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.794+0000 7f74a5ffb700 1 --2- 172.21.15.124:0/3325920793 >> v2:172.21.15.192:3300/0 conn(0x7f74a80b27b0 0x7f74a80c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:07.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.794+0000 7f74a5ffb700 1 -- 172.21.15.124:0/3325920793 >> v1:172.21.15.192:6789/0 conn(0x7f74a815dd10 legacy=0x7f74a806bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:07.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.794+0000 7f74a5ffb700 1 -- 172.21.15.124:0/3325920793 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a8161b60 con 0x7f74a80ca450 2023-10-16T13:00:07.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.794+0000 7f74a5ffb700 1 -- 172.21.15.124:0/3325920793 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f74a00019f0 con 0x7f74a80ca450 2023-10-16T13:00:07.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.795+0000 7f74a5ffb700 1 -- 172.21.15.124:0/3325920793 >> v1:172.21.15.124:6789/0 conn(0x7f74a80ca450 legacy=0x7f74a806a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:07.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.795+0000 7f74a5ffb700 1 --2- 172.21.15.124:0/3325920793 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7490003a00 0x7f7490003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:07.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.795+0000 7f74a5ffb700 1 --2- 172.21.15.124:0/3325920793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7490004850 0x7f7490004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:07.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.795+0000 7f74a5ffb700 1 --2- 172.21.15.124:0/3325920793 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7490005210 0x7f749000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:07.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.795+0000 7f74a5ffb700 1 -- 172.21.15.124:0/3325920793 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a8162500 con 0x7f7490005210 2023-10-16T13:00:07.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.795+0000 7f74a5ffb700 1 -- 172.21.15.124:0/3325920793 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749000c0b0 con 0x7f7490004850 2023-10-16T13:00:07.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.795+0000 7f74a5ffb700 1 -- 172.21.15.124:0/3325920793 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749000c270 con 0x7f7490003a00 2023-10-16T13:00:07.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.795+0000 7f74a77fe700 1 --2- 172.21.15.124:0/3325920793 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7490005210 0x7f749000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:07.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.795+0000 7f74a6ffd700 1 --2- 172.21.15.124:0/3325920793 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7490003a00 0x7f7490003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:07.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.795+0000 7f74a67fc700 1 --2- 172.21.15.124:0/3325920793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7490004850 0x7f7490004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:07.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.795+0000 7f74a77fe700 1 -- 172.21.15.124:0/3325920793 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7490003a00 msgr2=0x7f7490003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:07.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.795+0000 7f74a77fe700 1 --2- 172.21.15.124:0/3325920793 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7490003a00 0x7f7490003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:07.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.795+0000 7f74a77fe700 1 -- 172.21.15.124:0/3325920793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7490004850 msgr2=0x7f7490004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:07.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.795+0000 7f74a77fe700 1 --2- 172.21.15.124:0/3325920793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7490004850 0x7f7490004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:07.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.795+0000 7f74a77fe700 1 -- 172.21.15.124:0/3325920793 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74900035b0 con 0x7f7490005210 2023-10-16T13:00:07.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.795+0000 7f74a6ffd700 1 --2- 172.21.15.124:0/3325920793 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7490003a00 0x7f7490003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:00:07.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.795+0000 7f74a77fe700 1 -- 172.21.15.124:0/3325920793 reap_dead start 2023-10-16T13:00:07.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.795+0000 7f74a77fe700 1 --2- 172.21.15.124:0/3325920793 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7490005210 0x7f749000ba10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f74a000a830 tx=0x7f7490005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f65ddd3341f469 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:07.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.795+0000 7f74a5ffb700 1 -- 172.21.15.124:0/3325920793 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a000a2f0 con 0x7f7490005210 2023-10-16T13:00:07.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.795+0000 7f74a5ffb700 1 -- 172.21.15.124:0/3325920793 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a0012600 con 0x7f7490005210 2023-10-16T13:00:07.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.795+0000 7f74a5ffb700 1 -- 172.21.15.124:0/3325920793 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a00129b0 con 0x7f7490005210 2023-10-16T13:00:07.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.796+0000 7f74ad443700 1 -- 172.21.15.124:0/3325920793 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7490005210 msgr2=0x7f749000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:07.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.796+0000 7f74ad443700 1 --2- 172.21.15.124:0/3325920793 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7490005210 0x7f749000ba10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f74a000a830 tx=0x7f7490005880 comp rx=0 tx=0).stop 2023-10-16T13:00:07.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.796+0000 7f74ad443700 1 -- 172.21.15.124:0/3325920793 shutdown_connections 2023-10-16T13:00:07.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.796+0000 7f74ad443700 1 --2- 172.21.15.124:0/3325920793 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7490005210 0x7f749000ba10 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:07.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.796+0000 7f74ad443700 1 -- 172.21.15.124:0/3325920793 >> 172.21.15.124:0/3325920793 conn(0x7f74a80cfaa0 msgr2=0x7f74a80cfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:07.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.796+0000 7f74ad443700 1 -- 172.21.15.124:0/3325920793 shutdown_connections 2023-10-16T13:00:07.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.796+0000 7f74ad443700 1 -- 172.21.15.124:0/3325920793 wait complete. 2023-10-16T13:00:07.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.797+0000 7f74ad443700 1 Processor -- start 2023-10-16T13:00:07.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.797+0000 7f74ad443700 1 -- start start 2023-10-16T13:00:07.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.798+0000 7f74ad443700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7490005210 0x7f74a815f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:07.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.798+0000 7f74ad443700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74a80b3c10 0x7f74a80c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:07.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.798+0000 7f74ad443700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f74a815ca20 0x7f74a815cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:07.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.798+0000 7f74ad443700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a815d3e0 con 0x7f74a815ca20 2023-10-16T13:00:07.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.798+0000 7f74ad443700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a815fba0 con 0x7f74a80b3c10 2023-10-16T13:00:07.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.798+0000 7f74ad443700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a8151660 con 0x7f7490005210 2023-10-16T13:00:07.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.798+0000 7f74a77fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f74a815ca20 0x7f74a815cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:07.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.798+0000 7f74a77fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f74a815ca20 0x7f74a815cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55594/0 (socket says 172.21.15.124:55594) 2023-10-16T13:00:07.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.798+0000 7f74a77fe700 1 -- 172.21.15.124:0/3938210553 learned_addr learned my addr 172.21.15.124:0/3938210553 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:07.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.798+0000 7f74a67fc700 1 --2- 172.21.15.124:0/3938210553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74a80b3c10 0x7f74a80c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:07.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.798+0000 7f74a77fe700 1 -- 172.21.15.124:0/3938210553 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7490005210 msgr2=0x7f74a815f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:07.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.798+0000 7f74a6ffd700 1 --2- 172.21.15.124:0/3938210553 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7490005210 0x7f74a815f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:07.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.798+0000 7f74a77fe700 1 --2- 172.21.15.124:0/3938210553 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7490005210 0x7f74a815f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:07.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.798+0000 7f74a77fe700 1 -- 172.21.15.124:0/3938210553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74a80b3c10 msgr2=0x7f74a80c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:07.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.798+0000 7f74a77fe700 1 --2- 172.21.15.124:0/3938210553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74a80b3c10 0x7f74a80c5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:07.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.798+0000 7f74a77fe700 1 -- 172.21.15.124:0/3938210553 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a80c5b50 con 0x7f74a815ca20 2023-10-16T13:00:07.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.798+0000 7f74a67fc700 1 --2- 172.21.15.124:0/3938210553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74a80b3c10 0x7f74a80c5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:00:07.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.798+0000 7f74a6ffd700 1 --2- 172.21.15.124:0/3938210553 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7490005210 0x7f74a815f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:00:07.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.798+0000 7f74a77fe700 1 --2- 172.21.15.124:0/3938210553 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f74a815ca20 0x7f74a815cea0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f74a000ae20 tx=0x7f74a0001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:07.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.799+0000 7f748f7fe700 1 -- 172.21.15.124:0/3938210553 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a00017b0 con 0x7f74a815ca20 2023-10-16T13:00:07.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.799+0000 7f748f7fe700 1 -- 172.21.15.124:0/3938210553 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a0001910 con 0x7f74a815ca20 2023-10-16T13:00:07.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.799+0000 7f74ad443700 1 -- 172.21.15.124:0/3938210553 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a815fdf0 con 0x7f74a815ca20 2023-10-16T13:00:07.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.799+0000 7f748f7fe700 1 -- 172.21.15.124:0/3938210553 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a001d640 con 0x7f74a815ca20 2023-10-16T13:00:07.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.799+0000 7f74ad443700 1 -- 172.21.15.124:0/3938210553 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a81603b0 con 0x7f74a815ca20 2023-10-16T13:00:07.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.800+0000 7f74ad443700 1 -- 172.21.15.124:0/3938210553 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a804ebb0 con 0x7f74a815ca20 2023-10-16T13:00:07.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.800+0000 7f748f7fe700 1 -- 172.21.15.124:0/3938210553 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f74a001d7a0 con 0x7f74a815ca20 2023-10-16T13:00:07.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.800+0000 7f748f7fe700 1 --2- 172.21.15.124:0/3938210553 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f749406af00 0x7f749406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:07.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.801+0000 7f748f7fe700 1 -- 172.21.15.124:0/3938210553 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f74a008b830 con 0x7f74a815ca20 2023-10-16T13:00:07.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.801+0000 7f74a6ffd700 1 --2- 172.21.15.124:0/3938210553 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f749406af00 0x7f749406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:07.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.801+0000 7f74a6ffd700 1 --2- 172.21.15.124:0/3938210553 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f749406af00 0x7f749406d3c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f749c000c00 tx=0x7f749c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:07.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:07.805+0000 7f748f7fe700 1 -- 172.21.15.124:0/3938210553 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f74a0056950 con 0x7f74a815ca20 2023-10-16T13:00:08.045 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.042+0000 7f74ad443700 1 -- 172.21.15.124:0/3938210553 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f74a80cee10 con 0x7f74a815ca20 2023-10-16T13:00:08.654 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.652+0000 7f748f7fe700 1 -- 172.21.15.124:0/3938210553 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f74a0059f70 con 0x7f74a815ca20 2023-10-16T13:00:08.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.654+0000 7f74ad443700 1 -- 172.21.15.124:0/3938210553 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f749406af00 msgr2=0x7f749406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:08.657 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.654+0000 7f74ad443700 1 --2- 172.21.15.124:0/3938210553 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f749406af00 0x7f749406d3c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f749c000c00 tx=0x7f749c009040 comp rx=0 tx=0).stop 2023-10-16T13:00:08.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.654+0000 7f74ad443700 1 -- 172.21.15.124:0/3938210553 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f74a815ca20 msgr2=0x7f74a815cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:08.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.654+0000 7f74ad443700 1 --2- 172.21.15.124:0/3938210553 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f74a815ca20 0x7f74a815cea0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f74a000ae20 tx=0x7f74a0001d80 comp rx=0 tx=0).stop 2023-10-16T13:00:08.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.654+0000 7f74ad443700 1 -- 172.21.15.124:0/3938210553 shutdown_connections 2023-10-16T13:00:08.658 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.654+0000 7f74ad443700 1 --2- 172.21.15.124:0/3938210553 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f749406af00 0x7f749406d3c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:08.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.654+0000 7f74ad443700 1 --2- 172.21.15.124:0/3938210553 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f74a815ca20 0x7f74a815cea0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:08.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.654+0000 7f74ad443700 1 --2- 172.21.15.124:0/3938210553 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7490005210 0x7f74a815f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:08.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.654+0000 7f74ad443700 1 --2- 172.21.15.124:0/3938210553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74a80b3c10 0x7f74a80c5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:08.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.654+0000 7f74ad443700 1 -- 172.21.15.124:0/3938210553 >> 172.21.15.124:0/3938210553 conn(0x7f74a80cfaa0 msgr2=0x7f74a815c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:08.659 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.654+0000 7f74ad443700 1 -- 172.21.15.124:0/3938210553 shutdown_connections 2023-10-16T13:00:08.660 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.655+0000 7f74ad443700 1 -- 172.21.15.124:0/3938210553 wait complete. 2023-10-16T13:00:08.670 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-16T13:00:08.671 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:00:08.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.790+0000 7fa79b7a7700 1 Processor -- start 2023-10-16T13:00:08.793 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.791+0000 7fa79b7a7700 1 -- start start 2023-10-16T13:00:08.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.791+0000 7fa79b7a7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7940cd570 0x7fa7940cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:08.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.791+0000 7fa79b7a7700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7940cbe10 con 0x7fa7940b3410 2023-10-16T13:00:08.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.791+0000 7fa79b7a7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa794070d70 con 0x7fa794152470 2023-10-16T13:00:08.802 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.791+0000 7fa79b7a7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940cda20 con 0x7fa7940cd570 2023-10-16T13:00:08.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa798d42700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fa7940b3410 0x7fa7940b60f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:44268/0 (socket says 172.21.15.124:44268) 2023-10-16T13:00:08.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa798d42700 1 -- 172.21.15.124:0/3774471364 learned_addr learned my addr 172.21.15.124:0/3774471364 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T13:00:08.803 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa799d44700 1 --2- 172.21.15.124:0/3774471364 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7940cd570 0x7fa7940cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:08.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa78bfff700 1 -- 172.21.15.124:0/3774471364 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817888892 0 0) 0x7fa7940cbe10 con 0x7fa7940b3410 2023-10-16T13:00:08.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa78bfff700 1 -- 172.21.15.124:0/3774471364 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7800035b0 con 0x7fa7940b3410 2023-10-16T13:00:08.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa78bfff700 1 -- 172.21.15.124:0/3774471364 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1345733229 0 0) 0x7fa794070d70 con 0x7fa794152470 2023-10-16T13:00:08.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa78bfff700 1 -- 172.21.15.124:0/3774471364 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7940cbe10 con 0x7fa794152470 2023-10-16T13:00:08.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa78bfff700 1 -- 172.21.15.124:0/3774471364 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3925139485 0 0) 0x7fa7800035b0 con 0x7fa7940b3410 2023-10-16T13:00:08.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa78bfff700 1 -- 172.21.15.124:0/3774471364 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7940cd570 msgr2=0x7fa7940cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:08.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa78bfff700 1 --2- 172.21.15.124:0/3774471364 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7940cd570 0x7fa7940cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:08.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa78bfff700 1 -- 172.21.15.124:0/3774471364 >> v1:172.21.15.192:6789/0 conn(0x7fa794152470 legacy=0x7fa7940b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:08.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa78bfff700 1 -- 172.21.15.124:0/3774471364 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79415c990 con 0x7fa7940b3410 2023-10-16T13:00:08.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa78bfff700 1 -- 172.21.15.124:0/3774471364 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7fa790001670 con 0x7fa7940b3410 2023-10-16T13:00:08.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa78bfff700 1 -- 172.21.15.124:0/3774471364 >> v1:172.21.15.124:6789/0 conn(0x7fa7940b3410 legacy=0x7fa7940b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:08.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa78bfff700 1 --2- 172.21.15.124:0/3774471364 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa780003bc0 0x7fa780003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:08.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa78bfff700 1 --2- 172.21.15.124:0/3774471364 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7940cd570 0x7fa780004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:08.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa78bfff700 1 --2- 172.21.15.124:0/3774471364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa780004d90 0x7fa780005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:08.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa78bfff700 1 -- 172.21.15.124:0/3774471364 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940cda20 con 0x7fa780003bc0 2023-10-16T13:00:08.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa78bfff700 1 -- 172.21.15.124:0/3774471364 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78000bbd0 con 0x7fa780004d90 2023-10-16T13:00:08.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa78bfff700 1 -- 172.21.15.124:0/3774471364 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78000bd90 con 0x7fa7940cd570 2023-10-16T13:00:08.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa799543700 1 --2- 172.21.15.124:0/3774471364 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa780003bc0 0x7fa780003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:08.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa798d42700 1 --2- 172.21.15.124:0/3774471364 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7940cd570 0x7fa780004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:08.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa799d44700 1 --2- 172.21.15.124:0/3774471364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa780004d90 0x7fa780005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:08.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa799543700 1 -- 172.21.15.124:0/3774471364 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7940cd570 msgr2=0x7fa780004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:08.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.792+0000 7fa799543700 1 --2- 172.21.15.124:0/3774471364 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7940cd570 0x7fa780004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:08.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.793+0000 7fa799543700 1 -- 172.21.15.124:0/3774471364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa780004d90 msgr2=0x7fa780005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:08.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.793+0000 7fa799543700 1 --2- 172.21.15.124:0/3774471364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa780004d90 0x7fa780005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:08.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.793+0000 7fa799543700 1 -- 172.21.15.124:0/3774471364 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7800035b0 con 0x7fa780003bc0 2023-10-16T13:00:08.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.793+0000 7fa799d44700 1 --2- 172.21.15.124:0/3774471364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa780004d90 0x7fa780005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:00:08.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.793+0000 7fa799543700 1 --2- 172.21.15.124:0/3774471364 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa780003bc0 0x7fa780003fc0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa784001980 tx=0x7fa780005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0fd17f5ec92998 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:08.811 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.793+0000 7fa78bfff700 1 -- 172.21.15.124:0/3774471364 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa784001470 con 0x7fa780003bc0 2023-10-16T13:00:08.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.793+0000 7fa78bfff700 1 -- 172.21.15.124:0/3774471364 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7840052d0 con 0x7fa780003bc0 2023-10-16T13:00:08.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.793+0000 7fa78bfff700 1 -- 172.21.15.124:0/3774471364 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa784003680 con 0x7fa780003bc0 2023-10-16T13:00:08.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.793+0000 7fa79b7a7700 1 -- 172.21.15.124:0/3774471364 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa780003bc0 msgr2=0x7fa780003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:08.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.793+0000 7fa79b7a7700 1 --2- 172.21.15.124:0/3774471364 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa780003bc0 0x7fa780003fc0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa784001980 tx=0x7fa780005880 comp rx=0 tx=0).stop 2023-10-16T13:00:08.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.793+0000 7fa799d44700 1 -- 172.21.15.124:0/3774471364 reap_dead start 2023-10-16T13:00:08.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.793+0000 7fa79b7a7700 1 -- 172.21.15.124:0/3774471364 shutdown_connections 2023-10-16T13:00:08.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.793+0000 7fa79b7a7700 1 -- 172.21.15.124:0/3774471364 >> 172.21.15.124:0/3774471364 conn(0x7fa7940cdd00 msgr2=0x7fa7940ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:08.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.793+0000 7fa79b7a7700 1 -- 172.21.15.124:0/3774471364 shutdown_connections 2023-10-16T13:00:08.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.793+0000 7fa79b7a7700 1 -- 172.21.15.124:0/3774471364 wait complete. 2023-10-16T13:00:08.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.795+0000 7fa79b7a7700 1 Processor -- start 2023-10-16T13:00:08.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.795+0000 7fa79b7a7700 1 -- start start 2023-10-16T13:00:08.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.795+0000 7fa79b7a7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa780003bc0 0x7fa7940c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:08.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.795+0000 7fa79b7a7700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa79414e5c0 0x7fa79414f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:08.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.795+0000 7fa79b7a7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa79414f670 0x7fa79414fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:08.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.795+0000 7fa79b7a7700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa794155910 con 0x7fa79414e5c0 2023-10-16T13:00:08.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.795+0000 7fa79b7a7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940c7d80 con 0x7fa780003bc0 2023-10-16T13:00:08.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.795+0000 7fa79b7a7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940c52c0 con 0x7fa79414f670 2023-10-16T13:00:08.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.795+0000 7fa798d42700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa79414e5c0 0x7fa79414f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:08.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.795+0000 7fa798d42700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa79414e5c0 0x7fa79414f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55614/0 (socket says 172.21.15.124:55614) 2023-10-16T13:00:08.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.795+0000 7fa798d42700 1 -- 172.21.15.124:0/3864371050 learned_addr learned my addr 172.21.15.124:0/3864371050 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:08.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.796+0000 7fa799543700 1 --2- 172.21.15.124:0/3864371050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa780003bc0 0x7fa7940c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:08.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.796+0000 7fa799d44700 1 --2- 172.21.15.124:0/3864371050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa79414f670 0x7fa79414fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:08.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.796+0000 7fa798d42700 1 -- 172.21.15.124:0/3864371050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa79414f670 msgr2=0x7fa79414fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:08.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.796+0000 7fa798d42700 1 --2- 172.21.15.124:0/3864371050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa79414f670 0x7fa79414fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:08.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.796+0000 7fa798d42700 1 -- 172.21.15.124:0/3864371050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa780003bc0 msgr2=0x7fa7940c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:08.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.796+0000 7fa798d42700 1 --2- 172.21.15.124:0/3864371050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa780003bc0 0x7fa7940c7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:08.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.796+0000 7fa798d42700 1 -- 172.21.15.124:0/3864371050 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa794155350 con 0x7fa79414e5c0 2023-10-16T13:00:08.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.796+0000 7fa798d42700 1 --2- 172.21.15.124:0/3864371050 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa79414e5c0 0x7fa79414f130 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa790007370 tx=0x7fa790007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:08.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.796+0000 7fa789ffb700 1 -- 172.21.15.124:0/3864371050 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7900077b0 con 0x7fa79414e5c0 2023-10-16T13:00:08.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.796+0000 7fa789ffb700 1 -- 172.21.15.124:0/3864371050 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79000f870 con 0x7fa79414e5c0 2023-10-16T13:00:08.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.796+0000 7fa79b7a7700 1 -- 172.21.15.124:0/3864371050 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa794155630 con 0x7fa79414e5c0 2023-10-16T13:00:08.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.796+0000 7fa789ffb700 1 -- 172.21.15.124:0/3864371050 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79000fc20 con 0x7fa79414e5c0 2023-10-16T13:00:08.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.796+0000 7fa79b7a7700 1 -- 172.21.15.124:0/3864371050 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa79414ea40 con 0x7fa79414e5c0 2023-10-16T13:00:08.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.797+0000 7fa79b7a7700 1 -- 172.21.15.124:0/3864371050 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7940c5430 con 0x7fa79414e5c0 2023-10-16T13:00:08.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.798+0000 7fa789ffb700 1 -- 172.21.15.124:0/3864371050 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa79000fd80 con 0x7fa79414e5c0 2023-10-16T13:00:08.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.798+0000 7fa789ffb700 1 --2- 172.21.15.124:0/3864371050 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa77806af00 0x7fa77806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:08.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.798+0000 7fa789ffb700 1 -- 172.21.15.124:0/3864371050 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa790089750 con 0x7fa79414e5c0 2023-10-16T13:00:08.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.798+0000 7fa799543700 1 --2- 172.21.15.124:0/3864371050 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa77806af00 0x7fa77806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:08.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.798+0000 7fa799543700 1 --2- 172.21.15.124:0/3864371050 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa77806af00 0x7fa77806d3c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa784015040 tx=0x7fa78400a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:08.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:08.802+0000 7fa789ffb700 1 -- 172.21.15.124:0/3864371050 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa7900546c0 con 0x7fa79414e5c0 2023-10-16T13:00:09.039 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.036+0000 7fa79b7a7700 1 -- 172.21.15.124:0/3864371050 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7940c4d50 con 0x7fa79414e5c0 2023-10-16T13:00:09.040 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.037+0000 7fa789ffb700 1 -- 172.21.15.124:0/3864371050 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4922 (secure 0 0 0) 0x7fa790057ce0 con 0x7fa79414e5c0 2023-10-16T13:00:09.040 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:00:09.040 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6834/726195736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":726195736},{"type":"v1","addr":"172.21.15.192:6834","nonce":726195736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5334,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/2901678317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":2901678317},{"type":"v1","addr":"172.21.15.124:6836","nonce":2901678317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1705548477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":1705548477},{"type":"v1","addr":"172.21.15.124:6837","nonce":1705548477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:00:05.023759+0000","modified":"2023-10-16T13:00:08.044473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5352":{"gid":5352,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.192:6835/1442186653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6833","nonce":1442186653},{"type":"v1","addr":"172.21.15.192:6835","nonce":1442186653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-16T13:00:09.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.039+0000 7fa79b7a7700 1 -- 172.21.15.124:0/3864371050 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa77806af00 msgr2=0x7fa77806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:09.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.039+0000 7fa79b7a7700 1 --2- 172.21.15.124:0/3864371050 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa77806af00 0x7fa77806d3c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa784015040 tx=0x7fa78400a000 comp rx=0 tx=0).stop 2023-10-16T13:00:09.042 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.039+0000 7fa79b7a7700 1 -- 172.21.15.124:0/3864371050 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa79414e5c0 msgr2=0x7fa79414f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:09.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.039+0000 7fa79b7a7700 1 --2- 172.21.15.124:0/3864371050 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa79414e5c0 0x7fa79414f130 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa790007370 tx=0x7fa790007680 comp rx=0 tx=0).stop 2023-10-16T13:00:09.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.039+0000 7fa79b7a7700 1 -- 172.21.15.124:0/3864371050 shutdown_connections 2023-10-16T13:00:09.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.039+0000 7fa79b7a7700 1 --2- 172.21.15.124:0/3864371050 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa77806af00 0x7fa77806d3c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.039+0000 7fa79b7a7700 1 --2- 172.21.15.124:0/3864371050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa79414f670 0x7fa79414fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.039+0000 7fa79b7a7700 1 --2- 172.21.15.124:0/3864371050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa780003bc0 0x7fa7940c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.039+0000 7fa79b7a7700 1 --2- 172.21.15.124:0/3864371050 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa79414e5c0 0x7fa79414f130 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.039+0000 7fa79b7a7700 1 -- 172.21.15.124:0/3864371050 >> 172.21.15.124:0/3864371050 conn(0x7fa7940cdd00 msgr2=0x7fa7940cee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:09.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.039+0000 7fa79b7a7700 1 -- 172.21.15.124:0/3864371050 shutdown_connections 2023-10-16T13:00:09.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.039+0000 7fa79b7a7700 1 -- 172.21.15.124:0/3864371050 wait complete. 2023-10-16T13:00:09.045 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 17 2023-10-16T13:00:09.055 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T13:00:09.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.172+0000 7f5993e10700 1 Processor -- start 2023-10-16T13:00:09.175 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.172+0000 7f5993e10700 1 -- start start 2023-10-16T13:00:09.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.173+0000 7f5993e10700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f598c0cf7d0 0x7f598c15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:09.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.173+0000 7f5993e10700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f598c0cfeb0 con 0x7f598c0ca7d0 2023-10-16T13:00:09.178 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.173+0000 7f5993e10700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f598c0cfc30 con 0x7f598c06a820 2023-10-16T13:00:09.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.173+0000 7f5993e10700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f598c0ce410 con 0x7f598c0cf7d0 2023-10-16T13:00:09.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.173+0000 7f59913ab700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f598c0cf7d0 0x7f598c15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:09.179 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.173+0000 7f59923ad700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f598c0ca7d0 0x7f598c071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:44292/0 (socket says 172.21.15.124:44292) 2023-10-16T13:00:09.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.173+0000 7f59923ad700 1 -- 172.21.15.124:0/767011868 learned_addr learned my addr 172.21.15.124:0/767011868 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T13:00:09.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.174+0000 7f59913ab700 1 -- 172.21.15.124:0/767011868 >> v1:172.21.15.192:6789/0 conn(0x7f598c06a820 legacy=0x7f598c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:09.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.174+0000 7f59913ab700 1 -- 172.21.15.124:0/767011868 >> v1:172.21.15.124:6789/0 conn(0x7f598c0ca7d0 legacy=0x7f598c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:09.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.174+0000 7f5990baa700 1 -- 172.21.15.124:0/767011868 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1002976879 0 0) 0x7f598c0cfeb0 con 0x7f598c0ca7d0 2023-10-16T13:00:09.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.174+0000 7f59913ab700 1 -- 172.21.15.124:0/767011868 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598c0af9d0 con 0x7f598c0cf7d0 2023-10-16T13:00:09.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.174+0000 7f59913ab700 1 --2- 172.21.15.124:0/767011868 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f598c0cf7d0 0x7f598c15e7f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5988009840 tx=0x7f5988009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9c9072f92ef4fe server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:09.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.174+0000 7f5990baa700 1 -- 172.21.15.124:0/767011868 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988004230 con 0x7f598c0cf7d0 2023-10-16T13:00:09.181 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.174+0000 7f5990baa700 1 -- 172.21.15.124:0/767011868 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5988004390 con 0x7f598c0cf7d0 2023-10-16T13:00:09.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.174+0000 7f5990baa700 1 -- 172.21.15.124:0/767011868 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59880036a0 con 0x7f598c0cf7d0 2023-10-16T13:00:09.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.174+0000 7f5993e10700 1 -- 172.21.15.124:0/767011868 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f598c0cf7d0 msgr2=0x7f598c15e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:09.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.174+0000 7f5993e10700 1 --2- 172.21.15.124:0/767011868 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f598c0cf7d0 0x7f598c15e7f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5988009840 tx=0x7f5988009b50 comp rx=0 tx=0).stop 2023-10-16T13:00:09.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.175+0000 7f5993e10700 1 -- 172.21.15.124:0/767011868 shutdown_connections 2023-10-16T13:00:09.182 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.175+0000 7f5993e10700 1 --2- 172.21.15.124:0/767011868 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f598c0cf7d0 0x7f598c15e7f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.175+0000 7f5993e10700 1 -- 172.21.15.124:0/767011868 >> 172.21.15.124:0/767011868 conn(0x7f598c0d0180 msgr2=0x7f598c0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:09.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.175+0000 7f5993e10700 1 -- 172.21.15.124:0/767011868 shutdown_connections 2023-10-16T13:00:09.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.175+0000 7f5993e10700 1 -- 172.21.15.124:0/767011868 wait complete. 2023-10-16T13:00:09.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.176+0000 7f5993e10700 1 Processor -- start 2023-10-16T13:00:09.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.176+0000 7f5993e10700 1 -- start start 2023-10-16T13:00:09.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.176+0000 7f5993e10700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f598c06a820 0x7f598c0b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:09.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.176+0000 7f5993e10700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f598c0ca7d0 0x7f598c14b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:09.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.177+0000 7f5993e10700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f598c0cf7d0 0x7f598c14b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:09.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.177+0000 7f5993e10700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598c0afbe0 con 0x7f598c0ca7d0 2023-10-16T13:00:09.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.177+0000 7f5993e10700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598c0c4460 con 0x7f598c06a820 2023-10-16T13:00:09.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.177+0000 7f5993e10700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598c0c48a0 con 0x7f598c0cf7d0 2023-10-16T13:00:09.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.177+0000 7f59913ab700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f598c0ca7d0 0x7f598c14b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:09.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.177+0000 7f59913ab700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f598c0ca7d0 0x7f598c14b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55628/0 (socket says 172.21.15.124:55628) 2023-10-16T13:00:09.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.177+0000 7f59913ab700 1 -- 172.21.15.124:0/108948963 learned_addr learned my addr 172.21.15.124:0/108948963 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:09.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.177+0000 7f5991bac700 1 --2- 172.21.15.124:0/108948963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f598c06a820 0x7f598c0b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:09.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.177+0000 7f59923ad700 1 --2- 172.21.15.124:0/108948963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f598c0cf7d0 0x7f598c14b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:09.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.177+0000 7f59913ab700 1 -- 172.21.15.124:0/108948963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f598c0cf7d0 msgr2=0x7f598c14b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:09.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.177+0000 7f59913ab700 1 --2- 172.21.15.124:0/108948963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f598c0cf7d0 0x7f598c14b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.177+0000 7f59913ab700 1 -- 172.21.15.124:0/108948963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f598c06a820 msgr2=0x7f598c0b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:09.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.177+0000 7f59913ab700 1 --2- 172.21.15.124:0/108948963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f598c06a820 0x7f598c0b4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.177+0000 7f59913ab700 1 -- 172.21.15.124:0/108948963 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59880094a0 con 0x7f598c0ca7d0 2023-10-16T13:00:09.190 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.177+0000 7f59923ad700 1 --2- 172.21.15.124:0/108948963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f598c0cf7d0 0x7f598c14b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:00:09.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.177+0000 7f59913ab700 1 --2- 172.21.15.124:0/108948963 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f598c0ca7d0 0x7f598c14b1a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f59880090b0 tx=0x7f59880047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:09.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.177+0000 7f59827fc700 1 -- 172.21.15.124:0/108948963 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988003e60 con 0x7f598c0ca7d0 2023-10-16T13:00:09.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.177+0000 7f59827fc700 1 -- 172.21.15.124:0/108948963 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5988011630 con 0x7f598c0ca7d0 2023-10-16T13:00:09.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.177+0000 7f5993e10700 1 -- 172.21.15.124:0/108948963 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f598c0c4b80 con 0x7f598c0ca7d0 2023-10-16T13:00:09.191 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.177+0000 7f59827fc700 1 -- 172.21.15.124:0/108948963 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59880119e0 con 0x7f598c0ca7d0 2023-10-16T13:00:09.192 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.177+0000 7f5993e10700 1 -- 172.21.15.124:0/108948963 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f598c0c5140 con 0x7f598c0ca7d0 2023-10-16T13:00:09.192 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.178+0000 7f5993e10700 1 -- 172.21.15.124:0/108948963 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f598c04ebb0 con 0x7f598c0ca7d0 2023-10-16T13:00:09.192 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.179+0000 7f59827fc700 1 -- 172.21.15.124:0/108948963 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5988011b40 con 0x7f598c0ca7d0 2023-10-16T13:00:09.192 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.179+0000 7f59827fc700 1 --2- 172.21.15.124:0/108948963 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f597006af00 0x7f597006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:09.192 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.179+0000 7f59827fc700 1 -- 172.21.15.124:0/108948963 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f598808b100 con 0x7f598c0ca7d0 2023-10-16T13:00:09.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.179+0000 7f5991bac700 1 --2- 172.21.15.124:0/108948963 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f597006af00 0x7f597006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:09.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.180+0000 7f5991bac700 1 --2- 172.21.15.124:0/108948963 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f597006af00 0x7f597006d3c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f597c007fd0 tx=0x7f597c007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:09.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.184+0000 7f59827fc700 1 -- 172.21.15.124:0/108948963 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5988059cb0 con 0x7f598c0ca7d0 2023-10-16T13:00:09.376 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.372+0000 7f5993e10700 1 -- 172.21.15.124:0/108948963 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f598c0b6100 con 0x7f598c0ca7d0 2023-10-16T13:00:09.377 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.374+0000 7f59827fc700 1 -- 172.21.15.124:0/108948963 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16774 (secure 0 0 0) 0x7f5988059840 con 0x7f598c0ca7d0 2023-10-16T13:00:09.377 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:00:09.378 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":38,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T13:00:06.636312+0000","last_up_change":"2023-10-16T12:58:37.731971+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:00:02.825330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-16T13:00:03.997396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists","up"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists","up"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T13:00:09.379 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.376+0000 7f5993e10700 1 -- 172.21.15.124:0/108948963 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f597006af00 msgr2=0x7f597006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:09.379 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.376+0000 7f5993e10700 1 --2- 172.21.15.124:0/108948963 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f597006af00 0x7f597006d3c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f597c007fd0 tx=0x7f597c007ec0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.380 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.376+0000 7f5993e10700 1 -- 172.21.15.124:0/108948963 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f598c0ca7d0 msgr2=0x7f598c14b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:09.380 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.376+0000 7f5993e10700 1 --2- 172.21.15.124:0/108948963 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f598c0ca7d0 0x7f598c14b1a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f59880090b0 tx=0x7f59880047c0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.380 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.376+0000 7f5993e10700 1 -- 172.21.15.124:0/108948963 shutdown_connections 2023-10-16T13:00:09.380 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.376+0000 7f5993e10700 1 --2- 172.21.15.124:0/108948963 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f597006af00 0x7f597006d3c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.376+0000 7f5993e10700 1 --2- 172.21.15.124:0/108948963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f598c0cf7d0 0x7f598c14b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.376+0000 7f5993e10700 1 --2- 172.21.15.124:0/108948963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f598c06a820 0x7f598c0b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.376+0000 7f5993e10700 1 --2- 172.21.15.124:0/108948963 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f598c0ca7d0 0x7f598c14b1a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.376+0000 7f5993e10700 1 -- 172.21.15.124:0/108948963 >> 172.21.15.124:0/108948963 conn(0x7f598c0d0180 msgr2=0x7f598c06e270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:09.381 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.376+0000 7f5993e10700 1 -- 172.21.15.124:0/108948963 shutdown_connections 2023-10-16T13:00:09.382 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.376+0000 7f5993e10700 1 -- 172.21.15.124:0/108948963 wait complete. 2023-10-16T13:00:09.391 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-16T13:00:09.392 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:00:09.474 INFO:tasks.ceph.mds.d.smithi192.stderr:2023-10-16T13:00:09.472+0000 7f41ce50f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T13:00:09.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.510+0000 7f230a511700 1 Processor -- start 2023-10-16T13:00:09.513 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.510+0000 7f230a511700 1 -- start start 2023-10-16T13:00:09.515 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.511+0000 7f230a511700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2304152470 0x7f23040cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:09.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.511+0000 7f230a511700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f23040b3410 0x7f23040b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:09.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.511+0000 7f230a511700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2304070d70 con 0x7f23040cb8d0 2023-10-16T13:00:09.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.511+0000 7f230a511700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2304071200 con 0x7f23040b3410 2023-10-16T13:00:09.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.511+0000 7f230a511700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23040cbd80 con 0x7f2304152470 2023-10-16T13:00:09.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.511+0000 7f2308aae700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f23040b3410 0x7f23040b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:09.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.511+0000 7f2308aae700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f23040b3410 0x7f23040b60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55636/0 (socket says 172.21.15.124:55636) 2023-10-16T13:00:09.517 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.511+0000 7f2308aae700 1 -- 172.21.15.124:0/158281580 learned_addr learned my addr 172.21.15.124:0/158281580 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:09.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.511+0000 7f2303fff700 1 --2- 172.21.15.124:0/158281580 >> v2:172.21.15.192:3300/0 conn(0x7f2304152470 0x7f23040cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:09.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.511+0000 7f2308aae700 1 -- 172.21.15.124:0/158281580 >> v2:172.21.15.192:3300/0 conn(0x7f2304152470 msgr2=0x7f23040cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:09.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.511+0000 7f2308aae700 1 --2- 172.21.15.124:0/158281580 >> v2:172.21.15.192:3300/0 conn(0x7f2304152470 0x7f23040cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.518 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.511+0000 7f2308aae700 1 -- 172.21.15.124:0/158281580 >> v1:172.21.15.192:6789/0 conn(0x7f23040cb8d0 legacy=0x7f23040b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:09.519 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.511+0000 7f2308aae700 1 -- 172.21.15.124:0/158281580 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2304070440 con 0x7f23040b3410 2023-10-16T13:00:09.519 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.511+0000 7f2303fff700 1 --2- 172.21.15.124:0/158281580 >> v2:172.21.15.192:3300/0 conn(0x7f2304152470 0x7f23040cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:00:09.519 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.511+0000 7f2308aae700 1 --2- 172.21.15.124:0/158281580 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23040b3410 0x7f23040b60f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2304071460 tx=0x7f22fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a618fc10cc3805d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:09.519 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.511+0000 7f2302ffd700 1 -- 172.21.15.124:0/158281580 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc00e070 con 0x7f23040b3410 2023-10-16T13:00:09.519 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.511+0000 7f2302ffd700 1 -- 172.21.15.124:0/158281580 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22fc00b9c0 con 0x7f23040b3410 2023-10-16T13:00:09.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.511+0000 7f2302ffd700 1 -- 172.21.15.124:0/158281580 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc00bd70 con 0x7f23040b3410 2023-10-16T13:00:09.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.512+0000 7f230a511700 1 -- 172.21.15.124:0/158281580 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23040b3410 msgr2=0x7f23040b60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:09.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.512+0000 7f230a511700 1 --2- 172.21.15.124:0/158281580 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23040b3410 0x7f23040b60f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2304071460 tx=0x7f22fc00b330 comp rx=0 tx=0).stop 2023-10-16T13:00:09.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.512+0000 7f230a511700 1 -- 172.21.15.124:0/158281580 shutdown_connections 2023-10-16T13:00:09.520 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.512+0000 7f230a511700 1 --2- 172.21.15.124:0/158281580 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23040b3410 0x7f23040b60f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.521 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.512+0000 7f230a511700 1 --2- 172.21.15.124:0/158281580 >> v2:172.21.15.192:3300/0 conn(0x7f2304152470 0x7f23040cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.521 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.512+0000 7f230a511700 1 -- 172.21.15.124:0/158281580 >> 172.21.15.124:0/158281580 conn(0x7f23040cdd00 msgr2=0x7f23040ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:09.521 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.512+0000 7f230a511700 1 -- 172.21.15.124:0/158281580 shutdown_connections 2023-10-16T13:00:09.521 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.512+0000 7f230a511700 1 -- 172.21.15.124:0/158281580 wait complete. 2023-10-16T13:00:09.521 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.513+0000 7f230a511700 1 Processor -- start 2023-10-16T13:00:09.524 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.513+0000 7f230a511700 1 -- start start 2023-10-16T13:00:09.524 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.514+0000 7f230a511700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23040b3410 0x7f230414d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:09.524 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.514+0000 7f230a511700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23040cb8d0 0x7f23040c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:09.525 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.514+0000 7f230a511700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2304152470 0x7f230415d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:09.525 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.514+0000 7f230a511700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230414dc90 con 0x7f23040b3410 2023-10-16T13:00:09.525 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.514+0000 7f230a511700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23040b4020 con 0x7f2304152470 2023-10-16T13:00:09.525 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.514+0000 7f230a511700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23040b4300 con 0x7f23040cb8d0 2023-10-16T13:00:09.526 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.514+0000 7f2303fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23040b3410 0x7f230414d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:09.526 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.514+0000 7f2303fff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23040b3410 0x7f230414d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55638/0 (socket says 172.21.15.124:55638) 2023-10-16T13:00:09.526 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.514+0000 7f2303fff700 1 -- 172.21.15.124:0/1593923115 learned_addr learned my addr 172.21.15.124:0/1593923115 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:09.526 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.514+0000 7f23037fe700 1 --2- 172.21.15.124:0/1593923115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23040cb8d0 0x7f23040c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:09.526 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.514+0000 7f2308aae700 1 --2- 172.21.15.124:0/1593923115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2304152470 0x7f230415d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:09.527 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.514+0000 7f2303fff700 1 -- 172.21.15.124:0/1593923115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23040cb8d0 msgr2=0x7f23040c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:09.527 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.514+0000 7f2303fff700 1 --2- 172.21.15.124:0/1593923115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23040cb8d0 0x7f23040c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.527 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.514+0000 7f2303fff700 1 -- 172.21.15.124:0/1593923115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2304152470 msgr2=0x7f230415d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:09.527 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.514+0000 7f2303fff700 1 --2- 172.21.15.124:0/1593923115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2304152470 0x7f230415d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.527 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.515+0000 7f2303fff700 1 -- 172.21.15.124:0/1593923115 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22fc009b30 con 0x7f23040b3410 2023-10-16T13:00:09.528 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.515+0000 7f2308aae700 1 --2- 172.21.15.124:0/1593923115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2304152470 0x7f230415d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:00:09.528 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.515+0000 7f2303fff700 1 --2- 172.21.15.124:0/1593923115 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23040b3410 0x7f230414d750 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f22f400e810 tx=0x7f22f400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:09.528 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.515+0000 7f2300ff9700 1 -- 172.21.15.124:0/1593923115 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f4004230 con 0x7f23040b3410 2023-10-16T13:00:09.528 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.515+0000 7f2300ff9700 1 -- 172.21.15.124:0/1593923115 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f4004390 con 0x7f23040b3410 2023-10-16T13:00:09.528 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.515+0000 7f2300ff9700 1 -- 172.21.15.124:0/1593923115 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f40036a0 con 0x7f23040b3410 2023-10-16T13:00:09.529 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.515+0000 7f230a511700 1 -- 172.21.15.124:0/1593923115 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23040b45e0 con 0x7f23040b3410 2023-10-16T13:00:09.529 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.515+0000 7f230a511700 1 -- 172.21.15.124:0/1593923115 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23040b4ba0 con 0x7f23040b3410 2023-10-16T13:00:09.529 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.516+0000 7f230a511700 1 -- 172.21.15.124:0/1593923115 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23040cfda0 con 0x7f23040b3410 2023-10-16T13:00:09.529 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.516+0000 7f2300ff9700 1 -- 172.21.15.124:0/1593923115 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f22f4003800 con 0x7f23040b3410 2023-10-16T13:00:09.529 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.516+0000 7f2300ff9700 1 --2- 172.21.15.124:0/1593923115 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f22f006af00 0x7f22f006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:09.530 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.517+0000 7f2300ff9700 1 -- 172.21.15.124:0/1593923115 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f22f4089210 con 0x7f23040b3410 2023-10-16T13:00:09.530 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.517+0000 7f23037fe700 1 --2- 172.21.15.124:0/1593923115 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f22f006af00 0x7f22f006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:09.530 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.517+0000 7f23037fe700 1 --2- 172.21.15.124:0/1593923115 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f22f006af00 0x7f22f006d3c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f23040cb830 tx=0x7f22f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:09.530 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.521+0000 7f2300ff9700 1 -- 172.21.15.124:0/1593923115 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f22f4054180 con 0x7f23040b3410 2023-10-16T13:00:09.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.708+0000 7f230a511700 1 -- 172.21.15.124:0/1593923115 --> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2304070a00 con 0x7f22f006af00 2023-10-16T13:00:09.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.716+0000 7f2300ff9700 1 -- 172.21.15.124:0/1593923115 <== mgr.4104 v2:172.21.15.124:6832/2391611330 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277442 (secure 0 0 0) 0x7f22f8001490 con 0x7f22f006af00 2023-10-16T13:00:09.724 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:00:09.726 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.719+0000 7f230a511700 1 -- 172.21.15.124:0/1593923115 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f22f006af00 msgr2=0x7f22f006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:09.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.719+0000 7f230a511700 1 --2- 172.21.15.124:0/1593923115 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f22f006af00 0x7f22f006d3c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f23040cb830 tx=0x7f22f8009040 comp rx=0 tx=0).stop 2023-10-16T13:00:09.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.719+0000 7f230a511700 1 -- 172.21.15.124:0/1593923115 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23040b3410 msgr2=0x7f230414d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:09.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.719+0000 7f230a511700 1 --2- 172.21.15.124:0/1593923115 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23040b3410 0x7f230414d750 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f22f400e810 tx=0x7f22f400ebd0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.727 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.719+0000 7f230a511700 1 -- 172.21.15.124:0/1593923115 shutdown_connections 2023-10-16T13:00:09.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.719+0000 7f230a511700 1 --2- 172.21.15.124:0/1593923115 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f22f006af00 0x7f22f006d3c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.719+0000 7f230a511700 1 --2- 172.21.15.124:0/1593923115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2304152470 0x7f230415d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.719+0000 7f230a511700 1 --2- 172.21.15.124:0/1593923115 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f23040b3410 0x7f230414d750 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.719+0000 7f230a511700 1 --2- 172.21.15.124:0/1593923115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23040cb8d0 0x7f23040c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.719+0000 7f230a511700 1 -- 172.21.15.124:0/1593923115 >> 172.21.15.124:0/1593923115 conn(0x7f23040cdd00 msgr2=0x7f23040cf690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:09.728 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.719+0000 7f230a511700 1 -- 172.21.15.124:0/1593923115 shutdown_connections 2023-10-16T13:00:09.729 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.719+0000 7f230a511700 1 -- 172.21.15.124:0/1593923115 wait complete. 2023-10-16T13:00:09.729 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-16T13:00:09.734 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2023-10-16T13:00:08.637597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220436,"kb_used_data":4200,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754284,"statfs":{"total":773094113280,"available":772868386816,"internally_reserved":0,"allocated":4300800,"data_stored":2483016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.014921"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.630185+0000","last_change":"2023-10-16T13:00:03.630185+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.630185+0000","last_undegraded":"2023-10-16T13:00:03.630185+0000","last_fullsized":"2023-10-16T13:00:03.630185+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.629332+0000","last_change":"2023-10-16T13:00:03.629332+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.629332+0000","last_undegraded":"2023-10-16T13:00:03.629332+0000","last_fullsized":"2023-10-16T13:00:03.629332+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.626693+0000","last_change":"2023-10-16T13:00:03.626693+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.626693+0000","last_undegraded":"2023-10-16T13:00:03.626693+0000","last_fullsized":"2023-10-16T13:00:03.626693+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.631148+0000","last_change":"2023-10-16T13:00:03.631148+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.631148+0000","last_undegraded":"2023-10-16T13:00:03.631148+0000","last_fullsized":"2023-10-16T13:00:03.631148+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.629470+0000","last_change":"2023-10-16T13:00:03.629470+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.629470+0000","last_undegraded":"2023-10-16T13:00:03.629470+0000","last_fullsized":"2023-10-16T13:00:03.629470+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.625184+0000","last_change":"2023-10-16T13:00:03.625184+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.625184+0000","last_undegraded":"2023-10-16T13:00:03.625184+0000","last_fullsized":"2023-10-16T13:00:03.625184+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.626747+0000","last_change":"2023-10-16T13:00:03.626747+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.626747+0000","last_undegraded":"2023-10-16T13:00:03.626747+0000","last_fullsized":"2023-10-16T13:00:03.626747+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.630943+0000","last_change":"2023-10-16T13:00:03.630943+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.630943+0000","last_undegraded":"2023-10-16T13:00:03.630943+0000","last_fullsized":"2023-10-16T13:00:03.630943+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.625111+0000","last_change":"2023-10-16T13:00:03.625111+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.625111+0000","last_undegraded":"2023-10-16T13:00:03.625111+0000","last_fullsized":"2023-10-16T13:00:03.625111+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.629298+0000","last_change":"2023-10-16T13:00:03.629298+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.629298+0000","last_undegraded":"2023-10-16T13:00:03.629298+0000","last_fullsized":"2023-10-16T13:00:03.629298+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.629213+0000","last_change":"2023-10-16T13:00:03.629213+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.629213+0000","last_undegraded":"2023-10-16T13:00:03.629213+0000","last_fullsized":"2023-10-16T13:00:03.629213+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.624995+0000","last_change":"2023-10-16T13:00:03.624995+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.624995+0000","last_undegraded":"2023-10-16T13:00:03.624995+0000","last_fullsized":"2023-10-16T13:00:03.624995+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.625020+0000","last_change":"2023-10-16T13:00:03.625020+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.625020+0000","last_undegraded":"2023-10-16T13:00:03.625020+0000","last_fullsized":"2023-10-16T13:00:03.625020+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.626244+0000","last_change":"2023-10-16T13:00:03.626244+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.626244+0000","last_undegraded":"2023-10-16T13:00:03.626244+0000","last_fullsized":"2023-10-16T13:00:03.626244+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.629213+0000","last_change":"2023-10-16T13:00:03.629213+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.629213+0000","last_undegraded":"2023-10-16T13:00:03.629213+0000","last_fullsized":"2023-10-16T13:00:03.629213+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.625184+0000","last_change":"2023-10-16T13:00:03.625184+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.625184+0000","last_undegraded":"2023-10-16T13:00:03.625184+0000","last_fullsized":"2023-10-16T13:00:03.625184+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.629216+0000","last_change":"2023-10-16T13:00:03.629216+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.629216+0000","last_undegraded":"2023-10-16T13:00:03.629216+0000","last_fullsized":"2023-10-16T13:00:03.629216+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.631143+0000","last_change":"2023-10-16T13:00:03.631143+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.631143+0000","last_undegraded":"2023-10-16T13:00:03.631143+0000","last_fullsized":"2023-10-16T13:00:03.631143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.627883+0000","last_change":"2023-10-16T13:00:03.627883+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.627883+0000","last_undegraded":"2023-10-16T13:00:03.627883+0000","last_fullsized":"2023-10-16T13:00:03.627883+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.626476+0000","last_change":"2023-10-16T13:00:03.626476+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.626476+0000","last_undegraded":"2023-10-16T13:00:03.626476+0000","last_fullsized":"2023-10-16T13:00:03.626476+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.628265+0000","last_change":"2023-10-16T13:00:03.628265+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.628265+0000","last_undegraded":"2023-10-16T13:00:03.628265+0000","last_fullsized":"2023-10-16T13:00:03.628265+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.627796+0000","last_change":"2023-10-16T13:00:03.627796+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.627796+0000","last_undegraded":"2023-10-16T13:00:03.627796+0000","last_fullsized":"2023-10-16T13:00:03.627796+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.625191+0000","last_change":"2023-10-16T13:00:03.625191+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.625191+0000","last_undegraded":"2023-10-16T13:00:03.625191+0000","last_fullsized":"2023-10-16T13:00:03.625191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.627927+0000","last_change":"2023-10-16T13:00:03.627927+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.627927+0000","last_undegraded":"2023-10-16T13:00:03.627927+0000","last_fullsized":"2023-10-16T13:00:03.627927+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.630082+0000","last_change":"2023-10-16T13:00:03.630082+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.630082+0000","last_undegraded":"2023-10-16T13:00:03.630082+0000","last_fullsized":"2023-10-16T13:00:03.630082+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.628630+0000","last_change":"2023-10-16T13:00:03.628630+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.628630+0000","last_undegraded":"2023-10-16T13:00:03.628630+0000","last_fullsized":"2023-10-16T13:00:03.628630+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.629697+0000","last_change":"2023-10-16T13:00:03.629697+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.629697+0000","last_undegraded":"2023-10-16T13:00:03.629697+0000","last_fullsized":"2023-10-16T13:00:03.629697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.628760+0000","last_change":"2023-10-16T13:00:03.628760+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.628760+0000","last_undegraded":"2023-10-16T13:00:03.628760+0000","last_fullsized":"2023-10-16T13:00:03.628760+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.629737+0000","last_change":"2023-10-16T13:00:03.629737+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.629737+0000","last_undegraded":"2023-10-16T13:00:03.629737+0000","last_fullsized":"2023-10-16T13:00:03.629737+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.631147+0000","last_change":"2023-10-16T13:00:03.631147+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.631147+0000","last_undegraded":"2023-10-16T13:00:03.631147+0000","last_fullsized":"2023-10-16T13:00:03.631147+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.624997+0000","last_change":"2023-10-16T13:00:03.624997+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.624997+0000","last_undegraded":"2023-10-16T13:00:03.624997+0000","last_fullsized":"2023-10-16T13:00:03.624997+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.625277+0000","last_change":"2023-10-16T13:00:03.625277+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.625277+0000","last_undegraded":"2023-10-16T13:00:03.625277+0000","last_fullsized":"2023-10-16T13:00:03.625277+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-16T12:59:58.490916+0000","last_change":"2023-10-16T12:58:40.198340+0000","last_active":"2023-10-16T12:59:58.490916+0000","last_peered":"2023-10-16T12:59:58.490916+0000","last_clean":"2023-10-16T12:59:58.490916+0000","last_became_active":"2023-10-16T12:58:40.197354+0000","last_became_peered":"2023-10-16T12:58:40.197354+0000","last_unstale":"2023-10-16T12:59:58.490916+0000","last_undegraded":"2023-10-16T12:59:58.490916+0000","last_fullsized":"2023-10-16T12:59:58.490916+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:39.025347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:39.025347+0000","last_clean_scrub_stamp":"2023-10-16T12:58:39.025347+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:22:36.722419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":753153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.53700000000000003}]},{"osd":1,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":4.3369999999999997,"5min":4.3369999999999997,"15min":4.3369999999999997},"last":0.48999999999999999}]},{"osd":2,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.55900000000000005}]},{"osd":3,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":4.1520000000000001,"5min":4.1520000000000001,"15min":4.1520000000000001},"last":0.70599999999999996}]},{"osd":4,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.68100000000000005}]},{"osd":5,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.63800000000000001}]},{"osd":6,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.76500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":162785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":10.58,"5min":10.58,"15min":10.58},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":7.609,"5min":7.609,"15min":7.609},"last":0.56899999999999995}]},{"osd":1,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.5129999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.52500000000000002}]},{"osd":2,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.45500000000000002},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":10.622,"5min":10.622,"15min":10.622},"last":0.46999999999999997}]},{"osd":3,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":4.6349999999999998,"5min":4.6349999999999998,"15min":4.6349999999999998},"last":0.38200000000000001}]},{"osd":4,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.35899999999999999}]},{"osd":5,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.501},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.55500000000000005}]},{"osd":7,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.53900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":162785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.38900000000000001}]},{"osd":2,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.48799999999999999}]},{"osd":4,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.89100000000000001}]},{"osd":5,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.85799999999999998}]},{"osd":6,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.77200000000000002}]},{"osd":7,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.87},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.745}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":753153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.436},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.52200000000000002}]},{"osd":2,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":3.1190000000000002,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.503},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.57999999999999996}]},{"osd":3,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.56399999999999995}]},{"osd":4,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.90700000000000003}]},{"osd":5,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.88200000000000001}]},{"osd":6,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.92500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":162785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":11.090999999999999,"5min":11.090999999999999,"15min":11.090999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":0.36199999999999999}]},{"osd":1,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":11.076000000000001,"5min":11.076000000000001,"15min":11.076000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":17.914000000000001,"5min":17.914000000000001,"15min":17.914000000000001},"last":0.33400000000000002}]},{"osd":3,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.113,"5min":11.113,"15min":11.113},"last":0.35099999999999998}]},{"osd":4,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":10.993,"5min":10.993,"15min":10.993},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.6150000000000002,"5min":2.6150000000000002,"15min":2.6150000000000002},"last":0.439},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":11.055,"5min":11.055,"15min":11.055},"last":0.52300000000000002}]},{"osd":6,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.53800000000000003}]},{"osd":7,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.8559999999999999,"5min":2.8559999999999999,"15min":2.8559999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":0.502}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":162785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":0.32200000000000001},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":26.940999999999999,"5min":26.940999999999999,"15min":26.940999999999999},"last":0.29999999999999999}]},{"osd":1,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":8.2249999999999996,"5min":8.2249999999999996,"15min":8.2249999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.40999999999999998}]},{"osd":2,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":16.018999999999998,"5min":16.018999999999998,"15min":16.018999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":0.374}]},{"osd":4,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":8.3889999999999993,"5min":8.3889999999999993,"15min":8.3889999999999993},"last":0.502},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":8.3030000000000008,"5min":8.3030000000000008,"15min":8.3030000000000008},"last":0.42199999999999999}]},{"osd":5,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.51600000000000001},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":8.4139999999999997,"5min":8.4139999999999997,"15min":8.4139999999999997},"last":0.436}]},{"osd":6,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":8.2699999999999996,"5min":8.2699999999999996,"15min":8.2699999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.53600000000000003}]},{"osd":7,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":8.3629999999999995,"5min":8.3629999999999995,"15min":8.3629999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":8.3320000000000007,"5min":8.3320000000000007,"15min":8.3320000000000007},"last":0.45100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":162785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":3.7970000000000002,"5min":3.7970000000000002,"15min":3.7970000000000002},"last":0.43099999999999999}]},{"osd":1,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.52300000000000002}]},{"osd":2,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.56100000000000005}]},{"osd":3,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.626}]},{"osd":5,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.59299999999999997}]},{"osd":6,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.60899999999999999}]},{"osd":7,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.66200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":162785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.443},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.48799999999999999}]},{"osd":1,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.36399999999999999}]},{"osd":2,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.57099999999999995}]},{"osd":3,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.61399999999999999}]},{"osd":4,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.628},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.59399999999999997}]},{"osd":6,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.70099999999999996}]},{"osd":7,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:00:09.741 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:00:09.894 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.891+0000 7fbae6267700 1 Processor -- start 2023-10-16T13:00:09.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.892+0000 7fbae6267700 1 -- start start 2023-10-16T13:00:09.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.892+0000 7fbae6267700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbae006a820 0x7fbae00cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:09.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.892+0000 7fbae6267700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fbae015e7f0 0x7fbae006ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:09.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.892+0000 7fbae6267700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae00cfeb0 con 0x7fbae00ca7d0 2023-10-16T13:00:09.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.892+0000 7fbae6267700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae00ce410 con 0x7fbae015e7f0 2023-10-16T13:00:09.898 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.892+0000 7fbae6267700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae015ec50 con 0x7fbae006a820 2023-10-16T13:00:09.898 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.893+0000 7fbadf7fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fbae015e7f0 0x7fbae006ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:09.898 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.893+0000 7fbadf7fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fbae015e7f0 0x7fbae006ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55648/0 (socket says 172.21.15.124:55648) 2023-10-16T13:00:09.898 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.893+0000 7fbadf7fe700 1 -- 172.21.15.124:0/2875980375 learned_addr learned my addr 172.21.15.124:0/2875980375 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:09.899 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.893+0000 7fbadffff700 1 --2- 172.21.15.124:0/2875980375 >> v2:172.21.15.192:3300/0 conn(0x7fbae006a820 0x7fbae00cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:09.899 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.893+0000 7fbadf7fe700 1 -- 172.21.15.124:0/2875980375 >> v2:172.21.15.192:3300/0 conn(0x7fbae006a820 msgr2=0x7fbae00cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:09.899 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.893+0000 7fbadf7fe700 1 --2- 172.21.15.124:0/2875980375 >> v2:172.21.15.192:3300/0 conn(0x7fbae006a820 0x7fbae00cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.899 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.893+0000 7fbadf7fe700 1 -- 172.21.15.124:0/2875980375 >> v1:172.21.15.192:6789/0 conn(0x7fbae00ca7d0 legacy=0x7fbae0071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:09.899 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.893+0000 7fbadf7fe700 1 -- 172.21.15.124:0/2875980375 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae00af9d0 con 0x7fbae015e7f0 2023-10-16T13:00:09.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.893+0000 7fbadffff700 1 --2- 172.21.15.124:0/2875980375 >> v2:172.21.15.192:3300/0 conn(0x7fbae006a820 0x7fbae00cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:00:09.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.893+0000 7fbadf7fe700 1 --2- 172.21.15.124:0/2875980375 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbae015e7f0 0x7fbae006ac00 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbae0067df0 tx=0x7fbad4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6cf1cf033e956f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:09.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.893+0000 7fbadeffd700 1 -- 172.21.15.124:0/2875980375 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad400b870 con 0x7fbae015e7f0 2023-10-16T13:00:09.900 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.893+0000 7fbadeffd700 1 -- 172.21.15.124:0/2875980375 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad400b9d0 con 0x7fbae015e7f0 2023-10-16T13:00:09.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.893+0000 7fbadeffd700 1 -- 172.21.15.124:0/2875980375 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad400bd60 con 0x7fbae015e7f0 2023-10-16T13:00:09.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.894+0000 7fbae6267700 1 -- 172.21.15.124:0/2875980375 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbae015e7f0 msgr2=0x7fbae006ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:09.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.894+0000 7fbae6267700 1 --2- 172.21.15.124:0/2875980375 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbae015e7f0 0x7fbae006ac00 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbae0067df0 tx=0x7fbad4009bd0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.894+0000 7fbae6267700 1 -- 172.21.15.124:0/2875980375 shutdown_connections 2023-10-16T13:00:09.901 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.894+0000 7fbae6267700 1 --2- 172.21.15.124:0/2875980375 >> v2:172.21.15.192:3300/0 conn(0x7fbae006a820 0x7fbae00cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.894+0000 7fbae6267700 1 --2- 172.21.15.124:0/2875980375 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbae015e7f0 0x7fbae006ac00 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.894+0000 7fbae6267700 1 -- 172.21.15.124:0/2875980375 >> 172.21.15.124:0/2875980375 conn(0x7fbae00d0180 msgr2=0x7fbae00d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:09.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.894+0000 7fbae6267700 1 -- 172.21.15.124:0/2875980375 shutdown_connections 2023-10-16T13:00:09.902 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.894+0000 7fbae6267700 1 -- 172.21.15.124:0/2875980375 wait complete. 2023-10-16T13:00:09.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.895+0000 7fbae6267700 1 Processor -- start 2023-10-16T13:00:09.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.895+0000 7fbae6267700 1 -- start start 2023-10-16T13:00:09.905 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.896+0000 7fbae6267700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbae006a820 0x7fbae01554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:09.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.896+0000 7fbae6267700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbae00ca7d0 0x7fbae01f3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:09.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.896+0000 7fbae6267700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbae015e7f0 0x7fbae015c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:09.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.896+0000 7fbae6267700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae015cd90 con 0x7fbae00ca7d0 2023-10-16T13:00:09.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.896+0000 7fbae6267700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae01f3d40 con 0x7fbae006a820 2023-10-16T13:00:09.906 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.896+0000 7fbae6267700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae00c9920 con 0x7fbae015e7f0 2023-10-16T13:00:09.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.896+0000 7fbadf7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbae00ca7d0 0x7fbae01f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:09.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.896+0000 7fbadf7fe700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbae00ca7d0 0x7fbae01f3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55654/0 (socket says 172.21.15.124:55654) 2023-10-16T13:00:09.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.896+0000 7fbadf7fe700 1 -- 172.21.15.124:0/2888012359 learned_addr learned my addr 172.21.15.124:0/2888012359 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:09.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.896+0000 7fbadf7fe700 1 -- 172.21.15.124:0/2888012359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbae015e7f0 msgr2=0x7fbae015c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:09.907 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.896+0000 7fbadffff700 1 --2- 172.21.15.124:0/2888012359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbae006a820 0x7fbae01554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:09.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.896+0000 7fbadf7fe700 1 --2- 172.21.15.124:0/2888012359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbae015e7f0 0x7fbae015c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.896+0000 7fbadf7fe700 1 -- 172.21.15.124:0/2888012359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbae006a820 msgr2=0x7fbae01554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:09.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.896+0000 7fbadf7fe700 1 --2- 172.21.15.124:0/2888012359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbae006a820 0x7fbae01554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:09.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.896+0000 7fbadf7fe700 1 -- 172.21.15.124:0/2888012359 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad4009550 con 0x7fbae00ca7d0 2023-10-16T13:00:09.908 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.897+0000 7fbadf7fe700 1 --2- 172.21.15.124:0/2888012359 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbae00ca7d0 0x7fbae01f3680 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbad4000c00 tx=0x7fbad4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:09.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.897+0000 7fbadcff9700 1 -- 172.21.15.124:0/2888012359 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad4004520 con 0x7fbae00ca7d0 2023-10-16T13:00:09.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.897+0000 7fbadcff9700 1 -- 172.21.15.124:0/2888012359 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad401e070 con 0x7fbae00ca7d0 2023-10-16T13:00:09.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.897+0000 7fbae6267700 1 -- 172.21.15.124:0/2888012359 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae00c9c00 con 0x7fbae00ca7d0 2023-10-16T13:00:09.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.897+0000 7fbadcff9700 1 -- 172.21.15.124:0/2888012359 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad40038a0 con 0x7fbae00ca7d0 2023-10-16T13:00:09.909 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.897+0000 7fbae6267700 1 -- 172.21.15.124:0/2888012359 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae00acdf0 con 0x7fbae00ca7d0 2023-10-16T13:00:09.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.898+0000 7fbae6267700 1 -- 172.21.15.124:0/2888012359 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae00acf80 con 0x7fbae00ca7d0 2023-10-16T13:00:09.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.898+0000 7fbadcff9700 1 -- 172.21.15.124:0/2888012359 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbad4003a00 con 0x7fbae00ca7d0 2023-10-16T13:00:09.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.898+0000 7fbadcff9700 1 --2- 172.21.15.124:0/2888012359 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbacc06af00 0x7fbacc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:09.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.899+0000 7fbadcff9700 1 -- 172.21.15.124:0/2888012359 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbad4020070 con 0x7fbae00ca7d0 2023-10-16T13:00:09.910 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.899+0000 7fbadffff700 1 --2- 172.21.15.124:0/2888012359 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbacc06af00 0x7fbacc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:09.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.899+0000 7fbadffff700 1 --2- 172.21.15.124:0/2888012359 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbacc06af00 0x7fbacc06d3c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbad0009990 tx=0x7fbad0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:09.911 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:09.903+0000 7fbadcff9700 1 -- 172.21.15.124:0/2888012359 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbae00acf80 con 0x7fbae00ca7d0 2023-10-16T13:00:10.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.088+0000 7fbae6267700 1 -- 172.21.15.124:0/2888012359 --> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbae00af410 con 0x7fbacc06af00 2023-10-16T13:00:10.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.096+0000 7fbadcff9700 1 -- 172.21.15.124:0/2888012359 <== mgr.4104 v2:172.21.15.124:6832/2391611330 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277442 (secure 0 0 0) 0x7fbad000c050 con 0x7fbacc06af00 2023-10-16T13:00:10.104 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:00:10.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.099+0000 7fbae6267700 1 -- 172.21.15.124:0/2888012359 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbacc06af00 msgr2=0x7fbacc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:10.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.099+0000 7fbae6267700 1 --2- 172.21.15.124:0/2888012359 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbacc06af00 0x7fbacc06d3c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbad0009990 tx=0x7fbad0008040 comp rx=0 tx=0).stop 2023-10-16T13:00:10.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.099+0000 7fbae6267700 1 -- 172.21.15.124:0/2888012359 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbae00ca7d0 msgr2=0x7fbae01f3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:10.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.099+0000 7fbae6267700 1 --2- 172.21.15.124:0/2888012359 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbae00ca7d0 0x7fbae01f3680 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbad4000c00 tx=0x7fbad4004750 comp rx=0 tx=0).stop 2023-10-16T13:00:10.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.099+0000 7fbae6267700 1 -- 172.21.15.124:0/2888012359 shutdown_connections 2023-10-16T13:00:10.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.099+0000 7fbae6267700 1 --2- 172.21.15.124:0/2888012359 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbacc06af00 0x7fbacc06d3c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.099+0000 7fbae6267700 1 --2- 172.21.15.124:0/2888012359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbae015e7f0 0x7fbae015c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.099+0000 7fbae6267700 1 --2- 172.21.15.124:0/2888012359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbae006a820 0x7fbae01554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.099+0000 7fbae6267700 1 --2- 172.21.15.124:0/2888012359 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbae00ca7d0 0x7fbae01f3680 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.099+0000 7fbae6267700 1 -- 172.21.15.124:0/2888012359 >> 172.21.15.124:0/2888012359 conn(0x7fbae00d0180 msgr2=0x7fbae015a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:10.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.099+0000 7fbae6267700 1 -- 172.21.15.124:0/2888012359 shutdown_connections 2023-10-16T13:00:10.109 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.099+0000 7fbae6267700 1 -- 172.21.15.124:0/2888012359 wait complete. 2023-10-16T13:00:10.109 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-16T13:00:10.114 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2023-10-16T13:00:08.637597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220436,"kb_used_data":4200,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754284,"statfs":{"total":773094113280,"available":772868386816,"internally_reserved":0,"allocated":4300800,"data_stored":2483016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.014921"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.630185+0000","last_change":"2023-10-16T13:00:03.630185+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.630185+0000","last_undegraded":"2023-10-16T13:00:03.630185+0000","last_fullsized":"2023-10-16T13:00:03.630185+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.629332+0000","last_change":"2023-10-16T13:00:03.629332+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.629332+0000","last_undegraded":"2023-10-16T13:00:03.629332+0000","last_fullsized":"2023-10-16T13:00:03.629332+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.626693+0000","last_change":"2023-10-16T13:00:03.626693+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.626693+0000","last_undegraded":"2023-10-16T13:00:03.626693+0000","last_fullsized":"2023-10-16T13:00:03.626693+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.631148+0000","last_change":"2023-10-16T13:00:03.631148+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.631148+0000","last_undegraded":"2023-10-16T13:00:03.631148+0000","last_fullsized":"2023-10-16T13:00:03.631148+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.629470+0000","last_change":"2023-10-16T13:00:03.629470+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.629470+0000","last_undegraded":"2023-10-16T13:00:03.629470+0000","last_fullsized":"2023-10-16T13:00:03.629470+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.625184+0000","last_change":"2023-10-16T13:00:03.625184+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.625184+0000","last_undegraded":"2023-10-16T13:00:03.625184+0000","last_fullsized":"2023-10-16T13:00:03.625184+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.626747+0000","last_change":"2023-10-16T13:00:03.626747+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.626747+0000","last_undegraded":"2023-10-16T13:00:03.626747+0000","last_fullsized":"2023-10-16T13:00:03.626747+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.630943+0000","last_change":"2023-10-16T13:00:03.630943+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.630943+0000","last_undegraded":"2023-10-16T13:00:03.630943+0000","last_fullsized":"2023-10-16T13:00:03.630943+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.625111+0000","last_change":"2023-10-16T13:00:03.625111+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.625111+0000","last_undegraded":"2023-10-16T13:00:03.625111+0000","last_fullsized":"2023-10-16T13:00:03.625111+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.629298+0000","last_change":"2023-10-16T13:00:03.629298+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.629298+0000","last_undegraded":"2023-10-16T13:00:03.629298+0000","last_fullsized":"2023-10-16T13:00:03.629298+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.629213+0000","last_change":"2023-10-16T13:00:03.629213+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.629213+0000","last_undegraded":"2023-10-16T13:00:03.629213+0000","last_fullsized":"2023-10-16T13:00:03.629213+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.624995+0000","last_change":"2023-10-16T13:00:03.624995+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.624995+0000","last_undegraded":"2023-10-16T13:00:03.624995+0000","last_fullsized":"2023-10-16T13:00:03.624995+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.625020+0000","last_change":"2023-10-16T13:00:03.625020+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.625020+0000","last_undegraded":"2023-10-16T13:00:03.625020+0000","last_fullsized":"2023-10-16T13:00:03.625020+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.626244+0000","last_change":"2023-10-16T13:00:03.626244+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.626244+0000","last_undegraded":"2023-10-16T13:00:03.626244+0000","last_fullsized":"2023-10-16T13:00:03.626244+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.629213+0000","last_change":"2023-10-16T13:00:03.629213+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.629213+0000","last_undegraded":"2023-10-16T13:00:03.629213+0000","last_fullsized":"2023-10-16T13:00:03.629213+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.625184+0000","last_change":"2023-10-16T13:00:03.625184+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.625184+0000","last_undegraded":"2023-10-16T13:00:03.625184+0000","last_fullsized":"2023-10-16T13:00:03.625184+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.629216+0000","last_change":"2023-10-16T13:00:03.629216+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.629216+0000","last_undegraded":"2023-10-16T13:00:03.629216+0000","last_fullsized":"2023-10-16T13:00:03.629216+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.631143+0000","last_change":"2023-10-16T13:00:03.631143+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.631143+0000","last_undegraded":"2023-10-16T13:00:03.631143+0000","last_fullsized":"2023-10-16T13:00:03.631143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.627883+0000","last_change":"2023-10-16T13:00:03.627883+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.627883+0000","last_undegraded":"2023-10-16T13:00:03.627883+0000","last_fullsized":"2023-10-16T13:00:03.627883+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.626476+0000","last_change":"2023-10-16T13:00:03.626476+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.626476+0000","last_undegraded":"2023-10-16T13:00:03.626476+0000","last_fullsized":"2023-10-16T13:00:03.626476+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.628265+0000","last_change":"2023-10-16T13:00:03.628265+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.628265+0000","last_undegraded":"2023-10-16T13:00:03.628265+0000","last_fullsized":"2023-10-16T13:00:03.628265+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.627796+0000","last_change":"2023-10-16T13:00:03.627796+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.627796+0000","last_undegraded":"2023-10-16T13:00:03.627796+0000","last_fullsized":"2023-10-16T13:00:03.627796+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.625191+0000","last_change":"2023-10-16T13:00:03.625191+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.625191+0000","last_undegraded":"2023-10-16T13:00:03.625191+0000","last_fullsized":"2023-10-16T13:00:03.625191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.627927+0000","last_change":"2023-10-16T13:00:03.627927+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.627927+0000","last_undegraded":"2023-10-16T13:00:03.627927+0000","last_fullsized":"2023-10-16T13:00:03.627927+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.630082+0000","last_change":"2023-10-16T13:00:03.630082+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.630082+0000","last_undegraded":"2023-10-16T13:00:03.630082+0000","last_fullsized":"2023-10-16T13:00:03.630082+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.628630+0000","last_change":"2023-10-16T13:00:03.628630+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.628630+0000","last_undegraded":"2023-10-16T13:00:03.628630+0000","last_fullsized":"2023-10-16T13:00:03.628630+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.629697+0000","last_change":"2023-10-16T13:00:03.629697+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.629697+0000","last_undegraded":"2023-10-16T13:00:03.629697+0000","last_fullsized":"2023-10-16T13:00:03.629697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.628760+0000","last_change":"2023-10-16T13:00:03.628760+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.628760+0000","last_undegraded":"2023-10-16T13:00:03.628760+0000","last_fullsized":"2023-10-16T13:00:03.628760+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.629737+0000","last_change":"2023-10-16T13:00:03.629737+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.629737+0000","last_undegraded":"2023-10-16T13:00:03.629737+0000","last_fullsized":"2023-10-16T13:00:03.629737+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.631147+0000","last_change":"2023-10-16T13:00:03.631147+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.631147+0000","last_undegraded":"2023-10-16T13:00:03.631147+0000","last_fullsized":"2023-10-16T13:00:03.631147+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.624997+0000","last_change":"2023-10-16T13:00:03.624997+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.624997+0000","last_undegraded":"2023-10-16T13:00:03.624997+0000","last_fullsized":"2023-10-16T13:00:03.624997+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.625277+0000","last_change":"2023-10-16T13:00:03.625277+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.625277+0000","last_undegraded":"2023-10-16T13:00:03.625277+0000","last_fullsized":"2023-10-16T13:00:03.625277+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-16T12:59:58.490916+0000","last_change":"2023-10-16T12:58:40.198340+0000","last_active":"2023-10-16T12:59:58.490916+0000","last_peered":"2023-10-16T12:59:58.490916+0000","last_clean":"2023-10-16T12:59:58.490916+0000","last_became_active":"2023-10-16T12:58:40.197354+0000","last_became_peered":"2023-10-16T12:58:40.197354+0000","last_unstale":"2023-10-16T12:59:58.490916+0000","last_undegraded":"2023-10-16T12:59:58.490916+0000","last_fullsized":"2023-10-16T12:59:58.490916+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:39.025347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:39.025347+0000","last_clean_scrub_stamp":"2023-10-16T12:58:39.025347+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:22:36.722419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":753153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.53700000000000003}]},{"osd":1,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":4.3369999999999997,"5min":4.3369999999999997,"15min":4.3369999999999997},"last":0.48999999999999999}]},{"osd":2,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.55900000000000005}]},{"osd":3,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":4.1520000000000001,"5min":4.1520000000000001,"15min":4.1520000000000001},"last":0.70599999999999996}]},{"osd":4,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.68100000000000005}]},{"osd":5,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.63800000000000001}]},{"osd":6,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.76500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":162785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":10.58,"5min":10.58,"15min":10.58},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":7.609,"5min":7.609,"15min":7.609},"last":0.56899999999999995}]},{"osd":1,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.5129999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.52500000000000002}]},{"osd":2,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.45500000000000002},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":10.622,"5min":10.622,"15min":10.622},"last":0.46999999999999997}]},{"osd":3,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":4.6349999999999998,"5min":4.6349999999999998,"15min":4.6349999999999998},"last":0.38200000000000001}]},{"osd":4,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.35899999999999999}]},{"osd":5,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.501},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.55500000000000005}]},{"osd":7,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.53900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":162785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.38900000000000001}]},{"osd":2,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.48799999999999999}]},{"osd":4,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.89100000000000001}]},{"osd":5,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.85799999999999998}]},{"osd":6,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.77200000000000002}]},{"osd":7,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.87},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.745}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":753153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.436},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.52200000000000002}]},{"osd":2,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":3.1190000000000002,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.503},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.57999999999999996}]},{"osd":3,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.56399999999999995}]},{"osd":4,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.90700000000000003}]},{"osd":5,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.88200000000000001}]},{"osd":6,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.92500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":162785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":11.090999999999999,"5min":11.090999999999999,"15min":11.090999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":0.36199999999999999}]},{"osd":1,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":11.076000000000001,"5min":11.076000000000001,"15min":11.076000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":17.914000000000001,"5min":17.914000000000001,"15min":17.914000000000001},"last":0.33400000000000002}]},{"osd":3,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.113,"5min":11.113,"15min":11.113},"last":0.35099999999999998}]},{"osd":4,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":10.993,"5min":10.993,"15min":10.993},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.6150000000000002,"5min":2.6150000000000002,"15min":2.6150000000000002},"last":0.439},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":11.055,"5min":11.055,"15min":11.055},"last":0.52300000000000002}]},{"osd":6,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.53800000000000003}]},{"osd":7,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.8559999999999999,"5min":2.8559999999999999,"15min":2.8559999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":0.502}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":162785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":0.32200000000000001},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":26.940999999999999,"5min":26.940999999999999,"15min":26.940999999999999},"last":0.29999999999999999}]},{"osd":1,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":8.2249999999999996,"5min":8.2249999999999996,"15min":8.2249999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.40999999999999998}]},{"osd":2,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":16.018999999999998,"5min":16.018999999999998,"15min":16.018999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":0.374}]},{"osd":4,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":8.3889999999999993,"5min":8.3889999999999993,"15min":8.3889999999999993},"last":0.502},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":8.3030000000000008,"5min":8.3030000000000008,"15min":8.3030000000000008},"last":0.42199999999999999}]},{"osd":5,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.51600000000000001},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":8.4139999999999997,"5min":8.4139999999999997,"15min":8.4139999999999997},"last":0.436}]},{"osd":6,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":8.2699999999999996,"5min":8.2699999999999996,"15min":8.2699999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.53600000000000003}]},{"osd":7,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":8.3629999999999995,"5min":8.3629999999999995,"15min":8.3629999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":8.3320000000000007,"5min":8.3320000000000007,"15min":8.3320000000000007},"last":0.45100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":162785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":3.7970000000000002,"5min":3.7970000000000002,"15min":3.7970000000000002},"last":0.43099999999999999}]},{"osd":1,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.52300000000000002}]},{"osd":2,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.56100000000000005}]},{"osd":3,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.626}]},{"osd":5,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.59299999999999997}]},{"osd":6,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.60899999999999999}]},{"osd":7,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.66200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":162785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.443},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.48799999999999999}]},{"osd":1,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.36399999999999999}]},{"osd":2,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.57099999999999995}]},{"osd":3,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.61399999999999999}]},{"osd":4,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.628},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.59399999999999997}]},{"osd":6,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.70099999999999996}]},{"osd":7,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:00:10.121 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:00:10.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.271+0000 7f12cc40e700 1 Processor -- start 2023-10-16T13:00:10.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.271+0000 7f12cc40e700 1 -- start start 2023-10-16T13:00:10.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.272+0000 7f12cc40e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12c415b0e0 0x7f12c40ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:10.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.272+0000 7f12cc40e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f12c40cf420 0x7f12c40b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:10.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.272+0000 7f12cc40e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f12c40b3240 0x7f12c4070310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:10.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.272+0000 7f12cc40e700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c40cf8a0 con 0x7f12c40cf420 2023-10-16T13:00:10.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.272+0000 7f12cc40e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c40b3690 con 0x7f12c40b3240 2023-10-16T13:00:10.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.272+0000 7f12cc40e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c4161180 con 0x7f12c415b0e0 2023-10-16T13:00:10.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.272+0000 7f12c99a9700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f12c40cf420 0x7f12c40b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:10.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.272+0000 7f12c99a9700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f12c40cf420 0x7f12c40b2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55660/0 (socket says 172.21.15.124:55660) 2023-10-16T13:00:10.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.272+0000 7f12c99a9700 1 -- 172.21.15.124:0/1326165111 learned_addr learned my addr 172.21.15.124:0/1326165111 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:10.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.273+0000 7f12ca9ab700 1 --2- 172.21.15.124:0/1326165111 >> v2:172.21.15.192:3300/0 conn(0x7f12c40b3240 0x7f12c4070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:10.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.273+0000 7f12ca1aa700 1 --2- 172.21.15.124:0/1326165111 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12c415b0e0 0x7f12c40ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:10.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.273+0000 7f12c99a9700 1 -- 172.21.15.124:0/1326165111 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12c415b0e0 msgr2=0x7f12c40ceee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:10.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.273+0000 7f12c99a9700 1 --2- 172.21.15.124:0/1326165111 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12c415b0e0 0x7f12c40ceee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.273+0000 7f12c99a9700 1 -- 172.21.15.124:0/1326165111 >> v2:172.21.15.192:3300/0 conn(0x7f12c40b3240 msgr2=0x7f12c4070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:10.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.273+0000 7f12c99a9700 1 --2- 172.21.15.124:0/1326165111 >> v2:172.21.15.192:3300/0 conn(0x7f12c40b3240 0x7f12c4070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.273+0000 7f12c99a9700 1 -- 172.21.15.124:0/1326165111 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c4161fe0 con 0x7f12c40cf420 2023-10-16T13:00:10.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.273+0000 7f12ca1aa700 1 --2- 172.21.15.124:0/1326165111 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12c415b0e0 0x7f12c40ceee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:00:10.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.273+0000 7f12c99a9700 1 --2- 172.21.15.124:0/1326165111 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12c40cf420 0x7f12c40b2d00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f12c40d0b30 tx=0x7f12c0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e4b95d68fb3652 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:10.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.273+0000 7f12c91a8700 1 -- 172.21.15.124:0/1326165111 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c000b870 con 0x7f12c40cf420 2023-10-16T13:00:10.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.273+0000 7f12c91a8700 1 -- 172.21.15.124:0/1326165111 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c000b9d0 con 0x7f12c40cf420 2023-10-16T13:00:10.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.273+0000 7f12c91a8700 1 -- 172.21.15.124:0/1326165111 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c000bd60 con 0x7f12c40cf420 2023-10-16T13:00:10.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.274+0000 7f12cc40e700 1 -- 172.21.15.124:0/1326165111 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12c40cf420 msgr2=0x7f12c40b2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:10.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.274+0000 7f12cc40e700 1 --2- 172.21.15.124:0/1326165111 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12c40cf420 0x7f12c40b2d00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f12c40d0b30 tx=0x7f12c0009bd0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.274+0000 7f12cc40e700 1 -- 172.21.15.124:0/1326165111 shutdown_connections 2023-10-16T13:00:10.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.274+0000 7f12cc40e700 1 --2- 172.21.15.124:0/1326165111 >> v2:172.21.15.192:3300/0 conn(0x7f12c40b3240 0x7f12c4070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.274+0000 7f12cc40e700 1 --2- 172.21.15.124:0/1326165111 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12c415b0e0 0x7f12c40ceee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.274+0000 7f12cc40e700 1 --2- 172.21.15.124:0/1326165111 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12c40cf420 0x7f12c40b2d00 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.274+0000 7f12cc40e700 1 -- 172.21.15.124:0/1326165111 >> 172.21.15.124:0/1326165111 conn(0x7f12c40cdd00 msgr2=0x7f12c40ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:10.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.274+0000 7f12cc40e700 1 -- 172.21.15.124:0/1326165111 shutdown_connections 2023-10-16T13:00:10.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.274+0000 7f12cc40e700 1 -- 172.21.15.124:0/1326165111 wait complete. 2023-10-16T13:00:10.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.275+0000 7f12cc40e700 1 Processor -- start 2023-10-16T13:00:10.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.275+0000 7f12cc40e700 1 -- start start 2023-10-16T13:00:10.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.276+0000 7f12cc40e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12c40b3240 0x7f12c40b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:10.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.276+0000 7f12cc40e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12c40cf420 0x7f12c41f3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:10.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.276+0000 7f12cc40e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12c415b0e0 0x7f12c40c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:10.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.276+0000 7f12cc40e700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c41f4130 con 0x7f12c40b3240 2023-10-16T13:00:10.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.276+0000 7f12cc40e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c40b3ea0 con 0x7f12c415b0e0 2023-10-16T13:00:10.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.276+0000 7f12cc40e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c40b4140 con 0x7f12c40cf420 2023-10-16T13:00:10.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.276+0000 7f12ca1aa700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12c40b3240 0x7f12c40b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:10.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.276+0000 7f12ca1aa700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12c40b3240 0x7f12c40b51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55664/0 (socket says 172.21.15.124:55664) 2023-10-16T13:00:10.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.276+0000 7f12ca1aa700 1 -- 172.21.15.124:0/862791706 learned_addr learned my addr 172.21.15.124:0/862791706 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:10.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.277+0000 7f12ca9ab700 1 --2- 172.21.15.124:0/862791706 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12c415b0e0 0x7f12c40c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:10.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.277+0000 7f12c99a9700 1 --2- 172.21.15.124:0/862791706 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12c40cf420 0x7f12c41f3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:10.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.277+0000 7f12ca1aa700 1 -- 172.21.15.124:0/862791706 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12c40cf420 msgr2=0x7f12c41f3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:10.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.277+0000 7f12ca1aa700 1 --2- 172.21.15.124:0/862791706 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12c40cf420 0x7f12c41f3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.277+0000 7f12ca1aa700 1 -- 172.21.15.124:0/862791706 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12c415b0e0 msgr2=0x7f12c40c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:10.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.277+0000 7f12ca1aa700 1 --2- 172.21.15.124:0/862791706 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12c415b0e0 0x7f12c40c73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.277+0000 7f12ca1aa700 1 -- 172.21.15.124:0/862791706 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c0009550 con 0x7f12c40b3240 2023-10-16T13:00:10.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.277+0000 7f12ca1aa700 1 --2- 172.21.15.124:0/862791706 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12c40b3240 0x7f12c40b51e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f12b400c750 tx=0x7f12b400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:10.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.277+0000 7f12baffd700 1 -- 172.21.15.124:0/862791706 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b4011800 con 0x7f12c40b3240 2023-10-16T13:00:10.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.277+0000 7f12baffd700 1 -- 172.21.15.124:0/862791706 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b4011960 con 0x7f12c40b3240 2023-10-16T13:00:10.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.277+0000 7f12cc40e700 1 -- 172.21.15.124:0/862791706 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c40b4420 con 0x7f12c40b3240 2023-10-16T13:00:10.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.277+0000 7f12baffd700 1 -- 172.21.15.124:0/862791706 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b4011cd0 con 0x7f12c40b3240 2023-10-16T13:00:10.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.277+0000 7f12cc40e700 1 -- 172.21.15.124:0/862791706 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c40b49e0 con 0x7f12c40b3240 2023-10-16T13:00:10.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.278+0000 7f12cc40e700 1 -- 172.21.15.124:0/862791706 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c4160d70 con 0x7f12c40b3240 2023-10-16T13:00:10.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.278+0000 7f12baffd700 1 -- 172.21.15.124:0/862791706 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f12b4021350 con 0x7f12c40b3240 2023-10-16T13:00:10.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.278+0000 7f12baffd700 1 --2- 172.21.15.124:0/862791706 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f12a806af30 0x7f12a806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:10.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.279+0000 7f12baffd700 1 -- 172.21.15.124:0/862791706 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f12b40896d0 con 0x7f12c40b3240 2023-10-16T13:00:10.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.279+0000 7f12c99a9700 1 --2- 172.21.15.124:0/862791706 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f12a806af30 0x7f12a806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:10.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.279+0000 7f12c99a9700 1 --2- 172.21.15.124:0/862791706 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f12a806af30 0x7f12a806d3f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f12c0000c00 tx=0x7f12c0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:10.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.284+0000 7f12baffd700 1 -- 172.21.15.124:0/862791706 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f12b4054640 con 0x7f12c40b3240 2023-10-16T13:00:10.471 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.468+0000 7f12cc40e700 1 -- 172.21.15.124:0/862791706 --> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f12c41616b0 con 0x7f12a806af30 2023-10-16T13:00:10.478 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.475+0000 7f12baffd700 1 -- 172.21.15.124:0/862791706 <== mgr.4104 v2:172.21.15.124:6832/2391611330 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277442 (secure 0 0 0) 0x7f12c000bbc0 con 0x7f12a806af30 2023-10-16T13:00:10.481 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:00:10.483 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.479+0000 7f12cc40e700 1 -- 172.21.15.124:0/862791706 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f12a806af30 msgr2=0x7f12a806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:10.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.479+0000 7f12cc40e700 1 --2- 172.21.15.124:0/862791706 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f12a806af30 0x7f12a806d3f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f12c0000c00 tx=0x7f12c0008030 comp rx=0 tx=0).stop 2023-10-16T13:00:10.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.479+0000 7f12cc40e700 1 -- 172.21.15.124:0/862791706 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12c40b3240 msgr2=0x7f12c40b51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:10.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.479+0000 7f12cc40e700 1 --2- 172.21.15.124:0/862791706 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12c40b3240 0x7f12c40b51e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f12b400c750 tx=0x7f12b400cb10 comp rx=0 tx=0).stop 2023-10-16T13:00:10.484 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.479+0000 7f12cc40e700 1 -- 172.21.15.124:0/862791706 shutdown_connections 2023-10-16T13:00:10.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.479+0000 7f12cc40e700 1 --2- 172.21.15.124:0/862791706 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f12a806af30 0x7f12a806d3f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.479+0000 7f12cc40e700 1 --2- 172.21.15.124:0/862791706 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12c415b0e0 0x7f12c40c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.479+0000 7f12cc40e700 1 --2- 172.21.15.124:0/862791706 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12c40b3240 0x7f12c40b51e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.479+0000 7f12cc40e700 1 --2- 172.21.15.124:0/862791706 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12c40cf420 0x7f12c41f3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.485 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.479+0000 7f12cc40e700 1 -- 172.21.15.124:0/862791706 >> 172.21.15.124:0/862791706 conn(0x7f12c40cdd00 msgr2=0x7f12c415db90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:10.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.479+0000 7f12cc40e700 1 -- 172.21.15.124:0/862791706 shutdown_connections 2023-10-16T13:00:10.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.479+0000 7f12cc40e700 1 -- 172.21.15.124:0/862791706 wait complete. 2023-10-16T13:00:10.486 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-16T13:00:10.493 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2023-10-16T13:00:08.637597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220436,"kb_used_data":4200,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754284,"statfs":{"total":773094113280,"available":772868386816,"internally_reserved":0,"allocated":4300800,"data_stored":2483016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.014921"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.630185+0000","last_change":"2023-10-16T13:00:03.630185+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.630185+0000","last_undegraded":"2023-10-16T13:00:03.630185+0000","last_fullsized":"2023-10-16T13:00:03.630185+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.629332+0000","last_change":"2023-10-16T13:00:03.629332+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.629332+0000","last_undegraded":"2023-10-16T13:00:03.629332+0000","last_fullsized":"2023-10-16T13:00:03.629332+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.626693+0000","last_change":"2023-10-16T13:00:03.626693+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.626693+0000","last_undegraded":"2023-10-16T13:00:03.626693+0000","last_fullsized":"2023-10-16T13:00:03.626693+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.631148+0000","last_change":"2023-10-16T13:00:03.631148+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.631148+0000","last_undegraded":"2023-10-16T13:00:03.631148+0000","last_fullsized":"2023-10-16T13:00:03.631148+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.629470+0000","last_change":"2023-10-16T13:00:03.629470+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.629470+0000","last_undegraded":"2023-10-16T13:00:03.629470+0000","last_fullsized":"2023-10-16T13:00:03.629470+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.625184+0000","last_change":"2023-10-16T13:00:03.625184+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.625184+0000","last_undegraded":"2023-10-16T13:00:03.625184+0000","last_fullsized":"2023-10-16T13:00:03.625184+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.626747+0000","last_change":"2023-10-16T13:00:03.626747+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.626747+0000","last_undegraded":"2023-10-16T13:00:03.626747+0000","last_fullsized":"2023-10-16T13:00:03.626747+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.630943+0000","last_change":"2023-10-16T13:00:03.630943+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.630943+0000","last_undegraded":"2023-10-16T13:00:03.630943+0000","last_fullsized":"2023-10-16T13:00:03.630943+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.625111+0000","last_change":"2023-10-16T13:00:03.625111+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.625111+0000","last_undegraded":"2023-10-16T13:00:03.625111+0000","last_fullsized":"2023-10-16T13:00:03.625111+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.629298+0000","last_change":"2023-10-16T13:00:03.629298+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.629298+0000","last_undegraded":"2023-10-16T13:00:03.629298+0000","last_fullsized":"2023-10-16T13:00:03.629298+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.629213+0000","last_change":"2023-10-16T13:00:03.629213+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.629213+0000","last_undegraded":"2023-10-16T13:00:03.629213+0000","last_fullsized":"2023-10-16T13:00:03.629213+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.624995+0000","last_change":"2023-10-16T13:00:03.624995+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.624995+0000","last_undegraded":"2023-10-16T13:00:03.624995+0000","last_fullsized":"2023-10-16T13:00:03.624995+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.625020+0000","last_change":"2023-10-16T13:00:03.625020+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.625020+0000","last_undegraded":"2023-10-16T13:00:03.625020+0000","last_fullsized":"2023-10-16T13:00:03.625020+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.626244+0000","last_change":"2023-10-16T13:00:03.626244+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.626244+0000","last_undegraded":"2023-10-16T13:00:03.626244+0000","last_fullsized":"2023-10-16T13:00:03.626244+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.629213+0000","last_change":"2023-10-16T13:00:03.629213+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.629213+0000","last_undegraded":"2023-10-16T13:00:03.629213+0000","last_fullsized":"2023-10-16T13:00:03.629213+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.625184+0000","last_change":"2023-10-16T13:00:03.625184+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.625184+0000","last_undegraded":"2023-10-16T13:00:03.625184+0000","last_fullsized":"2023-10-16T13:00:03.625184+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.629216+0000","last_change":"2023-10-16T13:00:03.629216+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.629216+0000","last_undegraded":"2023-10-16T13:00:03.629216+0000","last_fullsized":"2023-10-16T13:00:03.629216+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.631143+0000","last_change":"2023-10-16T13:00:03.631143+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.631143+0000","last_undegraded":"2023-10-16T13:00:03.631143+0000","last_fullsized":"2023-10-16T13:00:03.631143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.627883+0000","last_change":"2023-10-16T13:00:03.627883+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.627883+0000","last_undegraded":"2023-10-16T13:00:03.627883+0000","last_fullsized":"2023-10-16T13:00:03.627883+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.626476+0000","last_change":"2023-10-16T13:00:03.626476+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.626476+0000","last_undegraded":"2023-10-16T13:00:03.626476+0000","last_fullsized":"2023-10-16T13:00:03.626476+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.628265+0000","last_change":"2023-10-16T13:00:03.628265+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.628265+0000","last_undegraded":"2023-10-16T13:00:03.628265+0000","last_fullsized":"2023-10-16T13:00:03.628265+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.627796+0000","last_change":"2023-10-16T13:00:03.627796+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.627796+0000","last_undegraded":"2023-10-16T13:00:03.627796+0000","last_fullsized":"2023-10-16T13:00:03.627796+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.625191+0000","last_change":"2023-10-16T13:00:03.625191+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.625191+0000","last_undegraded":"2023-10-16T13:00:03.625191+0000","last_fullsized":"2023-10-16T13:00:03.625191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.627927+0000","last_change":"2023-10-16T13:00:03.627927+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.627927+0000","last_undegraded":"2023-10-16T13:00:03.627927+0000","last_fullsized":"2023-10-16T13:00:03.627927+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.630082+0000","last_change":"2023-10-16T13:00:03.630082+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.630082+0000","last_undegraded":"2023-10-16T13:00:03.630082+0000","last_fullsized":"2023-10-16T13:00:03.630082+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.628630+0000","last_change":"2023-10-16T13:00:03.628630+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.628630+0000","last_undegraded":"2023-10-16T13:00:03.628630+0000","last_fullsized":"2023-10-16T13:00:03.628630+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.629697+0000","last_change":"2023-10-16T13:00:03.629697+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.629697+0000","last_undegraded":"2023-10-16T13:00:03.629697+0000","last_fullsized":"2023-10-16T13:00:03.629697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.628760+0000","last_change":"2023-10-16T13:00:03.628760+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.628760+0000","last_undegraded":"2023-10-16T13:00:03.628760+0000","last_fullsized":"2023-10-16T13:00:03.628760+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.629737+0000","last_change":"2023-10-16T13:00:03.629737+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.629737+0000","last_undegraded":"2023-10-16T13:00:03.629737+0000","last_fullsized":"2023-10-16T13:00:03.629737+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.631147+0000","last_change":"2023-10-16T13:00:03.631147+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.631147+0000","last_undegraded":"2023-10-16T13:00:03.631147+0000","last_fullsized":"2023-10-16T13:00:03.631147+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.624997+0000","last_change":"2023-10-16T13:00:03.624997+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.624997+0000","last_undegraded":"2023-10-16T13:00:03.624997+0000","last_fullsized":"2023-10-16T13:00:03.624997+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T13:00:04.622149+0000","last_change":"2023-10-16T13:00:04.622149+0000","last_active":"2023-10-16T13:00:04.622149+0000","last_peered":"2023-10-16T13:00:04.622149+0000","last_clean":"2023-10-16T13:00:04.622149+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:04.622149+0000","last_undegraded":"2023-10-16T13:00:04.622149+0000","last_fullsized":"2023-10-16T13:00:04.622149+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-10-16T13:00:03.625277+0000","last_change":"2023-10-16T13:00:03.625277+0000","last_active":"2023-10-16T13:00:03.615579+0000","last_peered":"2023-10-16T13:00:03.615579+0000","last_clean":"2023-10-16T13:00:03.615579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T13:00:03.625277+0000","last_undegraded":"2023-10-16T13:00:03.625277+0000","last_fullsized":"2023-10-16T13:00:03.625277+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-16T12:59:58.490916+0000","last_change":"2023-10-16T12:58:40.198340+0000","last_active":"2023-10-16T12:59:58.490916+0000","last_peered":"2023-10-16T12:59:58.490916+0000","last_clean":"2023-10-16T12:59:58.490916+0000","last_became_active":"2023-10-16T12:58:40.197354+0000","last_became_peered":"2023-10-16T12:58:40.197354+0000","last_unstale":"2023-10-16T12:59:58.490916+0000","last_undegraded":"2023-10-16T12:59:58.490916+0000","last_fullsized":"2023-10-16T12:59:58.490916+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:39.025347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:39.025347+0000","last_clean_scrub_stamp":"2023-10-16T12:58:39.025347+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:22:36.722419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":753153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.53700000000000003}]},{"osd":1,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":4.3369999999999997,"5min":4.3369999999999997,"15min":4.3369999999999997},"last":0.48999999999999999}]},{"osd":2,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.55900000000000005}]},{"osd":3,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":4.1520000000000001,"5min":4.1520000000000001,"15min":4.1520000000000001},"last":0.70599999999999996}]},{"osd":4,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.68100000000000005}]},{"osd":5,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.63800000000000001}]},{"osd":6,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.76500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":162785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":10.58,"5min":10.58,"15min":10.58},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":7.609,"5min":7.609,"15min":7.609},"last":0.56899999999999995}]},{"osd":1,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.5129999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.52500000000000002}]},{"osd":2,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.45500000000000002},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":10.622,"5min":10.622,"15min":10.622},"last":0.46999999999999997}]},{"osd":3,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":4.6349999999999998,"5min":4.6349999999999998,"15min":4.6349999999999998},"last":0.38200000000000001}]},{"osd":4,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.35899999999999999}]},{"osd":5,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.501},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.55500000000000005}]},{"osd":7,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.53900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":162785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.38900000000000001}]},{"osd":2,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.48799999999999999}]},{"osd":4,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.89100000000000001}]},{"osd":5,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.85799999999999998}]},{"osd":6,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.77200000000000002}]},{"osd":7,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.87},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.745}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":753153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.436},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.52200000000000002}]},{"osd":2,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":3.1190000000000002,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.503},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.57999999999999996}]},{"osd":3,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.56399999999999995}]},{"osd":4,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.90700000000000003}]},{"osd":5,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.88200000000000001}]},{"osd":6,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.92500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":162785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":11.090999999999999,"5min":11.090999999999999,"15min":11.090999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":0.36199999999999999}]},{"osd":1,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":11.076000000000001,"5min":11.076000000000001,"15min":11.076000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":17.914000000000001,"5min":17.914000000000001,"15min":17.914000000000001},"last":0.33400000000000002}]},{"osd":3,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.113,"5min":11.113,"15min":11.113},"last":0.35099999999999998}]},{"osd":4,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":10.993,"5min":10.993,"15min":10.993},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.6150000000000002,"5min":2.6150000000000002,"15min":2.6150000000000002},"last":0.439},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":11.055,"5min":11.055,"15min":11.055},"last":0.52300000000000002}]},{"osd":6,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.53800000000000003}]},{"osd":7,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.8559999999999999,"5min":2.8559999999999999,"15min":2.8559999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":0.502}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":162785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":0.32200000000000001},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":26.940999999999999,"5min":26.940999999999999,"15min":26.940999999999999},"last":0.29999999999999999}]},{"osd":1,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":8.2249999999999996,"5min":8.2249999999999996,"15min":8.2249999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.40999999999999998}]},{"osd":2,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":16.018999999999998,"5min":16.018999999999998,"15min":16.018999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":0.374}]},{"osd":4,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":8.3889999999999993,"5min":8.3889999999999993,"15min":8.3889999999999993},"last":0.502},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":8.3030000000000008,"5min":8.3030000000000008,"15min":8.3030000000000008},"last":0.42199999999999999}]},{"osd":5,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.51600000000000001},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":8.4139999999999997,"5min":8.4139999999999997,"15min":8.4139999999999997},"last":0.436}]},{"osd":6,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":8.2699999999999996,"5min":8.2699999999999996,"15min":8.2699999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.53600000000000003}]},{"osd":7,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":8.3629999999999995,"5min":8.3629999999999995,"15min":8.3629999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":8.3320000000000007,"5min":8.3320000000000007,"15min":8.3320000000000007},"last":0.45100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":162785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":3.7970000000000002,"5min":3.7970000000000002,"15min":3.7970000000000002},"last":0.43099999999999999}]},{"osd":1,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.52300000000000002}]},{"osd":2,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.56100000000000005}]},{"osd":3,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.626}]},{"osd":5,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.59299999999999997}]},{"osd":6,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.60899999999999999}]},{"osd":7,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.66200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":162785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.443},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.48799999999999999}]},{"osd":1,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.36399999999999999}]},{"osd":2,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.57099999999999995}]},{"osd":3,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.61399999999999999}]},{"osd":4,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.628},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.59399999999999997}]},{"osd":6,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.70099999999999996}]},{"osd":7,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:00:10.499 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2023-10-16T13:00:10.500 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.500 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2023-10-16T13:00:10.501 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.501 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2023-10-16T13:00:10.501 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.502 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2023-10-16T13:00:10.502 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.503 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2023-10-16T13:00:10.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2023-10-16T13:00:10.504 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2023-10-16T13:00:10.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.505 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2023-10-16T13:00:10.506 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.506 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2023-10-16T13:00:10.506 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.507 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2023-10-16T13:00:10.507 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.508 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2023-10-16T13:00:10.508 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.508 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2023-10-16T13:00:10.509 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2023-10-16T13:00:10.509 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2023-10-16T13:00:10.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2023-10-16T13:00:10.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2023-10-16T13:00:10.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2023-10-16T13:00:10.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2023-10-16T13:00:10.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2023-10-16T13:00:10.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2023-10-16T13:00:10.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2023-10-16T13:00:10.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2023-10-16T13:00:10.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2023-10-16T13:00:10.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2023-10-16T13:00:10.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2023-10-16T13:00:10.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2023-10-16T13:00:10.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2023-10-16T13:00:10.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2023-10-16T13:00:10.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.522 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2023-10-16T13:00:10.522 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.523 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2023-10-16T13:00:10.523 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.523 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2023-10-16T13:00:10.524 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.524 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2023-10-16T13:00:10.525 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.525 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-10-16T13:00:10.525 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.526 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-10-16T13:00:10.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.630185+0000', 'last_change': '2023-10-16T13:00:03.630185+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.630185+0000', 'last_undegraded': '2023-10-16T13:00:03.630185+0000', 'last_fullsized': '2023-10-16T13:00:03.630185+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-16T13:00:10.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-10-16T13:00:10.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-10-16T13:00:10.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.629332+0000', 'last_change': '2023-10-16T13:00:03.629332+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.629332+0000', 'last_undegraded': '2023-10-16T13:00:03.629332+0000', 'last_fullsized': '2023-10-16T13:00:03.629332+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T13:00:10.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-10-16T13:00:10.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-10-16T13:00:10.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.626693+0000', 'last_change': '2023-10-16T13:00:03.626693+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.626693+0000', 'last_undegraded': '2023-10-16T13:00:03.626693+0000', 'last_fullsized': '2023-10-16T13:00:03.626693+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T13:00:10.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-10-16T13:00:10.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-10-16T13:00:10.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.631148+0000', 'last_change': '2023-10-16T13:00:03.631148+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.631148+0000', 'last_undegraded': '2023-10-16T13:00:03.631148+0000', 'last_fullsized': '2023-10-16T13:00:03.631148+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-16T13:00:10.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-10-16T13:00:10.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-10-16T13:00:10.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.629470+0000', 'last_change': '2023-10-16T13:00:03.629470+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.629470+0000', 'last_undegraded': '2023-10-16T13:00:03.629470+0000', 'last_fullsized': '2023-10-16T13:00:03.629470+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-16T13:00:10.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-10-16T13:00:10.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-10-16T13:00:10.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.625184+0000', 'last_change': '2023-10-16T13:00:03.625184+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.625184+0000', 'last_undegraded': '2023-10-16T13:00:03.625184+0000', 'last_fullsized': '2023-10-16T13:00:03.625184+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T13:00:10.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-10-16T13:00:10.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-10-16T13:00:10.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.626747+0000', 'last_change': '2023-10-16T13:00:03.626747+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.626747+0000', 'last_undegraded': '2023-10-16T13:00:03.626747+0000', 'last_fullsized': '2023-10-16T13:00:03.626747+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T13:00:10.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-10-16T13:00:10.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-10-16T13:00:10.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.630943+0000', 'last_change': '2023-10-16T13:00:03.630943+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.630943+0000', 'last_undegraded': '2023-10-16T13:00:03.630943+0000', 'last_fullsized': '2023-10-16T13:00:03.630943+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-16T13:00:10.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-10-16T13:00:10.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-10-16T13:00:10.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.625111+0000', 'last_change': '2023-10-16T13:00:03.625111+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.625111+0000', 'last_undegraded': '2023-10-16T13:00:03.625111+0000', 'last_fullsized': '2023-10-16T13:00:03.625111+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T13:00:10.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-10-16T13:00:10.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-10-16T13:00:10.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.629298+0000', 'last_change': '2023-10-16T13:00:03.629298+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.629298+0000', 'last_undegraded': '2023-10-16T13:00:03.629298+0000', 'last_fullsized': '2023-10-16T13:00:03.629298+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-16T13:00:10.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-10-16T13:00:10.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-10-16T13:00:10.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.629213+0000', 'last_change': '2023-10-16T13:00:03.629213+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.629213+0000', 'last_undegraded': '2023-10-16T13:00:03.629213+0000', 'last_fullsized': '2023-10-16T13:00:03.629213+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-16T13:00:10.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-10-16T13:00:10.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-10-16T13:00:10.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.624995+0000', 'last_change': '2023-10-16T13:00:03.624995+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.624995+0000', 'last_undegraded': '2023-10-16T13:00:03.624995+0000', 'last_fullsized': '2023-10-16T13:00:03.624995+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T13:00:10.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-10-16T13:00:10.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-10-16T13:00:10.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.625020+0000', 'last_change': '2023-10-16T13:00:03.625020+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.625020+0000', 'last_undegraded': '2023-10-16T13:00:03.625020+0000', 'last_fullsized': '2023-10-16T13:00:03.625020+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T13:00:10.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-10-16T13:00:10.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-10-16T13:00:10.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.626244+0000', 'last_change': '2023-10-16T13:00:03.626244+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.626244+0000', 'last_undegraded': '2023-10-16T13:00:03.626244+0000', 'last_fullsized': '2023-10-16T13:00:03.626244+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T13:00:10.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-10-16T13:00:10.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-10-16T13:00:10.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.629213+0000', 'last_change': '2023-10-16T13:00:03.629213+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.629213+0000', 'last_undegraded': '2023-10-16T13:00:03.629213+0000', 'last_fullsized': '2023-10-16T13:00:03.629213+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-16T13:00:10.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-10-16T13:00:10.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-10-16T13:00:10.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.625184+0000', 'last_change': '2023-10-16T13:00:03.625184+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.625184+0000', 'last_undegraded': '2023-10-16T13:00:03.625184+0000', 'last_fullsized': '2023-10-16T13:00:03.625184+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T13:00:10.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-10-16T13:00:10.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-10-16T13:00:10.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.629216+0000', 'last_change': '2023-10-16T13:00:03.629216+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.629216+0000', 'last_undegraded': '2023-10-16T13:00:03.629216+0000', 'last_fullsized': '2023-10-16T13:00:03.629216+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-16T13:00:10.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-10-16T13:00:10.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-10-16T13:00:10.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.631143+0000', 'last_change': '2023-10-16T13:00:03.631143+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.631143+0000', 'last_undegraded': '2023-10-16T13:00:03.631143+0000', 'last_fullsized': '2023-10-16T13:00:03.631143+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-16T13:00:10.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-10-16T13:00:10.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.559 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-10-16T13:00:10.559 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.627883+0000', 'last_change': '2023-10-16T13:00:03.627883+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.627883+0000', 'last_undegraded': '2023-10-16T13:00:03.627883+0000', 'last_fullsized': '2023-10-16T13:00:03.627883+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T13:00:10.559 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-10-16T13:00:10.560 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.560 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-10-16T13:00:10.561 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.626476+0000', 'last_change': '2023-10-16T13:00:03.626476+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.626476+0000', 'last_undegraded': '2023-10-16T13:00:03.626476+0000', 'last_fullsized': '2023-10-16T13:00:03.626476+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T13:00:10.561 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-10-16T13:00:10.561 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.562 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-10-16T13:00:10.562 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.628265+0000', 'last_change': '2023-10-16T13:00:03.628265+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.628265+0000', 'last_undegraded': '2023-10-16T13:00:03.628265+0000', 'last_fullsized': '2023-10-16T13:00:03.628265+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T13:00:10.563 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-10-16T13:00:10.563 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.564 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-10-16T13:00:10.564 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.627796+0000', 'last_change': '2023-10-16T13:00:03.627796+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.627796+0000', 'last_undegraded': '2023-10-16T13:00:03.627796+0000', 'last_fullsized': '2023-10-16T13:00:03.627796+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T13:00:10.565 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-10-16T13:00:10.565 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.566 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-10-16T13:00:10.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.625191+0000', 'last_change': '2023-10-16T13:00:03.625191+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.625191+0000', 'last_undegraded': '2023-10-16T13:00:03.625191+0000', 'last_fullsized': '2023-10-16T13:00:03.625191+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T13:00:10.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-10-16T13:00:10.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-10-16T13:00:10.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.627927+0000', 'last_change': '2023-10-16T13:00:03.627927+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.627927+0000', 'last_undegraded': '2023-10-16T13:00:03.627927+0000', 'last_fullsized': '2023-10-16T13:00:03.627927+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T13:00:10.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-10-16T13:00:10.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-10-16T13:00:10.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.630082+0000', 'last_change': '2023-10-16T13:00:03.630082+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.630082+0000', 'last_undegraded': '2023-10-16T13:00:03.630082+0000', 'last_fullsized': '2023-10-16T13:00:03.630082+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-16T13:00:10.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-10-16T13:00:10.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-10-16T13:00:10.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.628630+0000', 'last_change': '2023-10-16T13:00:03.628630+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.628630+0000', 'last_undegraded': '2023-10-16T13:00:03.628630+0000', 'last_fullsized': '2023-10-16T13:00:03.628630+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T13:00:10.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-10-16T13:00:10.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-10-16T13:00:10.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.629697+0000', 'last_change': '2023-10-16T13:00:03.629697+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.629697+0000', 'last_undegraded': '2023-10-16T13:00:03.629697+0000', 'last_fullsized': '2023-10-16T13:00:03.629697+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T13:00:10.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-10-16T13:00:10.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-10-16T13:00:10.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.628760+0000', 'last_change': '2023-10-16T13:00:03.628760+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.628760+0000', 'last_undegraded': '2023-10-16T13:00:03.628760+0000', 'last_fullsized': '2023-10-16T13:00:03.628760+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T13:00:10.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-10-16T13:00:10.577 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.578 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-10-16T13:00:10.578 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.629737+0000', 'last_change': '2023-10-16T13:00:03.629737+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.629737+0000', 'last_undegraded': '2023-10-16T13:00:03.629737+0000', 'last_fullsized': '2023-10-16T13:00:03.629737+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-16T13:00:10.579 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-10-16T13:00:10.579 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.580 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-10-16T13:00:10.580 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.631147+0000', 'last_change': '2023-10-16T13:00:03.631147+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.631147+0000', 'last_undegraded': '2023-10-16T13:00:03.631147+0000', 'last_fullsized': '2023-10-16T13:00:03.631147+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-16T13:00:10.580 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-10-16T13:00:10.581 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.581 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-10-16T13:00:10.582 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.624997+0000', 'last_change': '2023-10-16T13:00:03.624997+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.624997+0000', 'last_undegraded': '2023-10-16T13:00:03.624997+0000', 'last_fullsized': '2023-10-16T13:00:03.624997+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T13:00:10.582 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-10-16T13:00:10.582 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T13:00:04.622149+0000', 'last_change': '2023-10-16T13:00:04.622149+0000', 'last_active': '2023-10-16T13:00:04.622149+0000', 'last_peered': '2023-10-16T13:00:04.622149+0000', 'last_clean': '2023-10-16T13:00:04.622149+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:04.622149+0000', 'last_undegraded': '2023-10-16T13:00:04.622149+0000', 'last_fullsized': '2023-10-16T13:00:04.622149+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:04.622149+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T13:00:10.583 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-10-16T13:00:10.583 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-10-16T13:00:03.625277+0000', 'last_change': '2023-10-16T13:00:03.625277+0000', 'last_active': '2023-10-16T13:00:03.615579+0000', 'last_peered': '2023-10-16T13:00:03.615579+0000', 'last_clean': '2023-10-16T13:00:03.615579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T13:00:03.625277+0000', 'last_undegraded': '2023-10-16T13:00:03.625277+0000', 'last_fullsized': '2023-10-16T13:00:03.625277+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'last_clean_scrub_stamp': '2023-10-16T13:00:03.615579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T13:00:10.584 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-16T13:00:10.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.702+0000 7f766188e700 1 Processor -- start 2023-10-16T13:00:10.705 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.702+0000 7f766188e700 1 -- start start 2023-10-16T13:00:10.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.703+0000 7f766188e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f765c0cf7d0 0x7f765c15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:10.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.703+0000 7f766188e700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f765c0ca7d0 0x7f765c071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:10.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.703+0000 7f766188e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f765c0cfeb0 con 0x7f765c06a820 2023-10-16T13:00:10.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.703+0000 7f766188e700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765c0ce410 con 0x7f765c0ca7d0 2023-10-16T13:00:10.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.703+0000 7f766188e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765c0cfc30 con 0x7f765c0cf7d0 2023-10-16T13:00:10.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.703+0000 7f765b7fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f765c0ca7d0 0x7f765c071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:10.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.703+0000 7f765b7fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f765c0ca7d0 0x7f765c071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55676/0 (socket says 172.21.15.124:55676) 2023-10-16T13:00:10.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.703+0000 7f765b7fe700 1 -- 172.21.15.124:0/1394277401 learned_addr learned my addr 172.21.15.124:0/1394277401 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:10.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.704+0000 7f765a7fc700 1 --2- 172.21.15.124:0/1394277401 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f765c0cf7d0 0x7f765c15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:10.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.704+0000 7f765b7fe700 1 -- 172.21.15.124:0/1394277401 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f765c0cf7d0 msgr2=0x7f765c15e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:10.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.704+0000 7f765b7fe700 1 --2- 172.21.15.124:0/1394277401 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f765c0cf7d0 0x7f765c15e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.710 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.704+0000 7f765b7fe700 1 -- 172.21.15.124:0/1394277401 >> v1:172.21.15.192:6789/0 conn(0x7f765c06a820 legacy=0x7f765c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:10.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.704+0000 7f765b7fe700 1 -- 172.21.15.124:0/1394277401 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765c0af9d0 con 0x7f765c0ca7d0 2023-10-16T13:00:10.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.704+0000 7f765a7fc700 1 --2- 172.21.15.124:0/1394277401 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f765c0cf7d0 0x7f765c15e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:00:10.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.704+0000 7f765b7fe700 1 --2- 172.21.15.124:0/1394277401 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f765c0ca7d0 0x7f765c071ea0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f76540098f0 tx=0x7f7654009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ddc0104d650cff server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:10.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.704+0000 7f7659ffb700 1 -- 172.21.15.124:0/1394277401 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7654005e80 con 0x7f765c0ca7d0 2023-10-16T13:00:10.711 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.704+0000 7f7659ffb700 1 -- 172.21.15.124:0/1394277401 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7654006030 con 0x7f765c0ca7d0 2023-10-16T13:00:10.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.704+0000 7f7659ffb700 1 -- 172.21.15.124:0/1394277401 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76540063a0 con 0x7f765c0ca7d0 2023-10-16T13:00:10.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.704+0000 7f766188e700 1 -- 172.21.15.124:0/1394277401 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f765c0ca7d0 msgr2=0x7f765c071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:10.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.704+0000 7f766188e700 1 --2- 172.21.15.124:0/1394277401 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f765c0ca7d0 0x7f765c071ea0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f76540098f0 tx=0x7f7654009c00 comp rx=0 tx=0).stop 2023-10-16T13:00:10.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.705+0000 7f766188e700 1 -- 172.21.15.124:0/1394277401 shutdown_connections 2023-10-16T13:00:10.712 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.705+0000 7f766188e700 1 --2- 172.21.15.124:0/1394277401 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f765c0ca7d0 0x7f765c071ea0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.705+0000 7f766188e700 1 --2- 172.21.15.124:0/1394277401 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f765c0cf7d0 0x7f765c15e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.705+0000 7f766188e700 1 -- 172.21.15.124:0/1394277401 >> 172.21.15.124:0/1394277401 conn(0x7f765c0d0180 msgr2=0x7f765c0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:10.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.705+0000 7f766188e700 1 -- 172.21.15.124:0/1394277401 shutdown_connections 2023-10-16T13:00:10.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.705+0000 7f766188e700 1 -- 172.21.15.124:0/1394277401 wait complete. 2023-10-16T13:00:10.713 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.706+0000 7f766188e700 1 Processor -- start 2023-10-16T13:00:10.714 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.706+0000 7f766188e700 1 -- start start 2023-10-16T13:00:10.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.707+0000 7f766188e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f765c06a820 0x7f765c0c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:10.716 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.707+0000 7f766188e700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f765c0ca7d0 0x7f765c157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:10.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.707+0000 7f766188e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f765c0cf7d0 0x7f765c06e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:10.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.707+0000 7f766188e700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c1f2c30 con 0x7f765c0ca7d0 2023-10-16T13:00:10.717 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.707+0000 7f766188e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c0c9c60 con 0x7f765c06a820 2023-10-16T13:00:10.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.707+0000 7f766188e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765c0add20 con 0x7f765c0cf7d0 2023-10-16T13:00:10.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.707+0000 7f765a7fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f765c0ca7d0 0x7f765c157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:10.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.707+0000 7f765a7fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f765c0ca7d0 0x7f765c157010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55680/0 (socket says 172.21.15.124:55680) 2023-10-16T13:00:10.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.707+0000 7f765a7fc700 1 -- 172.21.15.124:0/3173505617 learned_addr learned my addr 172.21.15.124:0/3173505617 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:10.718 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.707+0000 7f765affd700 1 --2- 172.21.15.124:0/3173505617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f765c06a820 0x7f765c0c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:10.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.707+0000 7f765b7fe700 1 --2- 172.21.15.124:0/3173505617 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f765c0cf7d0 0x7f765c06e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:10.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.707+0000 7f765a7fc700 1 -- 172.21.15.124:0/3173505617 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f765c0cf7d0 msgr2=0x7f765c06e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:10.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.707+0000 7f765a7fc700 1 --2- 172.21.15.124:0/3173505617 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f765c0cf7d0 0x7f765c06e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.707+0000 7f765a7fc700 1 -- 172.21.15.124:0/3173505617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f765c06a820 msgr2=0x7f765c0c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:10.719 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.707+0000 7f765a7fc700 1 --2- 172.21.15.124:0/3173505617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f765c06a820 0x7f765c0c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.707+0000 7f765a7fc700 1 -- 172.21.15.124:0/3173505617 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7654009550 con 0x7f765c0ca7d0 2023-10-16T13:00:10.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.707+0000 7f765b7fe700 1 --2- 172.21.15.124:0/3173505617 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f765c0cf7d0 0x7f765c06e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:00:10.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.707+0000 7f765a7fc700 1 --2- 172.21.15.124:0/3173505617 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f765c0ca7d0 0x7f765c157010 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f764400e760 tx=0x7f764400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:10.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.707+0000 7f7653fff700 1 -- 172.21.15.124:0/3173505617 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644013610 con 0x7f765c0ca7d0 2023-10-16T13:00:10.720 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.707+0000 7f7653fff700 1 -- 172.21.15.124:0/3173505617 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7644013770 con 0x7f765c0ca7d0 2023-10-16T13:00:10.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.707+0000 7f766188e700 1 -- 172.21.15.124:0/3173505617 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f765c157550 con 0x7f765c0ca7d0 2023-10-16T13:00:10.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.707+0000 7f7653fff700 1 -- 172.21.15.124:0/3173505617 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644013b20 con 0x7f765c0ca7d0 2023-10-16T13:00:10.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.707+0000 7f766188e700 1 -- 172.21.15.124:0/3173505617 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765c0c8f20 con 0x7f765c0ca7d0 2023-10-16T13:00:10.721 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.708+0000 7f766188e700 1 -- 172.21.15.124:0/3173505617 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f765c04ebb0 con 0x7f765c0ca7d0 2023-10-16T13:00:10.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.709+0000 7f7653fff700 1 -- 172.21.15.124:0/3173505617 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7644013c80 con 0x7f765c0ca7d0 2023-10-16T13:00:10.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.709+0000 7f7653fff700 1 --2- 172.21.15.124:0/3173505617 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f763c06af00 0x7f763c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:10.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.709+0000 7f7653fff700 1 -- 172.21.15.124:0/3173505617 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7644089260 con 0x7f765c0ca7d0 2023-10-16T13:00:10.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.709+0000 7f765affd700 1 --2- 172.21.15.124:0/3173505617 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f763c06af00 0x7f763c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:10.722 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.710+0000 7f765affd700 1 --2- 172.21.15.124:0/3173505617 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f763c06af00 0x7f763c06d3c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f764c0012e0 tx=0x7f764c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:10.723 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.714+0000 7f7653fff700 1 -- 172.21.15.124:0/3173505617 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f76440541d0 con 0x7f765c0ca7d0 2023-10-16T13:00:10.987 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.984+0000 7f766188e700 1 -- 172.21.15.124:0/3173505617 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f765c06b490 con 0x7f765c0ca7d0 2023-10-16T13:00:10.987 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.985+0000 7f7653fff700 1 -- 172.21.15.124:0/3173505617 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1173 (secure 0 0 0) 0x7f76440577f0 con 0x7f765c0ca7d0 2023-10-16T13:00:10.988 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:00:10.988 INFO:teuthology.orchestra.run.smithi124.stdout:{"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":104,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":38,"num_osds":8,"num_up_osds":8,"osd_up_since":1697461117,"num_in_osds":8,"osd_in_since":1697461109,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":226099200,"bytes_avail":772868014080,"bytes_total":773094113280,"write_bytes_sec":2384,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":5352}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-10-16T12:59:46.633499+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-16T13:00:10.989 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.987+0000 7f766188e700 1 -- 172.21.15.124:0/3173505617 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f763c06af00 msgr2=0x7f763c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:10.990 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.987+0000 7f766188e700 1 --2- 172.21.15.124:0/3173505617 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f763c06af00 0x7f763c06d3c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f764c0012e0 tx=0x7f764c009040 comp rx=0 tx=0).stop 2023-10-16T13:00:10.990 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.987+0000 7f766188e700 1 -- 172.21.15.124:0/3173505617 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f765c0ca7d0 msgr2=0x7f765c157010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:10.990 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.987+0000 7f766188e700 1 --2- 172.21.15.124:0/3173505617 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f765c0ca7d0 0x7f765c157010 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f764400e760 tx=0x7f764400ea70 comp rx=0 tx=0).stop 2023-10-16T13:00:10.990 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.987+0000 7f766188e700 1 -- 172.21.15.124:0/3173505617 shutdown_connections 2023-10-16T13:00:10.990 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.987+0000 7f766188e700 1 --2- 172.21.15.124:0/3173505617 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f763c06af00 0x7f763c06d3c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.991 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.987+0000 7f766188e700 1 --2- 172.21.15.124:0/3173505617 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f765c0cf7d0 0x7f765c06e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.991 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.987+0000 7f766188e700 1 --2- 172.21.15.124:0/3173505617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f765c06a820 0x7f765c0c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.991 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.987+0000 7f766188e700 1 --2- 172.21.15.124:0/3173505617 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f765c0ca7d0 0x7f765c157010 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:10.991 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.987+0000 7f766188e700 1 -- 172.21.15.124:0/3173505617 >> 172.21.15.124:0/3173505617 conn(0x7f765c0d0180 msgr2=0x7f765c0afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:10.991 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.987+0000 7f766188e700 1 -- 172.21.15.124:0/3173505617 shutdown_connections 2023-10-16T13:00:10.992 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:10.987+0000 7f766188e700 1 -- 172.21.15.124:0/3173505617 wait complete. 2023-10-16T13:00:11.001 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-16T13:00:11.002 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:00:11.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.118+0000 7fbd4f9d4700 1 Processor -- start 2023-10-16T13:00:11.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.118+0000 7fbd4f9d4700 1 -- start start 2023-10-16T13:00:11.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.119+0000 7fbd4f9d4700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbd4815e5b0 0x7fbd480cab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:11.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.119+0000 7fbd4f9d4700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd480cb0a0 con 0x7fbd4806df50 2023-10-16T13:00:11.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.119+0000 7fbd4f9d4700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd480cb2f0 con 0x7fbd4806ea40 2023-10-16T13:00:11.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.119+0000 7fbd4f9d4700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd480cb5d0 con 0x7fbd4815e5b0 2023-10-16T13:00:11.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.119+0000 7fbd4d770700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fbd4806df50 0x7fbd4806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:44354/0 (socket says 172.21.15.124:44354) 2023-10-16T13:00:11.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.119+0000 7fbd4d770700 1 -- 172.21.15.124:0/3134185960 learned_addr learned my addr 172.21.15.124:0/3134185960 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T13:00:11.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd4df71700 1 --2- 172.21.15.124:0/3134185960 >> v2:172.21.15.192:3300/0 conn(0x7fbd4815e5b0 0x7fbd480cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:11.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd3bfff700 1 -- 172.21.15.124:0/3134185960 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2252649609 0 0) 0x7fbd480cb0a0 con 0x7fbd4806df50 2023-10-16T13:00:11.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd3bfff700 1 -- 172.21.15.124:0/3134185960 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd340035b0 con 0x7fbd4806df50 2023-10-16T13:00:11.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd3bfff700 1 -- 172.21.15.124:0/3134185960 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3417415078 0 0) 0x7fbd340035b0 con 0x7fbd4806df50 2023-10-16T13:00:11.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd3bfff700 1 -- 172.21.15.124:0/3134185960 >> v2:172.21.15.192:3300/0 conn(0x7fbd4815e5b0 msgr2=0x7fbd480cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:11.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd3bfff700 1 --2- 172.21.15.124:0/3134185960 >> v2:172.21.15.192:3300/0 conn(0x7fbd4815e5b0 0x7fbd480cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:11.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd3bfff700 1 -- 172.21.15.124:0/3134185960 >> v1:172.21.15.192:6789/0 conn(0x7fbd4806ea40 legacy=0x7fbd4815dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:11.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd3bfff700 1 -- 172.21.15.124:0/3134185960 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd480cb8b0 con 0x7fbd4806df50 2023-10-16T13:00:11.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd3bfff700 1 -- 172.21.15.124:0/3134185960 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7fbd3c001670 con 0x7fbd4806df50 2023-10-16T13:00:11.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd3bfff700 1 -- 172.21.15.124:0/3134185960 >> v1:172.21.15.124:6789/0 conn(0x7fbd4806df50 legacy=0x7fbd4806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:11.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd3bfff700 1 --2- 172.21.15.124:0/3134185960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd34003a00 0x7fbd34003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:11.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd3bfff700 1 --2- 172.21.15.124:0/3134185960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbd34004850 0x7fbd34004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:11.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd3bfff700 1 --2- 172.21.15.124:0/3134185960 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd34005210 0x7fbd3400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:11.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd3bfff700 1 -- 172.21.15.124:0/3134185960 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd480cb5d0 con 0x7fbd34005210 2023-10-16T13:00:11.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd3bfff700 1 -- 172.21.15.124:0/3134185960 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3400c0b0 con 0x7fbd34003a00 2023-10-16T13:00:11.277 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd3bfff700 1 -- 172.21.15.124:0/3134185960 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3400c270 con 0x7fbd34004850 2023-10-16T13:00:11.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd4df71700 1 --2- 172.21.15.124:0/3134185960 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd34005210 0x7fbd3400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:11.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd4d770700 1 --2- 172.21.15.124:0/3134185960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd34003a00 0x7fbd34003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:11.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd4cf6f700 1 --2- 172.21.15.124:0/3134185960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbd34004850 0x7fbd34004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:11.278 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd4df71700 1 -- 172.21.15.124:0/3134185960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbd34004850 msgr2=0x7fbd34004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:11.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd4df71700 1 --2- 172.21.15.124:0/3134185960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbd34004850 0x7fbd34004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:11.279 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd4df71700 1 -- 172.21.15.124:0/3134185960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd34003a00 msgr2=0x7fbd34003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:11.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd4df71700 1 --2- 172.21.15.124:0/3134185960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd34003a00 0x7fbd34003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:11.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd4df71700 1 -- 172.21.15.124:0/3134185960 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd340035b0 con 0x7fbd34005210 2023-10-16T13:00:11.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd4cf6f700 1 --2- 172.21.15.124:0/3134185960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbd34004850 0x7fbd34004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:00:11.280 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.120+0000 7fbd4df71700 1 -- 172.21.15.124:0/3134185960 reap_dead start 2023-10-16T13:00:11.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.121+0000 7fbd4df71700 1 --2- 172.21.15.124:0/3134185960 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd34005210 0x7fbd3400ba10 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009fc0 tx=0x7fbd34005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699f9568b1975e4b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:11.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.121+0000 7fbd3bfff700 1 -- 172.21.15.124:0/3134185960 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd40003a20 con 0x7fbd34005210 2023-10-16T13:00:11.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.121+0000 7fbd3bfff700 1 -- 172.21.15.124:0/3134185960 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4000f040 con 0x7fbd34005210 2023-10-16T13:00:11.281 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.121+0000 7fbd3bfff700 1 -- 172.21.15.124:0/3134185960 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd40003da0 con 0x7fbd34005210 2023-10-16T13:00:11.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.121+0000 7fbd4f9d4700 1 -- 172.21.15.124:0/3134185960 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd34005210 msgr2=0x7fbd3400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:11.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.121+0000 7fbd4f9d4700 1 --2- 172.21.15.124:0/3134185960 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd34005210 0x7fbd3400ba10 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009fc0 tx=0x7fbd34005880 comp rx=0 tx=0).stop 2023-10-16T13:00:11.282 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.121+0000 7fbd4f9d4700 1 -- 172.21.15.124:0/3134185960 shutdown_connections 2023-10-16T13:00:11.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.121+0000 7fbd4f9d4700 1 --2- 172.21.15.124:0/3134185960 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd34005210 0x7fbd3400ba10 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:11.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.121+0000 7fbd4f9d4700 1 -- 172.21.15.124:0/3134185960 >> 172.21.15.124:0/3134185960 conn(0x7fbd480cfcd0 msgr2=0x7fbd480d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:11.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.121+0000 7fbd4f9d4700 1 -- 172.21.15.124:0/3134185960 shutdown_connections 2023-10-16T13:00:11.283 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.121+0000 7fbd4f9d4700 1 -- 172.21.15.124:0/3134185960 wait complete. 2023-10-16T13:00:11.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.123+0000 7fbd4f9d4700 1 Processor -- start 2023-10-16T13:00:11.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.123+0000 7fbd4f9d4700 1 -- start start 2023-10-16T13:00:11.284 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.123+0000 7fbd4f9d4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd34005210 0x7fbd480b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:11.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.123+0000 7fbd4f9d4700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd480c69b0 0x7fbd4814c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:11.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.123+0000 7fbd4f9d4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbd480c8360 0x7fbd480c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:11.285 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.123+0000 7fbd4f9d4700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd480c37e0 con 0x7fbd480c69b0 2023-10-16T13:00:11.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.123+0000 7fbd4f9d4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd480c8d20 con 0x7fbd34005210 2023-10-16T13:00:11.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.123+0000 7fbd4f9d4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4814c7d0 con 0x7fbd480c8360 2023-10-16T13:00:11.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.123+0000 7fbd4cf6f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd480c69b0 0x7fbd4814c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:11.286 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.123+0000 7fbd4cf6f700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd480c69b0 0x7fbd4814c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55698/0 (socket says 172.21.15.124:55698) 2023-10-16T13:00:11.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.123+0000 7fbd4cf6f700 1 -- 172.21.15.124:0/2367661367 learned_addr learned my addr 172.21.15.124:0/2367661367 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:11.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.124+0000 7fbd4d770700 1 --2- 172.21.15.124:0/2367661367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd34005210 0x7fbd480b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:11.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.124+0000 7fbd4df71700 1 --2- 172.21.15.124:0/2367661367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbd480c8360 0x7fbd480c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:11.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.124+0000 7fbd4cf6f700 1 -- 172.21.15.124:0/2367661367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbd480c8360 msgr2=0x7fbd480c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:11.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.124+0000 7fbd4cf6f700 1 --2- 172.21.15.124:0/2367661367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbd480c8360 0x7fbd480c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:11.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.124+0000 7fbd4cf6f700 1 -- 172.21.15.124:0/2367661367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd34005210 msgr2=0x7fbd480b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:11.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.124+0000 7fbd4cf6f700 1 --2- 172.21.15.124:0/2367661367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd34005210 0x7fbd480b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:11.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.124+0000 7fbd4cf6f700 1 -- 172.21.15.124:0/2367661367 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd480c7120 con 0x7fbd480c69b0 2023-10-16T13:00:11.288 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.124+0000 7fbd4cf6f700 1 --2- 172.21.15.124:0/2367661367 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd480c69b0 0x7fbd4814c290 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400e480 tx=0x7fbd4400e790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:11.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.124+0000 7fbd39ffb700 1 -- 172.21.15.124:0/2367661367 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4400ee10 con 0x7fbd480c69b0 2023-10-16T13:00:11.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.124+0000 7fbd39ffb700 1 -- 172.21.15.124:0/2367661367 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd440052e0 con 0x7fbd480c69b0 2023-10-16T13:00:11.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.124+0000 7fbd4f9d4700 1 -- 172.21.15.124:0/2367661367 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd480c7400 con 0x7fbd480c69b0 2023-10-16T13:00:11.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.124+0000 7fbd39ffb700 1 -- 172.21.15.124:0/2367661367 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd44003680 con 0x7fbd480c69b0 2023-10-16T13:00:11.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.124+0000 7fbd4f9d4700 1 -- 172.21.15.124:0/2367661367 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd480c79c0 con 0x7fbd480c69b0 2023-10-16T13:00:11.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.125+0000 7fbd4f9d4700 1 -- 172.21.15.124:0/2367661367 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd480b58f0 con 0x7fbd480c69b0 2023-10-16T13:00:11.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.125+0000 7fbd39ffb700 1 -- 172.21.15.124:0/2367661367 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbd440037e0 con 0x7fbd480c69b0 2023-10-16T13:00:11.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.126+0000 7fbd39ffb700 1 --2- 172.21.15.124:0/2367661367 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbd2c06af00 0x7fbd2c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:11.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.126+0000 7fbd39ffb700 1 -- 172.21.15.124:0/2367661367 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbd44088b10 con 0x7fbd480c69b0 2023-10-16T13:00:11.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.126+0000 7fbd4d770700 1 --2- 172.21.15.124:0/2367661367 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbd2c06af00 0x7fbd2c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:11.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.126+0000 7fbd4d770700 1 --2- 172.21.15.124:0/2367661367 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbd2c06af00 0x7fbd2c06d3c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c001050 tx=0x7fbd3c001c30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:11.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.130+0000 7fbd39ffb700 1 -- 172.21.15.124:0/2367661367 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbd44053bc0 con 0x7fbd480c69b0 2023-10-16T13:00:11.316 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.314+0000 7fbd4f9d4700 1 -- 172.21.15.124:0/2367661367 --> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbd480cbe70 con 0x7fbd2c06af00 2023-10-16T13:00:11.324 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.321+0000 7fbd39ffb700 1 -- 172.21.15.124:0/2367661367 <== mgr.4104 v2:172.21.15.124:6832/2391611330 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289326 (secure 0 0 0) 0x7fbd3c001600 con 0x7fbd2c06af00 2023-10-16T13:00:11.325 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:00:11.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.326+0000 7fbd4f9d4700 1 -- 172.21.15.124:0/2367661367 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbd2c06af00 msgr2=0x7fbd2c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:11.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.326+0000 7fbd4f9d4700 1 --2- 172.21.15.124:0/2367661367 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbd2c06af00 0x7fbd2c06d3c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c001050 tx=0x7fbd3c001c30 comp rx=0 tx=0).stop 2023-10-16T13:00:11.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.326+0000 7fbd4f9d4700 1 -- 172.21.15.124:0/2367661367 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd480c69b0 msgr2=0x7fbd4814c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:11.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.326+0000 7fbd4f9d4700 1 --2- 172.21.15.124:0/2367661367 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd480c69b0 0x7fbd4814c290 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400e480 tx=0x7fbd4400e790 comp rx=0 tx=0).stop 2023-10-16T13:00:11.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.326+0000 7fbd4f9d4700 1 -- 172.21.15.124:0/2367661367 shutdown_connections 2023-10-16T13:00:11.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.326+0000 7fbd4f9d4700 1 --2- 172.21.15.124:0/2367661367 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fbd2c06af00 0x7fbd2c06d3c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:11.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.326+0000 7fbd4f9d4700 1 --2- 172.21.15.124:0/2367661367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbd480c8360 0x7fbd480c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:11.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.326+0000 7fbd4f9d4700 1 --2- 172.21.15.124:0/2367661367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd34005210 0x7fbd480b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:11.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.326+0000 7fbd4f9d4700 1 --2- 172.21.15.124:0/2367661367 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd480c69b0 0x7fbd4814c290 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:11.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.326+0000 7fbd4f9d4700 1 -- 172.21.15.124:0/2367661367 >> 172.21.15.124:0/2367661367 conn(0x7fbd480cfcd0 msgr2=0x7fbd4806b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:11.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.326+0000 7fbd4f9d4700 1 -- 172.21.15.124:0/2367661367 shutdown_connections 2023-10-16T13:00:11.333 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:11.326+0000 7fbd4f9d4700 1 -- 172.21.15.124:0/2367661367 wait complete. 2023-10-16T13:00:11.333 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-16T13:00:11.340 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2023-10-16T13:00:10.638116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220800,"kb_used_data":4612,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753920,"statfs":{"total":773094113280,"available":772868014080,"internally_reserved":0,"allocated":4722688,"data_stored":2679552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.013119"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.656153+0000","last_change":"2023-10-16T13:00:05.660204+0000","last_active":"2023-10-16T13:00:06.656153+0000","last_peered":"2023-10-16T13:00:06.656153+0000","last_clean":"2023-10-16T13:00:06.656153+0000","last_became_active":"2023-10-16T13:00:05.659946+0000","last_became_peered":"2023-10-16T13:00:05.659946+0000","last_unstale":"2023-10-16T13:00:06.656153+0000","last_undegraded":"2023-10-16T13:00:06.656153+0000","last_fullsized":"2023-10-16T13:00:06.656153+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:06:10.221579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.656039+0000","last_change":"2023-10-16T13:00:05.659000+0000","last_active":"2023-10-16T13:00:06.656039+0000","last_peered":"2023-10-16T13:00:06.656039+0000","last_clean":"2023-10-16T13:00:06.656039+0000","last_became_active":"2023-10-16T13:00:05.658730+0000","last_became_peered":"2023-10-16T13:00:05.658730+0000","last_unstale":"2023-10-16T13:00:06.656039+0000","last_undegraded":"2023-10-16T13:00:06.656039+0000","last_fullsized":"2023-10-16T13:00:06.656039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:21:33.857630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.513561+0000","last_change":"2023-10-16T13:00:05.660819+0000","last_active":"2023-10-16T13:00:08.513561+0000","last_peered":"2023-10-16T13:00:08.513561+0000","last_clean":"2023-10-16T13:00:08.513561+0000","last_became_active":"2023-10-16T13:00:05.660563+0000","last_became_peered":"2023-10-16T13:00:05.660563+0000","last_unstale":"2023-10-16T13:00:08.513561+0000","last_undegraded":"2023-10-16T13:00:08.513561+0000","last_fullsized":"2023-10-16T13:00:08.513561+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:28:11.268287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.643422+0000","last_change":"2023-10-16T13:00:05.651833+0000","last_active":"2023-10-16T13:00:06.643422+0000","last_peered":"2023-10-16T13:00:06.643422+0000","last_clean":"2023-10-16T13:00:06.643422+0000","last_became_active":"2023-10-16T13:00:05.651044+0000","last_became_peered":"2023-10-16T13:00:05.651044+0000","last_unstale":"2023-10-16T13:00:06.643422+0000","last_undegraded":"2023-10-16T13:00:06.643422+0000","last_fullsized":"2023-10-16T13:00:06.643422+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:23:47.504340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.643759+0000","last_change":"2023-10-16T13:00:05.651222+0000","last_active":"2023-10-16T13:00:06.643759+0000","last_peered":"2023-10-16T13:00:06.643759+0000","last_clean":"2023-10-16T13:00:06.643759+0000","last_became_active":"2023-10-16T13:00:05.650908+0000","last_became_peered":"2023-10-16T13:00:05.650908+0000","last_unstale":"2023-10-16T13:00:06.643759+0000","last_undegraded":"2023-10-16T13:00:06.643759+0000","last_fullsized":"2023-10-16T13:00:06.643759+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:04:04.850060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.953402+0000","last_change":"2023-10-16T13:00:05.654633+0000","last_active":"2023-10-16T13:00:06.953402+0000","last_peered":"2023-10-16T13:00:06.953402+0000","last_clean":"2023-10-16T13:00:06.953402+0000","last_became_active":"2023-10-16T13:00:05.654374+0000","last_became_peered":"2023-10-16T13:00:05.654374+0000","last_unstale":"2023-10-16T13:00:06.953402+0000","last_undegraded":"2023-10-16T13:00:06.953402+0000","last_fullsized":"2023-10-16T13:00:06.953402+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:02:45.275287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.645085+0000","last_change":"2023-10-16T13:00:05.654167+0000","last_active":"2023-10-16T13:00:06.645085+0000","last_peered":"2023-10-16T13:00:06.645085+0000","last_clean":"2023-10-16T13:00:06.645085+0000","last_became_active":"2023-10-16T13:00:05.653868+0000","last_became_peered":"2023-10-16T13:00:05.653868+0000","last_unstale":"2023-10-16T13:00:06.645085+0000","last_undegraded":"2023-10-16T13:00:06.645085+0000","last_fullsized":"2023-10-16T13:00:06.645085+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:06:10.221579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.655853+0000","last_change":"2023-10-16T13:00:05.658016+0000","last_active":"2023-10-16T13:00:06.655853+0000","last_peered":"2023-10-16T13:00:06.655853+0000","last_clean":"2023-10-16T13:00:06.655853+0000","last_became_active":"2023-10-16T13:00:05.657700+0000","last_became_peered":"2023-10-16T13:00:05.657700+0000","last_unstale":"2023-10-16T13:00:06.655853+0000","last_undegraded":"2023-10-16T13:00:06.655853+0000","last_fullsized":"2023-10-16T13:00:06.655853+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:45:33.624699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.513650+0000","last_change":"2023-10-16T13:00:05.657558+0000","last_active":"2023-10-16T13:00:08.513650+0000","last_peered":"2023-10-16T13:00:08.513650+0000","last_clean":"2023-10-16T13:00:08.513650+0000","last_became_active":"2023-10-16T13:00:05.657301+0000","last_became_peered":"2023-10-16T13:00:05.657301+0000","last_unstale":"2023-10-16T13:00:08.513650+0000","last_undegraded":"2023-10-16T13:00:08.513650+0000","last_fullsized":"2023-10-16T13:00:08.513650+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:40:40.788684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.645059+0000","last_change":"2023-10-16T13:00:05.661583+0000","last_active":"2023-10-16T13:00:06.645059+0000","last_peered":"2023-10-16T13:00:06.645059+0000","last_clean":"2023-10-16T13:00:06.645059+0000","last_became_active":"2023-10-16T13:00:05.661060+0000","last_became_peered":"2023-10-16T13:00:05.661060+0000","last_unstale":"2023-10-16T13:00:06.645059+0000","last_undegraded":"2023-10-16T13:00:06.645059+0000","last_fullsized":"2023-10-16T13:00:06.645059+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:45:16.739801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.645031+0000","last_change":"2023-10-16T13:00:05.663599+0000","last_active":"2023-10-16T13:00:06.645031+0000","last_peered":"2023-10-16T13:00:06.645031+0000","last_clean":"2023-10-16T13:00:06.645031+0000","last_became_active":"2023-10-16T13:00:05.663312+0000","last_became_peered":"2023-10-16T13:00:05.663312+0000","last_unstale":"2023-10-16T13:00:06.645031+0000","last_undegraded":"2023-10-16T13:00:06.645031+0000","last_fullsized":"2023-10-16T13:00:06.645031+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:17:25.242336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.513489+0000","last_change":"2023-10-16T13:00:05.656214+0000","last_active":"2023-10-16T13:00:08.513489+0000","last_peered":"2023-10-16T13:00:08.513489+0000","last_clean":"2023-10-16T13:00:08.513489+0000","last_became_active":"2023-10-16T13:00:05.655947+0000","last_became_peered":"2023-10-16T13:00:05.655947+0000","last_unstale":"2023-10-16T13:00:08.513489+0000","last_undegraded":"2023-10-16T13:00:08.513489+0000","last_fullsized":"2023-10-16T13:00:08.513489+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:08:10.909311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644690+0000","last_change":"2023-10-16T13:00:05.660996+0000","last_active":"2023-10-16T13:00:06.644690+0000","last_peered":"2023-10-16T13:00:06.644690+0000","last_clean":"2023-10-16T13:00:06.644690+0000","last_became_active":"2023-10-16T13:00:05.660082+0000","last_became_peered":"2023-10-16T13:00:05.660082+0000","last_unstale":"2023-10-16T13:00:06.644690+0000","last_undegraded":"2023-10-16T13:00:06.644690+0000","last_fullsized":"2023-10-16T13:00:06.644690+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:37:00.043366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.514478+0000","last_change":"2023-10-16T13:00:05.672341+0000","last_active":"2023-10-16T13:00:08.514478+0000","last_peered":"2023-10-16T13:00:08.514478+0000","last_clean":"2023-10-16T13:00:08.514478+0000","last_became_active":"2023-10-16T13:00:05.672051+0000","last_became_peered":"2023-10-16T13:00:05.672051+0000","last_unstale":"2023-10-16T13:00:08.514478+0000","last_undegraded":"2023-10-16T13:00:08.514478+0000","last_fullsized":"2023-10-16T13:00:08.514478+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:02:45.275287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644924+0000","last_change":"2023-10-16T13:00:05.652667+0000","last_active":"2023-10-16T13:00:06.644924+0000","last_peered":"2023-10-16T13:00:06.644924+0000","last_clean":"2023-10-16T13:00:06.644924+0000","last_became_active":"2023-10-16T13:00:05.652391+0000","last_became_peered":"2023-10-16T13:00:05.652391+0000","last_unstale":"2023-10-16T13:00:06.644924+0000","last_undegraded":"2023-10-16T13:00:06.644924+0000","last_fullsized":"2023-10-16T13:00:06.644924+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:21:33.857630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.643712+0000","last_change":"2023-10-16T13:00:05.666083+0000","last_active":"2023-10-16T13:00:06.643712+0000","last_peered":"2023-10-16T13:00:06.643712+0000","last_clean":"2023-10-16T13:00:06.643712+0000","last_became_active":"2023-10-16T13:00:05.664951+0000","last_became_peered":"2023-10-16T13:00:05.664951+0000","last_unstale":"2023-10-16T13:00:06.643712+0000","last_undegraded":"2023-10-16T13:00:06.643712+0000","last_fullsized":"2023-10-16T13:00:06.643712+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:57:27.739256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.643862+0000","last_change":"2023-10-16T13:00:05.675572+0000","last_active":"2023-10-16T13:00:06.643862+0000","last_peered":"2023-10-16T13:00:06.643862+0000","last_clean":"2023-10-16T13:00:06.643862+0000","last_became_active":"2023-10-16T13:00:05.675236+0000","last_became_peered":"2023-10-16T13:00:05.675236+0000","last_unstale":"2023-10-16T13:00:06.643862+0000","last_undegraded":"2023-10-16T13:00:06.643862+0000","last_fullsized":"2023-10-16T13:00:06.643862+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:28:11.268287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.514025+0000","last_change":"2023-10-16T13:00:05.674798+0000","last_active":"2023-10-16T13:00:08.514025+0000","last_peered":"2023-10-16T13:00:08.514025+0000","last_clean":"2023-10-16T13:00:08.514025+0000","last_became_active":"2023-10-16T13:00:05.672996+0000","last_became_peered":"2023-10-16T13:00:05.672996+0000","last_unstale":"2023-10-16T13:00:08.514025+0000","last_undegraded":"2023-10-16T13:00:08.514025+0000","last_fullsized":"2023-10-16T13:00:08.514025+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:42:58.734095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.643554+0000","last_change":"2023-10-16T13:00:05.642228+0000","last_active":"2023-10-16T13:00:06.643554+0000","last_peered":"2023-10-16T13:00:06.643554+0000","last_clean":"2023-10-16T13:00:06.643554+0000","last_became_active":"2023-10-16T13:00:05.641950+0000","last_became_peered":"2023-10-16T13:00:05.641950+0000","last_unstale":"2023-10-16T13:00:06.643554+0000","last_undegraded":"2023-10-16T13:00:06.643554+0000","last_fullsized":"2023-10-16T13:00:06.643554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:58:40.119756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.513985+0000","last_change":"2023-10-16T13:00:05.672079+0000","last_active":"2023-10-16T13:00:08.513985+0000","last_peered":"2023-10-16T13:00:08.513985+0000","last_clean":"2023-10-16T13:00:08.513985+0000","last_became_active":"2023-10-16T13:00:05.671808+0000","last_became_peered":"2023-10-16T13:00:05.671808+0000","last_unstale":"2023-10-16T13:00:08.513985+0000","last_undegraded":"2023-10-16T13:00:08.513985+0000","last_fullsized":"2023-10-16T13:00:08.513985+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:20:39.964974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644769+0000","last_change":"2023-10-16T13:00:05.652007+0000","last_active":"2023-10-16T13:00:06.644769+0000","last_peered":"2023-10-16T13:00:06.644769+0000","last_clean":"2023-10-16T13:00:06.644769+0000","last_became_active":"2023-10-16T13:00:05.651714+0000","last_became_peered":"2023-10-16T13:00:05.651714+0000","last_unstale":"2023-10-16T13:00:06.644769+0000","last_undegraded":"2023-10-16T13:00:06.644769+0000","last_fullsized":"2023-10-16T13:00:06.644769+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:15.971169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.513932+0000","last_change":"2023-10-16T13:00:05.647717+0000","last_active":"2023-10-16T13:00:08.513932+0000","last_peered":"2023-10-16T13:00:08.513932+0000","last_clean":"2023-10-16T13:00:08.513932+0000","last_became_active":"2023-10-16T13:00:05.647387+0000","last_became_peered":"2023-10-16T13:00:05.647387+0000","last_unstale":"2023-10-16T13:00:08.513932+0000","last_undegraded":"2023-10-16T13:00:08.513932+0000","last_fullsized":"2023-10-16T13:00:08.513932+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:17:52.292656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644105+0000","last_change":"2023-10-16T13:00:05.669698+0000","last_active":"2023-10-16T13:00:06.644105+0000","last_peered":"2023-10-16T13:00:06.644105+0000","last_clean":"2023-10-16T13:00:06.644105+0000","last_became_active":"2023-10-16T13:00:05.669441+0000","last_became_peered":"2023-10-16T13:00:05.669441+0000","last_unstale":"2023-10-16T13:00:06.644105+0000","last_undegraded":"2023-10-16T13:00:06.644105+0000","last_fullsized":"2023-10-16T13:00:06.644105+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:37:00.043366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.643630+0000","last_change":"2023-10-16T13:00:05.659649+0000","last_active":"2023-10-16T13:00:06.643630+0000","last_peered":"2023-10-16T13:00:06.643630+0000","last_clean":"2023-10-16T13:00:06.643630+0000","last_became_active":"2023-10-16T13:00:05.659396+0000","last_became_peered":"2023-10-16T13:00:05.659396+0000","last_unstale":"2023-10-16T13:00:06.643630+0000","last_undegraded":"2023-10-16T13:00:06.643630+0000","last_fullsized":"2023-10-16T13:00:06.643630+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:52:45.017152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.514040+0000","last_change":"2023-10-16T13:00:05.673649+0000","last_active":"2023-10-16T13:00:08.514040+0000","last_peered":"2023-10-16T13:00:08.514040+0000","last_clean":"2023-10-16T13:00:08.514040+0000","last_became_active":"2023-10-16T13:00:05.672981+0000","last_became_peered":"2023-10-16T13:00:05.672981+0000","last_unstale":"2023-10-16T13:00:08.514040+0000","last_undegraded":"2023-10-16T13:00:08.514040+0000","last_fullsized":"2023-10-16T13:00:08.514040+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:17:52.292656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.953404+0000","last_change":"2023-10-16T13:00:05.656969+0000","last_active":"2023-10-16T13:00:06.953404+0000","last_peered":"2023-10-16T13:00:06.953404+0000","last_clean":"2023-10-16T13:00:06.953404+0000","last_became_active":"2023-10-16T13:00:05.656720+0000","last_became_peered":"2023-10-16T13:00:05.656720+0000","last_unstale":"2023-10-16T13:00:06.953404+0000","last_undegraded":"2023-10-16T13:00:06.953404+0000","last_fullsized":"2023-10-16T13:00:06.953404+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:28:11.268287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.514320+0000","last_change":"2023-10-16T13:00:05.672628+0000","last_active":"2023-10-16T13:00:08.514320+0000","last_peered":"2023-10-16T13:00:08.514320+0000","last_clean":"2023-10-16T13:00:08.514320+0000","last_became_active":"2023-10-16T13:00:05.672345+0000","last_became_peered":"2023-10-16T13:00:05.672345+0000","last_unstale":"2023-10-16T13:00:08.514320+0000","last_undegraded":"2023-10-16T13:00:08.514320+0000","last_fullsized":"2023-10-16T13:00:08.514320+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:21.549699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644813+0000","last_change":"2023-10-16T13:00:05.656815+0000","last_active":"2023-10-16T13:00:06.644813+0000","last_peered":"2023-10-16T13:00:06.644813+0000","last_clean":"2023-10-16T13:00:06.644813+0000","last_became_active":"2023-10-16T13:00:05.656357+0000","last_became_peered":"2023-10-16T13:00:05.656357+0000","last_unstale":"2023-10-16T13:00:06.644813+0000","last_undegraded":"2023-10-16T13:00:06.644813+0000","last_fullsized":"2023-10-16T13:00:06.644813+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:08:21.105118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.513726+0000","last_change":"2023-10-16T13:00:05.665017+0000","last_active":"2023-10-16T13:00:08.513726+0000","last_peered":"2023-10-16T13:00:08.513726+0000","last_clean":"2023-10-16T13:00:08.513726+0000","last_became_active":"2023-10-16T13:00:05.664708+0000","last_became_peered":"2023-10-16T13:00:05.664708+0000","last_unstale":"2023-10-16T13:00:08.513726+0000","last_undegraded":"2023-10-16T13:00:08.513726+0000","last_fullsized":"2023-10-16T13:00:08.513726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:30:42.210746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.515005+0000","last_change":"2023-10-16T13:00:05.665933+0000","last_active":"2023-10-16T13:00:08.515005+0000","last_peered":"2023-10-16T13:00:08.515005+0000","last_clean":"2023-10-16T13:00:08.515005+0000","last_became_active":"2023-10-16T13:00:05.665611+0000","last_became_peered":"2023-10-16T13:00:05.665611+0000","last_unstale":"2023-10-16T13:00:08.515005+0000","last_undegraded":"2023-10-16T13:00:08.515005+0000","last_fullsized":"2023-10-16T13:00:08.515005+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:27:05.813663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644066+0000","last_change":"2023-10-16T13:00:05.669393+0000","last_active":"2023-10-16T13:00:06.644066+0000","last_peered":"2023-10-16T13:00:06.644066+0000","last_clean":"2023-10-16T13:00:06.644066+0000","last_became_active":"2023-10-16T13:00:05.669076+0000","last_became_peered":"2023-10-16T13:00:05.669076+0000","last_unstale":"2023-10-16T13:00:06.644066+0000","last_undegraded":"2023-10-16T13:00:06.644066+0000","last_fullsized":"2023-10-16T13:00:06.644066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:12:22.267877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.953179+0000","last_change":"2023-10-16T13:00:05.642206+0000","last_active":"2023-10-16T13:00:06.953179+0000","last_peered":"2023-10-16T13:00:06.953179+0000","last_clean":"2023-10-16T13:00:06.953179+0000","last_became_active":"2023-10-16T13:00:05.641973+0000","last_became_peered":"2023-10-16T13:00:05.641973+0000","last_unstale":"2023-10-16T13:00:06.953179+0000","last_undegraded":"2023-10-16T13:00:06.953179+0000","last_fullsized":"2023-10-16T13:00:06.953179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:46:47.310390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.643924+0000","last_change":"2023-10-16T13:00:05.670471+0000","last_active":"2023-10-16T13:00:06.643924+0000","last_peered":"2023-10-16T13:00:06.643924+0000","last_clean":"2023-10-16T13:00:06.643924+0000","last_became_active":"2023-10-16T13:00:05.670150+0000","last_became_peered":"2023-10-16T13:00:05.670150+0000","last_unstale":"2023-10-16T13:00:06.643924+0000","last_undegraded":"2023-10-16T13:00:06.643924+0000","last_fullsized":"2023-10-16T13:00:06.643924+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:25:35.275968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.674447+0000","last_change":"2023-10-16T13:00:04.646837+0000","last_active":"2023-10-16T13:00:05.674447+0000","last_peered":"2023-10-16T13:00:05.674447+0000","last_clean":"2023-10-16T13:00:05.674447+0000","last_became_active":"2023-10-16T13:00:04.646560+0000","last_became_peered":"2023-10-16T13:00:04.646560+0000","last_unstale":"2023-10-16T13:00:05.674447+0000","last_undegraded":"2023-10-16T13:00:05.674447+0000","last_fullsized":"2023-10-16T13:00:05.674447+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:49:54.544627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.953433+0000","last_change":"2023-10-16T13:00:05.658504+0000","last_active":"2023-10-16T13:00:06.953433+0000","last_peered":"2023-10-16T13:00:06.953433+0000","last_clean":"2023-10-16T13:00:06.953433+0000","last_became_active":"2023-10-16T13:00:05.658239+0000","last_became_peered":"2023-10-16T13:00:05.658239+0000","last_unstale":"2023-10-16T13:00:06.953433+0000","last_undegraded":"2023-10-16T13:00:06.953433+0000","last_fullsized":"2023-10-16T13:00:06.953433+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:08:10.909311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.670142+0000","last_change":"2023-10-16T13:00:04.639644+0000","last_active":"2023-10-16T13:00:05.670142+0000","last_peered":"2023-10-16T13:00:05.670142+0000","last_clean":"2023-10-16T13:00:05.670142+0000","last_became_active":"2023-10-16T13:00:04.639397+0000","last_became_peered":"2023-10-16T13:00:04.639397+0000","last_unstale":"2023-10-16T13:00:05.670142+0000","last_undegraded":"2023-10-16T13:00:05.670142+0000","last_fullsized":"2023-10-16T13:00:05.670142+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:49:54.544627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.514125+0000","last_change":"2023-10-16T13:00:05.675571+0000","last_active":"2023-10-16T13:00:08.514125+0000","last_peered":"2023-10-16T13:00:08.514125+0000","last_clean":"2023-10-16T13:00:08.514125+0000","last_became_active":"2023-10-16T13:00:05.675343+0000","last_became_peered":"2023-10-16T13:00:05.675343+0000","last_unstale":"2023-10-16T13:00:08.514125+0000","last_undegraded":"2023-10-16T13:00:08.514125+0000","last_fullsized":"2023-10-16T13:00:08.514125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:27:05.813663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.666965+0000","last_change":"2023-10-16T13:00:04.643622+0000","last_active":"2023-10-16T13:00:05.666965+0000","last_peered":"2023-10-16T13:00:05.666965+0000","last_clean":"2023-10-16T13:00:05.666965+0000","last_became_active":"2023-10-16T13:00:04.643303+0000","last_became_peered":"2023-10-16T13:00:04.643303+0000","last_unstale":"2023-10-16T13:00:05.666965+0000","last_undegraded":"2023-10-16T13:00:05.666965+0000","last_fullsized":"2023-10-16T13:00:05.666965+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:17:51.286086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.656190+0000","last_change":"2023-10-16T13:00:05.674651+0000","last_active":"2023-10-16T13:00:06.656190+0000","last_peered":"2023-10-16T13:00:06.656190+0000","last_clean":"2023-10-16T13:00:06.656190+0000","last_became_active":"2023-10-16T13:00:05.674388+0000","last_became_peered":"2023-10-16T13:00:05.674388+0000","last_unstale":"2023-10-16T13:00:06.656190+0000","last_undegraded":"2023-10-16T13:00:06.656190+0000","last_fullsized":"2023-10-16T13:00:06.656190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:10:05.637340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.667307+0000","last_change":"2023-10-16T13:00:04.646615+0000","last_active":"2023-10-16T13:00:05.667307+0000","last_peered":"2023-10-16T13:00:05.667307+0000","last_clean":"2023-10-16T13:00:05.667307+0000","last_became_active":"2023-10-16T13:00:04.646288+0000","last_became_peered":"2023-10-16T13:00:04.646288+0000","last_unstale":"2023-10-16T13:00:05.667307+0000","last_undegraded":"2023-10-16T13:00:05.667307+0000","last_fullsized":"2023-10-16T13:00:05.667307+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:30:41.204176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.513385+0000","last_change":"2023-10-16T13:00:05.655869+0000","last_active":"2023-10-16T13:00:08.513385+0000","last_peered":"2023-10-16T13:00:08.513385+0000","last_clean":"2023-10-16T13:00:08.513385+0000","last_became_active":"2023-10-16T13:00:05.655575+0000","last_became_peered":"2023-10-16T13:00:05.655575+0000","last_unstale":"2023-10-16T13:00:08.513385+0000","last_undegraded":"2023-10-16T13:00:08.513385+0000","last_fullsized":"2023-10-16T13:00:08.513385+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:02:45.275287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.673763+0000","last_change":"2023-10-16T13:00:04.643729+0000","last_active":"2023-10-16T13:00:05.673763+0000","last_peered":"2023-10-16T13:00:05.673763+0000","last_clean":"2023-10-16T13:00:05.673763+0000","last_became_active":"2023-10-16T13:00:04.643444+0000","last_became_peered":"2023-10-16T13:00:04.643444+0000","last_unstale":"2023-10-16T13:00:05.673763+0000","last_undegraded":"2023-10-16T13:00:05.673763+0000","last_fullsized":"2023-10-16T13:00:05.673763+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:17:51.286086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644610+0000","last_change":"2023-10-16T13:00:05.654845+0000","last_active":"2023-10-16T13:00:06.644610+0000","last_peered":"2023-10-16T13:00:06.644610+0000","last_clean":"2023-10-16T13:00:06.644610+0000","last_became_active":"2023-10-16T13:00:05.654547+0000","last_became_peered":"2023-10-16T13:00:05.654547+0000","last_unstale":"2023-10-16T13:00:06.644610+0000","last_undegraded":"2023-10-16T13:00:06.644610+0000","last_fullsized":"2023-10-16T13:00:06.644610+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:12:22.267877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.670784+0000","last_change":"2023-10-16T13:00:04.645516+0000","last_active":"2023-10-16T13:00:05.670784+0000","last_peered":"2023-10-16T13:00:05.670784+0000","last_clean":"2023-10-16T13:00:05.670784+0000","last_became_active":"2023-10-16T13:00:04.645256+0000","last_became_peered":"2023-10-16T13:00:04.645256+0000","last_unstale":"2023-10-16T13:00:05.670784+0000","last_undegraded":"2023-10-16T13:00:05.670784+0000","last_fullsized":"2023-10-16T13:00:05.670784+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:42:57.727525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.514097+0000","last_change":"2023-10-16T13:00:05.659711+0000","last_active":"2023-10-16T13:00:08.514097+0000","last_peered":"2023-10-16T13:00:08.514097+0000","last_clean":"2023-10-16T13:00:08.514097+0000","last_became_active":"2023-10-16T13:00:05.659443+0000","last_became_peered":"2023-10-16T13:00:05.659443+0000","last_unstale":"2023-10-16T13:00:08.514097+0000","last_undegraded":"2023-10-16T13:00:08.514097+0000","last_fullsized":"2023-10-16T13:00:08.514097+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:21.549699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.641143+0000","last_change":"2023-10-16T13:00:04.646559+0000","last_active":"2023-10-16T13:00:05.641143+0000","last_peered":"2023-10-16T13:00:05.641143+0000","last_clean":"2023-10-16T13:00:05.641143+0000","last_became_active":"2023-10-16T13:00:04.646303+0000","last_became_peered":"2023-10-16T13:00:04.646303+0000","last_unstale":"2023-10-16T13:00:05.641143+0000","last_undegraded":"2023-10-16T13:00:05.641143+0000","last_fullsized":"2023-10-16T13:00:05.641143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:42:57.727525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.656142+0000","last_change":"2023-10-16T13:00:05.659870+0000","last_active":"2023-10-16T13:00:06.656142+0000","last_peered":"2023-10-16T13:00:06.656142+0000","last_clean":"2023-10-16T13:00:06.656142+0000","last_became_active":"2023-10-16T13:00:05.659554+0000","last_became_peered":"2023-10-16T13:00:05.659554+0000","last_unstale":"2023-10-16T13:00:06.656142+0000","last_undegraded":"2023-10-16T13:00:06.656142+0000","last_fullsized":"2023-10-16T13:00:06.656142+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:45:16.739801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.645093+0000","last_change":"2023-10-16T13:00:04.643342+0000","last_active":"2023-10-16T13:00:05.645093+0000","last_peered":"2023-10-16T13:00:05.645093+0000","last_clean":"2023-10-16T13:00:05.645093+0000","last_became_active":"2023-10-16T13:00:04.643059+0000","last_became_peered":"2023-10-16T13:00:04.643059+0000","last_unstale":"2023-10-16T13:00:05.645093+0000","last_undegraded":"2023-10-16T13:00:05.645093+0000","last_fullsized":"2023-10-16T13:00:05.645093+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:10:31.776395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.643668+0000","last_change":"2023-10-16T13:00:05.651663+0000","last_active":"2023-10-16T13:00:06.643668+0000","last_peered":"2023-10-16T13:00:06.643668+0000","last_clean":"2023-10-16T13:00:06.643668+0000","last_became_active":"2023-10-16T13:00:05.650687+0000","last_became_peered":"2023-10-16T13:00:05.650687+0000","last_unstale":"2023-10-16T13:00:06.643668+0000","last_undegraded":"2023-10-16T13:00:06.643668+0000","last_fullsized":"2023-10-16T13:00:06.643668+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:52:34.016689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.649935+0000","last_change":"2023-10-16T13:00:04.644161+0000","last_active":"2023-10-16T13:00:05.649935+0000","last_peered":"2023-10-16T13:00:05.649935+0000","last_clean":"2023-10-16T13:00:05.649935+0000","last_became_active":"2023-10-16T13:00:04.643949+0000","last_became_peered":"2023-10-16T13:00:04.643949+0000","last_unstale":"2023-10-16T13:00:05.649935+0000","last_undegraded":"2023-10-16T13:00:05.649935+0000","last_fullsized":"2023-10-16T13:00:05.649935+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:12:21.261307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644166+0000","last_change":"2023-10-16T13:00:05.675654+0000","last_active":"2023-10-16T13:00:06.644166+0000","last_peered":"2023-10-16T13:00:06.644166+0000","last_clean":"2023-10-16T13:00:06.644166+0000","last_became_active":"2023-10-16T13:00:05.675328+0000","last_became_peered":"2023-10-16T13:00:05.675328+0000","last_unstale":"2023-10-16T13:00:06.644166+0000","last_undegraded":"2023-10-16T13:00:06.644166+0000","last_fullsized":"2023-10-16T13:00:06.644166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:45:33.624699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.648833+0000","last_change":"2023-10-16T13:00:04.642355+0000","last_active":"2023-10-16T13:00:05.648833+0000","last_peered":"2023-10-16T13:00:05.648833+0000","last_clean":"2023-10-16T13:00:05.648833+0000","last_became_active":"2023-10-16T13:00:04.642073+0000","last_became_peered":"2023-10-16T13:00:04.642073+0000","last_unstale":"2023-10-16T13:00:05.648833+0000","last_undegraded":"2023-10-16T13:00:05.648833+0000","last_fullsized":"2023-10-16T13:00:05.648833+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:28:10.261717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.513550+0000","last_change":"2023-10-16T13:00:05.659910+0000","last_active":"2023-10-16T13:00:08.513550+0000","last_peered":"2023-10-16T13:00:08.513550+0000","last_clean":"2023-10-16T13:00:08.513550+0000","last_became_active":"2023-10-16T13:00:05.659661+0000","last_became_peered":"2023-10-16T13:00:05.659661+0000","last_unstale":"2023-10-16T13:00:08.513550+0000","last_undegraded":"2023-10-16T13:00:08.513550+0000","last_fullsized":"2023-10-16T13:00:08.513550+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:25:35.275968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.674151+0000","last_change":"2023-10-16T13:00:04.642687+0000","last_active":"2023-10-16T13:00:05.674151+0000","last_peered":"2023-10-16T13:00:05.674151+0000","last_clean":"2023-10-16T13:00:05.674151+0000","last_became_active":"2023-10-16T13:00:04.642406+0000","last_became_peered":"2023-10-16T13:00:04.642406+0000","last_unstale":"2023-10-16T13:00:05.674151+0000","last_undegraded":"2023-10-16T13:00:05.674151+0000","last_fullsized":"2023-10-16T13:00:05.674151+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:25:34.269398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.514849+0000","last_change":"2023-10-16T13:00:05.648259+0000","last_active":"2023-10-16T13:00:08.514849+0000","last_peered":"2023-10-16T13:00:08.514849+0000","last_clean":"2023-10-16T13:00:08.514849+0000","last_became_active":"2023-10-16T13:00:05.647937+0000","last_became_peered":"2023-10-16T13:00:05.647937+0000","last_unstale":"2023-10-16T13:00:08.514849+0000","last_undegraded":"2023-10-16T13:00:08.514849+0000","last_fullsized":"2023-10-16T13:00:08.514849+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:57:27.739256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.679575+0000","last_change":"2023-10-16T13:00:04.638599+0000","last_active":"2023-10-16T13:00:05.679575+0000","last_peered":"2023-10-16T13:00:05.679575+0000","last_clean":"2023-10-16T13:00:05.679575+0000","last_became_active":"2023-10-16T13:00:04.638318+0000","last_became_peered":"2023-10-16T13:00:04.638318+0000","last_unstale":"2023-10-16T13:00:05.679575+0000","last_undegraded":"2023-10-16T13:00:05.679575+0000","last_fullsized":"2023-10-16T13:00:05.679575+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:28:10.261717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.513234+0000","last_change":"2023-10-16T13:00:05.663456+0000","last_active":"2023-10-16T13:00:08.513234+0000","last_peered":"2023-10-16T13:00:08.513234+0000","last_clean":"2023-10-16T13:00:08.513234+0000","last_became_active":"2023-10-16T13:00:05.663194+0000","last_became_peered":"2023-10-16T13:00:05.663194+0000","last_unstale":"2023-10-16T13:00:08.513234+0000","last_undegraded":"2023-10-16T13:00:08.513234+0000","last_fullsized":"2023-10-16T13:00:08.513234+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:46:47.310390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.667825+0000","last_change":"2023-10-16T13:00:04.642636+0000","last_active":"2023-10-16T13:00:05.667825+0000","last_peered":"2023-10-16T13:00:05.667825+0000","last_clean":"2023-10-16T13:00:05.667825+0000","last_became_active":"2023-10-16T13:00:04.642326+0000","last_became_peered":"2023-10-16T13:00:04.642326+0000","last_unstale":"2023-10-16T13:00:05.667825+0000","last_undegraded":"2023-10-16T13:00:05.667825+0000","last_fullsized":"2023-10-16T13:00:05.667825+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:25:34.269398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.655956+0000","last_change":"2023-10-16T13:00:05.660761+0000","last_active":"2023-10-16T13:00:06.655956+0000","last_peered":"2023-10-16T13:00:06.655956+0000","last_clean":"2023-10-16T13:00:06.655956+0000","last_became_active":"2023-10-16T13:00:05.660496+0000","last_became_peered":"2023-10-16T13:00:05.660496+0000","last_unstale":"2023-10-16T13:00:06.655956+0000","last_undegraded":"2023-10-16T13:00:06.655956+0000","last_fullsized":"2023-10-16T13:00:06.655956+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:15.971169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.641076+0000","last_change":"2023-10-16T13:00:04.645998+0000","last_active":"2023-10-16T13:00:05.641076+0000","last_peered":"2023-10-16T13:00:05.641076+0000","last_clean":"2023-10-16T13:00:05.641076+0000","last_became_active":"2023-10-16T13:00:04.645740+0000","last_became_peered":"2023-10-16T13:00:04.645740+0000","last_unstale":"2023-10-16T13:00:05.641076+0000","last_undegraded":"2023-10-16T13:00:05.641076+0000","last_fullsized":"2023-10-16T13:00:05.641076+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:30:41.204176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.643831+0000","last_change":"2023-10-16T13:00:05.670659+0000","last_active":"2023-10-16T13:00:06.643831+0000","last_peered":"2023-10-16T13:00:06.643831+0000","last_clean":"2023-10-16T13:00:06.643831+0000","last_became_active":"2023-10-16T13:00:05.670393+0000","last_became_peered":"2023-10-16T13:00:05.670393+0000","last_unstale":"2023-10-16T13:00:06.643831+0000","last_undegraded":"2023-10-16T13:00:06.643831+0000","last_fullsized":"2023-10-16T13:00:06.643831+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:08:10.909311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.659143+0000","last_change":"2023-10-16T13:00:04.645848+0000","last_active":"2023-10-16T13:00:05.659143+0000","last_peered":"2023-10-16T13:00:05.659143+0000","last_clean":"2023-10-16T13:00:05.659143+0000","last_became_active":"2023-10-16T13:00:04.645516+0000","last_became_peered":"2023-10-16T13:00:04.645516+0000","last_unstale":"2023-10-16T13:00:05.659143+0000","last_undegraded":"2023-10-16T13:00:05.659143+0000","last_fullsized":"2023-10-16T13:00:05.659143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:45:04.187709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.656266+0000","last_change":"2023-10-16T13:00:05.661267+0000","last_active":"2023-10-16T13:00:06.656266+0000","last_peered":"2023-10-16T13:00:06.656266+0000","last_clean":"2023-10-16T13:00:06.656266+0000","last_became_active":"2023-10-16T13:00:05.661016+0000","last_became_peered":"2023-10-16T13:00:05.661016+0000","last_unstale":"2023-10-16T13:00:06.656266+0000","last_undegraded":"2023-10-16T13:00:06.656266+0000","last_fullsized":"2023-10-16T13:00:06.656266+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:37:46.134340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.677155+0000","last_change":"2023-10-16T13:00:04.643031+0000","last_active":"2023-10-16T13:00:05.677155+0000","last_peered":"2023-10-16T13:00:05.677155+0000","last_clean":"2023-10-16T13:00:05.677155+0000","last_became_active":"2023-10-16T13:00:04.642737+0000","last_became_peered":"2023-10-16T13:00:04.642737+0000","last_unstale":"2023-10-16T13:00:05.677155+0000","last_undegraded":"2023-10-16T13:00:05.677155+0000","last_fullsized":"2023-10-16T13:00:05.677155+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:10:31.776395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.655992+0000","last_change":"2023-10-16T13:00:05.673445+0000","last_active":"2023-10-16T13:00:06.655992+0000","last_peered":"2023-10-16T13:00:06.655992+0000","last_clean":"2023-10-16T13:00:06.655992+0000","last_became_active":"2023-10-16T13:00:05.673206+0000","last_became_peered":"2023-10-16T13:00:05.673206+0000","last_unstale":"2023-10-16T13:00:06.655992+0000","last_undegraded":"2023-10-16T13:00:06.655992+0000","last_fullsized":"2023-10-16T13:00:06.655992+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:08:21.105118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.675002+0000","last_change":"2023-10-16T13:00:04.647634+0000","last_active":"2023-10-16T13:00:05.675002+0000","last_peered":"2023-10-16T13:00:05.675002+0000","last_clean":"2023-10-16T13:00:05.675002+0000","last_became_active":"2023-10-16T13:00:04.647358+0000","last_became_peered":"2023-10-16T13:00:04.647358+0000","last_unstale":"2023-10-16T13:00:05.675002+0000","last_undegraded":"2023-10-16T13:00:05.675002+0000","last_fullsized":"2023-10-16T13:00:05.675002+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:06:40.796633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644956+0000","last_change":"2023-10-16T13:00:05.651957+0000","last_active":"2023-10-16T13:00:06.644956+0000","last_peered":"2023-10-16T13:00:06.644956+0000","last_clean":"2023-10-16T13:00:06.644956+0000","last_became_active":"2023-10-16T13:00:05.651658+0000","last_became_peered":"2023-10-16T13:00:05.651658+0000","last_unstale":"2023-10-16T13:00:06.644956+0000","last_undegraded":"2023-10-16T13:00:06.644956+0000","last_fullsized":"2023-10-16T13:00:06.644956+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:07:34.723972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.674770+0000","last_change":"2023-10-16T13:00:04.648554+0000","last_active":"2023-10-16T13:00:05.674770+0000","last_peered":"2023-10-16T13:00:05.674770+0000","last_clean":"2023-10-16T13:00:05.674770+0000","last_became_active":"2023-10-16T13:00:04.648272+0000","last_became_peered":"2023-10-16T13:00:04.648272+0000","last_unstale":"2023-10-16T13:00:05.674770+0000","last_undegraded":"2023-10-16T13:00:05.674770+0000","last_fullsized":"2023-10-16T13:00:05.674770+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:42:57.727525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.514220+0000","last_change":"2023-10-16T13:00:05.646284+0000","last_active":"2023-10-16T13:00:08.514220+0000","last_peered":"2023-10-16T13:00:08.514220+0000","last_clean":"2023-10-16T13:00:08.514220+0000","last_became_active":"2023-10-16T13:00:05.645955+0000","last_became_peered":"2023-10-16T13:00:05.645955+0000","last_unstale":"2023-10-16T13:00:08.514220+0000","last_undegraded":"2023-10-16T13:00:08.514220+0000","last_fullsized":"2023-10-16T13:00:08.514220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:46:47.310390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.676383+0000","last_change":"2023-10-16T13:00:04.638610+0000","last_active":"2023-10-16T13:00:05.676383+0000","last_peered":"2023-10-16T13:00:05.676383+0000","last_clean":"2023-10-16T13:00:05.676383+0000","last_became_active":"2023-10-16T13:00:04.638346+0000","last_became_peered":"2023-10-16T13:00:04.638346+0000","last_unstale":"2023-10-16T13:00:05.676383+0000","last_undegraded":"2023-10-16T13:00:05.676383+0000","last_fullsized":"2023-10-16T13:00:05.676383+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:36:03.848490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.643687+0000","last_change":"2023-10-16T13:00:05.658927+0000","last_active":"2023-10-16T13:00:06.643687+0000","last_peered":"2023-10-16T13:00:06.643687+0000","last_clean":"2023-10-16T13:00:06.643687+0000","last_became_active":"2023-10-16T13:00:05.658659+0000","last_became_peered":"2023-10-16T13:00:05.658659+0000","last_unstale":"2023-10-16T13:00:06.643687+0000","last_undegraded":"2023-10-16T13:00:06.643687+0000","last_fullsized":"2023-10-16T13:00:06.643687+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:05:25.841227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.641180+0000","last_change":"2023-10-16T13:00:04.641841+0000","last_active":"2023-10-16T13:00:05.641180+0000","last_peered":"2023-10-16T13:00:05.641180+0000","last_clean":"2023-10-16T13:00:05.641180+0000","last_became_active":"2023-10-16T13:00:04.641557+0000","last_became_peered":"2023-10-16T13:00:04.641557+0000","last_unstale":"2023-10-16T13:00:05.641180+0000","last_undegraded":"2023-10-16T13:00:05.641180+0000","last_fullsized":"2023-10-16T13:00:05.641180+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:20:38.958405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644209+0000","last_change":"2023-10-16T13:00:05.669247+0000","last_active":"2023-10-16T13:00:06.644209+0000","last_peered":"2023-10-16T13:00:06.644209+0000","last_clean":"2023-10-16T13:00:06.644209+0000","last_became_active":"2023-10-16T13:00:05.668965+0000","last_became_peered":"2023-10-16T13:00:05.668965+0000","last_unstale":"2023-10-16T13:00:06.644209+0000","last_undegraded":"2023-10-16T13:00:06.644209+0000","last_fullsized":"2023-10-16T13:00:06.644209+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:15.971169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.672860+0000","last_change":"2023-10-16T13:00:04.639492+0000","last_active":"2023-10-16T13:00:05.672860+0000","last_peered":"2023-10-16T13:00:05.672860+0000","last_clean":"2023-10-16T13:00:05.672860+0000","last_became_active":"2023-10-16T13:00:04.639192+0000","last_became_peered":"2023-10-16T13:00:04.639192+0000","last_unstale":"2023-10-16T13:00:05.672860+0000","last_undegraded":"2023-10-16T13:00:05.672860+0000","last_fullsized":"2023-10-16T13:00:05.672860+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:32:33.494952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.513394+0000","last_change":"2023-10-16T13:00:05.660689+0000","last_active":"2023-10-16T13:00:08.513394+0000","last_peered":"2023-10-16T13:00:08.513394+0000","last_clean":"2023-10-16T13:00:08.513394+0000","last_became_active":"2023-10-16T13:00:05.660430+0000","last_became_peered":"2023-10-16T13:00:05.660430+0000","last_unstale":"2023-10-16T13:00:08.513394+0000","last_undegraded":"2023-10-16T13:00:08.513394+0000","last_fullsized":"2023-10-16T13:00:08.513394+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:57:27.739256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.637511+0000","last_change":"2023-10-16T13:00:04.641050+0000","last_active":"2023-10-16T13:00:05.637511+0000","last_peered":"2023-10-16T13:00:05.637511+0000","last_clean":"2023-10-16T13:00:05.637511+0000","last_became_active":"2023-10-16T13:00:04.640795+0000","last_became_peered":"2023-10-16T13:00:04.640795+0000","last_unstale":"2023-10-16T13:00:05.637511+0000","last_undegraded":"2023-10-16T13:00:05.637511+0000","last_fullsized":"2023-10-16T13:00:05.637511+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:11.152311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644696+0000","last_change":"2023-10-16T13:00:05.669097+0000","last_active":"2023-10-16T13:00:06.644696+0000","last_peered":"2023-10-16T13:00:06.644696+0000","last_clean":"2023-10-16T13:00:06.644696+0000","last_became_active":"2023-10-16T13:00:05.668822+0000","last_became_peered":"2023-10-16T13:00:05.668822+0000","last_unstale":"2023-10-16T13:00:06.644696+0000","last_undegraded":"2023-10-16T13:00:06.644696+0000","last_fullsized":"2023-10-16T13:00:06.644696+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:45:33.624699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.656052+0000","last_change":"2023-10-16T13:00:04.644763+0000","last_active":"2023-10-16T13:00:05.656052+0000","last_peered":"2023-10-16T13:00:05.656052+0000","last_clean":"2023-10-16T13:00:05.656052+0000","last_became_active":"2023-10-16T13:00:04.644483+0000","last_became_peered":"2023-10-16T13:00:04.644483+0000","last_unstale":"2023-10-16T13:00:05.656052+0000","last_undegraded":"2023-10-16T13:00:05.656052+0000","last_fullsized":"2023-10-16T13:00:05.656052+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:06:40.796633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.656058+0000","last_change":"2023-10-16T13:00:05.659204+0000","last_active":"2023-10-16T13:00:06.656058+0000","last_peered":"2023-10-16T13:00:06.656058+0000","last_clean":"2023-10-16T13:00:06.656058+0000","last_became_active":"2023-10-16T13:00:05.658926+0000","last_became_peered":"2023-10-16T13:00:05.658926+0000","last_unstale":"2023-10-16T13:00:06.656058+0000","last_undegraded":"2023-10-16T13:00:06.656058+0000","last_fullsized":"2023-10-16T13:00:06.656058+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:07:34.723972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.637492+0000","last_change":"2023-10-16T13:00:04.643710+0000","last_active":"2023-10-16T13:00:05.637492+0000","last_peered":"2023-10-16T13:00:05.637492+0000","last_clean":"2023-10-16T13:00:05.637492+0000","last_became_active":"2023-10-16T13:00:04.643373+0000","last_became_peered":"2023-10-16T13:00:04.643373+0000","last_unstale":"2023-10-16T13:00:05.637492+0000","last_undegraded":"2023-10-16T13:00:05.637492+0000","last_fullsized":"2023-10-16T13:00:05.637492+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:25:29.608579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.953287+0000","last_change":"2023-10-16T13:00:05.657811+0000","last_active":"2023-10-16T13:00:06.953287+0000","last_peered":"2023-10-16T13:00:06.953287+0000","last_clean":"2023-10-16T13:00:06.953287+0000","last_became_active":"2023-10-16T13:00:05.657559+0000","last_became_peered":"2023-10-16T13:00:05.657559+0000","last_unstale":"2023-10-16T13:00:06.953287+0000","last_undegraded":"2023-10-16T13:00:06.953287+0000","last_fullsized":"2023-10-16T13:00:06.953287+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:57:27.739256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.673941+0000","last_change":"2023-10-16T13:00:04.642736+0000","last_active":"2023-10-16T13:00:05.673941+0000","last_peered":"2023-10-16T13:00:05.673941+0000","last_clean":"2023-10-16T13:00:05.673941+0000","last_became_active":"2023-10-16T13:00:04.642458+0000","last_became_peered":"2023-10-16T13:00:04.642458+0000","last_unstale":"2023-10-16T13:00:05.673941+0000","last_undegraded":"2023-10-16T13:00:05.673941+0000","last_fullsized":"2023-10-16T13:00:05.673941+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:20.543130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644013+0000","last_change":"2023-10-16T13:00:05.673856+0000","last_active":"2023-10-16T13:00:06.644013+0000","last_peered":"2023-10-16T13:00:06.644013+0000","last_clean":"2023-10-16T13:00:06.644013+0000","last_became_active":"2023-10-16T13:00:05.673586+0000","last_became_peered":"2023-10-16T13:00:05.673586+0000","last_unstale":"2023-10-16T13:00:06.644013+0000","last_undegraded":"2023-10-16T13:00:06.644013+0000","last_fullsized":"2023-10-16T13:00:06.644013+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:40:40.788684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.643775+0000","last_change":"2023-10-16T13:00:04.642925+0000","last_active":"2023-10-16T13:00:06.643775+0000","last_peered":"2023-10-16T13:00:06.643775+0000","last_clean":"2023-10-16T13:00:06.643775+0000","last_became_active":"2023-10-16T13:00:04.642648+0000","last_became_peered":"2023-10-16T13:00:04.642648+0000","last_unstale":"2023-10-16T13:00:06.643775+0000","last_undegraded":"2023-10-16T13:00:06.643775+0000","last_fullsized":"2023-10-16T13:00:06.643775+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:28:22.368402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.656206+0000","last_change":"2023-10-16T13:00:05.668273+0000","last_active":"2023-10-16T13:00:06.656206+0000","last_peered":"2023-10-16T13:00:06.656206+0000","last_clean":"2023-10-16T13:00:06.656206+0000","last_became_active":"2023-10-16T13:00:05.668004+0000","last_became_peered":"2023-10-16T13:00:05.668004+0000","last_unstale":"2023-10-16T13:00:06.656206+0000","last_undegraded":"2023-10-16T13:00:06.656206+0000","last_fullsized":"2023-10-16T13:00:06.656206+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:17:25.242336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.649826+0000","last_change":"2023-10-16T13:00:04.640885+0000","last_active":"2023-10-16T13:00:05.649826+0000","last_peered":"2023-10-16T13:00:05.649826+0000","last_clean":"2023-10-16T13:00:05.649826+0000","last_became_active":"2023-10-16T13:00:04.640624+0000","last_became_peered":"2023-10-16T13:00:04.640624+0000","last_unstale":"2023-10-16T13:00:05.649826+0000","last_undegraded":"2023-10-16T13:00:05.649826+0000","last_fullsized":"2023-10-16T13:00:05.649826+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:10:31.776395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.513318+0000","last_change":"2023-10-16T13:00:05.661164+0000","last_active":"2023-10-16T13:00:08.513318+0000","last_peered":"2023-10-16T13:00:08.513318+0000","last_clean":"2023-10-16T13:00:08.513318+0000","last_became_active":"2023-10-16T13:00:05.660015+0000","last_became_peered":"2023-10-16T13:00:05.660015+0000","last_unstale":"2023-10-16T13:00:08.513318+0000","last_undegraded":"2023-10-16T13:00:08.513318+0000","last_fullsized":"2023-10-16T13:00:08.513318+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:06:41.803202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.649687+0000","last_change":"2023-10-16T13:00:04.644563+0000","last_active":"2023-10-16T13:00:05.649687+0000","last_peered":"2023-10-16T13:00:05.649687+0000","last_clean":"2023-10-16T13:00:05.649687+0000","last_became_active":"2023-10-16T13:00:04.644201+0000","last_became_peered":"2023-10-16T13:00:04.644201+0000","last_unstale":"2023-10-16T13:00:05.649687+0000","last_undegraded":"2023-10-16T13:00:05.649687+0000","last_fullsized":"2023-10-16T13:00:05.649687+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:45:04.187709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.953212+0000","last_change":"2023-10-16T13:00:05.665107+0000","last_active":"2023-10-16T13:00:06.953212+0000","last_peered":"2023-10-16T13:00:06.953212+0000","last_clean":"2023-10-16T13:00:06.953212+0000","last_became_active":"2023-10-16T13:00:05.664822+0000","last_became_peered":"2023-10-16T13:00:05.664822+0000","last_unstale":"2023-10-16T13:00:06.953212+0000","last_undegraded":"2023-10-16T13:00:06.953212+0000","last_fullsized":"2023-10-16T13:00:06.953212+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:06:41.803202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.659336+0000","last_change":"2023-10-16T13:00:04.646689+0000","last_active":"2023-10-16T13:00:05.659336+0000","last_peered":"2023-10-16T13:00:05.659336+0000","last_clean":"2023-10-16T13:00:05.659336+0000","last_became_active":"2023-10-16T13:00:04.646366+0000","last_became_peered":"2023-10-16T13:00:04.646366+0000","last_unstale":"2023-10-16T13:00:05.659336+0000","last_undegraded":"2023-10-16T13:00:05.659336+0000","last_fullsized":"2023-10-16T13:00:05.659336+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:10:31.776395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.514259+0000","last_change":"2023-10-16T13:00:05.655773+0000","last_active":"2023-10-16T13:00:08.514259+0000","last_peered":"2023-10-16T13:00:08.514259+0000","last_clean":"2023-10-16T13:00:08.514259+0000","last_became_active":"2023-10-16T13:00:05.655488+0000","last_became_peered":"2023-10-16T13:00:05.655488+0000","last_unstale":"2023-10-16T13:00:08.514259+0000","last_undegraded":"2023-10-16T13:00:08.514259+0000","last_fullsized":"2023-10-16T13:00:08.514259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:06:41.803202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.645145+0000","last_change":"2023-10-16T13:00:04.646782+0000","last_active":"2023-10-16T13:00:05.645145+0000","last_peered":"2023-10-16T13:00:05.645145+0000","last_clean":"2023-10-16T13:00:05.645145+0000","last_became_active":"2023-10-16T13:00:04.646330+0000","last_became_peered":"2023-10-16T13:00:04.646330+0000","last_unstale":"2023-10-16T13:00:05.645145+0000","last_undegraded":"2023-10-16T13:00:05.645145+0000","last_fullsized":"2023-10-16T13:00:05.645145+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:49:54.544627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644292+0000","last_change":"2023-10-16T13:00:05.667397+0000","last_active":"2023-10-16T13:00:06.644292+0000","last_peered":"2023-10-16T13:00:06.644292+0000","last_clean":"2023-10-16T13:00:06.644292+0000","last_became_active":"2023-10-16T13:00:05.665478+0000","last_became_peered":"2023-10-16T13:00:05.665478+0000","last_unstale":"2023-10-16T13:00:06.644292+0000","last_undegraded":"2023-10-16T13:00:06.644292+0000","last_fullsized":"2023-10-16T13:00:06.644292+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:08:21.105118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.649871+0000","last_change":"2023-10-16T13:00:04.640662+0000","last_active":"2023-10-16T13:00:05.649871+0000","last_peered":"2023-10-16T13:00:05.649871+0000","last_clean":"2023-10-16T13:00:05.649871+0000","last_became_active":"2023-10-16T13:00:04.640353+0000","last_became_peered":"2023-10-16T13:00:04.640353+0000","last_unstale":"2023-10-16T13:00:05.649871+0000","last_undegraded":"2023-10-16T13:00:05.649871+0000","last_fullsized":"2023-10-16T13:00:05.649871+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:40:39.782114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.645091+0000","last_change":"2023-10-16T13:00:05.660655+0000","last_active":"2023-10-16T13:00:06.645091+0000","last_peered":"2023-10-16T13:00:06.645091+0000","last_clean":"2023-10-16T13:00:06.645091+0000","last_became_active":"2023-10-16T13:00:05.659409+0000","last_became_peered":"2023-10-16T13:00:05.659409+0000","last_unstale":"2023-10-16T13:00:06.645091+0000","last_undegraded":"2023-10-16T13:00:06.645091+0000","last_fullsized":"2023-10-16T13:00:06.645091+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:10:05.637340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.653730+0000","last_change":"2023-10-16T13:00:04.638198+0000","last_active":"2023-10-16T13:00:05.653730+0000","last_peered":"2023-10-16T13:00:05.653730+0000","last_clean":"2023-10-16T13:00:05.653730+0000","last_became_active":"2023-10-16T13:00:04.637703+0000","last_became_peered":"2023-10-16T13:00:04.637703+0000","last_unstale":"2023-10-16T13:00:05.653730+0000","last_undegraded":"2023-10-16T13:00:05.653730+0000","last_fullsized":"2023-10-16T13:00:05.653730+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:20:38.958405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.652830+0000","last_change":"2023-10-16T12:58:40.198340+0000","last_active":"2023-10-16T13:00:05.652830+0000","last_peered":"2023-10-16T13:00:05.652830+0000","last_clean":"2023-10-16T13:00:05.652830+0000","last_became_active":"2023-10-16T12:58:40.197354+0000","last_became_peered":"2023-10-16T12:58:40.197354+0000","last_unstale":"2023-10-16T13:00:05.652830+0000","last_undegraded":"2023-10-16T13:00:05.652830+0000","last_fullsized":"2023-10-16T13:00:05.652830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:39.025347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:39.025347+0000","last_clean_scrub_stamp":"2023-10-16T12:58:39.025347+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:22:36.722419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":781282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.751}]},{"osd":1,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":4.3369999999999997,"5min":4.3369999999999997,"15min":4.3369999999999997},"last":0.70299999999999996}]},{"osd":2,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.65100000000000002}]},{"osd":3,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":4.1520000000000001,"5min":4.1520000000000001,"15min":4.1520000000000001},"last":0.73499999999999999}]},{"osd":4,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.48899999999999999}]},{"osd":5,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.52800000000000002}]},{"osd":6,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.58999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":183194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":10.58,"5min":10.58,"15min":10.58},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":7.609,"5min":7.609,"15min":7.609},"last":0.56899999999999995}]},{"osd":1,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.5129999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.52500000000000002}]},{"osd":2,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.45500000000000002},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":10.622,"5min":10.622,"15min":10.622},"last":0.46999999999999997}]},{"osd":3,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":4.6349999999999998,"5min":4.6349999999999998,"15min":4.6349999999999998},"last":0.38200000000000001}]},{"osd":4,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.35899999999999999}]},{"osd":5,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.501},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.55500000000000005}]},{"osd":7,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.53900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":189322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.307}]},{"osd":2,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.34100000000000003}]},{"osd":3,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.377},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.40000000000000002}]},{"osd":4,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.55500000000000005}]},{"osd":5,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.68400000000000005}]},{"osd":6,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.54400000000000004}]},{"osd":7,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.69899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1024000,"data_stored":773014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.32600000000000001}]},{"osd":2,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":3.1190000000000002,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.23899999999999999}]},{"osd":3,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.30299999999999999}]},{"osd":4,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58199999999999996}]},{"osd":5,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.54700000000000004}]},{"osd":6,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.56599999999999995}]},{"osd":7,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.50800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":189302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":11.090999999999999,"5min":11.090999999999999,"15min":11.090999999999999},"last":0.249},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":0.27000000000000002}]},{"osd":1,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":11.076000000000001,"5min":11.076000000000001,"15min":11.076000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":17.914000000000001,"5min":17.914000000000001,"15min":17.914000000000001},"last":0.33600000000000002}]},{"osd":3,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.113,"5min":11.113,"15min":11.113},"last":0.29999999999999999}]},{"osd":4,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":10.993,"5min":10.993,"15min":10.993},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":0.61299999999999999}]},{"osd":5,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.6150000000000002,"5min":2.6150000000000002,"15min":2.6150000000000002},"last":0.56999999999999995},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":11.055,"5min":11.055,"15min":11.055},"last":0.67600000000000005}]},{"osd":6,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.65800000000000003}]},{"osd":7,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.8559999999999999,"5min":2.8559999999999999,"15min":2.8559999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":0.624}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":190878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":0.23100000000000001},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":26.940999999999999,"5min":26.940999999999999,"15min":26.940999999999999},"last":0.27300000000000002}]},{"osd":1,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":8.2249999999999996,"5min":8.2249999999999996,"15min":8.2249999999999996},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.374}]},{"osd":2,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":16.018999999999998,"5min":16.018999999999998,"15min":16.018999999999998},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":0.34899999999999998}]},{"osd":4,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":8.3889999999999993,"5min":8.3889999999999993,"15min":8.3889999999999993},"last":0.63},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":8.3030000000000008,"5min":8.3030000000000008,"15min":8.3030000000000008},"last":0.53300000000000003}]},{"osd":5,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":8.4139999999999997,"5min":8.4139999999999997,"15min":8.4139999999999997},"last":0.755}]},{"osd":6,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":8.2699999999999996,"5min":8.2699999999999996,"15min":8.2699999999999996},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.68400000000000005}]},{"osd":7,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":8.3629999999999995,"5min":8.3629999999999995,"15min":8.3629999999999995},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":8.3320000000000007,"5min":8.3320000000000007,"15min":8.3320000000000007},"last":0.77300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":183216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":3.7970000000000002,"5min":3.7970000000000002,"15min":3.7970000000000002},"last":0.54100000000000004}]},{"osd":1,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.32000000000000001}]},{"osd":2,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.42799999999999999}]},{"osd":3,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.439}]},{"osd":5,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.57099999999999995}]},{"osd":6,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.379},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.47199999999999998}]},{"osd":7,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.503},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.48399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":189344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.56000000000000005}]},{"osd":1,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.61799999999999999}]},{"osd":2,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.36099999999999999}]},{"osd":3,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.443}]},{"osd":4,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.45300000000000001}]},{"osd":6,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.60499999999999998}]},{"osd":7,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.54600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:00:14.348 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T13:00:14.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.485+0000 7f5de8a20700 1 Processor -- start 2023-10-16T13:00:14.487 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.485+0000 7f5de8a20700 1 -- start start 2023-10-16T13:00:14.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.486+0000 7f5de8a20700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5de4152470 0x7f5de40cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:14.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.486+0000 7f5de8a20700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de4070d70 con 0x7f5de40cb8d0 2023-10-16T13:00:14.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.486+0000 7f5de8a20700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de415c990 con 0x7f5de40b3410 2023-10-16T13:00:14.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.486+0000 7f5de8a20700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de4071200 con 0x7f5de4152470 2023-10-16T13:00:14.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.486+0000 7f5de1d9b700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f5de40cb8d0 0x7f5de40b2d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:44372/0 (socket says 172.21.15.124:44372) 2023-10-16T13:00:14.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.486+0000 7f5de1d9b700 1 -- 172.21.15.124:0/1589654994 learned_addr learned my addr 172.21.15.124:0/1589654994 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T13:00:14.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.486+0000 7f5de259c700 1 --2- 172.21.15.124:0/1589654994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5de4152470 0x7f5de40cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:14.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.486+0000 7f5de159a700 1 -- 172.21.15.124:0/1589654994 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1615754591 0 0) 0x7f5de4070d70 con 0x7f5de40cb8d0 2023-10-16T13:00:14.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.486+0000 7f5de159a700 1 -- 172.21.15.124:0/1589654994 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dcc0035b0 con 0x7f5de40cb8d0 2023-10-16T13:00:14.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.487+0000 7f5de159a700 1 -- 172.21.15.124:0/1589654994 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4290366007 0 0) 0x7f5de415c990 con 0x7f5de40b3410 2023-10-16T13:00:14.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.487+0000 7f5de159a700 1 -- 172.21.15.124:0/1589654994 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5de4070d70 con 0x7f5de40b3410 2023-10-16T13:00:14.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.487+0000 7f5de159a700 1 -- 172.21.15.124:0/1589654994 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3845119068 0 0) 0x7f5dcc0035b0 con 0x7f5de40cb8d0 2023-10-16T13:00:14.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.487+0000 7f5de159a700 1 -- 172.21.15.124:0/1589654994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5de4152470 msgr2=0x7f5de40cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:14.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.487+0000 7f5de159a700 1 --2- 172.21.15.124:0/1589654994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5de4152470 0x7f5de40cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:14.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.487+0000 7f5de159a700 1 -- 172.21.15.124:0/1589654994 >> v1:172.21.15.192:6789/0 conn(0x7f5de40b3410 legacy=0x7f5de40b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:14.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.487+0000 7f5de159a700 1 -- 172.21.15.124:0/1589654994 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de4070440 con 0x7f5de40cb8d0 2023-10-16T13:00:14.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.487+0000 7f5de159a700 1 -- 172.21.15.124:0/1589654994 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f5dd4001670 con 0x7f5de40cb8d0 2023-10-16T13:00:14.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.487+0000 7f5de159a700 1 -- 172.21.15.124:0/1589654994 >> v1:172.21.15.124:6789/0 conn(0x7f5de40cb8d0 legacy=0x7f5de40b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:14.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.487+0000 7f5de159a700 1 --2- 172.21.15.124:0/1589654994 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5dcc003bc0 0x7f5dcc003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:14.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.487+0000 7f5de159a700 1 --2- 172.21.15.124:0/1589654994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dcc004850 0x7f5dcc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:14.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.487+0000 7f5de159a700 1 --2- 172.21.15.124:0/1589654994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5de4152470 0x7f5dcc0052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:14.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.487+0000 7f5de159a700 1 -- 172.21.15.124:0/1589654994 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de4071200 con 0x7f5dcc003bc0 2023-10-16T13:00:14.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.487+0000 7f5de159a700 1 -- 172.21.15.124:0/1589654994 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc00bbd0 con 0x7f5dcc004850 2023-10-16T13:00:14.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.487+0000 7f5de159a700 1 -- 172.21.15.124:0/1589654994 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc00bd90 con 0x7f5de4152470 2023-10-16T13:00:14.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.487+0000 7f5de259c700 1 --2- 172.21.15.124:0/1589654994 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5dcc003bc0 0x7f5dcc003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:14.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.487+0000 7f5de1d9b700 1 --2- 172.21.15.124:0/1589654994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dcc004850 0x7f5dcc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:14.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.487+0000 7f5de2d9d700 1 --2- 172.21.15.124:0/1589654994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5de4152470 0x7f5dcc0052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:14.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.487+0000 7f5de259c700 1 -- 172.21.15.124:0/1589654994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5de4152470 msgr2=0x7f5dcc0052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:14.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.487+0000 7f5de259c700 1 --2- 172.21.15.124:0/1589654994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5de4152470 0x7f5dcc0052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:14.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.487+0000 7f5de259c700 1 -- 172.21.15.124:0/1589654994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dcc004850 msgr2=0x7f5dcc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:14.502 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.487+0000 7f5de259c700 1 --2- 172.21.15.124:0/1589654994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dcc004850 0x7f5dcc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:14.503 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.487+0000 7f5de259c700 1 -- 172.21.15.124:0/1589654994 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dcc0035b0 con 0x7f5dcc003bc0 2023-10-16T13:00:14.503 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.487+0000 7f5de259c700 1 --2- 172.21.15.124:0/1589654994 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5dcc003bc0 0x7f5dcc003fc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8009b60 tx=0x7f5dcc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318a0d0ef6972973 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:14.503 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.488+0000 7f5de159a700 1 -- 172.21.15.124:0/1589654994 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd800e6c0 con 0x7f5dcc003bc0 2023-10-16T13:00:14.503 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.488+0000 7f5de159a700 1 -- 172.21.15.124:0/1589654994 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd800e820 con 0x7f5dcc003bc0 2023-10-16T13:00:14.503 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.488+0000 7f5de159a700 1 -- 172.21.15.124:0/1589654994 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd800eb90 con 0x7f5dcc003bc0 2023-10-16T13:00:14.504 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.488+0000 7f5de8a20700 1 -- 172.21.15.124:0/1589654994 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5dcc003bc0 msgr2=0x7f5dcc003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:14.504 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.488+0000 7f5de8a20700 1 --2- 172.21.15.124:0/1589654994 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5dcc003bc0 0x7f5dcc003fc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8009b60 tx=0x7f5dcc005880 comp rx=0 tx=0).stop 2023-10-16T13:00:14.504 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.488+0000 7f5de2d9d700 1 -- 172.21.15.124:0/1589654994 reap_dead start 2023-10-16T13:00:14.504 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.488+0000 7f5de8a20700 1 -- 172.21.15.124:0/1589654994 shutdown_connections 2023-10-16T13:00:14.504 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.488+0000 7f5de8a20700 1 -- 172.21.15.124:0/1589654994 >> 172.21.15.124:0/1589654994 conn(0x7f5de40cdd00 msgr2=0x7f5de40ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:14.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.488+0000 7f5de8a20700 1 -- 172.21.15.124:0/1589654994 shutdown_connections 2023-10-16T13:00:14.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.488+0000 7f5de8a20700 1 -- 172.21.15.124:0/1589654994 wait complete. 2023-10-16T13:00:14.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.490+0000 7f5de8a20700 1 Processor -- start 2023-10-16T13:00:14.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.490+0000 7f5de8a20700 1 -- start start 2023-10-16T13:00:14.505 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.490+0000 7f5de8a20700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5dcc003bc0 0x7f5de41f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:14.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.490+0000 7f5de8a20700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5de40c8350 0x7f5de41505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:14.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.490+0000 7f5de8a20700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5de40cee00 0x7f5de40cf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:14.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.490+0000 7f5de8a20700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de40c4760 con 0x7f5dcc003bc0 2023-10-16T13:00:14.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.490+0000 7f5de8a20700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de41f4ff0 con 0x7f5de40cee00 2023-10-16T13:00:14.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.490+0000 7f5de8a20700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de40cf7c0 con 0x7f5de40c8350 2023-10-16T13:00:14.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.491+0000 7f5de259c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5dcc003bc0 0x7f5de41f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:14.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.491+0000 7f5de259c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5dcc003bc0 0x7f5de41f4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55716/0 (socket says 172.21.15.124:55716) 2023-10-16T13:00:14.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.491+0000 7f5de259c700 1 -- 172.21.15.124:0/285823878 learned_addr learned my addr 172.21.15.124:0/285823878 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:14.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.491+0000 7f5de1d9b700 1 --2- 172.21.15.124:0/285823878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5de40c8350 0x7f5de41505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:14.507 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.491+0000 7f5de2d9d700 1 --2- 172.21.15.124:0/285823878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5de40cee00 0x7f5de40cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:14.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.491+0000 7f5de259c700 1 -- 172.21.15.124:0/285823878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5de40c8350 msgr2=0x7f5de41505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:14.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.491+0000 7f5de259c700 1 --2- 172.21.15.124:0/285823878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5de40c8350 0x7f5de41505e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:14.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.491+0000 7f5de259c700 1 -- 172.21.15.124:0/285823878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5de40cee00 msgr2=0x7f5de40cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:14.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.491+0000 7f5de259c700 1 --2- 172.21.15.124:0/285823878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5de40cee00 0x7f5de40cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:14.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.491+0000 7f5de259c700 1 -- 172.21.15.124:0/285823878 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de40c9960 con 0x7f5dcc003bc0 2023-10-16T13:00:14.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.491+0000 7f5de259c700 1 --2- 172.21.15.124:0/285823878 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5dcc003bc0 0x7f5de41f4ab0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00bba0 tx=0x7f5dd80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:14.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.491+0000 7f5dd2ffd700 1 -- 172.21.15.124:0/285823878 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8021070 con 0x7f5dcc003bc0 2023-10-16T13:00:14.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.491+0000 7f5dd2ffd700 1 -- 172.21.15.124:0/285823878 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd8004470 con 0x7f5dcc003bc0 2023-10-16T13:00:14.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.491+0000 7f5de8a20700 1 -- 172.21.15.124:0/285823878 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de40c88c0 con 0x7f5dcc003bc0 2023-10-16T13:00:14.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.491+0000 7f5dd2ffd700 1 -- 172.21.15.124:0/285823878 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd800e6c0 con 0x7f5dcc003bc0 2023-10-16T13:00:14.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.491+0000 7f5de8a20700 1 -- 172.21.15.124:0/285823878 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de40c8e80 con 0x7f5dcc003bc0 2023-10-16T13:00:14.510 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.492+0000 7f5de8a20700 1 -- 172.21.15.124:0/285823878 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de404ebb0 con 0x7f5dcc003bc0 2023-10-16T13:00:14.510 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.493+0000 7f5dd2ffd700 1 -- 172.21.15.124:0/285823878 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5dd8025070 con 0x7f5dcc003bc0 2023-10-16T13:00:14.510 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.493+0000 7f5dd2ffd700 1 --2- 172.21.15.124:0/285823878 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5dc406af00 0x7f5dc406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:14.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.493+0000 7f5dd2ffd700 1 -- 172.21.15.124:0/285823878 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5dd808a780 con 0x7f5dcc003bc0 2023-10-16T13:00:14.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.493+0000 7f5de1d9b700 1 --2- 172.21.15.124:0/285823878 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5dc406af00 0x7f5dc406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:14.511 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.494+0000 7f5de1d9b700 1 --2- 172.21.15.124:0/285823878 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5dc406af00 0x7f5dc406d3c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5de415ba80 tx=0x7f5dd4001e20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:14.512 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.498+0000 7f5dd2ffd700 1 -- 172.21.15.124:0/285823878 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5dd80558a0 con 0x7f5dcc003bc0 2023-10-16T13:00:14.683 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.682+0000 7f5de8a20700 1 -- 172.21.15.124:0/285823878 --> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5de4070a00 con 0x7f5dc406af00 2023-10-16T13:00:14.691 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.690+0000 7f5dd2ffd700 1 -- 172.21.15.124:0/285823878 <== mgr.4104 v2:172.21.15.124:6832/2391611330 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289244 (secure 0 0 0) 0x7f5dd4007e20 con 0x7f5dc406af00 2023-10-16T13:00:14.695 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:00:14.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.693+0000 7f5de8a20700 1 -- 172.21.15.124:0/285823878 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5dc406af00 msgr2=0x7f5dc406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:14.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.693+0000 7f5de8a20700 1 --2- 172.21.15.124:0/285823878 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5dc406af00 0x7f5dc406d3c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5de415ba80 tx=0x7f5dd4001e20 comp rx=0 tx=0).stop 2023-10-16T13:00:14.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.693+0000 7f5de8a20700 1 -- 172.21.15.124:0/285823878 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5dcc003bc0 msgr2=0x7f5de41f4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:14.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.693+0000 7f5de8a20700 1 --2- 172.21.15.124:0/285823878 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5dcc003bc0 0x7f5de41f4ab0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00bba0 tx=0x7f5dd80047c0 comp rx=0 tx=0).stop 2023-10-16T13:00:14.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.693+0000 7f5de8a20700 1 -- 172.21.15.124:0/285823878 shutdown_connections 2023-10-16T13:00:14.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.693+0000 7f5de8a20700 1 --2- 172.21.15.124:0/285823878 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5dc406af00 0x7f5dc406d3c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:14.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.693+0000 7f5de8a20700 1 --2- 172.21.15.124:0/285823878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5de40cee00 0x7f5de40cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:14.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.693+0000 7f5de8a20700 1 --2- 172.21.15.124:0/285823878 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5dcc003bc0 0x7f5de41f4ab0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:14.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.693+0000 7f5de8a20700 1 --2- 172.21.15.124:0/285823878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5de40c8350 0x7f5de41505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:14.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.693+0000 7f5de8a20700 1 -- 172.21.15.124:0/285823878 >> 172.21.15.124:0/285823878 conn(0x7f5de40cdd00 msgr2=0x7f5de4151760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:14.699 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.693+0000 7f5de8a20700 1 -- 172.21.15.124:0/285823878 shutdown_connections 2023-10-16T13:00:14.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.693+0000 7f5de8a20700 1 -- 172.21.15.124:0/285823878 wait complete. 2023-10-16T13:00:14.700 INFO:teuthology.orchestra.run.smithi124.stderr:dumped all 2023-10-16T13:00:14.706 INFO:teuthology.orchestra.run.smithi124.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2023-10-16T13:00:14.638974+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220824,"kb_used_data":4648,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753896,"statfs":{"total":773094113280,"available":772867989504,"internally_reserved":0,"allocated":4759552,"data_stored":2699412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.002576"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.656153+0000","last_change":"2023-10-16T13:00:05.660204+0000","last_active":"2023-10-16T13:00:06.656153+0000","last_peered":"2023-10-16T13:00:06.656153+0000","last_clean":"2023-10-16T13:00:06.656153+0000","last_became_active":"2023-10-16T13:00:05.659946+0000","last_became_peered":"2023-10-16T13:00:05.659946+0000","last_unstale":"2023-10-16T13:00:06.656153+0000","last_undegraded":"2023-10-16T13:00:06.656153+0000","last_fullsized":"2023-10-16T13:00:06.656153+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:06:10.221579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.656039+0000","last_change":"2023-10-16T13:00:05.659000+0000","last_active":"2023-10-16T13:00:06.656039+0000","last_peered":"2023-10-16T13:00:06.656039+0000","last_clean":"2023-10-16T13:00:06.656039+0000","last_became_active":"2023-10-16T13:00:05.658730+0000","last_became_peered":"2023-10-16T13:00:05.658730+0000","last_unstale":"2023-10-16T13:00:06.656039+0000","last_undegraded":"2023-10-16T13:00:06.656039+0000","last_fullsized":"2023-10-16T13:00:06.656039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:21:33.857630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.513561+0000","last_change":"2023-10-16T13:00:05.660819+0000","last_active":"2023-10-16T13:00:08.513561+0000","last_peered":"2023-10-16T13:00:08.513561+0000","last_clean":"2023-10-16T13:00:08.513561+0000","last_became_active":"2023-10-16T13:00:05.660563+0000","last_became_peered":"2023-10-16T13:00:05.660563+0000","last_unstale":"2023-10-16T13:00:08.513561+0000","last_undegraded":"2023-10-16T13:00:08.513561+0000","last_fullsized":"2023-10-16T13:00:08.513561+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:28:11.268287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.643422+0000","last_change":"2023-10-16T13:00:05.651833+0000","last_active":"2023-10-16T13:00:06.643422+0000","last_peered":"2023-10-16T13:00:06.643422+0000","last_clean":"2023-10-16T13:00:06.643422+0000","last_became_active":"2023-10-16T13:00:05.651044+0000","last_became_peered":"2023-10-16T13:00:05.651044+0000","last_unstale":"2023-10-16T13:00:06.643422+0000","last_undegraded":"2023-10-16T13:00:06.643422+0000","last_fullsized":"2023-10-16T13:00:06.643422+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:23:47.504340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.643759+0000","last_change":"2023-10-16T13:00:05.651222+0000","last_active":"2023-10-16T13:00:06.643759+0000","last_peered":"2023-10-16T13:00:06.643759+0000","last_clean":"2023-10-16T13:00:06.643759+0000","last_became_active":"2023-10-16T13:00:05.650908+0000","last_became_peered":"2023-10-16T13:00:05.650908+0000","last_unstale":"2023-10-16T13:00:06.643759+0000","last_undegraded":"2023-10-16T13:00:06.643759+0000","last_fullsized":"2023-10-16T13:00:06.643759+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:04:04.850060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.953402+0000","last_change":"2023-10-16T13:00:05.654633+0000","last_active":"2023-10-16T13:00:06.953402+0000","last_peered":"2023-10-16T13:00:06.953402+0000","last_clean":"2023-10-16T13:00:06.953402+0000","last_became_active":"2023-10-16T13:00:05.654374+0000","last_became_peered":"2023-10-16T13:00:05.654374+0000","last_unstale":"2023-10-16T13:00:06.953402+0000","last_undegraded":"2023-10-16T13:00:06.953402+0000","last_fullsized":"2023-10-16T13:00:06.953402+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:02:45.275287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.645085+0000","last_change":"2023-10-16T13:00:05.654167+0000","last_active":"2023-10-16T13:00:06.645085+0000","last_peered":"2023-10-16T13:00:06.645085+0000","last_clean":"2023-10-16T13:00:06.645085+0000","last_became_active":"2023-10-16T13:00:05.653868+0000","last_became_peered":"2023-10-16T13:00:05.653868+0000","last_unstale":"2023-10-16T13:00:06.645085+0000","last_undegraded":"2023-10-16T13:00:06.645085+0000","last_fullsized":"2023-10-16T13:00:06.645085+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:06:10.221579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.655853+0000","last_change":"2023-10-16T13:00:05.658016+0000","last_active":"2023-10-16T13:00:06.655853+0000","last_peered":"2023-10-16T13:00:06.655853+0000","last_clean":"2023-10-16T13:00:06.655853+0000","last_became_active":"2023-10-16T13:00:05.657700+0000","last_became_peered":"2023-10-16T13:00:05.657700+0000","last_unstale":"2023-10-16T13:00:06.655853+0000","last_undegraded":"2023-10-16T13:00:06.655853+0000","last_fullsized":"2023-10-16T13:00:06.655853+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:45:33.624699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.513650+0000","last_change":"2023-10-16T13:00:05.657558+0000","last_active":"2023-10-16T13:00:08.513650+0000","last_peered":"2023-10-16T13:00:08.513650+0000","last_clean":"2023-10-16T13:00:08.513650+0000","last_became_active":"2023-10-16T13:00:05.657301+0000","last_became_peered":"2023-10-16T13:00:05.657301+0000","last_unstale":"2023-10-16T13:00:08.513650+0000","last_undegraded":"2023-10-16T13:00:08.513650+0000","last_fullsized":"2023-10-16T13:00:08.513650+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:40:40.788684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.645059+0000","last_change":"2023-10-16T13:00:05.661583+0000","last_active":"2023-10-16T13:00:06.645059+0000","last_peered":"2023-10-16T13:00:06.645059+0000","last_clean":"2023-10-16T13:00:06.645059+0000","last_became_active":"2023-10-16T13:00:05.661060+0000","last_became_peered":"2023-10-16T13:00:05.661060+0000","last_unstale":"2023-10-16T13:00:06.645059+0000","last_undegraded":"2023-10-16T13:00:06.645059+0000","last_fullsized":"2023-10-16T13:00:06.645059+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:45:16.739801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.645031+0000","last_change":"2023-10-16T13:00:05.663599+0000","last_active":"2023-10-16T13:00:06.645031+0000","last_peered":"2023-10-16T13:00:06.645031+0000","last_clean":"2023-10-16T13:00:06.645031+0000","last_became_active":"2023-10-16T13:00:05.663312+0000","last_became_peered":"2023-10-16T13:00:05.663312+0000","last_unstale":"2023-10-16T13:00:06.645031+0000","last_undegraded":"2023-10-16T13:00:06.645031+0000","last_fullsized":"2023-10-16T13:00:06.645031+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:17:25.242336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.513489+0000","last_change":"2023-10-16T13:00:05.656214+0000","last_active":"2023-10-16T13:00:08.513489+0000","last_peered":"2023-10-16T13:00:08.513489+0000","last_clean":"2023-10-16T13:00:08.513489+0000","last_became_active":"2023-10-16T13:00:05.655947+0000","last_became_peered":"2023-10-16T13:00:05.655947+0000","last_unstale":"2023-10-16T13:00:08.513489+0000","last_undegraded":"2023-10-16T13:00:08.513489+0000","last_fullsized":"2023-10-16T13:00:08.513489+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:08:10.909311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644690+0000","last_change":"2023-10-16T13:00:05.660996+0000","last_active":"2023-10-16T13:00:06.644690+0000","last_peered":"2023-10-16T13:00:06.644690+0000","last_clean":"2023-10-16T13:00:06.644690+0000","last_became_active":"2023-10-16T13:00:05.660082+0000","last_became_peered":"2023-10-16T13:00:05.660082+0000","last_unstale":"2023-10-16T13:00:06.644690+0000","last_undegraded":"2023-10-16T13:00:06.644690+0000","last_fullsized":"2023-10-16T13:00:06.644690+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:37:00.043366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.514478+0000","last_change":"2023-10-16T13:00:05.672341+0000","last_active":"2023-10-16T13:00:08.514478+0000","last_peered":"2023-10-16T13:00:08.514478+0000","last_clean":"2023-10-16T13:00:08.514478+0000","last_became_active":"2023-10-16T13:00:05.672051+0000","last_became_peered":"2023-10-16T13:00:05.672051+0000","last_unstale":"2023-10-16T13:00:08.514478+0000","last_undegraded":"2023-10-16T13:00:08.514478+0000","last_fullsized":"2023-10-16T13:00:08.514478+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:02:45.275287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644924+0000","last_change":"2023-10-16T13:00:05.652667+0000","last_active":"2023-10-16T13:00:06.644924+0000","last_peered":"2023-10-16T13:00:06.644924+0000","last_clean":"2023-10-16T13:00:06.644924+0000","last_became_active":"2023-10-16T13:00:05.652391+0000","last_became_peered":"2023-10-16T13:00:05.652391+0000","last_unstale":"2023-10-16T13:00:06.644924+0000","last_undegraded":"2023-10-16T13:00:06.644924+0000","last_fullsized":"2023-10-16T13:00:06.644924+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:21:33.857630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.643712+0000","last_change":"2023-10-16T13:00:05.666083+0000","last_active":"2023-10-16T13:00:06.643712+0000","last_peered":"2023-10-16T13:00:06.643712+0000","last_clean":"2023-10-16T13:00:06.643712+0000","last_became_active":"2023-10-16T13:00:05.664951+0000","last_became_peered":"2023-10-16T13:00:05.664951+0000","last_unstale":"2023-10-16T13:00:06.643712+0000","last_undegraded":"2023-10-16T13:00:06.643712+0000","last_fullsized":"2023-10-16T13:00:06.643712+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:57:27.739256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.643862+0000","last_change":"2023-10-16T13:00:05.675572+0000","last_active":"2023-10-16T13:00:06.643862+0000","last_peered":"2023-10-16T13:00:06.643862+0000","last_clean":"2023-10-16T13:00:06.643862+0000","last_became_active":"2023-10-16T13:00:05.675236+0000","last_became_peered":"2023-10-16T13:00:05.675236+0000","last_unstale":"2023-10-16T13:00:06.643862+0000","last_undegraded":"2023-10-16T13:00:06.643862+0000","last_fullsized":"2023-10-16T13:00:06.643862+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:28:11.268287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.514025+0000","last_change":"2023-10-16T13:00:05.674798+0000","last_active":"2023-10-16T13:00:08.514025+0000","last_peered":"2023-10-16T13:00:08.514025+0000","last_clean":"2023-10-16T13:00:08.514025+0000","last_became_active":"2023-10-16T13:00:05.672996+0000","last_became_peered":"2023-10-16T13:00:05.672996+0000","last_unstale":"2023-10-16T13:00:08.514025+0000","last_undegraded":"2023-10-16T13:00:08.514025+0000","last_fullsized":"2023-10-16T13:00:08.514025+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:42:58.734095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.643554+0000","last_change":"2023-10-16T13:00:05.642228+0000","last_active":"2023-10-16T13:00:06.643554+0000","last_peered":"2023-10-16T13:00:06.643554+0000","last_clean":"2023-10-16T13:00:06.643554+0000","last_became_active":"2023-10-16T13:00:05.641950+0000","last_became_peered":"2023-10-16T13:00:05.641950+0000","last_unstale":"2023-10-16T13:00:06.643554+0000","last_undegraded":"2023-10-16T13:00:06.643554+0000","last_fullsized":"2023-10-16T13:00:06.643554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:58:40.119756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.513985+0000","last_change":"2023-10-16T13:00:05.672079+0000","last_active":"2023-10-16T13:00:08.513985+0000","last_peered":"2023-10-16T13:00:08.513985+0000","last_clean":"2023-10-16T13:00:08.513985+0000","last_became_active":"2023-10-16T13:00:05.671808+0000","last_became_peered":"2023-10-16T13:00:05.671808+0000","last_unstale":"2023-10-16T13:00:08.513985+0000","last_undegraded":"2023-10-16T13:00:08.513985+0000","last_fullsized":"2023-10-16T13:00:08.513985+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:20:39.964974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644769+0000","last_change":"2023-10-16T13:00:05.652007+0000","last_active":"2023-10-16T13:00:06.644769+0000","last_peered":"2023-10-16T13:00:06.644769+0000","last_clean":"2023-10-16T13:00:06.644769+0000","last_became_active":"2023-10-16T13:00:05.651714+0000","last_became_peered":"2023-10-16T13:00:05.651714+0000","last_unstale":"2023-10-16T13:00:06.644769+0000","last_undegraded":"2023-10-16T13:00:06.644769+0000","last_fullsized":"2023-10-16T13:00:06.644769+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:15.971169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.513932+0000","last_change":"2023-10-16T13:00:05.647717+0000","last_active":"2023-10-16T13:00:08.513932+0000","last_peered":"2023-10-16T13:00:08.513932+0000","last_clean":"2023-10-16T13:00:08.513932+0000","last_became_active":"2023-10-16T13:00:05.647387+0000","last_became_peered":"2023-10-16T13:00:05.647387+0000","last_unstale":"2023-10-16T13:00:08.513932+0000","last_undegraded":"2023-10-16T13:00:08.513932+0000","last_fullsized":"2023-10-16T13:00:08.513932+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:17:52.292656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644105+0000","last_change":"2023-10-16T13:00:05.669698+0000","last_active":"2023-10-16T13:00:06.644105+0000","last_peered":"2023-10-16T13:00:06.644105+0000","last_clean":"2023-10-16T13:00:06.644105+0000","last_became_active":"2023-10-16T13:00:05.669441+0000","last_became_peered":"2023-10-16T13:00:05.669441+0000","last_unstale":"2023-10-16T13:00:06.644105+0000","last_undegraded":"2023-10-16T13:00:06.644105+0000","last_fullsized":"2023-10-16T13:00:06.644105+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:37:00.043366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.643630+0000","last_change":"2023-10-16T13:00:05.659649+0000","last_active":"2023-10-16T13:00:06.643630+0000","last_peered":"2023-10-16T13:00:06.643630+0000","last_clean":"2023-10-16T13:00:06.643630+0000","last_became_active":"2023-10-16T13:00:05.659396+0000","last_became_peered":"2023-10-16T13:00:05.659396+0000","last_unstale":"2023-10-16T13:00:06.643630+0000","last_undegraded":"2023-10-16T13:00:06.643630+0000","last_fullsized":"2023-10-16T13:00:06.643630+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:52:45.017152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.514040+0000","last_change":"2023-10-16T13:00:05.673649+0000","last_active":"2023-10-16T13:00:08.514040+0000","last_peered":"2023-10-16T13:00:08.514040+0000","last_clean":"2023-10-16T13:00:08.514040+0000","last_became_active":"2023-10-16T13:00:05.672981+0000","last_became_peered":"2023-10-16T13:00:05.672981+0000","last_unstale":"2023-10-16T13:00:08.514040+0000","last_undegraded":"2023-10-16T13:00:08.514040+0000","last_fullsized":"2023-10-16T13:00:08.514040+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:17:52.292656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.953404+0000","last_change":"2023-10-16T13:00:05.656969+0000","last_active":"2023-10-16T13:00:06.953404+0000","last_peered":"2023-10-16T13:00:06.953404+0000","last_clean":"2023-10-16T13:00:06.953404+0000","last_became_active":"2023-10-16T13:00:05.656720+0000","last_became_peered":"2023-10-16T13:00:05.656720+0000","last_unstale":"2023-10-16T13:00:06.953404+0000","last_undegraded":"2023-10-16T13:00:06.953404+0000","last_fullsized":"2023-10-16T13:00:06.953404+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:28:11.268287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.514320+0000","last_change":"2023-10-16T13:00:05.672628+0000","last_active":"2023-10-16T13:00:08.514320+0000","last_peered":"2023-10-16T13:00:08.514320+0000","last_clean":"2023-10-16T13:00:08.514320+0000","last_became_active":"2023-10-16T13:00:05.672345+0000","last_became_peered":"2023-10-16T13:00:05.672345+0000","last_unstale":"2023-10-16T13:00:08.514320+0000","last_undegraded":"2023-10-16T13:00:08.514320+0000","last_fullsized":"2023-10-16T13:00:08.514320+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:21.549699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644813+0000","last_change":"2023-10-16T13:00:05.656815+0000","last_active":"2023-10-16T13:00:06.644813+0000","last_peered":"2023-10-16T13:00:06.644813+0000","last_clean":"2023-10-16T13:00:06.644813+0000","last_became_active":"2023-10-16T13:00:05.656357+0000","last_became_peered":"2023-10-16T13:00:05.656357+0000","last_unstale":"2023-10-16T13:00:06.644813+0000","last_undegraded":"2023-10-16T13:00:06.644813+0000","last_fullsized":"2023-10-16T13:00:06.644813+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:08:21.105118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.513726+0000","last_change":"2023-10-16T13:00:05.665017+0000","last_active":"2023-10-16T13:00:08.513726+0000","last_peered":"2023-10-16T13:00:08.513726+0000","last_clean":"2023-10-16T13:00:08.513726+0000","last_became_active":"2023-10-16T13:00:05.664708+0000","last_became_peered":"2023-10-16T13:00:05.664708+0000","last_unstale":"2023-10-16T13:00:08.513726+0000","last_undegraded":"2023-10-16T13:00:08.513726+0000","last_fullsized":"2023-10-16T13:00:08.513726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:30:42.210746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.515005+0000","last_change":"2023-10-16T13:00:05.665933+0000","last_active":"2023-10-16T13:00:08.515005+0000","last_peered":"2023-10-16T13:00:08.515005+0000","last_clean":"2023-10-16T13:00:08.515005+0000","last_became_active":"2023-10-16T13:00:05.665611+0000","last_became_peered":"2023-10-16T13:00:05.665611+0000","last_unstale":"2023-10-16T13:00:08.515005+0000","last_undegraded":"2023-10-16T13:00:08.515005+0000","last_fullsized":"2023-10-16T13:00:08.515005+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:27:05.813663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644066+0000","last_change":"2023-10-16T13:00:05.669393+0000","last_active":"2023-10-16T13:00:06.644066+0000","last_peered":"2023-10-16T13:00:06.644066+0000","last_clean":"2023-10-16T13:00:06.644066+0000","last_became_active":"2023-10-16T13:00:05.669076+0000","last_became_peered":"2023-10-16T13:00:05.669076+0000","last_unstale":"2023-10-16T13:00:06.644066+0000","last_undegraded":"2023-10-16T13:00:06.644066+0000","last_fullsized":"2023-10-16T13:00:06.644066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:12:22.267877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.953179+0000","last_change":"2023-10-16T13:00:05.642206+0000","last_active":"2023-10-16T13:00:06.953179+0000","last_peered":"2023-10-16T13:00:06.953179+0000","last_clean":"2023-10-16T13:00:06.953179+0000","last_became_active":"2023-10-16T13:00:05.641973+0000","last_became_peered":"2023-10-16T13:00:05.641973+0000","last_unstale":"2023-10-16T13:00:06.953179+0000","last_undegraded":"2023-10-16T13:00:06.953179+0000","last_fullsized":"2023-10-16T13:00:06.953179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:46:47.310390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.643924+0000","last_change":"2023-10-16T13:00:05.670471+0000","last_active":"2023-10-16T13:00:06.643924+0000","last_peered":"2023-10-16T13:00:06.643924+0000","last_clean":"2023-10-16T13:00:06.643924+0000","last_became_active":"2023-10-16T13:00:05.670150+0000","last_became_peered":"2023-10-16T13:00:05.670150+0000","last_unstale":"2023-10-16T13:00:06.643924+0000","last_undegraded":"2023-10-16T13:00:06.643924+0000","last_fullsized":"2023-10-16T13:00:06.643924+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:25:35.275968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.674447+0000","last_change":"2023-10-16T13:00:04.646837+0000","last_active":"2023-10-16T13:00:05.674447+0000","last_peered":"2023-10-16T13:00:05.674447+0000","last_clean":"2023-10-16T13:00:05.674447+0000","last_became_active":"2023-10-16T13:00:04.646560+0000","last_became_peered":"2023-10-16T13:00:04.646560+0000","last_unstale":"2023-10-16T13:00:05.674447+0000","last_undegraded":"2023-10-16T13:00:05.674447+0000","last_fullsized":"2023-10-16T13:00:05.674447+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:49:54.544627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.953433+0000","last_change":"2023-10-16T13:00:05.658504+0000","last_active":"2023-10-16T13:00:06.953433+0000","last_peered":"2023-10-16T13:00:06.953433+0000","last_clean":"2023-10-16T13:00:06.953433+0000","last_became_active":"2023-10-16T13:00:05.658239+0000","last_became_peered":"2023-10-16T13:00:05.658239+0000","last_unstale":"2023-10-16T13:00:06.953433+0000","last_undegraded":"2023-10-16T13:00:06.953433+0000","last_fullsized":"2023-10-16T13:00:06.953433+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:08:10.909311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.670142+0000","last_change":"2023-10-16T13:00:04.639644+0000","last_active":"2023-10-16T13:00:05.670142+0000","last_peered":"2023-10-16T13:00:05.670142+0000","last_clean":"2023-10-16T13:00:05.670142+0000","last_became_active":"2023-10-16T13:00:04.639397+0000","last_became_peered":"2023-10-16T13:00:04.639397+0000","last_unstale":"2023-10-16T13:00:05.670142+0000","last_undegraded":"2023-10-16T13:00:05.670142+0000","last_fullsized":"2023-10-16T13:00:05.670142+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:49:54.544627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.514125+0000","last_change":"2023-10-16T13:00:05.675571+0000","last_active":"2023-10-16T13:00:08.514125+0000","last_peered":"2023-10-16T13:00:08.514125+0000","last_clean":"2023-10-16T13:00:08.514125+0000","last_became_active":"2023-10-16T13:00:05.675343+0000","last_became_peered":"2023-10-16T13:00:05.675343+0000","last_unstale":"2023-10-16T13:00:08.514125+0000","last_undegraded":"2023-10-16T13:00:08.514125+0000","last_fullsized":"2023-10-16T13:00:08.514125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:27:05.813663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.666965+0000","last_change":"2023-10-16T13:00:04.643622+0000","last_active":"2023-10-16T13:00:05.666965+0000","last_peered":"2023-10-16T13:00:05.666965+0000","last_clean":"2023-10-16T13:00:05.666965+0000","last_became_active":"2023-10-16T13:00:04.643303+0000","last_became_peered":"2023-10-16T13:00:04.643303+0000","last_unstale":"2023-10-16T13:00:05.666965+0000","last_undegraded":"2023-10-16T13:00:05.666965+0000","last_fullsized":"2023-10-16T13:00:05.666965+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:17:51.286086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.656190+0000","last_change":"2023-10-16T13:00:05.674651+0000","last_active":"2023-10-16T13:00:06.656190+0000","last_peered":"2023-10-16T13:00:06.656190+0000","last_clean":"2023-10-16T13:00:06.656190+0000","last_became_active":"2023-10-16T13:00:05.674388+0000","last_became_peered":"2023-10-16T13:00:05.674388+0000","last_unstale":"2023-10-16T13:00:06.656190+0000","last_undegraded":"2023-10-16T13:00:06.656190+0000","last_fullsized":"2023-10-16T13:00:06.656190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:10:05.637340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.667307+0000","last_change":"2023-10-16T13:00:04.646615+0000","last_active":"2023-10-16T13:00:05.667307+0000","last_peered":"2023-10-16T13:00:05.667307+0000","last_clean":"2023-10-16T13:00:05.667307+0000","last_became_active":"2023-10-16T13:00:04.646288+0000","last_became_peered":"2023-10-16T13:00:04.646288+0000","last_unstale":"2023-10-16T13:00:05.667307+0000","last_undegraded":"2023-10-16T13:00:05.667307+0000","last_fullsized":"2023-10-16T13:00:05.667307+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:30:41.204176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.513385+0000","last_change":"2023-10-16T13:00:05.655869+0000","last_active":"2023-10-16T13:00:08.513385+0000","last_peered":"2023-10-16T13:00:08.513385+0000","last_clean":"2023-10-16T13:00:08.513385+0000","last_became_active":"2023-10-16T13:00:05.655575+0000","last_became_peered":"2023-10-16T13:00:05.655575+0000","last_unstale":"2023-10-16T13:00:08.513385+0000","last_undegraded":"2023-10-16T13:00:08.513385+0000","last_fullsized":"2023-10-16T13:00:08.513385+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:02:45.275287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.673763+0000","last_change":"2023-10-16T13:00:04.643729+0000","last_active":"2023-10-16T13:00:05.673763+0000","last_peered":"2023-10-16T13:00:05.673763+0000","last_clean":"2023-10-16T13:00:05.673763+0000","last_became_active":"2023-10-16T13:00:04.643444+0000","last_became_peered":"2023-10-16T13:00:04.643444+0000","last_unstale":"2023-10-16T13:00:05.673763+0000","last_undegraded":"2023-10-16T13:00:05.673763+0000","last_fullsized":"2023-10-16T13:00:05.673763+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:17:51.286086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644610+0000","last_change":"2023-10-16T13:00:05.654845+0000","last_active":"2023-10-16T13:00:06.644610+0000","last_peered":"2023-10-16T13:00:06.644610+0000","last_clean":"2023-10-16T13:00:06.644610+0000","last_became_active":"2023-10-16T13:00:05.654547+0000","last_became_peered":"2023-10-16T13:00:05.654547+0000","last_unstale":"2023-10-16T13:00:06.644610+0000","last_undegraded":"2023-10-16T13:00:06.644610+0000","last_fullsized":"2023-10-16T13:00:06.644610+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:12:22.267877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.670784+0000","last_change":"2023-10-16T13:00:04.645516+0000","last_active":"2023-10-16T13:00:05.670784+0000","last_peered":"2023-10-16T13:00:05.670784+0000","last_clean":"2023-10-16T13:00:05.670784+0000","last_became_active":"2023-10-16T13:00:04.645256+0000","last_became_peered":"2023-10-16T13:00:04.645256+0000","last_unstale":"2023-10-16T13:00:05.670784+0000","last_undegraded":"2023-10-16T13:00:05.670784+0000","last_fullsized":"2023-10-16T13:00:05.670784+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:42:57.727525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.514097+0000","last_change":"2023-10-16T13:00:05.659711+0000","last_active":"2023-10-16T13:00:08.514097+0000","last_peered":"2023-10-16T13:00:08.514097+0000","last_clean":"2023-10-16T13:00:08.514097+0000","last_became_active":"2023-10-16T13:00:05.659443+0000","last_became_peered":"2023-10-16T13:00:05.659443+0000","last_unstale":"2023-10-16T13:00:08.514097+0000","last_undegraded":"2023-10-16T13:00:08.514097+0000","last_fullsized":"2023-10-16T13:00:08.514097+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:21.549699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.641143+0000","last_change":"2023-10-16T13:00:04.646559+0000","last_active":"2023-10-16T13:00:05.641143+0000","last_peered":"2023-10-16T13:00:05.641143+0000","last_clean":"2023-10-16T13:00:05.641143+0000","last_became_active":"2023-10-16T13:00:04.646303+0000","last_became_peered":"2023-10-16T13:00:04.646303+0000","last_unstale":"2023-10-16T13:00:05.641143+0000","last_undegraded":"2023-10-16T13:00:05.641143+0000","last_fullsized":"2023-10-16T13:00:05.641143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:42:57.727525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.656142+0000","last_change":"2023-10-16T13:00:05.659870+0000","last_active":"2023-10-16T13:00:06.656142+0000","last_peered":"2023-10-16T13:00:06.656142+0000","last_clean":"2023-10-16T13:00:06.656142+0000","last_became_active":"2023-10-16T13:00:05.659554+0000","last_became_peered":"2023-10-16T13:00:05.659554+0000","last_unstale":"2023-10-16T13:00:06.656142+0000","last_undegraded":"2023-10-16T13:00:06.656142+0000","last_fullsized":"2023-10-16T13:00:06.656142+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:45:16.739801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.645093+0000","last_change":"2023-10-16T13:00:04.643342+0000","last_active":"2023-10-16T13:00:05.645093+0000","last_peered":"2023-10-16T13:00:05.645093+0000","last_clean":"2023-10-16T13:00:05.645093+0000","last_became_active":"2023-10-16T13:00:04.643059+0000","last_became_peered":"2023-10-16T13:00:04.643059+0000","last_unstale":"2023-10-16T13:00:05.645093+0000","last_undegraded":"2023-10-16T13:00:05.645093+0000","last_fullsized":"2023-10-16T13:00:05.645093+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:10:31.776395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.643668+0000","last_change":"2023-10-16T13:00:05.651663+0000","last_active":"2023-10-16T13:00:06.643668+0000","last_peered":"2023-10-16T13:00:06.643668+0000","last_clean":"2023-10-16T13:00:06.643668+0000","last_became_active":"2023-10-16T13:00:05.650687+0000","last_became_peered":"2023-10-16T13:00:05.650687+0000","last_unstale":"2023-10-16T13:00:06.643668+0000","last_undegraded":"2023-10-16T13:00:06.643668+0000","last_fullsized":"2023-10-16T13:00:06.643668+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:52:34.016689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.649935+0000","last_change":"2023-10-16T13:00:04.644161+0000","last_active":"2023-10-16T13:00:05.649935+0000","last_peered":"2023-10-16T13:00:05.649935+0000","last_clean":"2023-10-16T13:00:05.649935+0000","last_became_active":"2023-10-16T13:00:04.643949+0000","last_became_peered":"2023-10-16T13:00:04.643949+0000","last_unstale":"2023-10-16T13:00:05.649935+0000","last_undegraded":"2023-10-16T13:00:05.649935+0000","last_fullsized":"2023-10-16T13:00:05.649935+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:12:21.261307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644166+0000","last_change":"2023-10-16T13:00:05.675654+0000","last_active":"2023-10-16T13:00:06.644166+0000","last_peered":"2023-10-16T13:00:06.644166+0000","last_clean":"2023-10-16T13:00:06.644166+0000","last_became_active":"2023-10-16T13:00:05.675328+0000","last_became_peered":"2023-10-16T13:00:05.675328+0000","last_unstale":"2023-10-16T13:00:06.644166+0000","last_undegraded":"2023-10-16T13:00:06.644166+0000","last_fullsized":"2023-10-16T13:00:06.644166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:45:33.624699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.648833+0000","last_change":"2023-10-16T13:00:04.642355+0000","last_active":"2023-10-16T13:00:05.648833+0000","last_peered":"2023-10-16T13:00:05.648833+0000","last_clean":"2023-10-16T13:00:05.648833+0000","last_became_active":"2023-10-16T13:00:04.642073+0000","last_became_peered":"2023-10-16T13:00:04.642073+0000","last_unstale":"2023-10-16T13:00:05.648833+0000","last_undegraded":"2023-10-16T13:00:05.648833+0000","last_fullsized":"2023-10-16T13:00:05.648833+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:28:10.261717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.513550+0000","last_change":"2023-10-16T13:00:05.659910+0000","last_active":"2023-10-16T13:00:08.513550+0000","last_peered":"2023-10-16T13:00:08.513550+0000","last_clean":"2023-10-16T13:00:08.513550+0000","last_became_active":"2023-10-16T13:00:05.659661+0000","last_became_peered":"2023-10-16T13:00:05.659661+0000","last_unstale":"2023-10-16T13:00:08.513550+0000","last_undegraded":"2023-10-16T13:00:08.513550+0000","last_fullsized":"2023-10-16T13:00:08.513550+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:25:35.275968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.674151+0000","last_change":"2023-10-16T13:00:04.642687+0000","last_active":"2023-10-16T13:00:05.674151+0000","last_peered":"2023-10-16T13:00:05.674151+0000","last_clean":"2023-10-16T13:00:05.674151+0000","last_became_active":"2023-10-16T13:00:04.642406+0000","last_became_peered":"2023-10-16T13:00:04.642406+0000","last_unstale":"2023-10-16T13:00:05.674151+0000","last_undegraded":"2023-10-16T13:00:05.674151+0000","last_fullsized":"2023-10-16T13:00:05.674151+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:25:34.269398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.514849+0000","last_change":"2023-10-16T13:00:05.648259+0000","last_active":"2023-10-16T13:00:08.514849+0000","last_peered":"2023-10-16T13:00:08.514849+0000","last_clean":"2023-10-16T13:00:08.514849+0000","last_became_active":"2023-10-16T13:00:05.647937+0000","last_became_peered":"2023-10-16T13:00:05.647937+0000","last_unstale":"2023-10-16T13:00:08.514849+0000","last_undegraded":"2023-10-16T13:00:08.514849+0000","last_fullsized":"2023-10-16T13:00:08.514849+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:57:27.739256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.679575+0000","last_change":"2023-10-16T13:00:04.638599+0000","last_active":"2023-10-16T13:00:05.679575+0000","last_peered":"2023-10-16T13:00:05.679575+0000","last_clean":"2023-10-16T13:00:05.679575+0000","last_became_active":"2023-10-16T13:00:04.638318+0000","last_became_peered":"2023-10-16T13:00:04.638318+0000","last_unstale":"2023-10-16T13:00:05.679575+0000","last_undegraded":"2023-10-16T13:00:05.679575+0000","last_fullsized":"2023-10-16T13:00:05.679575+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:28:10.261717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.513234+0000","last_change":"2023-10-16T13:00:05.663456+0000","last_active":"2023-10-16T13:00:08.513234+0000","last_peered":"2023-10-16T13:00:08.513234+0000","last_clean":"2023-10-16T13:00:08.513234+0000","last_became_active":"2023-10-16T13:00:05.663194+0000","last_became_peered":"2023-10-16T13:00:05.663194+0000","last_unstale":"2023-10-16T13:00:08.513234+0000","last_undegraded":"2023-10-16T13:00:08.513234+0000","last_fullsized":"2023-10-16T13:00:08.513234+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:46:47.310390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.667825+0000","last_change":"2023-10-16T13:00:04.642636+0000","last_active":"2023-10-16T13:00:05.667825+0000","last_peered":"2023-10-16T13:00:05.667825+0000","last_clean":"2023-10-16T13:00:05.667825+0000","last_became_active":"2023-10-16T13:00:04.642326+0000","last_became_peered":"2023-10-16T13:00:04.642326+0000","last_unstale":"2023-10-16T13:00:05.667825+0000","last_undegraded":"2023-10-16T13:00:05.667825+0000","last_fullsized":"2023-10-16T13:00:05.667825+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:25:34.269398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.655956+0000","last_change":"2023-10-16T13:00:05.660761+0000","last_active":"2023-10-16T13:00:06.655956+0000","last_peered":"2023-10-16T13:00:06.655956+0000","last_clean":"2023-10-16T13:00:06.655956+0000","last_became_active":"2023-10-16T13:00:05.660496+0000","last_became_peered":"2023-10-16T13:00:05.660496+0000","last_unstale":"2023-10-16T13:00:06.655956+0000","last_undegraded":"2023-10-16T13:00:06.655956+0000","last_fullsized":"2023-10-16T13:00:06.655956+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:15.971169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.641076+0000","last_change":"2023-10-16T13:00:04.645998+0000","last_active":"2023-10-16T13:00:05.641076+0000","last_peered":"2023-10-16T13:00:05.641076+0000","last_clean":"2023-10-16T13:00:05.641076+0000","last_became_active":"2023-10-16T13:00:04.645740+0000","last_became_peered":"2023-10-16T13:00:04.645740+0000","last_unstale":"2023-10-16T13:00:05.641076+0000","last_undegraded":"2023-10-16T13:00:05.641076+0000","last_fullsized":"2023-10-16T13:00:05.641076+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:30:41.204176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.643831+0000","last_change":"2023-10-16T13:00:05.670659+0000","last_active":"2023-10-16T13:00:06.643831+0000","last_peered":"2023-10-16T13:00:06.643831+0000","last_clean":"2023-10-16T13:00:06.643831+0000","last_became_active":"2023-10-16T13:00:05.670393+0000","last_became_peered":"2023-10-16T13:00:05.670393+0000","last_unstale":"2023-10-16T13:00:06.643831+0000","last_undegraded":"2023-10-16T13:00:06.643831+0000","last_fullsized":"2023-10-16T13:00:06.643831+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:08:10.909311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.659143+0000","last_change":"2023-10-16T13:00:04.645848+0000","last_active":"2023-10-16T13:00:05.659143+0000","last_peered":"2023-10-16T13:00:05.659143+0000","last_clean":"2023-10-16T13:00:05.659143+0000","last_became_active":"2023-10-16T13:00:04.645516+0000","last_became_peered":"2023-10-16T13:00:04.645516+0000","last_unstale":"2023-10-16T13:00:05.659143+0000","last_undegraded":"2023-10-16T13:00:05.659143+0000","last_fullsized":"2023-10-16T13:00:05.659143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:45:04.187709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.656266+0000","last_change":"2023-10-16T13:00:05.661267+0000","last_active":"2023-10-16T13:00:06.656266+0000","last_peered":"2023-10-16T13:00:06.656266+0000","last_clean":"2023-10-16T13:00:06.656266+0000","last_became_active":"2023-10-16T13:00:05.661016+0000","last_became_peered":"2023-10-16T13:00:05.661016+0000","last_unstale":"2023-10-16T13:00:06.656266+0000","last_undegraded":"2023-10-16T13:00:06.656266+0000","last_fullsized":"2023-10-16T13:00:06.656266+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:37:46.134340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.677155+0000","last_change":"2023-10-16T13:00:04.643031+0000","last_active":"2023-10-16T13:00:05.677155+0000","last_peered":"2023-10-16T13:00:05.677155+0000","last_clean":"2023-10-16T13:00:05.677155+0000","last_became_active":"2023-10-16T13:00:04.642737+0000","last_became_peered":"2023-10-16T13:00:04.642737+0000","last_unstale":"2023-10-16T13:00:05.677155+0000","last_undegraded":"2023-10-16T13:00:05.677155+0000","last_fullsized":"2023-10-16T13:00:05.677155+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:10:31.776395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.655992+0000","last_change":"2023-10-16T13:00:05.673445+0000","last_active":"2023-10-16T13:00:06.655992+0000","last_peered":"2023-10-16T13:00:06.655992+0000","last_clean":"2023-10-16T13:00:06.655992+0000","last_became_active":"2023-10-16T13:00:05.673206+0000","last_became_peered":"2023-10-16T13:00:05.673206+0000","last_unstale":"2023-10-16T13:00:06.655992+0000","last_undegraded":"2023-10-16T13:00:06.655992+0000","last_fullsized":"2023-10-16T13:00:06.655992+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:08:21.105118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.675002+0000","last_change":"2023-10-16T13:00:04.647634+0000","last_active":"2023-10-16T13:00:05.675002+0000","last_peered":"2023-10-16T13:00:05.675002+0000","last_clean":"2023-10-16T13:00:05.675002+0000","last_became_active":"2023-10-16T13:00:04.647358+0000","last_became_peered":"2023-10-16T13:00:04.647358+0000","last_unstale":"2023-10-16T13:00:05.675002+0000","last_undegraded":"2023-10-16T13:00:05.675002+0000","last_fullsized":"2023-10-16T13:00:05.675002+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:06:40.796633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644956+0000","last_change":"2023-10-16T13:00:05.651957+0000","last_active":"2023-10-16T13:00:06.644956+0000","last_peered":"2023-10-16T13:00:06.644956+0000","last_clean":"2023-10-16T13:00:06.644956+0000","last_became_active":"2023-10-16T13:00:05.651658+0000","last_became_peered":"2023-10-16T13:00:05.651658+0000","last_unstale":"2023-10-16T13:00:06.644956+0000","last_undegraded":"2023-10-16T13:00:06.644956+0000","last_fullsized":"2023-10-16T13:00:06.644956+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:07:34.723972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.674770+0000","last_change":"2023-10-16T13:00:04.648554+0000","last_active":"2023-10-16T13:00:05.674770+0000","last_peered":"2023-10-16T13:00:05.674770+0000","last_clean":"2023-10-16T13:00:05.674770+0000","last_became_active":"2023-10-16T13:00:04.648272+0000","last_became_peered":"2023-10-16T13:00:04.648272+0000","last_unstale":"2023-10-16T13:00:05.674770+0000","last_undegraded":"2023-10-16T13:00:05.674770+0000","last_fullsized":"2023-10-16T13:00:05.674770+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:42:57.727525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.514220+0000","last_change":"2023-10-16T13:00:05.646284+0000","last_active":"2023-10-16T13:00:08.514220+0000","last_peered":"2023-10-16T13:00:08.514220+0000","last_clean":"2023-10-16T13:00:08.514220+0000","last_became_active":"2023-10-16T13:00:05.645955+0000","last_became_peered":"2023-10-16T13:00:05.645955+0000","last_unstale":"2023-10-16T13:00:08.514220+0000","last_undegraded":"2023-10-16T13:00:08.514220+0000","last_fullsized":"2023-10-16T13:00:08.514220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:46:47.310390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.676383+0000","last_change":"2023-10-16T13:00:04.638610+0000","last_active":"2023-10-16T13:00:05.676383+0000","last_peered":"2023-10-16T13:00:05.676383+0000","last_clean":"2023-10-16T13:00:05.676383+0000","last_became_active":"2023-10-16T13:00:04.638346+0000","last_became_peered":"2023-10-16T13:00:04.638346+0000","last_unstale":"2023-10-16T13:00:05.676383+0000","last_undegraded":"2023-10-16T13:00:05.676383+0000","last_fullsized":"2023-10-16T13:00:05.676383+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:36:03.848490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.643687+0000","last_change":"2023-10-16T13:00:05.658927+0000","last_active":"2023-10-16T13:00:06.643687+0000","last_peered":"2023-10-16T13:00:06.643687+0000","last_clean":"2023-10-16T13:00:06.643687+0000","last_became_active":"2023-10-16T13:00:05.658659+0000","last_became_peered":"2023-10-16T13:00:05.658659+0000","last_unstale":"2023-10-16T13:00:06.643687+0000","last_undegraded":"2023-10-16T13:00:06.643687+0000","last_fullsized":"2023-10-16T13:00:06.643687+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:05:25.841227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.641180+0000","last_change":"2023-10-16T13:00:04.641841+0000","last_active":"2023-10-16T13:00:05.641180+0000","last_peered":"2023-10-16T13:00:05.641180+0000","last_clean":"2023-10-16T13:00:05.641180+0000","last_became_active":"2023-10-16T13:00:04.641557+0000","last_became_peered":"2023-10-16T13:00:04.641557+0000","last_unstale":"2023-10-16T13:00:05.641180+0000","last_undegraded":"2023-10-16T13:00:05.641180+0000","last_fullsized":"2023-10-16T13:00:05.641180+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:20:38.958405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644209+0000","last_change":"2023-10-16T13:00:05.669247+0000","last_active":"2023-10-16T13:00:06.644209+0000","last_peered":"2023-10-16T13:00:06.644209+0000","last_clean":"2023-10-16T13:00:06.644209+0000","last_became_active":"2023-10-16T13:00:05.668965+0000","last_became_peered":"2023-10-16T13:00:05.668965+0000","last_unstale":"2023-10-16T13:00:06.644209+0000","last_undegraded":"2023-10-16T13:00:06.644209+0000","last_fullsized":"2023-10-16T13:00:06.644209+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:15.971169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.672860+0000","last_change":"2023-10-16T13:00:04.639492+0000","last_active":"2023-10-16T13:00:05.672860+0000","last_peered":"2023-10-16T13:00:05.672860+0000","last_clean":"2023-10-16T13:00:05.672860+0000","last_became_active":"2023-10-16T13:00:04.639192+0000","last_became_peered":"2023-10-16T13:00:04.639192+0000","last_unstale":"2023-10-16T13:00:05.672860+0000","last_undegraded":"2023-10-16T13:00:05.672860+0000","last_fullsized":"2023-10-16T13:00:05.672860+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:32:33.494952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.513394+0000","last_change":"2023-10-16T13:00:05.660689+0000","last_active":"2023-10-16T13:00:08.513394+0000","last_peered":"2023-10-16T13:00:08.513394+0000","last_clean":"2023-10-16T13:00:08.513394+0000","last_became_active":"2023-10-16T13:00:05.660430+0000","last_became_peered":"2023-10-16T13:00:05.660430+0000","last_unstale":"2023-10-16T13:00:08.513394+0000","last_undegraded":"2023-10-16T13:00:08.513394+0000","last_fullsized":"2023-10-16T13:00:08.513394+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:57:27.739256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.637511+0000","last_change":"2023-10-16T13:00:04.641050+0000","last_active":"2023-10-16T13:00:05.637511+0000","last_peered":"2023-10-16T13:00:05.637511+0000","last_clean":"2023-10-16T13:00:05.637511+0000","last_became_active":"2023-10-16T13:00:04.640795+0000","last_became_peered":"2023-10-16T13:00:04.640795+0000","last_unstale":"2023-10-16T13:00:05.637511+0000","last_undegraded":"2023-10-16T13:00:05.637511+0000","last_fullsized":"2023-10-16T13:00:05.637511+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:11.152311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644696+0000","last_change":"2023-10-16T13:00:05.669097+0000","last_active":"2023-10-16T13:00:06.644696+0000","last_peered":"2023-10-16T13:00:06.644696+0000","last_clean":"2023-10-16T13:00:06.644696+0000","last_became_active":"2023-10-16T13:00:05.668822+0000","last_became_peered":"2023-10-16T13:00:05.668822+0000","last_unstale":"2023-10-16T13:00:06.644696+0000","last_undegraded":"2023-10-16T13:00:06.644696+0000","last_fullsized":"2023-10-16T13:00:06.644696+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:45:33.624699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.656052+0000","last_change":"2023-10-16T13:00:04.644763+0000","last_active":"2023-10-16T13:00:05.656052+0000","last_peered":"2023-10-16T13:00:05.656052+0000","last_clean":"2023-10-16T13:00:05.656052+0000","last_became_active":"2023-10-16T13:00:04.644483+0000","last_became_peered":"2023-10-16T13:00:04.644483+0000","last_unstale":"2023-10-16T13:00:05.656052+0000","last_undegraded":"2023-10-16T13:00:05.656052+0000","last_fullsized":"2023-10-16T13:00:05.656052+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:06:40.796633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.656058+0000","last_change":"2023-10-16T13:00:05.659204+0000","last_active":"2023-10-16T13:00:06.656058+0000","last_peered":"2023-10-16T13:00:06.656058+0000","last_clean":"2023-10-16T13:00:06.656058+0000","last_became_active":"2023-10-16T13:00:05.658926+0000","last_became_peered":"2023-10-16T13:00:05.658926+0000","last_unstale":"2023-10-16T13:00:06.656058+0000","last_undegraded":"2023-10-16T13:00:06.656058+0000","last_fullsized":"2023-10-16T13:00:06.656058+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:07:34.723972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.637492+0000","last_change":"2023-10-16T13:00:04.643710+0000","last_active":"2023-10-16T13:00:05.637492+0000","last_peered":"2023-10-16T13:00:05.637492+0000","last_clean":"2023-10-16T13:00:05.637492+0000","last_became_active":"2023-10-16T13:00:04.643373+0000","last_became_peered":"2023-10-16T13:00:04.643373+0000","last_unstale":"2023-10-16T13:00:05.637492+0000","last_undegraded":"2023-10-16T13:00:05.637492+0000","last_fullsized":"2023-10-16T13:00:05.637492+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:25:29.608579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.953287+0000","last_change":"2023-10-16T13:00:05.657811+0000","last_active":"2023-10-16T13:00:06.953287+0000","last_peered":"2023-10-16T13:00:06.953287+0000","last_clean":"2023-10-16T13:00:06.953287+0000","last_became_active":"2023-10-16T13:00:05.657559+0000","last_became_peered":"2023-10-16T13:00:05.657559+0000","last_unstale":"2023-10-16T13:00:06.953287+0000","last_undegraded":"2023-10-16T13:00:06.953287+0000","last_fullsized":"2023-10-16T13:00:06.953287+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:57:27.739256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.673941+0000","last_change":"2023-10-16T13:00:04.642736+0000","last_active":"2023-10-16T13:00:05.673941+0000","last_peered":"2023-10-16T13:00:05.673941+0000","last_clean":"2023-10-16T13:00:05.673941+0000","last_became_active":"2023-10-16T13:00:04.642458+0000","last_became_peered":"2023-10-16T13:00:04.642458+0000","last_unstale":"2023-10-16T13:00:05.673941+0000","last_undegraded":"2023-10-16T13:00:05.673941+0000","last_fullsized":"2023-10-16T13:00:05.673941+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:20.543130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644013+0000","last_change":"2023-10-16T13:00:05.673856+0000","last_active":"2023-10-16T13:00:06.644013+0000","last_peered":"2023-10-16T13:00:06.644013+0000","last_clean":"2023-10-16T13:00:06.644013+0000","last_became_active":"2023-10-16T13:00:05.673586+0000","last_became_peered":"2023-10-16T13:00:05.673586+0000","last_unstale":"2023-10-16T13:00:06.644013+0000","last_undegraded":"2023-10-16T13:00:06.644013+0000","last_fullsized":"2023-10-16T13:00:06.644013+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:40:40.788684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.643775+0000","last_change":"2023-10-16T13:00:04.642925+0000","last_active":"2023-10-16T13:00:06.643775+0000","last_peered":"2023-10-16T13:00:06.643775+0000","last_clean":"2023-10-16T13:00:06.643775+0000","last_became_active":"2023-10-16T13:00:04.642648+0000","last_became_peered":"2023-10-16T13:00:04.642648+0000","last_unstale":"2023-10-16T13:00:06.643775+0000","last_undegraded":"2023-10-16T13:00:06.643775+0000","last_fullsized":"2023-10-16T13:00:06.643775+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:28:22.368402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.656206+0000","last_change":"2023-10-16T13:00:05.668273+0000","last_active":"2023-10-16T13:00:06.656206+0000","last_peered":"2023-10-16T13:00:06.656206+0000","last_clean":"2023-10-16T13:00:06.656206+0000","last_became_active":"2023-10-16T13:00:05.668004+0000","last_became_peered":"2023-10-16T13:00:05.668004+0000","last_unstale":"2023-10-16T13:00:06.656206+0000","last_undegraded":"2023-10-16T13:00:06.656206+0000","last_fullsized":"2023-10-16T13:00:06.656206+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:17:25.242336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.649826+0000","last_change":"2023-10-16T13:00:04.640885+0000","last_active":"2023-10-16T13:00:05.649826+0000","last_peered":"2023-10-16T13:00:05.649826+0000","last_clean":"2023-10-16T13:00:05.649826+0000","last_became_active":"2023-10-16T13:00:04.640624+0000","last_became_peered":"2023-10-16T13:00:04.640624+0000","last_unstale":"2023-10-16T13:00:05.649826+0000","last_undegraded":"2023-10-16T13:00:05.649826+0000","last_fullsized":"2023-10-16T13:00:05.649826+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:10:31.776395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.513318+0000","last_change":"2023-10-16T13:00:05.661164+0000","last_active":"2023-10-16T13:00:08.513318+0000","last_peered":"2023-10-16T13:00:08.513318+0000","last_clean":"2023-10-16T13:00:08.513318+0000","last_became_active":"2023-10-16T13:00:05.660015+0000","last_became_peered":"2023-10-16T13:00:05.660015+0000","last_unstale":"2023-10-16T13:00:08.513318+0000","last_undegraded":"2023-10-16T13:00:08.513318+0000","last_fullsized":"2023-10-16T13:00:08.513318+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:06:41.803202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.649687+0000","last_change":"2023-10-16T13:00:04.644563+0000","last_active":"2023-10-16T13:00:05.649687+0000","last_peered":"2023-10-16T13:00:05.649687+0000","last_clean":"2023-10-16T13:00:05.649687+0000","last_became_active":"2023-10-16T13:00:04.644201+0000","last_became_peered":"2023-10-16T13:00:04.644201+0000","last_unstale":"2023-10-16T13:00:05.649687+0000","last_undegraded":"2023-10-16T13:00:05.649687+0000","last_fullsized":"2023-10-16T13:00:05.649687+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:45:04.187709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.953212+0000","last_change":"2023-10-16T13:00:05.665107+0000","last_active":"2023-10-16T13:00:06.953212+0000","last_peered":"2023-10-16T13:00:06.953212+0000","last_clean":"2023-10-16T13:00:06.953212+0000","last_became_active":"2023-10-16T13:00:05.664822+0000","last_became_peered":"2023-10-16T13:00:05.664822+0000","last_unstale":"2023-10-16T13:00:06.953212+0000","last_undegraded":"2023-10-16T13:00:06.953212+0000","last_fullsized":"2023-10-16T13:00:06.953212+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:06:41.803202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.659336+0000","last_change":"2023-10-16T13:00:04.646689+0000","last_active":"2023-10-16T13:00:05.659336+0000","last_peered":"2023-10-16T13:00:05.659336+0000","last_clean":"2023-10-16T13:00:05.659336+0000","last_became_active":"2023-10-16T13:00:04.646366+0000","last_became_peered":"2023-10-16T13:00:04.646366+0000","last_unstale":"2023-10-16T13:00:05.659336+0000","last_undegraded":"2023-10-16T13:00:05.659336+0000","last_fullsized":"2023-10-16T13:00:05.659336+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:10:31.776395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:08.514259+0000","last_change":"2023-10-16T13:00:05.655773+0000","last_active":"2023-10-16T13:00:08.514259+0000","last_peered":"2023-10-16T13:00:08.514259+0000","last_clean":"2023-10-16T13:00:08.514259+0000","last_became_active":"2023-10-16T13:00:05.655488+0000","last_became_peered":"2023-10-16T13:00:05.655488+0000","last_unstale":"2023-10-16T13:00:08.514259+0000","last_undegraded":"2023-10-16T13:00:08.514259+0000","last_fullsized":"2023-10-16T13:00:08.514259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:06:41.803202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.645145+0000","last_change":"2023-10-16T13:00:04.646782+0000","last_active":"2023-10-16T13:00:05.645145+0000","last_peered":"2023-10-16T13:00:05.645145+0000","last_clean":"2023-10-16T13:00:05.645145+0000","last_became_active":"2023-10-16T13:00:04.646330+0000","last_became_peered":"2023-10-16T13:00:04.646330+0000","last_unstale":"2023-10-16T13:00:05.645145+0000","last_undegraded":"2023-10-16T13:00:05.645145+0000","last_fullsized":"2023-10-16T13:00:05.645145+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:49:54.544627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.644292+0000","last_change":"2023-10-16T13:00:05.667397+0000","last_active":"2023-10-16T13:00:06.644292+0000","last_peered":"2023-10-16T13:00:06.644292+0000","last_clean":"2023-10-16T13:00:06.644292+0000","last_became_active":"2023-10-16T13:00:05.665478+0000","last_became_peered":"2023-10-16T13:00:05.665478+0000","last_unstale":"2023-10-16T13:00:06.644292+0000","last_undegraded":"2023-10-16T13:00:06.644292+0000","last_fullsized":"2023-10-16T13:00:06.644292+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:08:21.105118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.649871+0000","last_change":"2023-10-16T13:00:04.640662+0000","last_active":"2023-10-16T13:00:05.649871+0000","last_peered":"2023-10-16T13:00:05.649871+0000","last_clean":"2023-10-16T13:00:05.649871+0000","last_became_active":"2023-10-16T13:00:04.640353+0000","last_became_peered":"2023-10-16T13:00:04.640353+0000","last_unstale":"2023-10-16T13:00:05.649871+0000","last_undegraded":"2023-10-16T13:00:05.649871+0000","last_fullsized":"2023-10-16T13:00:05.649871+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:40:39.782114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T13:00:06.645091+0000","last_change":"2023-10-16T13:00:05.660655+0000","last_active":"2023-10-16T13:00:06.645091+0000","last_peered":"2023-10-16T13:00:06.645091+0000","last_clean":"2023-10-16T13:00:06.645091+0000","last_became_active":"2023-10-16T13:00:05.659409+0000","last_became_peered":"2023-10-16T13:00:05.659409+0000","last_unstale":"2023-10-16T13:00:06.645091+0000","last_undegraded":"2023-10-16T13:00:06.645091+0000","last_fullsized":"2023-10-16T13:00:06.645091+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:04.622149+0000","last_clean_scrub_stamp":"2023-10-16T13:00:04.622149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:10:05.637340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.653730+0000","last_change":"2023-10-16T13:00:04.638198+0000","last_active":"2023-10-16T13:00:05.653730+0000","last_peered":"2023-10-16T13:00:05.653730+0000","last_clean":"2023-10-16T13:00:05.653730+0000","last_became_active":"2023-10-16T13:00:04.637703+0000","last_became_peered":"2023-10-16T13:00:04.637703+0000","last_unstale":"2023-10-16T13:00:05.653730+0000","last_undegraded":"2023-10-16T13:00:05.653730+0000","last_fullsized":"2023-10-16T13:00:05.653730+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T13:00:03.615579+0000","last_clean_scrub_stamp":"2023-10-16T13:00:03.615579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:20:38.958405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T13:00:05.652830+0000","last_change":"2023-10-16T12:58:40.198340+0000","last_active":"2023-10-16T13:00:05.652830+0000","last_peered":"2023-10-16T13:00:05.652830+0000","last_clean":"2023-10-16T13:00:05.652830+0000","last_became_active":"2023-10-16T12:58:40.197354+0000","last_became_peered":"2023-10-16T12:58:40.197354+0000","last_unstale":"2023-10-16T13:00:05.652830+0000","last_undegraded":"2023-10-16T13:00:05.652830+0000","last_fullsized":"2023-10-16T13:00:05.652830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T12:58:39.025347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T12:58:39.025347+0000","last_clean_scrub_stamp":"2023-10-16T12:58:39.025347+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:22:36.722419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":781282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.751}]},{"osd":1,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":4.3369999999999997,"5min":4.3369999999999997,"15min":4.3369999999999997},"last":0.70299999999999996}]},{"osd":2,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.65100000000000002}]},{"osd":3,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":4.1520000000000001,"5min":4.1520000000000001,"15min":4.1520000000000001},"last":0.73499999999999999}]},{"osd":4,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.48899999999999999}]},{"osd":5,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.52800000000000002}]},{"osd":6,"last update":"Mon Oct 16 12:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.58999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":189814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":10.58,"5min":10.58,"15min":10.58},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":7.609,"5min":7.609,"15min":7.609},"last":0.61499999999999999}]},{"osd":1,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.5129999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.53900000000000003}]},{"osd":2,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.46100000000000002},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":10.622,"5min":10.622,"15min":10.622},"last":0.42099999999999999}]},{"osd":3,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":4.6349999999999998,"5min":4.6349999999999998,"15min":4.6349999999999998},"last":0.56399999999999995}]},{"osd":4,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.69799999999999995}]},{"osd":5,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.70999999999999996}]},{"osd":7,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.68200000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":189322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.35499999999999998}]},{"osd":2,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.39200000000000002}]},{"osd":3,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.40799999999999997}]},{"osd":4,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.64600000000000002}]},{"osd":5,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.53900000000000003}]},{"osd":6,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.621}]},{"osd":7,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.53100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":779634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.32200000000000001}]},{"osd":2,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":3.1190000000000002,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.26600000000000001}]},{"osd":3,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.34200000000000003}]},{"osd":4,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.72999999999999998}]},{"osd":5,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.66000000000000003}]},{"osd":6,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.622}]},{"osd":7,"last update":"Mon Oct 16 12:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.57899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":189302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":11.090999999999999,"5min":11.090999999999999,"15min":11.090999999999999},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":0.36399999999999999}]},{"osd":1,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":11.076000000000001,"5min":11.076000000000001,"15min":11.076000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":17.914000000000001,"5min":17.914000000000001,"15min":17.914000000000001},"last":0.34399999999999997}]},{"osd":3,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":0.309},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.113,"5min":11.113,"15min":11.113},"last":0.33100000000000002}]},{"osd":4,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":10.993,"5min":10.993,"15min":10.993},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":0.48599999999999999}]},{"osd":5,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.6150000000000002,"5min":2.6150000000000002,"15min":2.6150000000000002},"last":0.496},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":11.055,"5min":11.055,"15min":11.055},"last":0.59099999999999997}]},{"osd":6,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.52100000000000002}]},{"osd":7,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.8559999999999999,"5min":2.8559999999999999,"15min":2.8559999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":0.47699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":190878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":0.255},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":26.940999999999999,"5min":26.940999999999999,"15min":26.940999999999999},"last":0.38800000000000001}]},{"osd":1,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":8.2249999999999996,"5min":8.2249999999999996,"15min":8.2249999999999996},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.32700000000000001}]},{"osd":2,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":16.018999999999998,"5min":16.018999999999998,"15min":16.018999999999998},"last":0.377},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":0.36299999999999999}]},{"osd":4,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":8.3889999999999993,"5min":8.3889999999999993,"15min":8.3889999999999993},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":8.3030000000000008,"5min":8.3030000000000008,"15min":8.3030000000000008},"last":0.62}]},{"osd":5,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.628},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":8.4139999999999997,"5min":8.4139999999999997,"15min":8.4139999999999997},"last":0.67600000000000005}]},{"osd":6,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":8.2699999999999996,"5min":8.2699999999999996,"15min":8.2699999999999996},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.68999999999999995}]},{"osd":7,"last update":"Mon Oct 16 12:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":8.3629999999999995,"5min":8.3629999999999995,"15min":8.3629999999999995},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":8.3320000000000007,"5min":8.3320000000000007,"15min":8.3320000000000007},"last":0.54100000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":189836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":3.7970000000000002,"5min":3.7970000000000002,"15min":3.7970000000000002},"last":0.48699999999999999}]},{"osd":1,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.53700000000000003}]},{"osd":2,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.42899999999999999}]},{"osd":3,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.55800000000000005}]},{"osd":5,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.61099999999999999}]},{"osd":6,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.58799999999999997}]},{"osd":7,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.52200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":189344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.629}]},{"osd":1,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.52100000000000002}]},{"osd":2,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.64700000000000002}]},{"osd":3,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.55600000000000005}]},{"osd":4,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.68600000000000005}]},{"osd":6,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.79400000000000004}]},{"osd":7,"last update":"Mon Oct 16 12:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.748}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T13:00:14.713 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-16T13:00:14.713 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-16T13:00:14.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.872+0000 7fb6da241700 1 Processor -- start 2023-10-16T13:00:14.874 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.872+0000 7fb6da241700 1 -- start start 2023-10-16T13:00:14.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.873+0000 7fb6da241700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb6d406bd30 0x7fb6d406e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:14.876 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.873+0000 7fb6da241700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb6d40cdd40 0x7fb6d40ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:14.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.873+0000 7fb6da241700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d4159f30 con 0x7fb6d4159b50 2023-10-16T13:00:14.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.873+0000 7fb6da241700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d4066cb0 con 0x7fb6d40cdd40 2023-10-16T13:00:14.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.873+0000 7fb6da241700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d406c1e0 con 0x7fb6d406bd30 2023-10-16T13:00:14.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.873+0000 7fb6d3fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb6d40cdd40 0x7fb6d40ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:14.877 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.873+0000 7fb6d3fff700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb6d40cdd40 0x7fb6d40ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55728/0 (socket says 172.21.15.124:55728) 2023-10-16T13:00:14.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.873+0000 7fb6d3fff700 1 -- 172.21.15.124:0/1682903872 learned_addr learned my addr 172.21.15.124:0/1682903872 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:14.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.873+0000 7fb6d2ffd700 1 --2- 172.21.15.124:0/1682903872 >> v2:172.21.15.192:3300/0 conn(0x7fb6d406bd30 0x7fb6d406e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:14.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.873+0000 7fb6d3fff700 1 -- 172.21.15.124:0/1682903872 >> v2:172.21.15.192:3300/0 conn(0x7fb6d406bd30 msgr2=0x7fb6d406e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:14.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.874+0000 7fb6d3fff700 1 --2- 172.21.15.124:0/1682903872 >> v2:172.21.15.192:3300/0 conn(0x7fb6d406bd30 0x7fb6d406e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:14.878 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.874+0000 7fb6d3fff700 1 -- 172.21.15.124:0/1682903872 >> v1:172.21.15.192:6789/0 conn(0x7fb6d4159b50 legacy=0x7fb6d40665a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:14.879 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.874+0000 7fb6d3fff700 1 -- 172.21.15.124:0/1682903872 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d40ce6d0 con 0x7fb6d40cdd40 2023-10-16T13:00:14.879 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.874+0000 7fb6d3fff700 1 --2- 172.21.15.124:0/1682903872 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb6d40cdd40 0x7fb6d40ce190 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4070cb0 tx=0x7fb6cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d342bd7ab8441fbf server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:14.879 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.874+0000 7fb6d27fc700 1 -- 172.21.15.124:0/1682903872 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc00e070 con 0x7fb6d40cdd40 2023-10-16T13:00:14.879 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.874+0000 7fb6d27fc700 1 -- 172.21.15.124:0/1682903872 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6cc003a20 con 0x7fb6d40cdd40 2023-10-16T13:00:14.879 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.874+0000 7fb6d27fc700 1 -- 172.21.15.124:0/1682903872 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc003dd0 con 0x7fb6d40cdd40 2023-10-16T13:00:14.880 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.874+0000 7fb6da241700 1 -- 172.21.15.124:0/1682903872 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb6d40cdd40 msgr2=0x7fb6d40ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:14.880 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.874+0000 7fb6da241700 1 --2- 172.21.15.124:0/1682903872 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb6d40cdd40 0x7fb6d40ce190 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4070cb0 tx=0x7fb6cc00b330 comp rx=0 tx=0).stop 2023-10-16T13:00:14.880 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.874+0000 7fb6da241700 1 -- 172.21.15.124:0/1682903872 shutdown_connections 2023-10-16T13:00:14.880 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.874+0000 7fb6da241700 1 --2- 172.21.15.124:0/1682903872 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb6d40cdd40 0x7fb6d40ce190 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:14.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.874+0000 7fb6da241700 1 --2- 172.21.15.124:0/1682903872 >> v2:172.21.15.192:3300/0 conn(0x7fb6d406bd30 0x7fb6d406e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:14.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.874+0000 7fb6da241700 1 -- 172.21.15.124:0/1682903872 >> 172.21.15.124:0/1682903872 conn(0x7fb6d40b13e0 msgr2=0x7fb6d40b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:14.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.874+0000 7fb6da241700 1 -- 172.21.15.124:0/1682903872 shutdown_connections 2023-10-16T13:00:14.881 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.875+0000 7fb6da241700 1 -- 172.21.15.124:0/1682903872 wait complete. 2023-10-16T13:00:14.884 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.876+0000 7fb6da241700 1 Processor -- start 2023-10-16T13:00:14.884 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.876+0000 7fb6da241700 1 -- start start 2023-10-16T13:00:14.884 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.876+0000 7fb6da241700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6d406bd30 0x7fb6d40c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:14.884 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.876+0000 7fb6da241700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb6d40cdd40 0x7fb6d41520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:14.885 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.876+0000 7fb6da241700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6d4159b50 0x7fb6d406dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:14.885 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.876+0000 7fb6da241700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d40c9860 con 0x7fb6d40cdd40 2023-10-16T13:00:14.885 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.876+0000 7fb6da241700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d40c7520 con 0x7fb6d406bd30 2023-10-16T13:00:14.885 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.876+0000 7fb6da241700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d40c71f0 con 0x7fb6d4159b50 2023-10-16T13:00:14.885 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.877+0000 7fb6d2ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb6d40cdd40 0x7fb6d41520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:14.886 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.877+0000 7fb6d2ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb6d40cdd40 0x7fb6d41520a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55732/0 (socket says 172.21.15.124:55732) 2023-10-16T13:00:14.886 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.877+0000 7fb6d2ffd700 1 -- 172.21.15.124:0/1964127884 learned_addr learned my addr 172.21.15.124:0/1964127884 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:14.886 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.877+0000 7fb6d37fe700 1 --2- 172.21.15.124:0/1964127884 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6d406bd30 0x7fb6d40c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:14.886 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.877+0000 7fb6d3fff700 1 --2- 172.21.15.124:0/1964127884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6d4159b50 0x7fb6d406dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:14.886 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.877+0000 7fb6d2ffd700 1 -- 172.21.15.124:0/1964127884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6d4159b50 msgr2=0x7fb6d406dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:14.887 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.877+0000 7fb6d2ffd700 1 --2- 172.21.15.124:0/1964127884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6d4159b50 0x7fb6d406dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:14.887 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.877+0000 7fb6d2ffd700 1 -- 172.21.15.124:0/1964127884 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6d406bd30 msgr2=0x7fb6d40c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:14.887 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.877+0000 7fb6d2ffd700 1 --2- 172.21.15.124:0/1964127884 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6d406bd30 0x7fb6d40c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:14.887 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.877+0000 7fb6d2ffd700 1 -- 172.21.15.124:0/1964127884 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6cc009b30 con 0x7fb6d40cdd40 2023-10-16T13:00:14.888 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.877+0000 7fb6d2ffd700 1 --2- 172.21.15.124:0/1964127884 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb6d40cdd40 0x7fb6d41520a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb6c400c7f0 tx=0x7fb6c400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:14.888 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.877+0000 7fb6bbfff700 1 -- 172.21.15.124:0/1964127884 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4011800 con 0x7fb6d40cdd40 2023-10-16T13:00:14.888 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.877+0000 7fb6bbfff700 1 -- 172.21.15.124:0/1964127884 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c4011960 con 0x7fb6d40cdd40 2023-10-16T13:00:14.888 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.877+0000 7fb6bbfff700 1 -- 172.21.15.124:0/1964127884 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4011cf0 con 0x7fb6d40cdd40 2023-10-16T13:00:14.888 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.877+0000 7fb6da241700 1 -- 172.21.15.124:0/1964127884 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d41529f0 con 0x7fb6d40cdd40 2023-10-16T13:00:14.888 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.877+0000 7fb6da241700 1 -- 172.21.15.124:0/1964127884 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d4152fb0 con 0x7fb6d40cdd40 2023-10-16T13:00:14.889 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.878+0000 7fb6da241700 1 -- 172.21.15.124:0/1964127884 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d406b230 con 0x7fb6d40cdd40 2023-10-16T13:00:14.889 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.879+0000 7fb6bbfff700 1 -- 172.21.15.124:0/1964127884 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb6c4018360 con 0x7fb6d40cdd40 2023-10-16T13:00:14.889 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.879+0000 7fb6bbfff700 1 --2- 172.21.15.124:0/1964127884 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb6c006af00 0x7fb6c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:14.889 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.879+0000 7fb6d37fe700 1 --2- 172.21.15.124:0/1964127884 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb6c006af00 0x7fb6c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:14.890 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.879+0000 7fb6bbfff700 1 -- 172.21.15.124:0/1964127884 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb6c4089700 con 0x7fb6d40cdd40 2023-10-16T13:00:14.890 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.879+0000 7fb6d37fe700 1 --2- 172.21.15.124:0/1964127884 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb6c006af00 0x7fb6c006d3c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009870 tx=0x7fb6c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:14.890 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:14.884+0000 7fb6bbfff700 1 -- 172.21.15.124:0/1964127884 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb6d406b230 con 0x7fb6d40cdd40 2023-10-16T13:00:15.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.146+0000 7fb6da241700 1 -- 172.21.15.124:0/1964127884 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb6d406b230 con 0x7fb6d40cdd40 2023-10-16T13:00:15.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.150+0000 7fb6bbfff700 1 -- 172.21.15.124:0/1964127884 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7fb6d406b230 con 0x7fb6d40cdd40 2023-10-16T13:00:15.152 INFO:teuthology.orchestra.run.smithi124.stdout:[client.0] 2023-10-16T13:00:15.152 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBRMy1lwsZ6CxAAIfzwHgkpk89tbUgo7jfrhw== 2023-10-16T13:00:15.152 INFO:teuthology.orchestra.run.smithi124.stdout: caps mds = "allow" 2023-10-16T13:00:15.153 INFO:teuthology.orchestra.run.smithi124.stdout: caps mon = "allow r" 2023-10-16T13:00:15.153 INFO:teuthology.orchestra.run.smithi124.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-16T13:00:15.154 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.152+0000 7fb6da241700 1 -- 172.21.15.124:0/1964127884 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb6c006af00 msgr2=0x7fb6c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:15.154 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.152+0000 7fb6da241700 1 --2- 172.21.15.124:0/1964127884 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb6c006af00 0x7fb6c006d3c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009870 tx=0x7fb6c8008040 comp rx=0 tx=0).stop 2023-10-16T13:00:15.155 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.152+0000 7fb6da241700 1 -- 172.21.15.124:0/1964127884 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb6d40cdd40 msgr2=0x7fb6d41520a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:15.155 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.152+0000 7fb6da241700 1 --2- 172.21.15.124:0/1964127884 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb6d40cdd40 0x7fb6d41520a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb6c400c7f0 tx=0x7fb6c400cbb0 comp rx=0 tx=0).stop 2023-10-16T13:00:15.155 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.152+0000 7fb6da241700 1 -- 172.21.15.124:0/1964127884 shutdown_connections 2023-10-16T13:00:15.155 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.152+0000 7fb6da241700 1 --2- 172.21.15.124:0/1964127884 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fb6c006af00 0x7fb6c006d3c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:15.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.152+0000 7fb6da241700 1 --2- 172.21.15.124:0/1964127884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6d4159b50 0x7fb6d406dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:15.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.152+0000 7fb6da241700 1 --2- 172.21.15.124:0/1964127884 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6d406bd30 0x7fb6d40c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:15.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.152+0000 7fb6da241700 1 --2- 172.21.15.124:0/1964127884 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb6d40cdd40 0x7fb6d41520a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:15.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.152+0000 7fb6da241700 1 -- 172.21.15.124:0/1964127884 >> 172.21.15.124:0/1964127884 conn(0x7fb6d40b13e0 msgr2=0x7fb6d40af350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:15.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.152+0000 7fb6da241700 1 -- 172.21.15.124:0/1964127884 shutdown_connections 2023-10-16T13:00:15.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.152+0000 7fb6da241700 1 -- 172.21.15.124:0/1964127884 wait complete. 2023-10-16T13:00:15.157 INFO:teuthology.orchestra.run.smithi124.stderr:updated caps for client.0 2023-10-16T13:00:15.166 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T13:00:15.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.285+0000 7f5dd4d87700 1 Processor -- start 2023-10-16T13:00:15.287 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.285+0000 7f5dd4d87700 1 -- start start 2023-10-16T13:00:15.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.286+0000 7f5dd4d87700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd00cf7d0 0x7f5dd015e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:15.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.286+0000 7f5dd4d87700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5dd00ca7d0 0x7f5dd0071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:15.289 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.286+0000 7f5dd4d87700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd00cfeb0 con 0x7f5dd006a820 2023-10-16T13:00:15.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.286+0000 7f5dd4d87700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd00ce410 con 0x7f5dd00ca7d0 2023-10-16T13:00:15.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.286+0000 7f5dd4d87700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd00cfc30 con 0x7f5dd00cf7d0 2023-10-16T13:00:15.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.286+0000 7f5dcdd9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd00cf7d0 0x7f5dd015e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:15.290 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.286+0000 7f5dced9d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5dd00ca7d0 0x7f5dd0071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:15.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.286+0000 7f5dced9d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5dd00ca7d0 0x7f5dd0071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.124:35904/0 (socket says 172.21.15.124:35904) 2023-10-16T13:00:15.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.286+0000 7f5dcdd9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd00cf7d0 0x7f5dd015e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.124:41816/0 (socket says 172.21.15.124:41816) 2023-10-16T13:00:15.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.286+0000 7f5dce59c700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f5dd006a820 0x7f5dd006ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.124:56402/0 (socket says 172.21.15.124:56402) 2023-10-16T13:00:15.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.286+0000 7f5dced9d700 1 -- 172.21.15.124:0/4199586990 learned_addr learned my addr 172.21.15.124:0/4199586990 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:15.291 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.287+0000 7f5dcdd9b700 1 -- 172.21.15.124:0/4199586990 >> v2:172.21.15.192:3300/0 conn(0x7f5dd00ca7d0 msgr2=0x7f5dd0071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:15.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.287+0000 7f5dcdd9b700 1 --2- 172.21.15.124:0/4199586990 >> v2:172.21.15.192:3300/0 conn(0x7f5dd00ca7d0 0x7f5dd0071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:15.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.287+0000 7f5dcdd9b700 1 -- 172.21.15.124:0/4199586990 >> v1:172.21.15.192:6789/0 conn(0x7f5dd006a820 legacy=0x7f5dd006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:15.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.287+0000 7f5dcdd9b700 1 -- 172.21.15.124:0/4199586990 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd00af9d0 con 0x7f5dd00cf7d0 2023-10-16T13:00:15.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.287+0000 7f5dced9d700 1 --2- 172.21.15.124:0/4199586990 >> v2:172.21.15.192:3300/0 conn(0x7f5dd00ca7d0 0x7f5dd0071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T13:00:15.292 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.287+0000 7f5dcdd9b700 1 --2- 172.21.15.124:0/4199586990 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd00cf7d0 0x7f5dd015e7f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0009840 tx=0x7f5dc0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=296e5aea726cf515 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:15.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.287+0000 7f5dcd59a700 1 -- 172.21.15.124:0/4199586990 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0011830 con 0x7f5dd00cf7d0 2023-10-16T13:00:15.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.287+0000 7f5dcd59a700 1 -- 172.21.15.124:0/4199586990 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc0011990 con 0x7f5dd00cf7d0 2023-10-16T13:00:15.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.287+0000 7f5dcd59a700 1 -- 172.21.15.124:0/4199586990 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0011d20 con 0x7f5dd00cf7d0 2023-10-16T13:00:15.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.287+0000 7f5dd4d87700 1 -- 172.21.15.124:0/4199586990 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd00cf7d0 msgr2=0x7f5dd015e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:15.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.287+0000 7f5dd4d87700 1 --2- 172.21.15.124:0/4199586990 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd00cf7d0 0x7f5dd015e7f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0009840 tx=0x7f5dc0009b50 comp rx=0 tx=0).stop 2023-10-16T13:00:15.293 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.288+0000 7f5dd4d87700 1 -- 172.21.15.124:0/4199586990 shutdown_connections 2023-10-16T13:00:15.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.288+0000 7f5dd4d87700 1 --2- 172.21.15.124:0/4199586990 >> v2:172.21.15.192:3300/0 conn(0x7f5dd00ca7d0 0x7f5dd0071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:15.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.288+0000 7f5dd4d87700 1 --2- 172.21.15.124:0/4199586990 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd00cf7d0 0x7f5dd015e7f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:15.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.288+0000 7f5dd4d87700 1 -- 172.21.15.124:0/4199586990 >> 172.21.15.124:0/4199586990 conn(0x7f5dd00d0180 msgr2=0x7f5dd00d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:15.294 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.288+0000 7f5dd4d87700 1 -- 172.21.15.124:0/4199586990 shutdown_connections 2023-10-16T13:00:15.295 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.288+0000 7f5dd4d87700 1 -- 172.21.15.124:0/4199586990 wait complete. 2023-10-16T13:00:15.297 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.289+0000 7f5dd4d87700 1 Processor -- start 2023-10-16T13:00:15.297 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.289+0000 7f5dd4d87700 1 -- start start 2023-10-16T13:00:15.298 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.290+0000 7f5dd4d87700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5dd006a820 0x7f5dd01f6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:15.298 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.290+0000 7f5dd4d87700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd00ca7d0 0x7f5dd006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:15.298 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.290+0000 7f5dd4d87700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd00cf7d0 0x7f5dd01f3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:15.298 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.290+0000 7f5dd4d87700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd01f3230 con 0x7f5dd006a820 2023-10-16T13:00:15.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.290+0000 7f5dd4d87700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd01f6d60 con 0x7f5dd00ca7d0 2023-10-16T13:00:15.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.290+0000 7f5dd4d87700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd01f7030 con 0x7f5dd00cf7d0 2023-10-16T13:00:15.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.290+0000 7f5dce59c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5dd006a820 0x7f5dd01f6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:15.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.290+0000 7f5dce59c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5dd006a820 0x7f5dd01f6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55742/0 (socket says 172.21.15.124:55742) 2023-10-16T13:00:15.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.290+0000 7f5dce59c700 1 -- 172.21.15.124:0/1331820419 learned_addr learned my addr 172.21.15.124:0/1331820419 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:15.299 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.290+0000 7f5dcdd9b700 1 --2- 172.21.15.124:0/1331820419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd00ca7d0 0x7f5dd006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:15.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.290+0000 7f5dced9d700 1 --2- 172.21.15.124:0/1331820419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd00cf7d0 0x7f5dd01f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:15.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.290+0000 7f5dce59c700 1 -- 172.21.15.124:0/1331820419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd00cf7d0 msgr2=0x7f5dd01f3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:15.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.290+0000 7f5dce59c700 1 --2- 172.21.15.124:0/1331820419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd00cf7d0 0x7f5dd01f3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:15.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.290+0000 7f5dce59c700 1 -- 172.21.15.124:0/1331820419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd00ca7d0 msgr2=0x7f5dd006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:15.300 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.290+0000 7f5dce59c700 1 --2- 172.21.15.124:0/1331820419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd00ca7d0 0x7f5dd006e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:15.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.290+0000 7f5dce59c700 1 -- 172.21.15.124:0/1331820419 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc8009b30 con 0x7f5dd006a820 2023-10-16T13:00:15.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.290+0000 7f5dce59c700 1 --2- 172.21.15.124:0/1331820419 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5dd006a820 0x7f5dd01f6820 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400c520 tx=0x7f5dc400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:15.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.290+0000 7f5dbeffd700 1 -- 172.21.15.124:0/1331820419 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4005cb0 con 0x7f5dd006a820 2023-10-16T13:00:15.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.290+0000 7f5dbeffd700 1 -- 172.21.15.124:0/1331820419 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc4005e10 con 0x7f5dd006a820 2023-10-16T13:00:15.301 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.290+0000 7f5dd4d87700 1 -- 172.21.15.124:0/1331820419 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc00094a0 con 0x7f5dd006a820 2023-10-16T13:00:15.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.290+0000 7f5dbeffd700 1 -- 172.21.15.124:0/1331820419 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc40072d0 con 0x7f5dd006a820 2023-10-16T13:00:15.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.291+0000 7f5dd4d87700 1 -- 172.21.15.124:0/1331820419 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd01f75f0 con 0x7f5dd006a820 2023-10-16T13:00:15.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.291+0000 7f5dd4d87700 1 -- 172.21.15.124:0/1331820419 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd00af3d0 con 0x7f5dd006a820 2023-10-16T13:00:15.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.292+0000 7f5dbeffd700 1 -- 172.21.15.124:0/1331820419 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5dc4007430 con 0x7f5dd006a820 2023-10-16T13:00:15.302 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.292+0000 7f5dbeffd700 1 --2- 172.21.15.124:0/1331820419 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5db006af00 0x7f5db006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:15.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.292+0000 7f5dbeffd700 1 -- 172.21.15.124:0/1331820419 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5dc40889b0 con 0x7f5dd006a820 2023-10-16T13:00:15.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.292+0000 7f5dcdd9b700 1 --2- 172.21.15.124:0/1331820419 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5db006af00 0x7f5db006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:15.303 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.293+0000 7f5dcdd9b700 1 --2- 172.21.15.124:0/1331820419 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5db006af00 0x7f5db006d3c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0009fd0 tx=0x7f5dc001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:15.304 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.296+0000 7f5dbeffd700 1 -- 172.21.15.124:0/1331820419 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5dc40539d0 con 0x7f5dd006a820 2023-10-16T13:00:15.528 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.527+0000 7f5dd4d87700 1 -- 172.21.15.124:0/1331820419 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5dd004ebb0 con 0x7f5dd006a820 2023-10-16T13:00:15.529 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.527+0000 7f5dbeffd700 1 -- 172.21.15.124:0/1331820419 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f5dc4017020 con 0x7f5dd006a820 2023-10-16T13:00:15.529 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:00:15.530 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5110,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6834/726195736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":726195736},{"type":"v1","addr":"172.21.15.192:6834","nonce":726195736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5334,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6836/2901678317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":2901678317},{"type":"v1","addr":"172.21.15.124:6836","nonce":2901678317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6837/1705548477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6835","nonce":1705548477},{"type":"v1","addr":"172.21.15.124:6837","nonce":1705548477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T13:00:05.023759+0000","modified":"2023-10-16T13:00:08.044473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5352":{"gid":5352,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.192:6835/1442186653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6833","nonce":1442186653},{"type":"v1","addr":"172.21.15.192:6835","nonce":1442186653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-16T13:00:15.531 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.530+0000 7f5dd4d87700 1 -- 172.21.15.124:0/1331820419 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5db006af00 msgr2=0x7f5db006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:15.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.530+0000 7f5dd4d87700 1 --2- 172.21.15.124:0/1331820419 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5db006af00 0x7f5db006d3c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0009fd0 tx=0x7f5dc001c040 comp rx=0 tx=0).stop 2023-10-16T13:00:15.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.530+0000 7f5dd4d87700 1 -- 172.21.15.124:0/1331820419 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5dd006a820 msgr2=0x7f5dd01f6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:15.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.530+0000 7f5dd4d87700 1 --2- 172.21.15.124:0/1331820419 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5dd006a820 0x7f5dd01f6820 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400c520 tx=0x7f5dc400c830 comp rx=0 tx=0).stop 2023-10-16T13:00:15.532 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.530+0000 7f5dd4d87700 1 -- 172.21.15.124:0/1331820419 shutdown_connections 2023-10-16T13:00:15.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.530+0000 7f5dd4d87700 1 --2- 172.21.15.124:0/1331820419 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f5db006af00 0x7f5db006d3c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:15.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.530+0000 7f5dd4d87700 1 --2- 172.21.15.124:0/1331820419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd00cf7d0 0x7f5dd01f3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:15.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.530+0000 7f5dd4d87700 1 --2- 172.21.15.124:0/1331820419 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5dd006a820 0x7f5dd01f6820 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:15.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.530+0000 7f5dd4d87700 1 --2- 172.21.15.124:0/1331820419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd00ca7d0 0x7f5dd006e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:15.533 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.530+0000 7f5dd4d87700 1 -- 172.21.15.124:0/1331820419 >> 172.21.15.124:0/1331820419 conn(0x7f5dd00d0180 msgr2=0x7f5dd00b07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:15.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.530+0000 7f5dd4d87700 1 -- 172.21.15.124:0/1331820419 shutdown_connections 2023-10-16T13:00:15.534 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:15.530+0000 7f5dd4d87700 1 -- 172.21.15.124:0/1331820419 wait complete. 2023-10-16T13:00:15.534 INFO:teuthology.orchestra.run.smithi124.stderr:dumped fsmap epoch 17 2023-10-16T13:00:15.946 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T13:00:05.023759+0000', 'modified': '2023-10-16T13:00:08.044473+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5352}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5352': {'gid': 5352, 'name': 'd', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.192:6835/1442186653', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6833', 'nonce': 1442186653}, {'type': 'v1', 'addr': '172.21.15.192:6835', 'nonce': 1442186653}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T13:00:15.946 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T13:00:15.947 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-16T13:00:16.069 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.068+0000 7f895fa8b700 1 Processor -- start 2023-10-16T13:00:16.070 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.068+0000 7f895fa8b700 1 -- start start 2023-10-16T13:00:16.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.069+0000 7f895fa8b700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f895806dfc0 0x7f89580717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:16.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.069+0000 7f895fa8b700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f895806f270 con 0x7f8958071d20 2023-10-16T13:00:16.072 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.069+0000 7f895fa8b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f895815aa30 con 0x7f895815a650 2023-10-16T13:00:16.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.069+0000 7f895fa8b700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f895806e470 con 0x7f895806dfc0 2023-10-16T13:00:16.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.069+0000 7f895d026700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f895806dfc0 0x7f89580717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:16.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.069+0000 7f895e028700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f8958071d20 0x7f89580ca7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:44422/0 (socket says 172.21.15.124:44422) 2023-10-16T13:00:16.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.069+0000 7f895e028700 1 -- 172.21.15.124:0/929215249 learned_addr learned my addr 172.21.15.124:0/929215249 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T13:00:16.073 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.069+0000 7f895d026700 1 -- 172.21.15.124:0/929215249 >> v1:172.21.15.192:6789/0 conn(0x7f895815a650 legacy=0x7f895815b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:16.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.069+0000 7f895d026700 1 -- 172.21.15.124:0/929215249 >> v1:172.21.15.124:6789/0 conn(0x7f8958071d20 legacy=0x7f89580ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:16.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.069+0000 7f895d026700 1 -- 172.21.15.124:0/929215249 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895806e660 con 0x7f895806dfc0 2023-10-16T13:00:16.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.069+0000 7f895c825700 1 -- 172.21.15.124:0/929215249 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875178620 0 0) 0x7f895806f270 con 0x7f8958071d20 2023-10-16T13:00:16.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.070+0000 7f895d026700 1 --2- 172.21.15.124:0/929215249 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f895806dfc0 0x7f89580717e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8954009840 tx=0x7f8954009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21772df9a8fa9c3f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:16.074 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.070+0000 7f895c825700 1 -- 172.21.15.124:0/929215249 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954004230 con 0x7f895806dfc0 2023-10-16T13:00:16.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.070+0000 7f895c825700 1 -- 172.21.15.124:0/929215249 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8954004390 con 0x7f895806dfc0 2023-10-16T13:00:16.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.070+0000 7f895c825700 1 -- 172.21.15.124:0/929215249 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89540036a0 con 0x7f895806dfc0 2023-10-16T13:00:16.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.070+0000 7f895fa8b700 1 -- 172.21.15.124:0/929215249 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f895806dfc0 msgr2=0x7f89580717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:16.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.070+0000 7f895fa8b700 1 --2- 172.21.15.124:0/929215249 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f895806dfc0 0x7f89580717e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8954009840 tx=0x7f8954009b50 comp rx=0 tx=0).stop 2023-10-16T13:00:16.075 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.070+0000 7f895fa8b700 1 -- 172.21.15.124:0/929215249 shutdown_connections 2023-10-16T13:00:16.076 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.070+0000 7f895fa8b700 1 --2- 172.21.15.124:0/929215249 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f895806dfc0 0x7f89580717e0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.076 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.070+0000 7f895fa8b700 1 -- 172.21.15.124:0/929215249 >> 172.21.15.124:0/929215249 conn(0x7f89580d0180 msgr2=0x7f89580d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:16.076 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.070+0000 7f895fa8b700 1 -- 172.21.15.124:0/929215249 shutdown_connections 2023-10-16T13:00:16.076 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.070+0000 7f895fa8b700 1 -- 172.21.15.124:0/929215249 wait complete. 2023-10-16T13:00:16.085 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.071+0000 7f895fa8b700 1 Processor -- start 2023-10-16T13:00:16.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.071+0000 7f895fa8b700 1 -- start start 2023-10-16T13:00:16.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.072+0000 7f895fa8b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f895806dfc0 0x7f89580b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:16.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.072+0000 7f895fa8b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8958071d20 0x7f89580b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:16.086 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.072+0000 7f895fa8b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f895815a650 0x7f895814f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:16.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.072+0000 7f895fa8b700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89581519d0 con 0x7f895815a650 2023-10-16T13:00:16.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.072+0000 7f895fa8b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8958150e50 con 0x7f895806dfc0 2023-10-16T13:00:16.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.072+0000 7f895fa8b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8958151130 con 0x7f8958071d20 2023-10-16T13:00:16.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.072+0000 7f895e028700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f895815a650 0x7f895814f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:16.087 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.072+0000 7f895e028700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f895815a650 0x7f895814f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55760/0 (socket says 172.21.15.124:55760) 2023-10-16T13:00:16.088 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.072+0000 7f895e028700 1 -- 172.21.15.124:0/3932378466 learned_addr learned my addr 172.21.15.124:0/3932378466 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:16.088 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.072+0000 7f895d827700 1 --2- 172.21.15.124:0/3932378466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f895806dfc0 0x7f89580b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:16.088 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.072+0000 7f895d026700 1 --2- 172.21.15.124:0/3932378466 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8958071d20 0x7f89580b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:16.088 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.073+0000 7f895e028700 1 -- 172.21.15.124:0/3932378466 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8958071d20 msgr2=0x7f89580b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:16.088 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.073+0000 7f895e028700 1 --2- 172.21.15.124:0/3932378466 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8958071d20 0x7f89580b1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.073+0000 7f895e028700 1 -- 172.21.15.124:0/3932378466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f895806dfc0 msgr2=0x7f89580b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:16.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.073+0000 7f895e028700 1 --2- 172.21.15.124:0/3932378466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f895806dfc0 0x7f89580b37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.073+0000 7f895e028700 1 -- 172.21.15.124:0/3932378466 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89540094a0 con 0x7f895815a650 2023-10-16T13:00:16.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.073+0000 7f895e028700 1 --2- 172.21.15.124:0/3932378466 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f895815a650 0x7f895814f170 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f895000cca0 tx=0x7f895000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:16.089 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.073+0000 7f894e7fc700 1 -- 172.21.15.124:0/3932378466 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895000cea0 con 0x7f895815a650 2023-10-16T13:00:16.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.073+0000 7f894e7fc700 1 -- 172.21.15.124:0/3932378466 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895000ade0 con 0x7f895815a650 2023-10-16T13:00:16.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.073+0000 7f895fa8b700 1 -- 172.21.15.124:0/3932378466 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8958151410 con 0x7f895815a650 2023-10-16T13:00:16.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.073+0000 7f894e7fc700 1 -- 172.21.15.124:0/3932378466 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950007310 con 0x7f895815a650 2023-10-16T13:00:16.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.073+0000 7f895fa8b700 1 -- 172.21.15.124:0/3932378466 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89580b3cf0 con 0x7f895815a650 2023-10-16T13:00:16.090 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.074+0000 7f894e7fc700 1 -- 172.21.15.124:0/3932378466 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8950007470 con 0x7f895815a650 2023-10-16T13:00:16.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.075+0000 7f894e7fc700 1 --2- 172.21.15.124:0/3932378466 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f893c06af00 0x7f893c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:16.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.075+0000 7f894e7fc700 1 -- 172.21.15.124:0/3932378466 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f89500895c0 con 0x7f895815a650 2023-10-16T13:00:16.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.075+0000 7f895d827700 1 --2- 172.21.15.124:0/3932378466 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f893c06af00 0x7f893c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:16.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.075+0000 7f895d827700 1 --2- 172.21.15.124:0/3932378466 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f893c06af00 0x7f893c06d3c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8948009870 tx=0x7f8948008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:16.091 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.077+0000 7f896bc75b80 1 Processor -- start 2023-10-16T13:00:16.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.077+0000 7f896bc75b80 1 -- start start 2023-10-16T13:00:16.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.078+0000 7f896bc75b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56305b529b40 0x56305b529f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:16.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.078+0000 7f896bc75b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b550f30 0x56305b529280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:16.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.078+0000 7f896bc75b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56305b524f00 0x56305b550300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:16.092 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.078+0000 7f896bc75b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x56305b49dc20 con 0x56305b550f30 2023-10-16T13:00:16.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.078+0000 7f896bc75b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56305b482c10 con 0x56305b529b40 2023-10-16T13:00:16.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.078+0000 7f896bc75b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x56305b480530 con 0x56305b524f00 2023-10-16T13:00:16.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.078+0000 7f895d026700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b550f30 0x56305b529280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:16.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.078+0000 7f895d026700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b550f30 0x56305b529280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55766/0 (socket says 172.21.15.124:55766) 2023-10-16T13:00:16.093 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.078+0000 7f895d026700 1 -- 172.21.15.124:0/2884436077 learned_addr learned my addr 172.21.15.124:0/2884436077 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:16.094 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.078+0000 7f895d827700 1 --2- 172.21.15.124:0/2884436077 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56305b529b40 0x56305b529f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:16.094 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.078+0000 7f895e028700 1 --2- 172.21.15.124:0/2884436077 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56305b524f00 0x56305b550300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:16.094 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.078+0000 7f895d026700 1 -- 172.21.15.124:0/2884436077 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56305b524f00 msgr2=0x56305b550300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:16.094 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.078+0000 7f895d026700 1 --2- 172.21.15.124:0/2884436077 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56305b524f00 0x56305b550300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.094 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.078+0000 7f895d026700 1 -- 172.21.15.124:0/2884436077 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56305b529b40 msgr2=0x56305b529f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:16.095 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.078+0000 7f895d026700 1 --2- 172.21.15.124:0/2884436077 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56305b529b40 0x56305b529f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.095 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.078+0000 7f895d026700 1 -- 172.21.15.124:0/2884436077 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56305b4393a0 con 0x56305b550f30 2023-10-16T13:00:16.095 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.078+0000 7f895e028700 1 --2- 172.21.15.124:0/2884436077 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56305b524f00 0x56305b550300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:00:16.095 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.078+0000 7f895d026700 1 --2- 172.21.15.124:0/2884436077 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b550f30 0x56305b529280 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8954004000 tx=0x7f8954008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637619892f362ade server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:16.095 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.078+0000 7f893b7fe700 1 -- 172.21.15.124:0/2884436077 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89540040f0 con 0x56305b550f30 2023-10-16T13:00:16.095 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.078+0000 7f893b7fe700 1 -- 172.21.15.124:0/2884436077 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8954003850 con 0x56305b550f30 2023-10-16T13:00:16.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.078+0000 7f893b7fe700 1 -- 172.21.15.124:0/2884436077 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954003c00 con 0x56305b550f30 2023-10-16T13:00:16.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.079+0000 7f896bc75b80 1 -- 172.21.15.124:0/2884436077 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b550f30 msgr2=0x56305b529280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:16.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.079+0000 7f896bc75b80 1 --2- 172.21.15.124:0/2884436077 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b550f30 0x56305b529280 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8954004000 tx=0x7f8954008030 comp rx=0 tx=0).stop 2023-10-16T13:00:16.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.079+0000 7f896bc75b80 1 -- 172.21.15.124:0/2884436077 shutdown_connections 2023-10-16T13:00:16.096 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.079+0000 7f896bc75b80 1 --2- 172.21.15.124:0/2884436077 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56305b524f00 0x56305b550300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.079+0000 7f896bc75b80 1 --2- 172.21.15.124:0/2884436077 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56305b529b40 0x56305b529f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.079+0000 7f896bc75b80 1 --2- 172.21.15.124:0/2884436077 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b550f30 0x56305b529280 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.079+0000 7f896bc75b80 1 -- 172.21.15.124:0/2884436077 >> 172.21.15.124:0/2884436077 conn(0x56305b456d80 msgr2=0x56305b571ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:16.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.079+0000 7f896bc75b80 1 -- 172.21.15.124:0/2884436077 shutdown_connections 2023-10-16T13:00:16.097 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.079+0000 7f896bc75b80 1 -- 172.21.15.124:0/2884436077 wait complete. 2023-10-16T13:00:16.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.080+0000 7f896bc75b80 1 -- start start 2023-10-16T13:00:16.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.080+0000 7f896bc75b80 1 Processor -- start 2023-10-16T13:00:16.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.081+0000 7f896bc75b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56305b524f00 0x56305b53ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:16.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.081+0000 7f896bc75b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b529b40 0x56305b552640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:16.098 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.081+0000 7f896bc75b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56305b550f30 0x56305b54df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:16.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.081+0000 7f896bc75b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x56305b47be20 con 0x56305b529b40 2023-10-16T13:00:16.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.081+0000 7f896bc75b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56305b4186c0 con 0x56305b524f00 2023-10-16T13:00:16.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.081+0000 7f896bc75b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x56305b418360 con 0x56305b550f30 2023-10-16T13:00:16.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.081+0000 7f896bc75b80 10 client.0 _ll_register_callbacks cb 0x56305b2757b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:00:16.099 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.081+0000 7f895d026700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b529b40 0x56305b552640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:16.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.081+0000 7f895d026700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b529b40 0x56305b552640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55772/0 (socket says 172.21.15.124:55772) 2023-10-16T13:00:16.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.081+0000 7f895d026700 1 -- 172.21.15.124:0/523505958 learned_addr learned my addr 172.21.15.124:0/523505958 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:16.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.081+0000 7f895d026700 1 -- 172.21.15.124:0/523505958 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56305b550f30 msgr2=0x56305b54df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:16.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.081+0000 7f895d026700 1 --2- 172.21.15.124:0/523505958 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56305b550f30 0x56305b54df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.100 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.081+0000 7f895d026700 1 -- 172.21.15.124:0/523505958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56305b524f00 msgr2=0x56305b53ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:16.101 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.081+0000 7f895d827700 1 --2- 172.21.15.124:0/523505958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56305b524f00 0x56305b53ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:16.101 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.081+0000 7f895d026700 1 --2- 172.21.15.124:0/523505958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56305b524f00 0x56305b53ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.101 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.081+0000 7f895d026700 1 -- 172.21.15.124:0/523505958 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f895806e660 con 0x56305b529b40 2023-10-16T13:00:16.101 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.081+0000 7f895d827700 1 --2- 172.21.15.124:0/523505958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56305b524f00 0x56305b53ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T13:00:16.101 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.081+0000 7f895d026700 1 --2- 172.21.15.124:0/523505958 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b529b40 0x56305b552640 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8954000c00 tx=0x7f89540047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7710e919122cee9a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:16.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.081+0000 7f8938ff9700 10 client.0 ms_handle_connect on v2:172.21.15.124:3300/0 2023-10-16T13:00:16.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.081+0000 7f8938ff9700 1 -- 172.21.15.124:0/523505958 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954011630 con 0x56305b529b40 2023-10-16T13:00:16.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.081+0000 7f8938ff9700 1 -- 172.21.15.124:0/523505958 <== mon.0 v2:172.21.15.124:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8954025be0 con 0x56305b529b40 2023-10-16T13:00:16.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.081+0000 7f896bc75b80 1 -- 172.21.15.124:0/523505958 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56305b51c5b0 con 0x56305b529b40 2023-10-16T13:00:16.102 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.082+0000 7f8938ff9700 1 -- 172.21.15.124:0/523505958 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8954025dc0 con 0x56305b529b40 2023-10-16T13:00:16.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.082+0000 7f896bc75b80 10 client.5547 fetch_fsmap learned FSMap version 17 2023-10-16T13:00:16.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.082+0000 7f896bc75b80 1 -- 172.21.15.124:0/523505958 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56305b2a6d90 con 0x56305b529b40 2023-10-16T13:00:16.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.082+0000 7f8938ff9700 1 -- 172.21.15.124:0/523505958 <== mon.0 v2:172.21.15.124:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56305b51c5b0 con 0x56305b529b40 2023-10-16T13:00:16.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.082+0000 7f8938ff9700 1 -- 172.21.15.124:0/523505958 <== mon.0 v2:172.21.15.124:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8954018070 con 0x56305b529b40 2023-10-16T13:00:16.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.082+0000 7f896bc75b80 10 client.5547 fetch_fsmap finished waiting for FSMap version 17 2023-10-16T13:00:16.103 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.082+0000 7f896bc75b80 10 client.5547 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-16T13:00:16.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.082+0000 7f896bc75b80 20 client.5547 populate_metadata read hostname 'smithi124' 2023-10-16T13:00:16.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.082+0000 7f896bc75b80 1 --2- 172.21.15.124:0/523505958 >> [v2:172.21.15.192:6833/1442186653,v1:172.21.15.192:6835/1442186653] conn(0x56305b56d750 0x56305b56db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:16.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.082+0000 7f896bc75b80 4 client.5547 mds_command: new command op to 5352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T13:00:16.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.082+0000 7f896bc75b80 1 -- 172.21.15.124:0/523505958 --> [v2:172.21.15.192:6833/1442186653,v1:172.21.15.192:6835/1442186653] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56305b474e00 con 0x56305b56d750 2023-10-16T13:00:16.104 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.082+0000 7f895d827700 1 --2- 172.21.15.124:0/523505958 >> [v2:172.21.15.192:6833/1442186653,v1:172.21.15.192:6835/1442186653] conn(0x56305b56d750 0x56305b56db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:16.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.083+0000 7f8938ff9700 10 client.5547 ms_handle_connect on v2:172.21.15.192:6833/1442186653 2023-10-16T13:00:16.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.083+0000 7f895d827700 1 --2- 172.21.15.124:0/523505958 >> [v2:172.21.15.192:6833/1442186653,v1:172.21.15.192:6835/1442186653] conn(0x56305b56d750 0x56305b56db30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ba692825b20d7e4 server_cookie=7eeb04d5736a70a5 in_seq=0 out_seq=0 2023-10-16T13:00:16.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.083+0000 7f8938ff9700 1 -- 172.21.15.124:0/523505958 <== mds.0 v2:172.21.15.192:6833/1442186653 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56305b474e00 con 0x56305b56d750 2023-10-16T13:00:16.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.083+0000 7f8938ff9700 10 client.5547 handle_command_reply: tid=0 2023-10-16T13:00:16.105 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.083+0000 7f896bc75b80 1 client.5547 shutdown 2023-10-16T13:00:16.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.083+0000 7f896bc75b80 1 -- 172.21.15.124:0/523505958 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b529b40 msgr2=0x56305b552640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:16.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.083+0000 7f896bc75b80 1 --2- 172.21.15.124:0/523505958 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b529b40 0x56305b552640 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8954000c00 tx=0x7f89540047c0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.083+0000 7f896bc75b80 1 -- 172.21.15.124:0/523505958 shutdown_connections 2023-10-16T13:00:16.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.083+0000 7f896bc75b80 1 --2- 172.21.15.124:0/523505958 >> [v2:172.21.15.192:6833/1442186653,v1:172.21.15.192:6835/1442186653] conn(0x56305b56d750 0x56305b56db30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.106 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.083+0000 7f896bc75b80 1 --2- 172.21.15.124:0/523505958 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56305b550f30 0x56305b54df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.083+0000 7f8938ff9700 0 client.5547 ms_handle_reset on v2:172.21.15.192:6833/1442186653 2023-10-16T13:00:16.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.083+0000 7f896bc75b80 1 --2- 172.21.15.124:0/523505958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56305b524f00 0x56305b53ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.083+0000 7f896bc75b80 1 --2- 172.21.15.124:0/523505958 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b529b40 0x56305b552640 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.083+0000 7f896bc75b80 1 -- 172.21.15.124:0/523505958 >> 172.21.15.124:0/523505958 conn(0x56305b456d80 msgr2=0x56305b51df40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:16.107 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.084+0000 7f896bc75b80 1 -- 172.21.15.124:0/523505958 shutdown_connections 2023-10-16T13:00:16.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.084+0000 7f896bc75b80 1 -- 172.21.15.124:0/523505958 wait complete. 2023-10-16T13:00:16.108 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.084+0000 7f896bc75b80 20 client.5547 trim_cache size 0 max 16384 2023-10-16T13:00:16.114 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.101+0000 7f896bc75b80 1 Processor -- start 2023-10-16T13:00:16.114 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.101+0000 7f896bc75b80 1 -- start start 2023-10-16T13:00:16.114 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.102+0000 7f896bc75b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56305b524f00 0x56305b54dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:16.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.102+0000 7f896bc75b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56305b529b40 0x56305b53a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:16.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.102+0000 7f896bc75b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b550f30 0x56305b53ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:16.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.102+0000 7f896bc75b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x56305b2fc8d0 con 0x56305b550f30 2023-10-16T13:00:16.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.102+0000 7f896bc75b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56305b555e10 con 0x56305b524f00 2023-10-16T13:00:16.115 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.102+0000 7f896bc75b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x56305b54fba0 con 0x56305b529b40 2023-10-16T13:00:16.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.102+0000 7f895e028700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b550f30 0x56305b53ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:16.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.102+0000 7f895e028700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b550f30 0x56305b53ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55782/0 (socket says 172.21.15.124:55782) 2023-10-16T13:00:16.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.102+0000 7f895e028700 1 -- 172.21.15.124:0/1190562556 learned_addr learned my addr 172.21.15.124:0/1190562556 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:16.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.102+0000 7f895d026700 1 --2- 172.21.15.124:0/1190562556 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56305b529b40 0x56305b53a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:16.116 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.102+0000 7f895d827700 1 --2- 172.21.15.124:0/1190562556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56305b524f00 0x56305b54dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:16.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.102+0000 7f895e028700 1 -- 172.21.15.124:0/1190562556 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56305b529b40 msgr2=0x56305b53a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:16.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.102+0000 7f895e028700 1 --2- 172.21.15.124:0/1190562556 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56305b529b40 0x56305b53a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.102+0000 7f895e028700 1 -- 172.21.15.124:0/1190562556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56305b524f00 msgr2=0x56305b54dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:16.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.102+0000 7f895e028700 1 --2- 172.21.15.124:0/1190562556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56305b524f00 0x56305b54dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.117 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.102+0000 7f895e028700 1 -- 172.21.15.124:0/1190562556 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56305b28fc10 con 0x56305b550f30 2023-10-16T13:00:16.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.102+0000 7f895e028700 1 --2- 172.21.15.124:0/1190562556 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b550f30 0x56305b53ad60 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8950060050 tx=0x7f8950089040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5dc89fc6c5fe6d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:16.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.102+0000 7f893bfff700 1 -- 172.21.15.124:0/1190562556 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950058280 con 0x56305b550f30 2023-10-16T13:00:16.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.102+0000 7f893bfff700 1 -- 172.21.15.124:0/1190562556 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895005c3d0 con 0x56305b550f30 2023-10-16T13:00:16.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.102+0000 7f893bfff700 1 -- 172.21.15.124:0/1190562556 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950060580 con 0x56305b550f30 2023-10-16T13:00:16.118 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.103+0000 7f896bc75b80 1 -- 172.21.15.124:0/1190562556 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b550f30 msgr2=0x56305b53ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:16.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.103+0000 7f896bc75b80 1 --2- 172.21.15.124:0/1190562556 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b550f30 0x56305b53ad60 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8950060050 tx=0x7f8950089040 comp rx=0 tx=0).stop 2023-10-16T13:00:16.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.103+0000 7f896bc75b80 1 -- 172.21.15.124:0/1190562556 shutdown_connections 2023-10-16T13:00:16.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.103+0000 7f896bc75b80 1 --2- 172.21.15.124:0/1190562556 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b550f30 0x56305b53ad60 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.103+0000 7f896bc75b80 1 --2- 172.21.15.124:0/1190562556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56305b524f00 0x56305b54dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.119 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.103+0000 7f896bc75b80 1 --2- 172.21.15.124:0/1190562556 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56305b529b40 0x56305b53a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.120 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.103+0000 7f896bc75b80 1 -- 172.21.15.124:0/1190562556 >> 172.21.15.124:0/1190562556 conn(0x56305b456d80 msgr2=0x56305b54c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:16.120 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.103+0000 7f896bc75b80 1 -- 172.21.15.124:0/1190562556 shutdown_connections 2023-10-16T13:00:16.120 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.103+0000 7f896bc75b80 1 -- 172.21.15.124:0/1190562556 wait complete. 2023-10-16T13:00:16.120 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.103+0000 7f896bc75b80 1 -- start start 2023-10-16T13:00:16.120 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.103+0000 7f896bc75b80 1 Processor -- start 2023-10-16T13:00:16.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.105+0000 7f896bc75b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56305b524f00 0x56305b54ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:16.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.105+0000 7f896bc75b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56305b529b40 0x56305b5d9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:16.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.105+0000 7f896bc75b80 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b550f30 0x56305b54b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:16.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.105+0000 7f896bc75b80 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x56305b56d460 con 0x56305b550f30 2023-10-16T13:00:16.121 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.105+0000 7f896bc75b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56305b5647f0 con 0x56305b529b40 2023-10-16T13:00:16.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.105+0000 7f896bc75b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x56305b53bfe0 con 0x56305b524f00 2023-10-16T13:00:16.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.105+0000 7f896bc75b80 10 client.0 _ll_register_callbacks cb 0x7f89540096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T13:00:16.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.105+0000 7f895e028700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b550f30 0x56305b54b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:16.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.105+0000 7f895e028700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b550f30 0x56305b54b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55788/0 (socket says 172.21.15.124:55788) 2023-10-16T13:00:16.122 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.105+0000 7f895e028700 1 -- 172.21.15.124:0/351476656 learned_addr learned my addr 172.21.15.124:0/351476656 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:16.123 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.105+0000 7f895d026700 1 --2- 172.21.15.124:0/351476656 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56305b529b40 0x56305b5d9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:16.123 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.105+0000 7f895d827700 1 --2- 172.21.15.124:0/351476656 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56305b524f00 0x56305b54ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:16.123 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.105+0000 7f895e028700 1 -- 172.21.15.124:0/351476656 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56305b524f00 msgr2=0x56305b54ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:16.123 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.105+0000 7f895e028700 1 --2- 172.21.15.124:0/351476656 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56305b524f00 0x56305b54ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.105+0000 7f895e028700 1 -- 172.21.15.124:0/351476656 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56305b529b40 msgr2=0x56305b5d9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:16.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.105+0000 7f895e028700 1 --2- 172.21.15.124:0/351476656 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56305b529b40 0x56305b5d9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.105+0000 7f895e028700 1 -- 172.21.15.124:0/351476656 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89580b3cf0 con 0x56305b550f30 2023-10-16T13:00:16.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.105+0000 7f895e028700 1 --2- 172.21.15.124:0/351476656 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b550f30 0x56305b54b3e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8950087a90 tx=0x7f895005b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785d1c73707b1798 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:16.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.105+0000 7f8938ff9700 10 client.0 ms_handle_connect on v2:172.21.15.124:3300/0 2023-10-16T13:00:16.124 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.105+0000 7f8938ff9700 1 -- 172.21.15.124:0/351476656 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89500600f0 con 0x56305b550f30 2023-10-16T13:00:16.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.105+0000 7f8938ff9700 1 -- 172.21.15.124:0/351476656 <== mon.0 v2:172.21.15.124:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8950060250 con 0x56305b550f30 2023-10-16T13:00:16.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.105+0000 7f896bc75b80 1 -- 172.21.15.124:0/351476656 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8954003850 con 0x56305b550f30 2023-10-16T13:00:16.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.106+0000 7f8938ff9700 1 -- 172.21.15.124:0/351476656 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89500890f0 con 0x56305b550f30 2023-10-16T13:00:16.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.106+0000 7f896bc75b80 10 client.5553 fetch_fsmap learned FSMap version 17 2023-10-16T13:00:16.125 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.106+0000 7f896bc75b80 1 -- 172.21.15.124:0/351476656 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56305b2cd200 con 0x56305b550f30 2023-10-16T13:00:16.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.106+0000 7f8938ff9700 1 -- 172.21.15.124:0/351476656 <== mon.0 v2:172.21.15.124:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8950075020 con 0x56305b550f30 2023-10-16T13:00:16.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.106+0000 7f8938ff9700 1 -- 172.21.15.124:0/351476656 <== mon.0 v2:172.21.15.124:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8950089250 con 0x56305b550f30 2023-10-16T13:00:16.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.106+0000 7f896bc75b80 10 client.5553 fetch_fsmap finished waiting for FSMap version 17 2023-10-16T13:00:16.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.106+0000 7f896bc75b80 10 client.5553 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-16T13:00:16.126 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.106+0000 7f896bc75b80 20 client.5553 populate_metadata read hostname 'smithi124' 2023-10-16T13:00:16.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.106+0000 7f896bc75b80 1 --2- 172.21.15.124:0/351476656 >> [v2:172.21.15.192:6833/1442186653,v1:172.21.15.192:6835/1442186653] conn(0x56305b56c510 0x56305b56c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:16.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.106+0000 7f896bc75b80 4 client.5553 mds_command: new command op to 5352 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T13:00:16.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.106+0000 7f896bc75b80 1 -- 172.21.15.124:0/351476656 --> [v2:172.21.15.192:6833/1442186653,v1:172.21.15.192:6835/1442186653] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56305b474b20 con 0x56305b56c510 2023-10-16T13:00:16.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.106+0000 7f895d827700 1 --2- 172.21.15.124:0/351476656 >> [v2:172.21.15.192:6833/1442186653,v1:172.21.15.192:6835/1442186653] conn(0x56305b56c510 0x56305b56c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:16.127 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.106+0000 7f8938ff9700 10 client.5553 ms_handle_connect on v2:172.21.15.192:6833/1442186653 2023-10-16T13:00:16.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.106+0000 7f895d827700 1 --2- 172.21.15.124:0/351476656 >> [v2:172.21.15.192:6833/1442186653,v1:172.21.15.192:6835/1442186653] conn(0x56305b56c510 0x56305b56c8f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d90df61e62fe2f73 server_cookie=52c69e1c10536399 in_seq=0 out_seq=0 2023-10-16T13:00:16.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.107+0000 7f8938ff9700 1 -- 172.21.15.124:0/351476656 <== mds.0 v2:172.21.15.192:6833/1442186653 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x56305b474b20 con 0x56305b56c510 2023-10-16T13:00:16.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.107+0000 7f8938ff9700 10 client.5553 handle_command_reply: tid=0 2023-10-16T13:00:16.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.107+0000 7f896bc75b80 1 client.5553 shutdown 2023-10-16T13:00:16.128 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.107+0000 7f896bc75b80 1 -- 172.21.15.124:0/351476656 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b550f30 msgr2=0x56305b54b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:16.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.107+0000 7f896bc75b80 1 --2- 172.21.15.124:0/351476656 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b550f30 0x56305b54b3e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8950087a90 tx=0x7f895005b000 comp rx=0 tx=0).stop 2023-10-16T13:00:16.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.107+0000 7f896bc75b80 1 -- 172.21.15.124:0/351476656 shutdown_connections 2023-10-16T13:00:16.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.107+0000 7f896bc75b80 1 --2- 172.21.15.124:0/351476656 >> [v2:172.21.15.192:6833/1442186653,v1:172.21.15.192:6835/1442186653] conn(0x56305b56c510 0x56305b56c8f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.107+0000 7f896bc75b80 1 --2- 172.21.15.124:0/351476656 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x56305b550f30 0x56305b54b3e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.129 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.107+0000 7f8938ff9700 0 client.5553 ms_handle_reset on v2:172.21.15.192:6833/1442186653 2023-10-16T13:00:16.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.107+0000 7f896bc75b80 1 --2- 172.21.15.124:0/351476656 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56305b524f00 0x56305b54ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.107+0000 7f896bc75b80 1 --2- 172.21.15.124:0/351476656 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56305b529b40 0x56305b5d9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.107+0000 7f896bc75b80 1 -- 172.21.15.124:0/351476656 >> 172.21.15.124:0/351476656 conn(0x56305b456d80 msgr2=0x56305b54dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:16.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.107+0000 7f896bc75b80 1 -- 172.21.15.124:0/351476656 shutdown_connections 2023-10-16T13:00:16.130 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.107+0000 7f896bc75b80 1 -- 172.21.15.124:0/351476656 wait complete. 2023-10-16T13:00:16.131 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.107+0000 7f896bc75b80 20 client.5553 trim_cache size 0 max 16384 2023-10-16T13:00:16.131 INFO:teuthology.orchestra.run.smithi124.stdout:{ 2023-10-16T13:00:16.131 INFO:teuthology.orchestra.run.smithi124.stdout: "cluster_fsid": "4cfd077b-2400-4ae1-a7e8-14265fee7113", 2023-10-16T13:00:16.131 INFO:teuthology.orchestra.run.smithi124.stdout: "whoami": 0, 2023-10-16T13:00:16.132 INFO:teuthology.orchestra.run.smithi124.stdout: "id": 5352, 2023-10-16T13:00:16.132 INFO:teuthology.orchestra.run.smithi124.stdout: "want_state": "up:active", 2023-10-16T13:00:16.132 INFO:teuthology.orchestra.run.smithi124.stdout: "state": "up:active", 2023-10-16T13:00:16.132 INFO:teuthology.orchestra.run.smithi124.stdout: "fs_name": "cephfs", 2023-10-16T13:00:16.132 INFO:teuthology.orchestra.run.smithi124.stdout: "rank_uptime": 10.455902652000001, 2023-10-16T13:00:16.133 INFO:teuthology.orchestra.run.smithi124.stdout: "mdsmap_epoch": 17, 2023-10-16T13:00:16.133 INFO:teuthology.orchestra.run.smithi124.stdout: "osdmap_epoch": 38, 2023-10-16T13:00:16.133 INFO:teuthology.orchestra.run.smithi124.stdout: "osdmap_epoch_barrier": 38, 2023-10-16T13:00:16.133 INFO:teuthology.orchestra.run.smithi124.stdout: "uptime": 18.483314899 2023-10-16T13:00:16.133 INFO:teuthology.orchestra.run.smithi124.stdout:} 2023-10-16T13:00:16.135 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.107+0000 7f895fa8b700 1 -- 172.21.15.124:0/3932378466 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f893c06af00 msgr2=0x7f893c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:16.135 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.107+0000 7f895fa8b700 1 --2- 172.21.15.124:0/3932378466 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f893c06af00 0x7f893c06d3c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8948009870 tx=0x7f8948008040 comp rx=0 tx=0).stop 2023-10-16T13:00:16.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.107+0000 7f895fa8b700 1 -- 172.21.15.124:0/3932378466 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f895815a650 msgr2=0x7f895814f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:16.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.107+0000 7f895fa8b700 1 --2- 172.21.15.124:0/3932378466 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f895815a650 0x7f895814f170 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f895000cca0 tx=0x7f895000a340 comp rx=0 tx=0).stop 2023-10-16T13:00:16.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.108+0000 7f895fa8b700 1 -- 172.21.15.124:0/3932378466 shutdown_connections 2023-10-16T13:00:16.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.108+0000 7f895fa8b700 1 --2- 172.21.15.124:0/3932378466 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f893c06af00 0x7f893c06d3c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.108+0000 7f895fa8b700 1 --2- 172.21.15.124:0/3932378466 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f895815a650 0x7f895814f170 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.136 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.108+0000 7f895fa8b700 1 --2- 172.21.15.124:0/3932378466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f895806dfc0 0x7f89580b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.108+0000 7f895fa8b700 1 --2- 172.21.15.124:0/3932378466 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8958071d20 0x7f89580b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.108+0000 7f895fa8b700 1 -- 172.21.15.124:0/3932378466 >> 172.21.15.124:0/3932378466 conn(0x7f89580d0180 msgr2=0x7f895806a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:16.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.108+0000 7f895fa8b700 1 -- 172.21.15.124:0/3932378466 shutdown_connections 2023-10-16T13:00:16.137 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.108+0000 7f895fa8b700 1 -- 172.21.15.124:0/3932378466 wait complete. 2023-10-16T13:00:16.138 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T13:00:16.258 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.257+0000 7ff012520700 1 Processor -- start 2023-10-16T13:00:16.259 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.257+0000 7ff012520700 1 -- start start 2023-10-16T13:00:16.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.257+0000 7ff012520700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff00c0b3410 0x7ff00c0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:16.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.258+0000 7ff012520700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff00c070d70 con 0x7ff00c0cb8d0 2023-10-16T13:00:16.261 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.258+0000 7ff012520700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff00c15c990 con 0x7ff00c152470 2023-10-16T13:00:16.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.258+0000 7ff012520700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff00c071200 con 0x7ff00c0b3410 2023-10-16T13:00:16.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.258+0000 7ff00b7fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff00c0b3410 0x7ff00c0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:16.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.258+0000 7ff00b7fe700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff00c0b3410 0x7ff00c0cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55794/0 (socket says 172.21.15.124:55794) 2023-10-16T13:00:16.262 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.258+0000 7ff010abd700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7ff00c0cb8d0 0x7ff00c0b60f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:44464/0 (socket says 172.21.15.124:44464) 2023-10-16T13:00:16.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.258+0000 7ff00b7fe700 1 -- 172.21.15.124:0/2193947028 learned_addr learned my addr 172.21.15.124:0/2193947028 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:16.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.258+0000 7ff00b7fe700 1 -- 172.21.15.124:0/2193947028 >> v1:172.21.15.192:6789/0 conn(0x7ff00c152470 legacy=0x7ff00c0b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:16.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.258+0000 7ff00b7fe700 1 -- 172.21.15.124:0/2193947028 >> v1:172.21.15.124:6789/0 conn(0x7ff00c0cb8d0 legacy=0x7ff00c0b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:16.263 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.258+0000 7ff00b7fe700 1 -- 172.21.15.124:0/2193947028 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00c070440 con 0x7ff00c0b3410 2023-10-16T13:00:16.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.258+0000 7ff00affd700 1 -- 172.21.15.124:0/2193947028 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2994341148 0 0) 0x7ff00c070d70 con 0x7ff00c0cb8d0 2023-10-16T13:00:16.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.258+0000 7ff00b7fe700 1 --2- 172.21.15.124:0/2193947028 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff00c0b3410 0x7ff00c0cd570 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff0000098f0 tx=0x7ff000009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f536083d07d9664b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:16.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.258+0000 7ff00affd700 1 -- 172.21.15.124:0/2193947028 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000004230 con 0x7ff00c0b3410 2023-10-16T13:00:16.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.258+0000 7ff00affd700 1 -- 172.21.15.124:0/2193947028 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff000004390 con 0x7ff00c0b3410 2023-10-16T13:00:16.264 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.258+0000 7ff00affd700 1 -- 172.21.15.124:0/2193947028 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0000036a0 con 0x7ff00c0b3410 2023-10-16T13:00:16.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.259+0000 7ff012520700 1 -- 172.21.15.124:0/2193947028 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff00c0b3410 msgr2=0x7ff00c0cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:16.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.259+0000 7ff012520700 1 --2- 172.21.15.124:0/2193947028 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff00c0b3410 0x7ff00c0cd570 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff0000098f0 tx=0x7ff000009c00 comp rx=0 tx=0).stop 2023-10-16T13:00:16.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.259+0000 7ff012520700 1 -- 172.21.15.124:0/2193947028 shutdown_connections 2023-10-16T13:00:16.265 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.259+0000 7ff012520700 1 --2- 172.21.15.124:0/2193947028 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff00c0b3410 0x7ff00c0cd570 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.259+0000 7ff012520700 1 -- 172.21.15.124:0/2193947028 >> 172.21.15.124:0/2193947028 conn(0x7ff00c0cdd00 msgr2=0x7ff00c0ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:16.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.259+0000 7ff012520700 1 -- 172.21.15.124:0/2193947028 shutdown_connections 2023-10-16T13:00:16.266 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.259+0000 7ff012520700 1 -- 172.21.15.124:0/2193947028 wait complete. 2023-10-16T13:00:16.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.260+0000 7ff012520700 1 Processor -- start 2023-10-16T13:00:16.269 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.260+0000 7ff012520700 1 -- start start 2023-10-16T13:00:16.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.261+0000 7ff012520700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff00c0b3410 0x7ff00c0c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:16.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.261+0000 7ff012520700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff00c0cb8d0 0x7ff00c158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:16.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.261+0000 7ff012520700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff00c152470 0x7ff00c0b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:16.270 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.261+0000 7ff012520700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c0c7510 con 0x7ff00c0b3410 2023-10-16T13:00:16.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.261+0000 7ff012520700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c0b65f0 con 0x7ff00c152470 2023-10-16T13:00:16.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.261+0000 7ff012520700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c158fc0 con 0x7ff00c0cb8d0 2023-10-16T13:00:16.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.261+0000 7ff00bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff00c0b3410 0x7ff00c0c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:16.271 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.261+0000 7ff00bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff00c0b3410 0x7ff00c0c6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55798/0 (socket says 172.21.15.124:55798) 2023-10-16T13:00:16.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.261+0000 7ff00bfff700 1 -- 172.21.15.124:0/2989943795 learned_addr learned my addr 172.21.15.124:0/2989943795 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:16.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.261+0000 7ff010abd700 1 --2- 172.21.15.124:0/2989943795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff00c152470 0x7ff00c0b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:16.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.261+0000 7ff00bfff700 1 -- 172.21.15.124:0/2989943795 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff00c0cb8d0 msgr2=0x7ff00c158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:16.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.261+0000 7ff00bfff700 1 --2- 172.21.15.124:0/2989943795 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff00c0cb8d0 0x7ff00c158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.272 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.261+0000 7ff00bfff700 1 -- 172.21.15.124:0/2989943795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff00c152470 msgr2=0x7ff00c0b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:16.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.261+0000 7ff00bfff700 1 --2- 172.21.15.124:0/2989943795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff00c152470 0x7ff00c0b4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.261+0000 7ff00bfff700 1 -- 172.21.15.124:0/2989943795 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff000009550 con 0x7ff00c0b3410 2023-10-16T13:00:16.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.262+0000 7ff00bfff700 1 --2- 172.21.15.124:0/2989943795 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff00c0b3410 0x7ff00c0c6fd0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7feffc00c4d0 tx=0x7feffc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:16.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.262+0000 7ff008ff9700 1 -- 172.21.15.124:0/2989943795 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc011790 con 0x7ff00c0b3410 2023-10-16T13:00:16.273 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.262+0000 7ff008ff9700 1 -- 172.21.15.124:0/2989943795 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feffc0118f0 con 0x7ff00c0b3410 2023-10-16T13:00:16.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.262+0000 7ff012520700 1 -- 172.21.15.124:0/2989943795 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff00c155970 con 0x7ff00c0b3410 2023-10-16T13:00:16.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.262+0000 7ff008ff9700 1 -- 172.21.15.124:0/2989943795 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc011ca0 con 0x7ff00c0b3410 2023-10-16T13:00:16.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.262+0000 7ff012520700 1 -- 172.21.15.124:0/2989943795 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff00c0b5fa0 con 0x7ff00c0b3410 2023-10-16T13:00:16.274 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.263+0000 7ff012520700 1 -- 172.21.15.124:0/2989943795 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff00c0b68d0 con 0x7ff00c0b3410 2023-10-16T13:00:16.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.263+0000 7ff008ff9700 1 -- 172.21.15.124:0/2989943795 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7feffc01c460 con 0x7ff00c0b3410 2023-10-16T13:00:16.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.264+0000 7ff008ff9700 1 --2- 172.21.15.124:0/2989943795 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7feff806af00 0x7feff806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:16.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.264+0000 7ff008ff9700 1 -- 172.21.15.124:0/2989943795 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7feffc089600 con 0x7ff00c0b3410 2023-10-16T13:00:16.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.264+0000 7ff00b7fe700 1 --2- 172.21.15.124:0/2989943795 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7feff806af00 0x7feff806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:16.275 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.264+0000 7ff00b7fe700 1 --2- 172.21.15.124:0/2989943795 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7feff806af00 0x7feff806d3c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff00c1584b0 tx=0x7ff000010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:16.276 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.268+0000 7ff008ff9700 1 -- 172.21.15.124:0/2989943795 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feffc054580 con 0x7ff00c0b3410 2023-10-16T13:00:16.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.504+0000 7ff012520700 1 -- 172.21.15.124:0/2989943795 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff00c0cbd40 con 0x7ff00c0b3410 2023-10-16T13:00:16.506 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.504+0000 7ff008ff9700 1 -- 172.21.15.124:0/2989943795 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7feffc057ba0 con 0x7ff00c0b3410 2023-10-16T13:00:16.507 INFO:teuthology.orchestra.run.smithi124.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T13:00:16.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.506+0000 7ff012520700 1 -- 172.21.15.124:0/2989943795 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7feff806af00 msgr2=0x7feff806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:16.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.506+0000 7ff012520700 1 --2- 172.21.15.124:0/2989943795 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7feff806af00 0x7feff806d3c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff00c1584b0 tx=0x7ff000010000 comp rx=0 tx=0).stop 2023-10-16T13:00:16.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.506+0000 7ff012520700 1 -- 172.21.15.124:0/2989943795 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff00c0b3410 msgr2=0x7ff00c0c6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:16.508 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.506+0000 7ff012520700 1 --2- 172.21.15.124:0/2989943795 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff00c0b3410 0x7ff00c0c6fd0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7feffc00c4d0 tx=0x7feffc00c890 comp rx=0 tx=0).stop 2023-10-16T13:00:16.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.506+0000 7ff012520700 1 -- 172.21.15.124:0/2989943795 shutdown_connections 2023-10-16T13:00:16.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.506+0000 7ff012520700 1 --2- 172.21.15.124:0/2989943795 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7feff806af00 0x7feff806d3c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.506+0000 7ff012520700 1 --2- 172.21.15.124:0/2989943795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff00c152470 0x7ff00c0b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.506+0000 7ff012520700 1 --2- 172.21.15.124:0/2989943795 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff00c0b3410 0x7ff00c0c6fd0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.509 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.506+0000 7ff012520700 1 --2- 172.21.15.124:0/2989943795 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff00c0cb8d0 0x7ff00c158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:16.510 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.506+0000 7ff012520700 1 -- 172.21.15.124:0/2989943795 >> 172.21.15.124:0/2989943795 conn(0x7ff00c0cdd00 msgr2=0x7ff00c159e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:16.510 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.506+0000 7ff012520700 1 -- 172.21.15.124:0/2989943795 shutdown_connections 2023-10-16T13:00:16.510 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:16.506+0000 7ff012520700 1 -- 172.21.15.124:0/2989943795 wait complete. 2023-10-16T13:00:16.519 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T13:00:16.520 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T13:00:16.520 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi124.front.sepia.ceph.com 2023-10-16T13:00:16.521 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-16T13:00:16.521 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T13:00:16.521 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T13:00:16.522 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-16T13:00:16.522 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T13:00:16.522 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:00:16.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:00:16.523 DEBUG:teuthology.orchestra.run.smithi124:> ip addr 2023-10-16T13:00:16.540 INFO:teuthology.orchestra.run.smithi124.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T13:00:16.541 INFO:teuthology.orchestra.run.smithi124.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T13:00:16.541 INFO:teuthology.orchestra.run.smithi124.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T13:00:16.541 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:00:16.541 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 ::1/128 scope host 2023-10-16T13:00:16.541 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:00:16.542 INFO:teuthology.orchestra.run.smithi124.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:00:16.542 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:d8:a1:a6 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:00:16.542 INFO:teuthology.orchestra.run.smithi124.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:00:16.542 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:d8:a1:a7 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:00:16.543 INFO:teuthology.orchestra.run.smithi124.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T13:00:16.543 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:8f:d5:c4 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:00:16.543 INFO:teuthology.orchestra.run.smithi124.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T13:00:16.543 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 0c:c4:7a:8f:d5:c5 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:00:16.544 INFO:teuthology.orchestra.run.smithi124.stdout: inet 172.21.15.124/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T13:00:16.544 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft 42343sec preferred_lft 42343sec 2023-10-16T13:00:16.544 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::1cab:2850:a634:5e4f/64 scope link noprefixroute 2023-10-16T13:00:16.544 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:00:16.544 INFO:teuthology.orchestra.run.smithi124.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T13:00:16.544 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 76:ac:d4:62:c0:51 brd ff:ff:ff:ff:ff:ff 2023-10-16T13:00:16.545 INFO:teuthology.orchestra.run.smithi124.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T13:00:16.545 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:00:16.545 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::2c14:adff:fe0c:d2d6/64 scope link 2023-10-16T13:00:16.545 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:00:16.545 INFO:teuthology.orchestra.run.smithi124.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:00:16.546 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether 76:ac:d4:62:c0:51 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T13:00:16.546 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::74ac:d4ff:fe62:c051/64 scope link 2023-10-16T13:00:16.546 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:00:16.546 INFO:teuthology.orchestra.run.smithi124.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T13:00:16.546 INFO:teuthology.orchestra.run.smithi124.stdout: link/ether ba:16:d4:2e:ea:3d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T13:00:16.547 INFO:teuthology.orchestra.run.smithi124.stdout: inet6 fe80::b816:d4ff:fe2e:ea3d/64 scope link 2023-10-16T13:00:16.547 INFO:teuthology.orchestra.run.smithi124.stdout: valid_lft forever preferred_lft forever 2023-10-16T13:00:16.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:00:16.548 DEBUG:teuthology.orchestra.run.smithi124:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T13:00:16.605 INFO:teuthology.orchestra.run.smithi124.stdout:1 2023-10-16T13:00:16.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:00:16.607 DEBUG:teuthology.orchestra.run.smithi124:> route 2023-10-16T13:00:16.666 INFO:teuthology.orchestra.run.smithi124.stdout:Kernel IP routing table 2023-10-16T13:00:16.666 INFO:teuthology.orchestra.run.smithi124.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T13:00:16.667 INFO:teuthology.orchestra.run.smithi124.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T13:00:16.667 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T13:00:16.667 INFO:teuthology.orchestra.run.smithi124.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T13:00:16.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:00:16.668 DEBUG:teuthology.orchestra.run.smithi124:> (cd / && exec bash -c ' 2023-10-16T13:00:16.668 DEBUG:teuthology.orchestra.run.smithi124:> set -e 2023-10-16T13:00:16.669 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T13:00:16.669 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T13:00:16.669 DEBUG:teuthology.orchestra.run.smithi124:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T13:00:16.670 DEBUG:teuthology.orchestra.run.smithi124:> ') 2023-10-16T13:00:16.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:00:16.771 DEBUG:teuthology.orchestra.run.smithi124:> ip netns list 2023-10-16T13:00:16.787 INFO:teuthology.orchestra.run.smithi124.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-16T13:00:16.788 INFO:teuthology.orchestra.run.smithi124.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T13:00:16.788 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:00:16.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:00:16.789 DEBUG:teuthology.orchestra.run.smithi124:> sudo ip link set brx.0 up 2023-10-16T13:00:16.855 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:00:16.855 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-16T13:00:16.911 INFO:teuthology.orchestra.run.smithi124.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-16T13:00:16.911 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T13:00:16.912 DEBUG:teuthology.orchestra.run.smithi124:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-16T13:00:16.967 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-16T13:00:16.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:00:16.968 DEBUG:teuthology.orchestra.run.smithi124:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:00:17.052 INFO:teuthology.orchestra.run.smithi124.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:00:17.053 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:00:17.081 INFO:teuthology.orchestra.run.smithi124.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:00:17.081 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:00:17.082 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: resolved to: "172.21.15.124:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-16T13:00:17.082 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: trying mount with new device syntax: 0@4cfd077b-2400-4ae1-a7e8-14265fee7113.cephfs=/ 2023-10-16T13:00:17.082 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.124:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-16T13:00:17.083 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:00:17.083 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:00:17.083 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:00:17.159 INFO:teuthology.orchestra.run.smithi124.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T13:00:17.160 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T13:00:17.160 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: resolved to: "172.21.15.124:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-16T13:00:17.160 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: trying mount with new device syntax: 0@4cfd077b-2400-4ae1-a7e8-14265fee7113.cephfs=/ 2023-10-16T13:00:17.160 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.124:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-16T13:00:17.161 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T13:00:17.161 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T13:00:17.161 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T13:00:17.161 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: resolved to: "172.21.15.124:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-16T13:00:17.161 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.124:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-16T13:00:17.162 INFO:teuthology.orchestra.run.smithi124.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=4cfd077b-2400-4ae1-a7e8-14265fee7113" will pass to kernel 2023-10-16T13:00:17.163 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T13:00:17.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:00:17.164 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-16T13:00:17.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:00:17.192 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T13:00:17.279 INFO:teuthology.orchestra.run.smithi124.stdout:client5269 2023-10-16T13:00:17.280 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T13:00:17.280 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T13:00:17.298 DEBUG:teuthology.orchestra.run.smithi124:> mktemp -d --suffix=xfstests-dev 2023-10-16T13:00:17.355 INFO:teuthology.orchestra.run.smithi124.stdout:/tmp/tmp.pHbfHGg5qgxfstests-dev 2023-10-16T13:00:17.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:00:17.356 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.pHbfHGg5qgxfstests-dev) 2023-10-16T13:00:17.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:00:17.424 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.pHbfHGg5qgxfstests-dev) 2023-10-16T13:00:17.485 INFO:teuthology.orchestra.run.smithi124.stderr:Cloning into '/tmp/tmp.pHbfHGg5qgxfstests-dev'... 2023-10-16T13:00:18.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:00:18.183 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-10-16T13:00:18.244 DEBUG:teuthology.orchestra.run.smithi124:> mktemp -d --suffix=test 2023-10-16T13:00:18.301 INFO:teuthology.orchestra.run.smithi124.stdout:/tmp/tmp.I407zfbFe1test 2023-10-16T13:00:18.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:00:18.302 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-10-16T13:00:18.360 DEBUG:teuthology.orchestra.run.smithi124:> mktemp -d --suffix=scratch 2023-10-16T13:00:18.416 INFO:teuthology.orchestra.run.smithi124.stdout:/tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:00:18.417 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "rhel" and "8.6". 2023-10-16T13:00:18.417 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python3 sqlite xfsprogs-qa-devel 2023-10-16T13:00:18.815 INFO:teuthology.orchestra.run.smithi124.stdout:Updating Subscription Management repositories. 2023-10-16T13:00:19.654 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:04:28 ago on Mon 16 Oct 2023 12:55:51 PM UTC. 2023-10-16T13:00:20.358 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:00:20.361 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:00:20.939 INFO:teuthology.orchestra.run.smithi124.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-10-16T13:00:20.940 INFO:teuthology.orchestra.run.smithi124.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-10-16T13:00:20.941 INFO:teuthology.orchestra.run.smithi124.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-10-16T13:00:20.942 INFO:teuthology.orchestra.run.smithi124.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-10-16T13:00:20.943 INFO:teuthology.orchestra.run.smithi124.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-10-16T13:00:20.945 INFO:teuthology.orchestra.run.smithi124.stdout:Package e2fsprogs-1.45.6-4.el8.x86_64 is already installed. 2023-10-16T13:00:20.947 INFO:teuthology.orchestra.run.smithi124.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-10-16T13:00:20.948 INFO:teuthology.orchestra.run.smithi124.stdout:Package gcc-8.5.0-10.1.el8_6.x86_64 is already installed. 2023-10-16T13:00:20.950 INFO:teuthology.orchestra.run.smithi124.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-10-16T13:00:20.951 INFO:teuthology.orchestra.run.smithi124.stdout:Package lvm2-8:2.03.14-3.el8_6.2.x86_64 is already installed. 2023-10-16T13:00:20.953 INFO:teuthology.orchestra.run.smithi124.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-10-16T13:00:20.954 INFO:teuthology.orchestra.run.smithi124.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-10-16T13:00:20.955 INFO:teuthology.orchestra.run.smithi124.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-10-16T13:00:20.956 INFO:teuthology.orchestra.run.smithi124.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-10-16T13:00:20.957 INFO:teuthology.orchestra.run.smithi124.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-16T13:00:20.958 INFO:teuthology.orchestra.run.smithi124.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-16T13:00:20.959 INFO:teuthology.orchestra.run.smithi124.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-16T13:00:20.960 INFO:teuthology.orchestra.run.smithi124.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-16T13:00:20.961 INFO:teuthology.orchestra.run.smithi124.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-10-16T13:00:20.962 INFO:teuthology.orchestra.run.smithi124.stdout:Package libuuid-devel-2.32.1-35.el8.x86_64 is already installed. 2023-10-16T13:00:20.964 INFO:teuthology.orchestra.run.smithi124.stdout:Package xfsprogs-devel-5.0.0-10.el8.x86_64 is already installed. 2023-10-16T13:00:20.968 INFO:teuthology.orchestra.run.smithi124.stdout:Package python36-3.6.8-38.module+el8.5.0+12207+5c5719bc.x86_64 is already installed. 2023-10-16T13:00:20.969 INFO:teuthology.orchestra.run.smithi124.stdout:Package sqlite-3.26.0-15.el8.x86_64 is already installed. 2023-10-16T13:00:20.974 INFO:teuthology.orchestra.run.smithi124.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-16T13:00:21.085 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-10-16T13:00:21.086 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-10-16T13:00:21.086 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2023-10-16T13:00:21.087 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-10-16T13:00:21.087 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2023-10-16T13:00:21.087 INFO:teuthology.orchestra.run.smithi124.stdout: dump x86_64 1:0.4-0.36.b46.el8 rhel-8-for-x86_64-baseos-rpms 164 k 2023-10-16T13:00:21.087 INFO:teuthology.orchestra.run.smithi124.stdout: fio x86_64 3.19-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-16T13:00:21.087 INFO:teuthology.orchestra.run.smithi124.stdout: indent x86_64 2.2.13-4.el8 epel 187 k 2023-10-16T13:00:21.088 INFO:teuthology.orchestra.run.smithi124.stdout:Upgrading: 2023-10-16T13:00:21.088 INFO:teuthology.orchestra.run.smithi124.stdout: sqlite x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 668 k 2023-10-16T13:00:21.088 INFO:teuthology.orchestra.run.smithi124.stdout: sqlite-libs x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 581 k 2023-10-16T13:00:21.089 INFO:teuthology.orchestra.run.smithi124.stdout:Installing dependencies: 2023-10-16T13:00:21.089 INFO:teuthology.orchestra.run.smithi124.stdout: daxctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 42 k 2023-10-16T13:00:21.089 INFO:teuthology.orchestra.run.smithi124.stdout: libpmemblk x86_64 1.6.1-1.el8 rhel-8-for-x86_64-appstream-rpms 92 k 2023-10-16T13:00:21.089 INFO:teuthology.orchestra.run.smithi124.stdout: ndctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 79 k 2023-10-16T13:00:21.089 INFO:teuthology.orchestra.run.smithi124.stdout: rmt x86_64 2:1.5.3-13.el8 rhel-8-for-x86_64-baseos-rpms 51 k 2023-10-16T13:00:21.090 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:00:21.090 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2023-10-16T13:00:21.090 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-10-16T13:00:21.090 INFO:teuthology.orchestra.run.smithi124.stdout:Install 7 Packages 2023-10-16T13:00:21.090 INFO:teuthology.orchestra.run.smithi124.stdout:Upgrade 2 Packages 2023-10-16T13:00:21.091 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:00:21.091 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 2.3 M 2023-10-16T13:00:21.091 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading Packages: 2023-10-16T13:00:21.228 INFO:teuthology.orchestra.run.smithi124.stdout:(1/9): rmt-1.5.3-13.el8.x86_64.rpm 589 kB/s | 51 kB 00:00 2023-10-16T13:00:21.253 INFO:teuthology.orchestra.run.smithi124.stdout:(2/9): dump-0.4-0.36.b46.el8.x86_64.rpm 1.4 MB/s | 164 kB 00:00 2023-10-16T13:00:21.287 INFO:teuthology.orchestra.run.smithi124.stdout:(3/9): daxctl-libs-71.1-3.el8.x86_64.rpm 714 kB/s | 42 kB 00:00 2023-10-16T13:00:21.312 INFO:teuthology.orchestra.run.smithi124.stdout:(4/9): ndctl-libs-71.1-3.el8.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2023-10-16T13:00:21.346 INFO:teuthology.orchestra.run.smithi124.stdout:(5/9): fio-3.19-3.el8.x86_64.rpm 8.9 MB/s | 538 kB 00:00 2023-10-16T13:00:21.371 INFO:teuthology.orchestra.run.smithi124.stdout:(6/9): libpmemblk-1.6.1-1.el8.x86_64.rpm 1.5 MB/s | 92 kB 00:00 2023-10-16T13:00:21.413 INFO:teuthology.orchestra.run.smithi124.stdout:(7/9): sqlite-3.26.0-16.el8_6.x86_64.rpm 9.8 MB/s | 668 kB 00:00 2023-10-16T13:00:21.477 INFO:teuthology.orchestra.run.smithi124.stdout:(8/9): sqlite-libs-3.26.0-16.el8_6.x86_64.rpm 5.4 MB/s | 581 kB 00:00 2023-10-16T13:00:21.506 INFO:teuthology.orchestra.run.smithi124.stdout:(9/9): indent-2.2.13-4.el8.x86_64.rpm 513 kB/s | 187 kB 00:00 2023-10-16T13:00:21.506 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2023-10-16T13:00:21.506 INFO:teuthology.orchestra.run.smithi124.stdout:Total 5.6 MB/s | 2.3 MB 00:00 2023-10-16T13:00:21.588 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2023-10-16T13:00:21.620 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction check succeeded. 2023-10-16T13:00:21.620 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2023-10-16T13:00:21.715 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded. 2023-10-16T13:00:21.719 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2023-10-16T13:00:22.091 INFO:teuthology.orchestra.run.smithi124.stdout: Preparing : 1/1 2023-10-16T13:00:22.232 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : daxctl-libs-71.1-3.el8.x86_64 1/11 2023-10-16T13:00:22.291 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: daxctl-libs-71.1-3.el8.x86_64 1/11 2023-10-16T13:00:22.490 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ndctl-libs-71.1-3.el8.x86_64 2/11 2023-10-16T13:00:22.554 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ndctl-libs-71.1-3.el8.x86_64 2/11 2023-10-16T13:00:22.746 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 3/11 2023-10-16T13:00:22.857 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 3/11 2023-10-16T13:00:23.033 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : sqlite-libs-3.26.0-16.el8_6.x86_64 4/11 2023-10-16T13:00:23.200 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 5/11 2023-10-16T13:00:23.479 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 6/11 2023-10-16T13:00:23.778 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : sqlite-3.26.0-16.el8_6.x86_64 7/11 2023-10-16T13:00:24.070 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : fio-3.19-3.el8.x86_64 8/11 2023-10-16T13:00:24.258 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : indent-2.2.13-4.el8.x86_64 9/11 2023-10-16T13:00:24.390 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : sqlite-3.26.0-15.el8.x86_64 10/11 2023-10-16T13:00:24.530 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : sqlite-libs-3.26.0-15.el8.x86_64 11/11 2023-10-16T13:00:24.798 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: sqlite-libs-3.26.0-15.el8.x86_64 11/11 2023-10-16T13:00:24.799 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : indent-2.2.13-4.el8.x86_64 1/11 2023-10-16T13:00:24.799 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 2/11 2023-10-16T13:00:24.799 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 3/11 2023-10-16T13:00:24.799 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : daxctl-libs-71.1-3.el8.x86_64 4/11 2023-10-16T13:00:24.799 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ndctl-libs-71.1-3.el8.x86_64 5/11 2023-10-16T13:00:24.800 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : fio-3.19-3.el8.x86_64 6/11 2023-10-16T13:00:24.800 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 7/11 2023-10-16T13:00:24.800 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : sqlite-3.26.0-16.el8_6.x86_64 8/11 2023-10-16T13:00:24.800 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : sqlite-3.26.0-15.el8.x86_64 9/11 2023-10-16T13:00:24.800 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : sqlite-libs-3.26.0-16.el8_6.x86_64 10/11 2023-10-16T13:00:26.001 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : sqlite-libs-3.26.0-15.el8.x86_64 11/11 2023-10-16T13:00:26.001 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:04:34 ago on Mon 16 Oct 2023 12:55:51 PM UTC. 2023-10-16T13:00:28.553 INFO:teuthology.orchestra.run.smithi124.stdout:Installed products updated. 2023-10-16T13:00:28.748 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:00:28.748 INFO:teuthology.orchestra.run.smithi124.stdout:Upgraded: 2023-10-16T13:00:28.748 INFO:teuthology.orchestra.run.smithi124.stdout: sqlite-3.26.0-16.el8_6.x86_64 sqlite-libs-3.26.0-16.el8_6.x86_64 2023-10-16T13:00:28.749 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2023-10-16T13:00:28.749 INFO:teuthology.orchestra.run.smithi124.stdout: daxctl-libs-71.1-3.el8.x86_64 dump-1:0.4-0.36.b46.el8.x86_64 2023-10-16T13:00:28.749 INFO:teuthology.orchestra.run.smithi124.stdout: fio-3.19-3.el8.x86_64 indent-2.2.13-4.el8.x86_64 2023-10-16T13:00:28.749 INFO:teuthology.orchestra.run.smithi124.stdout: libpmemblk-1.6.1-1.el8.x86_64 ndctl-libs-71.1-3.el8.x86_64 2023-10-16T13:00:28.749 INFO:teuthology.orchestra.run.smithi124.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-10-16T13:00:28.749 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:00:28.750 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-10-16T13:00:28.914 DEBUG:teuthology.orchestra.run.smithi124:> sudo useradd -m fsgqa 2023-10-16T13:00:28.942 INFO:teuthology.orchestra.run.smithi124.stderr:useradd: user 'fsgqa' already exists 2023-10-16T13:00:28.943 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-10-16T13:00:28.944 DEBUG:teuthology.orchestra.run.smithi124:> sudo groupadd fsgqa 2023-10-16T13:00:29.011 INFO:teuthology.orchestra.run.smithi124.stderr:groupadd: group 'fsgqa' already exists 2023-10-16T13:00:29.011 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-10-16T13:00:29.012 DEBUG:teuthology.orchestra.run.smithi124:> sudo useradd fsgqa2 2023-10-16T13:00:30.217 DEBUG:teuthology.orchestra.run.smithi124:> sudo useradd 123456-fsgqa 2023-10-16T13:00:32.799 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-10-16T13:00:32.931 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.929+0000 7faa5219b700 1 Processor -- start 2023-10-16T13:00:32.932 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.929+0000 7faa5219b700 1 -- start start 2023-10-16T13:00:32.935 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.930+0000 7faa5219b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa4c15f6c0 0x7faa4c15c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:32.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.930+0000 7faa5219b700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4c06d6b0 con 0x7faa4c0c9dd0 2023-10-16T13:00:32.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.930+0000 7faa5219b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4c15fea0 con 0x7faa4c0cc170 2023-10-16T13:00:32.936 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.930+0000 7faa5219b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c15fbc0 con 0x7faa4c15f6c0 2023-10-16T13:00:32.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.930+0000 7faa4b7fe700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7faa4c0c9dd0 0x7faa4c0cba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:44494/0 (socket says 172.21.15.124:44494) 2023-10-16T13:00:32.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.930+0000 7faa4b7fe700 1 -- 172.21.15.124:0/4119202 learned_addr learned my addr 172.21.15.124:0/4119202 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T13:00:32.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.930+0000 7faa4a7fc700 1 -- 172.21.15.124:0/4119202 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090776549 0 0) 0x7faa44001490 con 0x7faa4c0c9dd0 2023-10-16T13:00:32.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.930+0000 7faa4bfff700 1 --2- 172.21.15.124:0/4119202 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa4c15f6c0 0x7faa4c15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:32.937 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.930+0000 7faa4a7fc700 1 -- 172.21.15.124:0/4119202 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa380035b0 con 0x7faa4c0c9dd0 2023-10-16T13:00:32.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.930+0000 7faa4a7fc700 1 -- 172.21.15.124:0/4119202 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3072536762 0 0) 0x7faa380035b0 con 0x7faa4c0c9dd0 2023-10-16T13:00:32.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.930+0000 7faa4a7fc700 1 -- 172.21.15.124:0/4119202 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa4c15f6c0 msgr2=0x7faa4c15c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:32.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.930+0000 7faa4a7fc700 1 --2- 172.21.15.124:0/4119202 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa4c15f6c0 0x7faa4c15c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:32.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.930+0000 7faa4a7fc700 1 -- 172.21.15.124:0/4119202 >> v1:172.21.15.192:6789/0 conn(0x7faa4c0cc170 legacy=0x7faa4c15efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:32.938 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.930+0000 7faa4a7fc700 1 -- 172.21.15.124:0/4119202 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c15bb40 con 0x7faa4c0c9dd0 2023-10-16T13:00:32.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.930+0000 7faa4a7fc700 1 -- 172.21.15.124:0/4119202 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7faa44001b80 con 0x7faa4c0c9dd0 2023-10-16T13:00:32.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.930+0000 7faa4a7fc700 1 -- 172.21.15.124:0/4119202 >> v1:172.21.15.124:6789/0 conn(0x7faa4c0c9dd0 legacy=0x7faa4c0cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:32.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.930+0000 7faa4a7fc700 1 --2- 172.21.15.124:0/4119202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa38003a30 0x7faa38003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:32.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.930+0000 7faa4a7fc700 1 --2- 172.21.15.124:0/4119202 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa38004850 0x7faa38004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:32.939 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.930+0000 7faa4a7fc700 1 --2- 172.21.15.124:0/4119202 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa4c15f6c0 0x7faa38005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:32.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.930+0000 7faa4a7fc700 1 -- 172.21.15.124:0/4119202 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c15fbc0 con 0x7faa38004850 2023-10-16T13:00:32.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.930+0000 7faa4a7fc700 1 -- 172.21.15.124:0/4119202 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3800bac0 con 0x7faa38003a30 2023-10-16T13:00:32.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.931+0000 7faa4a7fc700 1 -- 172.21.15.124:0/4119202 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa3800bc80 con 0x7faa4c15f6c0 2023-10-16T13:00:32.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.931+0000 7faa4affd700 1 --2- 172.21.15.124:0/4119202 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa38004850 0x7faa38004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:32.940 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.931+0000 7faa4b7fe700 1 --2- 172.21.15.124:0/4119202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa38003a30 0x7faa38003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:32.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.931+0000 7faa4bfff700 1 --2- 172.21.15.124:0/4119202 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa4c15f6c0 0x7faa38005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:32.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.931+0000 7faa4affd700 1 -- 172.21.15.124:0/4119202 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa4c15f6c0 msgr2=0x7faa38005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:32.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.931+0000 7faa4affd700 1 --2- 172.21.15.124:0/4119202 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa4c15f6c0 0x7faa38005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:32.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.931+0000 7faa4affd700 1 -- 172.21.15.124:0/4119202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa38003a30 msgr2=0x7faa38003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:32.941 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.931+0000 7faa4affd700 1 --2- 172.21.15.124:0/4119202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa38003a30 0x7faa38003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:32.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.931+0000 7faa4affd700 1 -- 172.21.15.124:0/4119202 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa380035b0 con 0x7faa38004850 2023-10-16T13:00:32.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.931+0000 7faa4b7fe700 1 --2- 172.21.15.124:0/4119202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa38003a30 0x7faa38003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T13:00:32.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.931+0000 7faa4affd700 1 --2- 172.21.15.124:0/4119202 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa38004850 0x7faa38004cd0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7faa34007fd0 tx=0x7faa38005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c32abed74a29681 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:32.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.931+0000 7faa4a7fc700 1 -- 172.21.15.124:0/4119202 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa340052d0 con 0x7faa38004850 2023-10-16T13:00:32.942 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.931+0000 7faa4a7fc700 1 -- 172.21.15.124:0/4119202 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa34005470 con 0x7faa38004850 2023-10-16T13:00:32.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.931+0000 7faa4a7fc700 1 -- 172.21.15.124:0/4119202 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa340038c0 con 0x7faa38004850 2023-10-16T13:00:32.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.932+0000 7faa5219b700 1 -- 172.21.15.124:0/4119202 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa38004850 msgr2=0x7faa38004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:32.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.932+0000 7faa5219b700 1 --2- 172.21.15.124:0/4119202 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa38004850 0x7faa38004cd0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7faa34007fd0 tx=0x7faa38005880 comp rx=0 tx=0).stop 2023-10-16T13:00:32.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.932+0000 7faa4bfff700 1 -- 172.21.15.124:0/4119202 reap_dead start 2023-10-16T13:00:32.943 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.932+0000 7faa5219b700 1 -- 172.21.15.124:0/4119202 shutdown_connections 2023-10-16T13:00:32.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.932+0000 7faa5219b700 1 -- 172.21.15.124:0/4119202 >> 172.21.15.124:0/4119202 conn(0x7faa4c06c850 msgr2=0x7faa4c06cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:32.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.932+0000 7faa5219b700 1 -- 172.21.15.124:0/4119202 shutdown_connections 2023-10-16T13:00:32.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.932+0000 7faa5219b700 1 -- 172.21.15.124:0/4119202 wait complete. 2023-10-16T13:00:32.944 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.933+0000 7faa5219b700 1 Processor -- start 2023-10-16T13:00:32.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.934+0000 7faa5219b700 1 -- start start 2023-10-16T13:00:32.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.934+0000 7faa5219b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa38004850 0x7faa4c13fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:32.947 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.934+0000 7faa5219b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa4c0b4880 0x7faa4c0b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:32.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.934+0000 7faa5219b700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa4c0b0960 0x7faa4c0b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:32.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.934+0000 7faa5219b700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c14b570 con 0x7faa4c0b0960 2023-10-16T13:00:32.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.934+0000 7faa5219b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c1403e0 con 0x7faa38004850 2023-10-16T13:00:32.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.934+0000 7faa5219b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c0b3530 con 0x7faa4c0b4880 2023-10-16T13:00:32.948 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.935+0000 7faa4bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa4c0b0960 0x7faa4c0b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:32.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.935+0000 7faa4bfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa4c0b0960 0x7faa4c0b1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55842/0 (socket says 172.21.15.124:55842) 2023-10-16T13:00:32.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.935+0000 7faa4bfff700 1 -- 172.21.15.124:0/378751293 learned_addr learned my addr 172.21.15.124:0/378751293 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:32.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.935+0000 7faa4b7fe700 1 --2- 172.21.15.124:0/378751293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa38004850 0x7faa4c13fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:32.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.935+0000 7faa4affd700 1 --2- 172.21.15.124:0/378751293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa4c0b4880 0x7faa4c0b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:32.949 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.935+0000 7faa4bfff700 1 -- 172.21.15.124:0/378751293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa4c0b4880 msgr2=0x7faa4c0b0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:32.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.935+0000 7faa4bfff700 1 --2- 172.21.15.124:0/378751293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa4c0b4880 0x7faa4c0b0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:32.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.935+0000 7faa4bfff700 1 -- 172.21.15.124:0/378751293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa38004850 msgr2=0x7faa4c13fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:32.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.935+0000 7faa4bfff700 1 --2- 172.21.15.124:0/378751293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa38004850 0x7faa4c13fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:32.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.935+0000 7faa4bfff700 1 -- 172.21.15.124:0/378751293 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c0b3810 con 0x7faa4c0b0960 2023-10-16T13:00:32.950 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.935+0000 7faa4bfff700 1 --2- 172.21.15.124:0/378751293 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa4c0b0960 0x7faa4c0b1fd0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7faa4c0730e0 tx=0x7faa3c011770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:32.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.935+0000 7faa43fff700 1 -- 172.21.15.124:0/378751293 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c004230 con 0x7faa4c0b0960 2023-10-16T13:00:32.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.935+0000 7faa43fff700 1 -- 172.21.15.124:0/378751293 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c004390 con 0x7faa4c0b0960 2023-10-16T13:00:32.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.935+0000 7faa43fff700 1 -- 172.21.15.124:0/378751293 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c0038e0 con 0x7faa4c0b0960 2023-10-16T13:00:32.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.935+0000 7faa5219b700 1 -- 172.21.15.124:0/378751293 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4c0b3af0 con 0x7faa4c0b0960 2023-10-16T13:00:32.951 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.935+0000 7faa5219b700 1 -- 172.21.15.124:0/378751293 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4c0b0de0 con 0x7faa4c0b0960 2023-10-16T13:00:32.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.936+0000 7faa5219b700 1 -- 172.21.15.124:0/378751293 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa4c04f400 con 0x7faa4c0b0960 2023-10-16T13:00:32.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.937+0000 7faa43fff700 1 -- 172.21.15.124:0/378751293 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faa3c003a40 con 0x7faa4c0b0960 2023-10-16T13:00:32.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.937+0000 7faa43fff700 1 --2- 172.21.15.124:0/378751293 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7faa2c06af00 0x7faa2c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:32.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.937+0000 7faa43fff700 1 -- 172.21.15.124:0/378751293 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faa3c0897e0 con 0x7faa4c0b0960 2023-10-16T13:00:32.952 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.937+0000 7faa4b7fe700 1 --2- 172.21.15.124:0/378751293 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7faa2c06af00 0x7faa2c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:32.953 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.937+0000 7faa4b7fe700 1 --2- 172.21.15.124:0/378751293 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7faa2c06af00 0x7faa2c06d3c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faa44001330 tx=0x7faa44001650 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:32.953 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:32.941+0000 7faa43fff700 1 -- 172.21.15.124:0/378751293 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faa3c0547e0 con 0x7faa4c0b0960 2023-10-16T13:00:33.218 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.215+0000 7faa5219b700 1 -- 172.21.15.124:0/378751293 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7faa4c04ebb0 con 0x7faa4c0b0960 2023-10-16T13:00:33.218 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.215+0000 7faa43fff700 1 -- 172.21.15.124:0/378751293 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1280 (secure 0 0 0) 0x7faa3c019510 con 0x7faa4c0b0960 2023-10-16T13:00:33.219 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:00:33.219 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":1,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","modified":"2023-10-16T12:57:51.971210Z","created":"2023-10-16T12:57:51.971210Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:3300","nonce":0},{"type":"v1","addr":"172.21.15.124:6789","nonce":0}]},"addr":"172.21.15.124:6789/0","public_addr":"172.21.15.124:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:3300","nonce":0},{"type":"v1","addr":"172.21.15.192:6789","nonce":0}]},"addr":"172.21.15.192:6789/0","public_addr":"172.21.15.192:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:3301","nonce":0},{"type":"v1","addr":"172.21.15.192:6790","nonce":0}]},"addr":"172.21.15.192:6790/0","public_addr":"172.21.15.192:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-10-16T13:00:33.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.217+0000 7faa5219b700 1 -- 172.21.15.124:0/378751293 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7faa2c06af00 msgr2=0x7faa2c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:33.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.217+0000 7faa5219b700 1 --2- 172.21.15.124:0/378751293 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7faa2c06af00 0x7faa2c06d3c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faa44001330 tx=0x7faa44001650 comp rx=0 tx=0).stop 2023-10-16T13:00:33.220 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.217+0000 7faa5219b700 1 -- 172.21.15.124:0/378751293 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa4c0b0960 msgr2=0x7faa4c0b1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:33.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.217+0000 7faa5219b700 1 --2- 172.21.15.124:0/378751293 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa4c0b0960 0x7faa4c0b1fd0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7faa4c0730e0 tx=0x7faa3c011770 comp rx=0 tx=0).stop 2023-10-16T13:00:33.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.217+0000 7faa5219b700 1 -- 172.21.15.124:0/378751293 shutdown_connections 2023-10-16T13:00:33.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.217+0000 7faa5219b700 1 --2- 172.21.15.124:0/378751293 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7faa2c06af00 0x7faa2c06d3c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:33.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.217+0000 7faa5219b700 1 --2- 172.21.15.124:0/378751293 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa4c0b0960 0x7faa4c0b1fd0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:33.221 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.217+0000 7faa5219b700 1 --2- 172.21.15.124:0/378751293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa38004850 0x7faa4c13fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:33.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.217+0000 7faa5219b700 1 --2- 172.21.15.124:0/378751293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa4c0b4880 0x7faa4c0b0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:33.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.217+0000 7faa5219b700 1 -- 172.21.15.124:0/378751293 >> 172.21.15.124:0/378751293 conn(0x7faa4c06c850 msgr2=0x7faa4c15dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:33.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.217+0000 7faa5219b700 1 -- 172.21.15.124:0/378751293 shutdown_connections 2023-10-16T13:00:33.222 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.218+0000 7faa5219b700 1 -- 172.21.15.124:0/378751293 wait complete. 2023-10-16T13:00:33.223 INFO:teuthology.orchestra.run.smithi124.stderr:dumped monmap epoch 1 2023-10-16T13:00:33.232 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-10-16T13:00:33.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.351+0000 7f8da2d8c700 1 Processor -- start 2023-10-16T13:00:33.354 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.351+0000 7f8da2d8c700 1 -- start start 2023-10-16T13:00:33.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.352+0000 7f8da2d8c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8d9c071850 0x7f8d9c071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:33.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.352+0000 7f8da2d8c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d9c06d100 0x7f8d9c06d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:33.358 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.352+0000 7f8da2d8c700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d9c0721f0 con 0x7f8d9c15daa0 2023-10-16T13:00:33.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.352+0000 7f8da2d8c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d9c15ed10 con 0x7f8d9c071850 2023-10-16T13:00:33.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.352+0000 7f8da2d8c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c15de80 con 0x7f8d9c06d100 2023-10-16T13:00:33.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.352+0000 7f8da0b28700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f8d9c15daa0 0x7f8d9c0af020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:44514/0 (socket says 172.21.15.124:44514) 2023-10-16T13:00:33.359 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.352+0000 7f8da0b28700 1 -- 172.21.15.124:0/1160512723 learned_addr learned my addr 172.21.15.124:0/1160512723 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T13:00:33.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.352+0000 7f8d9b7fe700 1 -- 172.21.15.124:0/1160512723 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179258890 0 0) 0x7f8d9c0721f0 con 0x7f8d9c15daa0 2023-10-16T13:00:33.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.352+0000 7f8d9b7fe700 1 -- 172.21.15.124:0/1160512723 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d8c0035b0 con 0x7f8d9c15daa0 2023-10-16T13:00:33.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.352+0000 7f8d9bfff700 1 --2- 172.21.15.124:0/1160512723 >> v2:172.21.15.192:3300/0 conn(0x7f8d9c071850 0x7f8d9c071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:33.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.352+0000 7f8da1329700 1 --2- 172.21.15.124:0/1160512723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d9c06d100 0x7f8d9c06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:33.360 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8d9b7fe700 1 -- 172.21.15.124:0/1160512723 <== mon.0 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 390455111 0 0) 0x7f8d8c0035b0 con 0x7f8d9c15daa0 2023-10-16T13:00:33.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8d9b7fe700 1 -- 172.21.15.124:0/1160512723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d9c06d100 msgr2=0x7f8d9c06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:33.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8d9b7fe700 1 --2- 172.21.15.124:0/1160512723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d9c06d100 0x7f8d9c06d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:33.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8d9b7fe700 1 -- 172.21.15.124:0/1160512723 >> v2:172.21.15.192:3300/0 conn(0x7f8d9c071850 msgr2=0x7f8d9c071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:33.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8d9b7fe700 1 --2- 172.21.15.124:0/1160512723 >> v2:172.21.15.192:3300/0 conn(0x7f8d9c071850 0x7f8d9c071cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:33.361 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8d9b7fe700 1 -- 172.21.15.124:0/1160512723 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9c15e100 con 0x7f8d9c15daa0 2023-10-16T13:00:33.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8d9b7fe700 1 -- 172.21.15.124:0/1160512723 <== mon.0 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3955598927 0 0) 0x7f8d90001670 con 0x7f8d9c15daa0 2023-10-16T13:00:33.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8d9b7fe700 1 -- 172.21.15.124:0/1160512723 >> v1:172.21.15.124:6789/0 conn(0x7f8d9c15daa0 legacy=0x7f8d9c0af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:33.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8d9b7fe700 1 --2- 172.21.15.124:0/1160512723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d8c003a00 0x7f8d8c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:33.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8d9b7fe700 1 --2- 172.21.15.124:0/1160512723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d9c06d100 0x7f8d8c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:33.362 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8d9b7fe700 1 --2- 172.21.15.124:0/1160512723 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8d8c004d90 0x7f8d8c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:33.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8d9b7fe700 1 -- 172.21.15.124:0/1160512723 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c15ed10 con 0x7f8d8c004d90 2023-10-16T13:00:33.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8d9b7fe700 1 -- 172.21.15.124:0/1160512723 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c15de80 con 0x7f8d8c003a00 2023-10-16T13:00:33.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8d9b7fe700 1 -- 172.21.15.124:0/1160512723 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c00ba10 con 0x7f8d9c06d100 2023-10-16T13:00:33.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8da1329700 1 --2- 172.21.15.124:0/1160512723 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8d8c004d90 0x7f8d8c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:33.363 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8da0b28700 1 --2- 172.21.15.124:0/1160512723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d8c003a00 0x7f8d8c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:33.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8d9bfff700 1 --2- 172.21.15.124:0/1160512723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d9c06d100 0x7f8d8c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:33.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8da1329700 1 -- 172.21.15.124:0/1160512723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d9c06d100 msgr2=0x7f8d8c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:33.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8da1329700 1 --2- 172.21.15.124:0/1160512723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d9c06d100 0x7f8d8c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:33.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8da1329700 1 -- 172.21.15.124:0/1160512723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d8c003a00 msgr2=0x7f8d8c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T13:00:33.364 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8da1329700 1 --2- 172.21.15.124:0/1160512723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d8c003a00 0x7f8d8c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:33.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8da1329700 1 -- 172.21.15.124:0/1160512723 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8c0035b0 con 0x7f8d8c004d90 2023-10-16T13:00:33.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8da1329700 1 --2- 172.21.15.124:0/1160512723 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8d8c004d90 0x7f8d8c005210 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8d94009fc0 tx=0x7f8d8c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c54ef2886f0301a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:33.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8d9b7fe700 1 -- 172.21.15.124:0/1160512723 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9400ec30 con 0x7f8d8c004d90 2023-10-16T13:00:33.365 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8d9b7fe700 1 -- 172.21.15.124:0/1160512723 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9400f040 con 0x7f8d8c004d90 2023-10-16T13:00:33.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.353+0000 7f8d9b7fe700 1 -- 172.21.15.124:0/1160512723 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d94014480 con 0x7f8d8c004d90 2023-10-16T13:00:33.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.354+0000 7f8da2d8c700 1 -- 172.21.15.124:0/1160512723 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8d8c004d90 msgr2=0x7f8d8c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:33.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.354+0000 7f8da2d8c700 1 --2- 172.21.15.124:0/1160512723 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8d8c004d90 0x7f8d8c005210 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8d94009fc0 tx=0x7f8d8c005880 comp rx=0 tx=0).stop 2023-10-16T13:00:33.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.354+0000 7f8da1329700 1 -- 172.21.15.124:0/1160512723 reap_dead start 2023-10-16T13:00:33.366 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.354+0000 7f8da2d8c700 1 -- 172.21.15.124:0/1160512723 shutdown_connections 2023-10-16T13:00:33.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.354+0000 7f8da2d8c700 1 -- 172.21.15.124:0/1160512723 >> 172.21.15.124:0/1160512723 conn(0x7f8d9c0d0180 msgr2=0x7f8d9c0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:33.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.354+0000 7f8da2d8c700 1 -- 172.21.15.124:0/1160512723 shutdown_connections 2023-10-16T13:00:33.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.354+0000 7f8da2d8c700 1 -- 172.21.15.124:0/1160512723 wait complete. 2023-10-16T13:00:33.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.355+0000 7f8da2d8c700 1 Processor -- start 2023-10-16T13:00:33.367 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.355+0000 7f8da2d8c700 1 -- start start 2023-10-16T13:00:33.369 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.356+0000 7f8da2d8c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8d9c1f06f0 0x7f8d9c1f0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:33.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.356+0000 7f8da2d8c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d9c0c8010 0x7f8d9c0b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:33.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.356+0000 7f8da2d8c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d9c0b40b0 0x7f8d9c0b1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:33.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.356+0000 7f8da2d8c700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c1f1010 con 0x7f8d9c1f06f0 2023-10-16T13:00:33.370 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.356+0000 7f8da2d8c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c0b4550 con 0x7f8d9c0b40b0 2023-10-16T13:00:33.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.356+0000 7f8da2d8c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c0c7250 con 0x7f8d9c0c8010 2023-10-16T13:00:33.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.356+0000 7f8da0b28700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8d9c1f06f0 0x7f8d9c1f0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:33.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.356+0000 7f8da0b28700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8d9c1f06f0 0x7f8d9c1f0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:55858/0 (socket says 172.21.15.124:55858) 2023-10-16T13:00:33.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.356+0000 7f8da0b28700 1 -- 172.21.15.124:0/1470195423 learned_addr learned my addr 172.21.15.124:0/1470195423 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T13:00:33.371 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.356+0000 7f8d9bfff700 1 --2- 172.21.15.124:0/1470195423 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d9c0c8010 0x7f8d9c0b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:33.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.356+0000 7f8da1329700 1 --2- 172.21.15.124:0/1470195423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d9c0b40b0 0x7f8d9c0b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:33.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.357+0000 7f8da0b28700 1 -- 172.21.15.124:0/1470195423 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d9c0c8010 msgr2=0x7f8d9c0b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:33.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.357+0000 7f8da0b28700 1 --2- 172.21.15.124:0/1470195423 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d9c0c8010 0x7f8d9c0b3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:33.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.357+0000 7f8da0b28700 1 -- 172.21.15.124:0/1470195423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d9c0b40b0 msgr2=0x7f8d9c0b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:33.372 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.357+0000 7f8da0b28700 1 --2- 172.21.15.124:0/1470195423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d9c0b40b0 0x7f8d9c0b1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:33.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.357+0000 7f8da0b28700 1 -- 172.21.15.124:0/1470195423 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9c0c7530 con 0x7f8d9c1f06f0 2023-10-16T13:00:33.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.357+0000 7f8da0b28700 1 --2- 172.21.15.124:0/1470195423 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8d9c1f06f0 0x7f8d9c1f0ad0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8d90000c00 tx=0x7f8d90007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:33.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.357+0000 7f8d997fa700 1 -- 172.21.15.124:0/1470195423 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d90011ac0 con 0x7f8d9c1f06f0 2023-10-16T13:00:33.373 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.357+0000 7f8d997fa700 1 -- 172.21.15.124:0/1470195423 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d90011c40 con 0x7f8d9c1f06f0 2023-10-16T13:00:33.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.357+0000 7f8da2d8c700 1 -- 172.21.15.124:0/1470195423 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d9c0c7810 con 0x7f8d9c1f06f0 2023-10-16T13:00:33.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.357+0000 7f8d997fa700 1 -- 172.21.15.124:0/1470195423 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d90014370 con 0x7f8d9c1f06f0 2023-10-16T13:00:33.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.357+0000 7f8da2d8c700 1 -- 172.21.15.124:0/1470195423 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9c0b16a0 con 0x7f8d9c1f06f0 2023-10-16T13:00:33.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.358+0000 7f8da2d8c700 1 -- 172.21.15.124:0/1470195423 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d9c0b4690 con 0x7f8d9c1f06f0 2023-10-16T13:00:33.374 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.358+0000 7f8d997fa700 1 -- 172.21.15.124:0/1470195423 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8d900144d0 con 0x7f8d9c1f06f0 2023-10-16T13:00:33.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.359+0000 7f8d997fa700 1 --2- 172.21.15.124:0/1470195423 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f8d8006af00 0x7f8d8006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T13:00:33.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.359+0000 7f8d997fa700 1 -- 172.21.15.124:0/1470195423 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8d9008b720 con 0x7f8d9c1f06f0 2023-10-16T13:00:33.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.359+0000 7f8d9bfff700 1 --2- 172.21.15.124:0/1470195423 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f8d8006af00 0x7f8d8006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T13:00:33.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.359+0000 7f8d9bfff700 1 --2- 172.21.15.124:0/1470195423 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f8d8006af00 0x7f8d8006d3c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8d88009ce0 tx=0x7f8d88009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T13:00:33.375 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.363+0000 7f8d997fa700 1 -- 172.21.15.124:0/1470195423 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8d90056720 con 0x7f8d9c1f06f0 2023-10-16T13:00:33.633 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.630+0000 7f8da2d8c700 1 -- 172.21.15.124:0/1470195423 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f8d9c04ebb0 con 0x7f8d9c1f06f0 2023-10-16T13:00:33.633 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.630+0000 7f8d997fa700 1 -- 172.21.15.124:0/1470195423 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7f8d90059d40 con 0x7f8d9c1f06f0 2023-10-16T13:00:33.634 INFO:teuthology.orchestra.run.smithi124.stdout:[client.admin] 2023-10-16T13:00:33.634 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== 2023-10-16T13:00:33.636 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.632+0000 7f8da2d8c700 1 -- 172.21.15.124:0/1470195423 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f8d8006af00 msgr2=0x7f8d8006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:33.636 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.632+0000 7f8da2d8c700 1 --2- 172.21.15.124:0/1470195423 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f8d8006af00 0x7f8d8006d3c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8d88009ce0 tx=0x7f8d88009210 comp rx=0 tx=0).stop 2023-10-16T13:00:33.636 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.632+0000 7f8da2d8c700 1 -- 172.21.15.124:0/1470195423 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8d9c1f06f0 msgr2=0x7f8d9c1f0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T13:00:33.637 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.632+0000 7f8da2d8c700 1 --2- 172.21.15.124:0/1470195423 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8d9c1f06f0 0x7f8d9c1f0ad0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8d90000c00 tx=0x7f8d90007860 comp rx=0 tx=0).stop 2023-10-16T13:00:33.637 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.632+0000 7f8da2d8c700 1 -- 172.21.15.124:0/1470195423 shutdown_connections 2023-10-16T13:00:33.637 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.632+0000 7f8da2d8c700 1 --2- 172.21.15.124:0/1470195423 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f8d8006af00 0x7f8d8006d3c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:33.638 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.632+0000 7f8da2d8c700 1 --2- 172.21.15.124:0/1470195423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d9c0b40b0 0x7f8d9c0b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:33.638 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.632+0000 7f8da2d8c700 1 --2- 172.21.15.124:0/1470195423 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8d9c1f06f0 0x7f8d9c1f0ad0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:33.638 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.632+0000 7f8da2d8c700 1 --2- 172.21.15.124:0/1470195423 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d9c0c8010 0x7f8d9c0b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T13:00:33.638 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.632+0000 7f8da2d8c700 1 -- 172.21.15.124:0/1470195423 >> 172.21.15.124:0/1470195423 conn(0x7f8d9c0d0180 msgr2=0x7f8d9c0cb8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T13:00:33.639 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.632+0000 7f8da2d8c700 1 -- 172.21.15.124:0/1470195423 shutdown_connections 2023-10-16T13:00:33.639 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T13:00:33.632+0000 7f8da2d8c700 1 -- 172.21.15.124:0/1470195423 wait complete. 2023-10-16T13:00:33.648 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T13:00:33.648 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/tmp/tmp.pHbfHGg5qgxfstests-dev/local.config 2023-10-16T13:00:33.675 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.124:6789:/test export TEST_DIR=/tmp/tmp.I407zfbFe1test export SCRATCH_DEV=172.21.15.124:6789:/scratch export SCRATCH_MNT=/tmp/tmp.z8tNCKJUiGscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg==" 2023-10-16T13:00:33.676 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T13:00:33.676 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/tmp/tmp.pHbfHGg5qgxfstests-dev/ceph.exclude 2023-10-16T13:00:33.741 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo make) 2023-10-16T13:00:33.826 INFO:teuthology.orchestra.run.smithi124.stdout:libtoolize -cfi 2023-10-16T13:00:34.147 INFO:teuthology.orchestra.run.smithi124.stdout:libtoolize: putting auxiliary files in '.'. 2023-10-16T13:00:34.147 INFO:teuthology.orchestra.run.smithi124.stdout:libtoolize: copying file './config.guess' 2023-10-16T13:00:34.150 INFO:teuthology.orchestra.run.smithi124.stdout:libtoolize: copying file './config.sub' 2023-10-16T13:00:34.153 INFO:teuthology.orchestra.run.smithi124.stdout:libtoolize: copying file './install-sh' 2023-10-16T13:00:34.157 INFO:teuthology.orchestra.run.smithi124.stdout:libtoolize: copying file './ltmain.sh' 2023-10-16T13:00:34.177 INFO:teuthology.orchestra.run.smithi124.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-10-16T13:00:34.177 INFO:teuthology.orchestra.run.smithi124.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-10-16T13:00:34.181 INFO:teuthology.orchestra.run.smithi124.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-10-16T13:00:34.186 INFO:teuthology.orchestra.run.smithi124.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-10-16T13:00:34.190 INFO:teuthology.orchestra.run.smithi124.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-10-16T13:00:34.195 INFO:teuthology.orchestra.run.smithi124.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-10-16T13:00:34.200 INFO:teuthology.orchestra.run.smithi124.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-10-16T13:00:34.201 INFO:teuthology.orchestra.run.smithi124.stdout:cp include/install-sh . 2023-10-16T13:00:34.202 INFO:teuthology.orchestra.run.smithi124.stdout:aclocal -I m4 2023-10-16T13:00:35.365 INFO:teuthology.orchestra.run.smithi124.stdout:autoheader 2023-10-16T13:00:35.664 INFO:teuthology.orchestra.run.smithi124.stdout:autoconf 2023-10-16T13:00:35.822 INFO:teuthology.orchestra.run.smithi124.stdout:./configure \ 2023-10-16T13:00:35.822 INFO:teuthology.orchestra.run.smithi124.stdout: --libexecdir=/usr/lib \ 2023-10-16T13:00:35.823 INFO:teuthology.orchestra.run.smithi124.stdout: --exec_prefix=/var/lib 2023-10-16T13:00:36.281 INFO:teuthology.orchestra.run.smithi124.stdout:checking build system type... x86_64-pc-linux-gnu 2023-10-16T13:00:36.282 INFO:teuthology.orchestra.run.smithi124.stdout:checking host system type... x86_64-pc-linux-gnu 2023-10-16T13:00:36.283 INFO:teuthology.orchestra.run.smithi124.stdout:checking how to print strings... printf 2023-10-16T13:00:36.283 INFO:teuthology.orchestra.run.smithi124.stdout:checking for gcc... gcc 2023-10-16T13:00:36.412 INFO:teuthology.orchestra.run.smithi124.stdout:checking whether the C compiler works... yes 2023-10-16T13:00:36.412 INFO:teuthology.orchestra.run.smithi124.stdout:checking for C compiler default output file name... a.out 2023-10-16T13:00:36.439 INFO:teuthology.orchestra.run.smithi124.stdout:checking for suffix of executables... 2023-10-16T13:00:36.490 INFO:teuthology.orchestra.run.smithi124.stdout:checking whether we are cross compiling... no 2023-10-16T13:00:36.508 INFO:teuthology.orchestra.run.smithi124.stdout:checking for suffix of object files... o 2023-10-16T13:00:36.524 INFO:teuthology.orchestra.run.smithi124.stdout:checking whether we are using the GNU C compiler... yes 2023-10-16T13:00:36.539 INFO:teuthology.orchestra.run.smithi124.stdout:checking whether gcc accepts -g... yes 2023-10-16T13:00:36.565 INFO:teuthology.orchestra.run.smithi124.stdout:checking for gcc option to accept ISO C89... none needed 2023-10-16T13:00:36.568 INFO:teuthology.orchestra.run.smithi124.stdout:checking for a sed that does not truncate output... /bin/sed 2023-10-16T13:00:36.570 INFO:teuthology.orchestra.run.smithi124.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-10-16T13:00:36.571 INFO:teuthology.orchestra.run.smithi124.stdout:checking for egrep... /bin/grep -E 2023-10-16T13:00:36.572 INFO:teuthology.orchestra.run.smithi124.stdout:checking for fgrep... /bin/grep -F 2023-10-16T13:00:36.575 INFO:teuthology.orchestra.run.smithi124.stdout:checking for ld used by gcc... /bin/ld 2023-10-16T13:00:36.577 INFO:teuthology.orchestra.run.smithi124.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-10-16T13:00:36.585 INFO:teuthology.orchestra.run.smithi124.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-10-16T13:00:36.601 INFO:teuthology.orchestra.run.smithi124.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-10-16T13:00:36.602 INFO:teuthology.orchestra.run.smithi124.stdout:checking whether ln -s works... yes 2023-10-16T13:00:36.611 INFO:teuthology.orchestra.run.smithi124.stdout:checking the maximum length of command line arguments... 1572864 2023-10-16T13:00:36.614 INFO:teuthology.orchestra.run.smithi124.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-10-16T13:00:36.614 INFO:teuthology.orchestra.run.smithi124.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-10-16T13:00:36.614 INFO:teuthology.orchestra.run.smithi124.stdout:checking for /bin/ld option to reload object files... -r 2023-10-16T13:00:36.615 INFO:teuthology.orchestra.run.smithi124.stdout:checking for objdump... objdump 2023-10-16T13:00:36.616 INFO:teuthology.orchestra.run.smithi124.stdout:checking how to recognize dependent libraries... pass_all 2023-10-16T13:00:36.616 INFO:teuthology.orchestra.run.smithi124.stdout:checking for dlltool... no 2023-10-16T13:00:36.616 INFO:teuthology.orchestra.run.smithi124.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-10-16T13:00:36.616 INFO:teuthology.orchestra.run.smithi124.stdout:checking for ar... ar 2023-10-16T13:00:36.647 INFO:teuthology.orchestra.run.smithi124.stdout:checking for archiver @FILE support... @ 2023-10-16T13:00:36.647 INFO:teuthology.orchestra.run.smithi124.stdout:checking for strip... strip 2023-10-16T13:00:36.647 INFO:teuthology.orchestra.run.smithi124.stdout:checking for ranlib... ranlib 2023-10-16T13:00:36.648 INFO:teuthology.orchestra.run.smithi124.stdout:checking for gawk... gawk 2023-10-16T13:00:36.697 INFO:teuthology.orchestra.run.smithi124.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-10-16T13:00:36.698 INFO:teuthology.orchestra.run.smithi124.stdout:checking for sysroot... no 2023-10-16T13:00:36.701 INFO:teuthology.orchestra.run.smithi124.stdout:checking for a working dd... /bin/dd 2023-10-16T13:00:36.703 INFO:teuthology.orchestra.run.smithi124.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-10-16T13:00:36.715 INFO:teuthology.orchestra.run.smithi124.stdout:checking for mt... no 2023-10-16T13:00:36.717 INFO:teuthology.orchestra.run.smithi124.stdout:checking if : is a manifest tool... no 2023-10-16T13:00:36.743 INFO:teuthology.orchestra.run.smithi124.stdout:checking how to run the C preprocessor... gcc -E 2023-10-16T13:00:36.877 INFO:teuthology.orchestra.run.smithi124.stdout:checking for ANSI C header files... yes 2023-10-16T13:00:36.897 INFO:teuthology.orchestra.run.smithi124.stdout:checking for sys/types.h... yes 2023-10-16T13:00:36.920 INFO:teuthology.orchestra.run.smithi124.stdout:checking for sys/stat.h... yes 2023-10-16T13:00:36.942 INFO:teuthology.orchestra.run.smithi124.stdout:checking for stdlib.h... yes 2023-10-16T13:00:36.966 INFO:teuthology.orchestra.run.smithi124.stdout:checking for string.h... yes 2023-10-16T13:00:36.990 INFO:teuthology.orchestra.run.smithi124.stdout:checking for memory.h... yes 2023-10-16T13:00:37.013 INFO:teuthology.orchestra.run.smithi124.stdout:checking for strings.h... yes 2023-10-16T13:00:37.039 INFO:teuthology.orchestra.run.smithi124.stdout:checking for inttypes.h... yes 2023-10-16T13:00:37.063 INFO:teuthology.orchestra.run.smithi124.stdout:checking for stdint.h... yes 2023-10-16T13:00:37.090 INFO:teuthology.orchestra.run.smithi124.stdout:checking for unistd.h... yes 2023-10-16T13:00:37.115 INFO:teuthology.orchestra.run.smithi124.stdout:checking for dlfcn.h... yes 2023-10-16T13:00:37.118 INFO:teuthology.orchestra.run.smithi124.stdout:checking for objdir... .libs 2023-10-16T13:00:37.182 INFO:teuthology.orchestra.run.smithi124.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-10-16T13:00:37.183 INFO:teuthology.orchestra.run.smithi124.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-10-16T13:00:37.198 INFO:teuthology.orchestra.run.smithi124.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-10-16T13:00:37.216 INFO:teuthology.orchestra.run.smithi124.stdout:checking if gcc static flag -static works... no 2023-10-16T13:00:37.236 INFO:teuthology.orchestra.run.smithi124.stdout:checking if gcc supports -c -o file.o... yes 2023-10-16T13:00:37.237 INFO:teuthology.orchestra.run.smithi124.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-10-16T13:00:37.242 INFO:teuthology.orchestra.run.smithi124.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-10-16T13:00:37.266 INFO:teuthology.orchestra.run.smithi124.stdout:checking whether -lc should be explicitly linked in... no 2023-10-16T13:00:37.309 INFO:teuthology.orchestra.run.smithi124.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-10-16T13:00:37.309 INFO:teuthology.orchestra.run.smithi124.stdout:checking how to hardcode library paths into programs... immediate 2023-10-16T13:00:37.316 INFO:teuthology.orchestra.run.smithi124.stdout:checking whether stripping libraries is possible... yes 2023-10-16T13:00:37.316 INFO:teuthology.orchestra.run.smithi124.stdout:checking if libtool supports shared libraries... yes 2023-10-16T13:00:37.316 INFO:teuthology.orchestra.run.smithi124.stdout:checking whether to build shared libraries... yes 2023-10-16T13:00:37.316 INFO:teuthology.orchestra.run.smithi124.stdout:checking whether to build static libraries... yes 2023-10-16T13:00:37.320 INFO:teuthology.orchestra.run.smithi124.stdout:checking for gcc... (cached) gcc 2023-10-16T13:00:37.335 INFO:teuthology.orchestra.run.smithi124.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-10-16T13:00:37.336 INFO:teuthology.orchestra.run.smithi124.stdout:checking whether gcc accepts -g... (cached) yes 2023-10-16T13:00:37.336 INFO:teuthology.orchestra.run.smithi124.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-10-16T13:00:37.336 INFO:teuthology.orchestra.run.smithi124.stdout:checking for gmake... /usr/bin/gmake 2023-10-16T13:00:37.337 INFO:teuthology.orchestra.run.smithi124.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-10-16T13:00:37.337 INFO:teuthology.orchestra.run.smithi124.stdout:checking for tar... /bin/tar 2023-10-16T13:00:37.338 INFO:teuthology.orchestra.run.smithi124.stdout:checking for gzip... /bin/gzip 2023-10-16T13:00:37.343 INFO:teuthology.orchestra.run.smithi124.stdout:checking whether gcc -MM is supported... yes 2023-10-16T13:00:37.344 INFO:teuthology.orchestra.run.smithi124.stdout:checking for sort... /bin/sort 2023-10-16T13:00:37.344 INFO:teuthology.orchestra.run.smithi124.stdout:checking whether ln -s works... yes 2023-10-16T13:00:37.344 INFO:teuthology.orchestra.run.smithi124.stdout:checking for rpm... /bin/rpm 2023-10-16T13:00:37.348 INFO:teuthology.orchestra.run.smithi124.stdout:checking for rpmbuild... no 2023-10-16T13:00:37.372 INFO:teuthology.orchestra.run.smithi124.stdout:checking assert.h usability... yes 2023-10-16T13:00:37.379 INFO:teuthology.orchestra.run.smithi124.stdout:checking assert.h presence... yes 2023-10-16T13:00:37.379 INFO:teuthology.orchestra.run.smithi124.stdout:checking for assert.h... yes 2023-10-16T13:00:37.404 INFO:teuthology.orchestra.run.smithi124.stdout:checking bstring.h usability... no 2023-10-16T13:00:37.413 INFO:teuthology.orchestra.run.smithi124.stdout:checking bstring.h presence... no 2023-10-16T13:00:37.414 INFO:teuthology.orchestra.run.smithi124.stdout:checking for bstring.h... no 2023-10-16T13:00:37.437 INFO:teuthology.orchestra.run.smithi124.stdout:checking libgen.h usability... yes 2023-10-16T13:00:37.443 INFO:teuthology.orchestra.run.smithi124.stdout:checking libgen.h presence... yes 2023-10-16T13:00:37.444 INFO:teuthology.orchestra.run.smithi124.stdout:checking for libgen.h... yes 2023-10-16T13:00:37.473 INFO:teuthology.orchestra.run.smithi124.stdout:checking dirent.h usability... yes 2023-10-16T13:00:37.480 INFO:teuthology.orchestra.run.smithi124.stdout:checking dirent.h presence... yes 2023-10-16T13:00:37.480 INFO:teuthology.orchestra.run.smithi124.stdout:checking for dirent.h... yes 2023-10-16T13:00:37.528 INFO:teuthology.orchestra.run.smithi124.stdout:checking errno.h usability... yes 2023-10-16T13:00:37.535 INFO:teuthology.orchestra.run.smithi124.stdout:checking errno.h presence... yes 2023-10-16T13:00:37.535 INFO:teuthology.orchestra.run.smithi124.stdout:checking for errno.h... yes 2023-10-16T13:00:37.562 INFO:teuthology.orchestra.run.smithi124.stdout:checking malloc.h usability... yes 2023-10-16T13:00:37.569 INFO:teuthology.orchestra.run.smithi124.stdout:checking malloc.h presence... yes 2023-10-16T13:00:37.570 INFO:teuthology.orchestra.run.smithi124.stdout:checking for malloc.h... yes 2023-10-16T13:00:37.595 INFO:teuthology.orchestra.run.smithi124.stdout:checking uuid.h usability... no 2023-10-16T13:00:37.604 INFO:teuthology.orchestra.run.smithi124.stdout:checking uuid.h presence... no 2023-10-16T13:00:37.604 INFO:teuthology.orchestra.run.smithi124.stdout:checking for uuid.h... no 2023-10-16T13:00:37.630 INFO:teuthology.orchestra.run.smithi124.stdout:checking uuid/uuid.h usability... yes 2023-10-16T13:00:37.638 INFO:teuthology.orchestra.run.smithi124.stdout:checking uuid/uuid.h presence... yes 2023-10-16T13:00:37.638 INFO:teuthology.orchestra.run.smithi124.stdout:checking for uuid/uuid.h... yes 2023-10-16T13:00:37.664 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/uuid.h usability... no 2023-10-16T13:00:37.673 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/uuid.h presence... no 2023-10-16T13:00:37.674 INFO:teuthology.orchestra.run.smithi124.stdout:checking for sys/uuid.h... no 2023-10-16T13:00:37.698 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/file.h usability... yes 2023-10-16T13:00:37.706 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/file.h presence... yes 2023-10-16T13:00:37.706 INFO:teuthology.orchestra.run.smithi124.stdout:checking for sys/file.h... yes 2023-10-16T13:00:37.732 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/fcntl.h usability... yes 2023-10-16T13:00:37.739 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/fcntl.h presence... yes 2023-10-16T13:00:37.739 INFO:teuthology.orchestra.run.smithi124.stdout:checking for sys/fcntl.h... yes 2023-10-16T13:00:37.765 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/syssgi.h usability... no 2023-10-16T13:00:37.774 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/syssgi.h presence... no 2023-10-16T13:00:37.774 INFO:teuthology.orchestra.run.smithi124.stdout:checking for sys/syssgi.h... no 2023-10-16T13:00:37.815 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/param.h usability... yes 2023-10-16T13:00:37.824 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/param.h presence... yes 2023-10-16T13:00:37.824 INFO:teuthology.orchestra.run.smithi124.stdout:checking for sys/param.h... yes 2023-10-16T13:00:37.829 INFO:teuthology.orchestra.run.smithi124.stdout:checking for sys/stat.h... (cached) yes 2023-10-16T13:00:37.856 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/statvfs.h usability... yes 2023-10-16T13:00:37.863 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/statvfs.h presence... yes 2023-10-16T13:00:37.863 INFO:teuthology.orchestra.run.smithi124.stdout:checking for sys/statvfs.h... yes 2023-10-16T13:00:37.889 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/time.h usability... yes 2023-10-16T13:00:37.896 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/time.h presence... yes 2023-10-16T13:00:37.896 INFO:teuthology.orchestra.run.smithi124.stdout:checking for sys/time.h... yes 2023-10-16T13:00:37.925 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/ioctl.h usability... yes 2023-10-16T13:00:37.931 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/ioctl.h presence... yes 2023-10-16T13:00:37.932 INFO:teuthology.orchestra.run.smithi124.stdout:checking for sys/ioctl.h... yes 2023-10-16T13:00:37.960 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/wait.h usability... yes 2023-10-16T13:00:37.968 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/wait.h presence... yes 2023-10-16T13:00:37.968 INFO:teuthology.orchestra.run.smithi124.stdout:checking for sys/wait.h... yes 2023-10-16T13:00:37.973 INFO:teuthology.orchestra.run.smithi124.stdout:checking for sys/types.h... (cached) yes 2023-10-16T13:00:37.977 INFO:teuthology.orchestra.run.smithi124.stdout:checking for strings.h... (cached) yes 2023-10-16T13:00:38.003 INFO:teuthology.orchestra.run.smithi124.stdout:checking err.h usability... yes 2023-10-16T13:00:38.010 INFO:teuthology.orchestra.run.smithi124.stdout:checking err.h presence... yes 2023-10-16T13:00:38.011 INFO:teuthology.orchestra.run.smithi124.stdout:checking for err.h... yes 2023-10-16T13:00:38.037 INFO:teuthology.orchestra.run.smithi124.stdout:checking linux/falloc.h usability... yes 2023-10-16T13:00:38.043 INFO:teuthology.orchestra.run.smithi124.stdout:checking linux/falloc.h presence... yes 2023-10-16T13:00:38.044 INFO:teuthology.orchestra.run.smithi124.stdout:checking for linux/falloc.h... yes 2023-10-16T13:00:38.068 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-10-16T13:00:38.078 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-10-16T13:00:38.078 INFO:teuthology.orchestra.run.smithi124.stdout:checking for sys/fs/xfs_fsops.h... no 2023-10-16T13:00:38.100 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/fs/xfs_itable.h usability... no 2023-10-16T13:00:38.109 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/fs/xfs_itable.h presence... no 2023-10-16T13:00:38.110 INFO:teuthology.orchestra.run.smithi124.stdout:checking for sys/fs/xfs_itable.h... no 2023-10-16T13:00:38.132 INFO:teuthology.orchestra.run.smithi124.stdout:checking xfs/platform_defs.h usability... no 2023-10-16T13:00:38.141 INFO:teuthology.orchestra.run.smithi124.stdout:checking xfs/platform_defs.h presence... no 2023-10-16T13:00:38.141 INFO:teuthology.orchestra.run.smithi124.stdout:checking for xfs/platform_defs.h... no 2023-10-16T13:00:38.164 INFO:teuthology.orchestra.run.smithi124.stdout:checking btrfs/ioctl.h usability... no 2023-10-16T13:00:38.173 INFO:teuthology.orchestra.run.smithi124.stdout:checking btrfs/ioctl.h presence... no 2023-10-16T13:00:38.173 INFO:teuthology.orchestra.run.smithi124.stdout:checking for btrfs/ioctl.h... no 2023-10-16T13:00:38.195 INFO:teuthology.orchestra.run.smithi124.stdout:checking cifs/ioctl.h usability... no 2023-10-16T13:00:38.204 INFO:teuthology.orchestra.run.smithi124.stdout:checking cifs/ioctl.h presence... no 2023-10-16T13:00:38.205 INFO:teuthology.orchestra.run.smithi124.stdout:checking for cifs/ioctl.h... no 2023-10-16T13:00:38.229 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/mman.h usability... yes 2023-10-16T13:00:38.237 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/mman.h presence... yes 2023-10-16T13:00:38.237 INFO:teuthology.orchestra.run.smithi124.stdout:checking for sys/mman.h... yes 2023-10-16T13:00:38.260 INFO:teuthology.orchestra.run.smithi124.stdout:checking for xfs/xfs_log_format.h... no 2023-10-16T13:00:38.293 INFO:teuthology.orchestra.run.smithi124.stdout:checking for uuid_compare... no 2023-10-16T13:00:38.322 INFO:teuthology.orchestra.run.smithi124.stdout:checking for uuid_compare in -luuid... yes 2023-10-16T13:00:38.375 INFO:teuthology.orchestra.run.smithi124.stdout:checking for xfs/xfs.h... yes 2023-10-16T13:00:38.388 INFO:teuthology.orchestra.run.smithi124.stdout:checking for xfs/libxfs.h... no 2023-10-16T13:00:38.403 INFO:teuthology.orchestra.run.smithi124.stdout:checking whether xlog_assign_lsn is declared... no 2023-10-16T13:00:38.429 INFO:teuthology.orchestra.run.smithi124.stdout:checking for xfs/xqm.h... yes 2023-10-16T13:00:38.473 INFO:teuthology.orchestra.run.smithi124.stdout:checking xfsctl from xfs/xfs.h... ok 2023-10-16T13:00:38.495 INFO:teuthology.orchestra.run.smithi124.stdout:checking xfs/handle.h usability... yes 2023-10-16T13:00:38.502 INFO:teuthology.orchestra.run.smithi124.stdout:checking xfs/handle.h presence... yes 2023-10-16T13:00:38.502 INFO:teuthology.orchestra.run.smithi124.stdout:checking for xfs/handle.h... yes 2023-10-16T13:00:38.540 INFO:teuthology.orchestra.run.smithi124.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-10-16T13:00:38.575 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/acl.h usability... yes 2023-10-16T13:00:38.583 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/acl.h presence... yes 2023-10-16T13:00:38.583 INFO:teuthology.orchestra.run.smithi124.stdout:checking for sys/acl.h... yes 2023-10-16T13:00:38.613 INFO:teuthology.orchestra.run.smithi124.stdout:checking acl/libacl.h usability... yes 2023-10-16T13:00:38.621 INFO:teuthology.orchestra.run.smithi124.stdout:checking acl/libacl.h presence... yes 2023-10-16T13:00:38.621 INFO:teuthology.orchestra.run.smithi124.stdout:checking for acl/libacl.h... yes 2023-10-16T13:00:38.652 INFO:teuthology.orchestra.run.smithi124.stdout:checking for acl_init in -lacl... yes 2023-10-16T13:00:38.674 INFO:teuthology.orchestra.run.smithi124.stdout:checking gdbm-ndbm.h usability... no 2023-10-16T13:00:38.683 INFO:teuthology.orchestra.run.smithi124.stdout:checking gdbm-ndbm.h presence... no 2023-10-16T13:00:38.683 INFO:teuthology.orchestra.run.smithi124.stdout:checking for gdbm-ndbm.h... no 2023-10-16T13:00:38.703 INFO:teuthology.orchestra.run.smithi124.stdout:checking gdbm/ndbm.h usability... no 2023-10-16T13:00:38.713 INFO:teuthology.orchestra.run.smithi124.stdout:checking gdbm/ndbm.h presence... no 2023-10-16T13:00:38.713 INFO:teuthology.orchestra.run.smithi124.stdout:checking for gdbm/ndbm.h... no 2023-10-16T13:00:38.734 INFO:teuthology.orchestra.run.smithi124.stdout:checking ndbm.h usability... no 2023-10-16T13:00:38.743 INFO:teuthology.orchestra.run.smithi124.stdout:checking ndbm.h presence... no 2023-10-16T13:00:38.743 INFO:teuthology.orchestra.run.smithi124.stdout:checking for ndbm.h... no 2023-10-16T13:00:38.767 INFO:teuthology.orchestra.run.smithi124.stdout:checking libaio.h usability... yes 2023-10-16T13:00:38.777 INFO:teuthology.orchestra.run.smithi124.stdout:checking libaio.h presence... yes 2023-10-16T13:00:38.778 INFO:teuthology.orchestra.run.smithi124.stdout:checking for libaio.h... yes 2023-10-16T13:00:38.799 INFO:teuthology.orchestra.run.smithi124.stdout:checking liburing.h usability... no 2023-10-16T13:00:38.808 INFO:teuthology.orchestra.run.smithi124.stdout:checking liburing.h presence... no 2023-10-16T13:00:38.808 INFO:teuthology.orchestra.run.smithi124.stdout:checking for liburing.h... no 2023-10-16T13:00:38.829 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/capability.h usability... no 2023-10-16T13:00:38.838 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/capability.h presence... no 2023-10-16T13:00:38.838 INFO:teuthology.orchestra.run.smithi124.stdout:checking for sys/capability.h... no 2023-10-16T13:00:38.860 INFO:teuthology.orchestra.run.smithi124.stdout:checking linux/fiemap.h usability... yes 2023-10-16T13:00:38.866 INFO:teuthology.orchestra.run.smithi124.stdout:checking linux/fiemap.h presence... yes 2023-10-16T13:00:38.867 INFO:teuthology.orchestra.run.smithi124.stdout:checking for linux/fiemap.h... yes 2023-10-16T13:00:38.898 INFO:teuthology.orchestra.run.smithi124.stdout:checking for fallocate... yes 2023-10-16T13:00:38.929 INFO:teuthology.orchestra.run.smithi124.stdout:checking for open_by_handle_at... yes 2023-10-16T13:00:38.952 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/prctl.h usability... yes 2023-10-16T13:00:38.959 INFO:teuthology.orchestra.run.smithi124.stdout:checking sys/prctl.h presence... yes 2023-10-16T13:00:38.960 INFO:teuthology.orchestra.run.smithi124.stdout:checking for sys/prctl.h... yes 2023-10-16T13:00:38.983 INFO:teuthology.orchestra.run.smithi124.stdout:checking linux/fs.h usability... yes 2023-10-16T13:00:38.990 INFO:teuthology.orchestra.run.smithi124.stdout:checking linux/fs.h presence... yes 2023-10-16T13:00:38.990 INFO:teuthology.orchestra.run.smithi124.stdout:checking for linux/fs.h... yes 2023-10-16T13:00:39.010 INFO:teuthology.orchestra.run.smithi124.stdout:checking btrfsutil.h usability... no 2023-10-16T13:00:39.019 INFO:teuthology.orchestra.run.smithi124.stdout:checking btrfsutil.h presence... no 2023-10-16T13:00:39.020 INFO:teuthology.orchestra.run.smithi124.stdout:checking for btrfsutil.h... no 2023-10-16T13:00:39.053 INFO:teuthology.orchestra.run.smithi124.stdout:checking for copy_file_range... yes 2023-10-16T13:00:39.087 INFO:teuthology.orchestra.run.smithi124.stdout:checking for SEEK_DATA... yes 2023-10-16T13:00:39.131 INFO:teuthology.orchestra.run.smithi124.stdout:checking for BMV_OF_SHARED... yes 2023-10-16T13:00:39.166 INFO:teuthology.orchestra.run.smithi124.stdout:checking for nftw... yes 2023-10-16T13:00:39.198 INFO:teuthology.orchestra.run.smithi124.stdout:checking for RLIMIT_NOFILE... yes 2023-10-16T13:00:39.215 INFO:teuthology.orchestra.run.smithi124.stdout:checking for FIEXCHANGE_RANGE... no 2023-10-16T13:00:39.246 INFO:teuthology.orchestra.run.smithi124.stdout:checking for renameat2... yes 2023-10-16T13:00:39.278 INFO:teuthology.orchestra.run.smithi124.stdout:checking for reallocarray... yes 2023-10-16T13:00:39.291 INFO:teuthology.orchestra.run.smithi124.stdout:checking for struct mount_attr... no 2023-10-16T13:00:39.324 INFO:teuthology.orchestra.run.smithi124.stdout:checking for struct btrfs_qgroup_limit... yes 2023-10-16T13:00:39.357 INFO:teuthology.orchestra.run.smithi124.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-10-16T13:00:39.390 INFO:teuthology.orchestra.run.smithi124.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-10-16T13:00:39.424 INFO:teuthology.orchestra.run.smithi124.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-10-16T13:00:39.457 INFO:teuthology.orchestra.run.smithi124.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-10-16T13:00:39.491 INFO:teuthology.orchestra.run.smithi124.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-10-16T13:00:39.524 INFO:teuthology.orchestra.run.smithi124.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-10-16T13:00:39.549 INFO:teuthology.orchestra.run.smithi124.stdout:checking linux/btrfs.h usability... yes 2023-10-16T13:00:39.556 INFO:teuthology.orchestra.run.smithi124.stdout:checking linux/btrfs.h presence... yes 2023-10-16T13:00:39.556 INFO:teuthology.orchestra.run.smithi124.stdout:checking for linux/btrfs.h... yes 2023-10-16T13:00:39.584 INFO:teuthology.orchestra.run.smithi124.stdout:checking linux/btrfs_tree.h usability... yes 2023-10-16T13:00:39.591 INFO:teuthology.orchestra.run.smithi124.stdout:checking linux/btrfs_tree.h presence... yes 2023-10-16T13:00:39.591 INFO:teuthology.orchestra.run.smithi124.stdout:checking for linux/btrfs_tree.h... yes 2023-10-16T13:00:39.621 INFO:teuthology.orchestra.run.smithi124.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-10-16T13:00:39.636 INFO:teuthology.orchestra.run.smithi124.stdout:configure: creating ./config.status 2023-10-16T13:00:39.929 INFO:teuthology.orchestra.run.smithi124.stdout:config.status: creating include/builddefs 2023-10-16T13:00:39.939 INFO:teuthology.orchestra.run.smithi124.stdout:config.status: creating include/config.h 2023-10-16T13:00:39.947 INFO:teuthology.orchestra.run.smithi124.stdout:config.status: executing libtool commands 2023-10-16T13:00:39.983 INFO:teuthology.orchestra.run.smithi124.stdout:Building include 2023-10-16T13:00:39.986 INFO:teuthology.orchestra.run.smithi124.stdout:Building lib 2023-10-16T13:00:39.989 INFO:teuthology.orchestra.run.smithi124.stdout: [LTDEP] 2023-10-16T13:00:40.094 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] dataascii.lo 2023-10-16T13:00:40.205 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] databin.lo 2023-10-16T13:00:40.341 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] datapid.lo 2023-10-16T13:00:40.436 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] file_lock.lo 2023-10-16T13:00:40.572 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] forker.lo 2023-10-16T13:00:40.694 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] pattern.lo 2023-10-16T13:00:40.807 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] open_flags.lo 2023-10-16T13:00:40.937 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] random_range.lo 2023-10-16T13:00:41.144 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] string_to_tokens.lo 2023-10-16T13:00:41.244 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] str_to_bytes.lo 2023-10-16T13:00:41.364 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] tlibio.lo 2023-10-16T13:00:41.575 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] write_log.lo 2023-10-16T13:00:41.793 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] random.lo 2023-10-16T13:00:41.906 INFO:teuthology.orchestra.run.smithi124.stdout: [LD] 2023-10-16T13:00:41.980 INFO:teuthology.orchestra.run.smithi124.stdout:Building ltp 2023-10-16T13:00:41.983 INFO:teuthology.orchestra.run.smithi124.stdout: [DEP] 2023-10-16T13:00:42.108 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] doio 2023-10-16T13:00:42.693 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] fsstress 2023-10-16T13:00:43.876 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] fsx 2023-10-16T13:00:44.649 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] growfiles 2023-10-16T13:00:45.102 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] iogen 2023-10-16T13:00:45.419 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] aio-stress 2023-10-16T13:00:45.800 INFO:teuthology.orchestra.run.smithi124.stdout:Building src 2023-10-16T13:00:45.806 INFO:teuthology.orchestra.run.smithi124.stdout: [DEP] 2023-10-16T13:00:47.138 INFO:teuthology.orchestra.run.smithi124.stdout: [DEP] 2023-10-16T13:00:47.162 INFO:teuthology.orchestra.run.smithi124.stdout: [DEP] 2023-10-16T13:00:47.170 INFO:teuthology.orchestra.run.smithi124.stdout: [DEP] 2023-10-16T13:00:47.346 INFO:teuthology.orchestra.run.smithi124.stdout: [DEP] 2023-10-16T13:00:47.367 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] dirstress 2023-10-16T13:00:47.578 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] fill 2023-10-16T13:00:47.720 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] fill2 2023-10-16T13:00:47.926 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] getpagesize 2023-10-16T13:00:48.048 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] holes 2023-10-16T13:00:48.226 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] lstat64 2023-10-16T13:00:48.387 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] nametest 2023-10-16T13:00:48.600 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] permname 2023-10-16T13:00:48.780 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] randholes 2023-10-16T13:00:49.002 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] runas 2023-10-16T13:00:49.159 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] truncfile 2023-10-16T13:00:49.319 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] usemem 2023-10-16T13:00:49.456 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] mmapcat 2023-10-16T13:00:49.592 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] append_reader 2023-10-16T13:00:49.730 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] append_writer 2023-10-16T13:00:49.866 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] dirperf 2023-10-16T13:00:50.062 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] metaperf 2023-10-16T13:00:50.289 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] devzero 2023-10-16T13:00:50.431 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:00:50.434 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:00:50.447 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] feature 2023-10-16T13:00:50.643 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] alloc 2023-10-16T13:00:50.839 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] fault 2023-10-16T13:00:50.987 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] fstest 2023-10-16T13:00:51.198 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_access_root 2023-10-16T13:00:51.338 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] godown 2023-10-16T13:00:51.491 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] resvtest 2023-10-16T13:00:51.658 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] writemod 2023-10-16T13:00:51.792 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] writev_on_pagefault 2023-10-16T13:00:51.938 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] makeextents 2023-10-16T13:00:52.097 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] itrash 2023-10-16T13:00:52.239 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] rename 2023-10-16T13:00:52.366 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] multi_open_unlink 2023-10-16T13:00:52.515 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] unwritten_sync 2023-10-16T13:00:52.679 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] genhashnames 2023-10-16T13:00:52.848 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_holes 2023-10-16T13:00:52.982 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_mmap_writev 2023-10-16T13:00:53.117 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_truncate_cmtime 2023-10-16T13:00:53.260 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] dirhash_collide 2023-10-16T13:00:53.425 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_rename_overwrite 2023-10-16T13:00:53.555 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] holetest 2023-10-16T13:00:53.755 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_truncate_self 2023-10-16T13:00:53.883 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] af_unix 2023-10-16T13:00:54.021 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_mmap_stale_pmd 2023-10-16T13:00:54.160 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_mmap_cow_race 2023-10-16T13:00:54.309 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_mmap_fallocate 2023-10-16T13:00:54.448 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] fsync-err 2023-10-16T13:00:54.614 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_mmap_write_ro 2023-10-16T13:00:54.753 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_ext4_dax_journal_corruption 2023-10-16T13:00:54.897 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_ext4_dax_inline_corruption 2023-10-16T13:00:55.038 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_ofd_locks 2023-10-16T13:00:55.215 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_mmap_collision 2023-10-16T13:00:55.392 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] mmap-write-concurrent 2023-10-16T13:00:55.547 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_get_file_time 2023-10-16T13:00:55.681 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_create_short_dirs 2023-10-16T13:00:55.833 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_create_long_dirs 2023-10-16T13:00:55.982 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_enospc 2023-10-16T13:00:56.149 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_mmap_writev_overlap 2023-10-16T13:00:56.302 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] checkpoint_journal 2023-10-16T13:00:56.444 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] mmap-rw-fault 2023-10-16T13:00:56.611 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] allocstale 2023-10-16T13:00:56.764 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_mmap_cow_memory_failure 2023-10-16T13:00:56.918 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] fake-dump-rootino 2023-10-16T13:00:57.054 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] dio-buf-fault 2023-10-16T13:00:57.196 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] rewinddir-test 2023-10-16T13:00:57.349 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] xfsctl 2023-10-16T13:00:57.519 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] bstat 2023-10-16T13:00:57.703 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_mtab 2023-10-16T13:00:57.870 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] getdevicesize 2023-10-16T13:00:58.000 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] preallo_rw_pattern_reader 2023-10-16T13:00:58.144 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] preallo_rw_pattern_writer 2023-10-16T13:00:58.287 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] ftrunc 2023-10-16T13:00:58.422 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] trunc 2023-10-16T13:00:58.570 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] fs_perms 2023-10-16T13:00:58.720 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] testx 2023-10-16T13:00:58.841 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] looptest 2023-10-16T13:00:59.015 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] locktest 2023-10-16T13:00:59.290 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] unwritten_mmap 2023-10-16T13:00:59.439 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] bulkstat_unlink_test 2023-10-16T13:00:59.619 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] deduperace 2023-10-16T13:00:59.795 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] bulkstat_unlink_test_modified 2023-10-16T13:00:59.972 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_dir_offset 2023-10-16T13:01:00.107 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_futimens 2023-10-16T13:01:00.237 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_immutable 2023-10-16T13:01:00.781 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] stale_handle 2023-10-16T13:01:00.935 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] pwrite_mmap_blocked 2023-10-16T13:01:01.081 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_dir_offset2 2023-10-16T13:01:01.254 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] seek_sanity_test 2023-10-16T13:01:01.632 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] seek_copy_test 2023-10-16T13:01:01.796 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_readdir_1 2023-10-16T13:01:01.931 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_readdir_2 2023-10-16T13:01:02.070 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] fsync-tester 2023-10-16T13:01:02.293 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] nsexec 2023-10-16T13:01:02.452 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] cloner 2023-10-16T13:01:02.613 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] renameat2 2023-10-16T13:01:02.763 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_getcwd 2023-10-16T13:01:02.907 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] e4compact 2023-10-16T13:01:03.088 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] test-nextquota 2023-10-16T13:01:03.241 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] punch-alternating 2023-10-16T13:01:03.396 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] attr-list-by-handle-cursor-test 2023-10-16T13:01:03.548 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] listxattr 2023-10-16T13:01:03.683 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] dio-interleaved 2023-10-16T13:01:03.831 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_dir_type 2023-10-16T13:01:03.973 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] dio-invalidate-cache 2023-10-16T13:01:04.156 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] stat_test 2023-10-16T13:01:04.423 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_encrypted_d_revalidate 2023-10-16T13:01:04.574 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] attr_replace_test 2023-10-16T13:01:04.722 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] swapon 2023-10-16T13:01:04.871 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] mkswap 2023-10-16T13:01:05.010 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_attr_corruption 2023-10-16T13:01:05.146 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_open_tmpfiles 2023-10-16T13:01:05.308 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] fscrypt-crypt-util 2023-10-16T13:01:05.878 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] bulkstat_null_ocount 2023-10-16T13:01:06.023 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] splice-test 2023-10-16T13:01:06.186 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] chprojid_fail 2023-10-16T13:01:06.332 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] detached_mounts_propagation 2023-10-16T13:01:06.498 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] ext4_resize 2023-10-16T13:01:06.707 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_readdir_3 2023-10-16T13:01:06.876 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] splice2pipe 2023-10-16T13:01:07.025 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] uuid_ioctl 2023-10-16T13:01:07.166 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] fiemap-tester 2023-10-16T13:01:07.406 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_stripealign 2023-10-16T13:01:07.549 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] open_by_handle 2023-10-16T13:01:07.779 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] t_mmap_dio 2023-10-16T13:01:07.927 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] xfsfind 2023-10-16T13:01:08.100 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] fssum 2023-10-16T13:01:08.486 INFO:teuthology.orchestra.run.smithi124.stdout:Building log-writes 2023-10-16T13:01:08.491 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] replay-log 2023-10-16T13:01:08.773 INFO:teuthology.orchestra.run.smithi124.stdout:Building perf 2023-10-16T13:01:08.776 INFO:teuthology.orchestra.run.smithi124.stdout:Building aio-dio-regress 2023-10-16T13:01:08.782 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] aio-dio-append-write-fallocate-race 2023-10-16T13:01:08.939 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] aio-dio-fcntl-race 2023-10-16T13:01:09.090 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] aio-dio-subblock-eof-read 2023-10-16T13:01:09.225 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] aio-dio-append-write-read-race 2023-10-16T13:01:09.387 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] aio-dio-invalidate-readahead 2023-10-16T13:01:09.540 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] aio-dio-write-verify 2023-10-16T13:01:09.722 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-10-16T13:01:09.849 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] aio-last-ref-held-by-io 2023-10-16T13:01:10.009 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] aio-dio-cycle-write 2023-10-16T13:01:10.180 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] aio-dio-extend-stat 2023-10-16T13:01:10.333 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-10-16T13:01:10.458 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] aio-dio-hole-filling-race 2023-10-16T13:01:10.597 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] aio-dio-invalidate-failure 2023-10-16T13:01:10.746 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] aiodio_sparse2 2023-10-16T13:01:10.942 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] aiocp 2023-10-16T13:01:11.148 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] aio-dio-cow-race 2023-10-16T13:01:11.292 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] aio-dio-eof-race 2023-10-16T13:01:11.463 INFO:teuthology.orchestra.run.smithi124.stdout:Building vfs 2023-10-16T13:01:11.467 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] vfstest 2023-10-16T13:01:13.126 INFO:teuthology.orchestra.run.smithi124.stdout: [CC] mount-idmapped 2023-10-16T13:01:13.452 INFO:teuthology.orchestra.run.smithi124.stdout:Building m4 2023-10-16T13:01:13.455 INFO:teuthology.orchestra.run.smithi124.stdout:Building common 2023-10-16T13:01:13.458 INFO:teuthology.orchestra.run.smithi124.stdout:Building tests 2023-10-16T13:01:13.463 INFO:teuthology.orchestra.run.smithi124.stdout:Building perf 2023-10-16T13:01:13.468 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/perf/group.list 2023-10-16T13:01:13.478 INFO:teuthology.orchestra.run.smithi124.stdout:Building ext4 2023-10-16T13:01:13.483 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/ext4/group.list 2023-10-16T13:01:13.516 INFO:teuthology.orchestra.run.smithi124.stdout:Building ocfs2 2023-10-16T13:01:13.521 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/ocfs2/group.list 2023-10-16T13:01:13.533 INFO:teuthology.orchestra.run.smithi124.stdout:Building overlay 2023-10-16T13:01:13.538 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/overlay/group.list 2023-10-16T13:01:13.573 INFO:teuthology.orchestra.run.smithi124.stdout:Building cifs 2023-10-16T13:01:13.578 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/cifs/group.list 2023-10-16T13:01:13.589 INFO:teuthology.orchestra.run.smithi124.stdout:Building generic 2023-10-16T13:01:13.595 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/generic/group.list 2023-10-16T13:01:13.684 INFO:teuthology.orchestra.run.smithi124.stdout:Building shared 2023-10-16T13:01:13.688 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/shared/group.list 2023-10-16T13:01:13.704 INFO:teuthology.orchestra.run.smithi124.stdout:Building nfs 2023-10-16T13:01:13.709 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/nfs/group.list 2023-10-16T13:01:13.721 INFO:teuthology.orchestra.run.smithi124.stdout:Building f2fs 2023-10-16T13:01:13.726 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/f2fs/group.list 2023-10-16T13:01:13.741 INFO:teuthology.orchestra.run.smithi124.stdout:Building udf 2023-10-16T13:01:13.746 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/udf/group.list 2023-10-16T13:01:13.756 INFO:teuthology.orchestra.run.smithi124.stdout:Building ceph 2023-10-16T13:01:13.761 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/ceph/group.list 2023-10-16T13:01:13.773 INFO:teuthology.orchestra.run.smithi124.stdout:Building xfs 2023-10-16T13:01:13.779 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/xfs/group.list 2023-10-16T13:01:13.868 INFO:teuthology.orchestra.run.smithi124.stdout:Building btrfs 2023-10-16T13:01:13.873 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/btrfs/group.list 2023-10-16T13:01:13.926 INFO:teuthology.orchestra.run.smithi124.stdout:Building tmpfs 2023-10-16T13:01:13.931 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/tmpfs/group.list 2023-10-16T13:01:13.942 INFO:teuthology.orchestra.run.smithi124.stdout:Building selftest 2023-10-16T13:01:13.947 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/selftest/group.list 2023-10-16T13:01:13.961 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo make install) 2023-10-16T13:01:13.999 INFO:teuthology.orchestra.run.smithi124.stdout:Building include 2023-10-16T13:01:14.002 INFO:teuthology.orchestra.run.smithi124.stdout:Building lib 2023-10-16T13:01:14.006 INFO:teuthology.orchestra.run.smithi124.stdout:Building ltp 2023-10-16T13:01:14.010 INFO:teuthology.orchestra.run.smithi124.stdout:Building src 2023-10-16T13:01:14.042 INFO:teuthology.orchestra.run.smithi124.stdout:Building log-writes 2023-10-16T13:01:14.046 INFO:teuthology.orchestra.run.smithi124.stdout:Building perf 2023-10-16T13:01:14.049 INFO:teuthology.orchestra.run.smithi124.stdout:Building aio-dio-regress 2023-10-16T13:01:14.053 INFO:teuthology.orchestra.run.smithi124.stdout:Building vfs 2023-10-16T13:01:14.056 INFO:teuthology.orchestra.run.smithi124.stdout:Building m4 2023-10-16T13:01:14.060 INFO:teuthology.orchestra.run.smithi124.stdout:Building common 2023-10-16T13:01:14.063 INFO:teuthology.orchestra.run.smithi124.stdout:Building tests 2023-10-16T13:01:14.068 INFO:teuthology.orchestra.run.smithi124.stdout:Building perf 2023-10-16T13:01:14.072 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/perf/group.list 2023-10-16T13:01:14.083 INFO:teuthology.orchestra.run.smithi124.stdout:Building ext4 2023-10-16T13:01:14.088 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/ext4/group.list 2023-10-16T13:01:14.121 INFO:teuthology.orchestra.run.smithi124.stdout:Building ocfs2 2023-10-16T13:01:14.126 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/ocfs2/group.list 2023-10-16T13:01:14.138 INFO:teuthology.orchestra.run.smithi124.stdout:Building overlay 2023-10-16T13:01:14.143 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/overlay/group.list 2023-10-16T13:01:14.178 INFO:teuthology.orchestra.run.smithi124.stdout:Building cifs 2023-10-16T13:01:14.182 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/cifs/group.list 2023-10-16T13:01:14.194 INFO:teuthology.orchestra.run.smithi124.stdout:Building generic 2023-10-16T13:01:14.200 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/generic/group.list 2023-10-16T13:01:14.286 INFO:teuthology.orchestra.run.smithi124.stdout:Building shared 2023-10-16T13:01:14.291 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/shared/group.list 2023-10-16T13:01:14.306 INFO:teuthology.orchestra.run.smithi124.stdout:Building nfs 2023-10-16T13:01:14.311 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/nfs/group.list 2023-10-16T13:01:14.324 INFO:teuthology.orchestra.run.smithi124.stdout:Building f2fs 2023-10-16T13:01:14.328 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/f2fs/group.list 2023-10-16T13:01:14.343 INFO:teuthology.orchestra.run.smithi124.stdout:Building udf 2023-10-16T13:01:14.348 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/udf/group.list 2023-10-16T13:01:14.358 INFO:teuthology.orchestra.run.smithi124.stdout:Building ceph 2023-10-16T13:01:14.363 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/ceph/group.list 2023-10-16T13:01:14.375 INFO:teuthology.orchestra.run.smithi124.stdout:Building xfs 2023-10-16T13:01:14.382 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/xfs/group.list 2023-10-16T13:01:14.469 INFO:teuthology.orchestra.run.smithi124.stdout:Building btrfs 2023-10-16T13:01:14.475 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/btrfs/group.list 2023-10-16T13:01:14.528 INFO:teuthology.orchestra.run.smithi124.stdout:Building tmpfs 2023-10-16T13:01:14.532 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/tmpfs/group.list 2023-10-16T13:01:14.544 INFO:teuthology.orchestra.run.smithi124.stdout:Building selftest 2023-10-16T13:01:14.549 INFO:teuthology.orchestra.run.smithi124.stdout: [GROUP] /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/selftest/group.list 2023-10-16T13:01:14.559 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-10-16T13:01:14.561 INFO:teuthology.orchestra.run.smithi124.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-16T13:01:14.561 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-10-16T13:01:14.563 INFO:teuthology.orchestra.run.smithi124.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-16T13:01:14.563 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-10-16T13:01:14.565 INFO:teuthology.orchestra.run.smithi124.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-10-16T13:01:14.574 INFO:teuthology.orchestra.run.smithi124.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-10-16T13:01:14.650 INFO:teuthology.orchestra.run.smithi124.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-10-16T13:01:14.659 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-10-16T13:01:14.675 INFO:teuthology.orchestra.run.smithi124.stdout:Building log-writes 2023-10-16T13:01:14.678 INFO:teuthology.orchestra.run.smithi124.stdout:Building perf 2023-10-16T13:01:14.681 INFO:teuthology.orchestra.run.smithi124.stdout:Building aio-dio-regress 2023-10-16T13:01:14.685 INFO:teuthology.orchestra.run.smithi124.stdout:Building vfs 2023-10-16T13:01:14.688 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake -C log-writes install 2023-10-16T13:01:14.689 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-10-16T13:01:14.697 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-10-16T13:01:14.706 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake -C perf install 2023-10-16T13:01:14.708 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-10-16T13:01:14.717 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-10-16T13:01:14.738 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-10-16T13:01:14.740 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-10-16T13:01:14.749 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 aio-dio-append-write-fallocate-race aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-hole-filling-race aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-10-16T13:01:14.800 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake -C vfs install 2023-10-16T13:01:14.802 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-10-16T13:01:14.810 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-10-16T13:01:14.822 INFO:teuthology.orchestra.run.smithi124.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-10-16T13:01:14.830 INFO:teuthology.orchestra.run.smithi124.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-10-16T13:01:16.023 INFO:teuthology.orchestra.run.smithi124.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-10-16T13:01:16.125 INFO:teuthology.orchestra.run.smithi124.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-10-16T13:01:16.155 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-10-16T13:01:16.157 INFO:teuthology.orchestra.run.smithi124.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-16T13:01:16.157 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-10-16T13:01:16.158 INFO:teuthology.orchestra.run.smithi124.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-10-16T13:01:16.166 INFO:teuthology.orchestra.run.smithi124.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-10-16T13:01:16.298 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-10-16T13:01:16.299 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/btrfs/ install 2023-10-16T13:01:16.302 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-10-16T13:01:16.311 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 299 300 /var/lib/xfstests/tests/btrfs 2023-10-16T13:01:17.122 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-10-16T13:01:17.130 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 175.out 186.out 240.out 092.out 077.out 140.out 265.out 236.out 108.out 204.out 233.out 194.out 234.out 295.out 109.out 033.out 082.out 252.out 270.out 040.out 176.out 202.out 137.out 034.out 125.out 014.out 165.out 181.out 152.out 024.out 192.out 148.out 282.out 267.out 052.out 256.out 228.out 183.out 273.out 251.out 110.out 043.out 069.out 151.out 206.out 195.out 274.out 215.out 115.out 015.out 275.out 250.out 191.out 281.out 046.out 051.out 131.out 244.out 219.out 119.out 019.out 128.out 177.out 232.out 189.out 220.out 120.out 020.out 102.out 263.out 171.out 261.out 045.out 217.out 117.out 017.out 072.out 068.out 048.out 062.out 038.out 084.out 129.out 066.out 029.out 229.out 103.out 111.out 011.out 243.out 134.out 170.out 260.out 157.out 143.out 133.out 286.out 161.out 246.out 216.out 116.out 016.out 155.out 296.out 118.out 287.out 067.out 010.out 238.out 141.out 114.out 138.out 095.out 297.out 160.out 091.out 081.out 071.out 061.out 085.out 037.out 300.out 200.out 100.out 025.out 258.out 185.out 269.out 208.out 039.out 173.out 222.out 035.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 106.out 009.out 167.out 211.out 158.out 182.out 146.out 188.out 293.out 104.out 089.out 086.out 254.out 279.out 225.out 174.out 156.out 268.out 135.out 257.out 124.out 172.out 063.out 058.out 113.out 262.out 036.out 042.out 047.out 193.out 097.out 271.out 283.out 083.out 199.out 099.out 278.out 007.out 209.out 053.out 164.out 154.out 239.out 241.out 002.out 178.out 190.out 214.out 074.out 056.out 041.out 057.out 005.out 223.out 150.out 123.out 179.out 144.out 032.out 277.out 205.out 136.out 096.out 198.out 008.out 280.out 050.out 105.out 027.out 187.out 153.out 088.out 285.out 044.out 201.out 101.out 001.out 266.out 237.out 065.out 231.out 227.out 075.out 028.out 213.out 142.out 013.out 031.out 272.out 078.out 184.out 259.out 210.out 132.out 093.out 235.out 127.out 230.out 166.out 292.out 130.out 023.out 073.out 030.out 203.out 003.out 055.out 291.out 245.out 145.out 159.out 249.out 122.out 076.out 022.out 289.out 006.out 284.out 299.out 224.out 276.out 149.out 064.out 264.out 218.out 018.out 168.out 021.out 079.out 054.out 059.out 049.out 226.out 163.out 126.out 121.out 026.out 180.out 253.out 255.out 139.out 090.out 221.out 087.out 294.out 212.out 112.out 094.out 012.out 247.out 107.out 248.out 162.out 147.out 288.out 197.out 196.out 242.out 004.out /var/lib/xfstests/tests/btrfs 2023-10-16T13:01:17.939 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/ceph/ install 2023-10-16T13:01:17.940 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-10-16T13:01:17.949 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-10-16T13:01:17.968 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-10-16T13:01:17.977 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-10-16T13:01:17.996 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/cifs/ install 2023-10-16T13:01:17.997 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-10-16T13:01:18.006 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-10-16T13:01:18.014 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-10-16T13:01:18.023 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-10-16T13:01:18.032 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/ext4/ install 2023-10-16T13:01:18.034 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-10-16T13:01:18.042 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-10-16T13:01:18.230 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-10-16T13:01:18.238 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 305.out 005.out 008.out 035.out 036.out 308.out 050.out 040.out 306.out 007.out 021.out 046.out 012.out 009.out 033.out 045.out 034.out 056.out 047.out 018.out 023.out 302.out 020.out 002.out 014.out 024.out 013.out 031.out 015.out 304.out 004.out 048.out 038.out 052.out 303.out 029.out 011.out 027.out 042.out 044.out 055.out 030.out 058.out 003.out 017.out 043.out 053.out 016.out 059.out 037.out 301.out 010.out 022.out 006.out 057.out 025.out 026.out 271.out 051.out 041.out 307.out 019.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-10-16T13:01:18.433 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/f2fs/ install 2023-10-16T13:01:18.434 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-10-16T13:01:18.443 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-10-16T13:01:18.454 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-10-16T13:01:18.462 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-10-16T13:01:18.474 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/generic/ install 2023-10-16T13:01:18.478 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-10-16T13:01:18.486 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 /var/lib/xfstests/tests/generic 2023-10-16T13:01:20.459 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-10-16T13:01:20.468 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 050.out.xfsquota 035.out.nfs 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 208.out 433.out 670.out 040.out 104.out 575.out 537.out 683.out 497.out 337.out 702.out 460.out 149.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 403.out 593.out 571.out 243.out 592.out 282.out 472.out 468.out 628.out 528.out 607.out 428.out 659.out 407.out 228.out 128.out 171.out 028.out 620.out 273.out 474.out 492.out 609.out 707.out 693.out 595.out 506.out 268.out 632.out 532.out 591.out 281.out 471.out 619.out 519.out 013.out 419.out 319.out 177.out 523.out 119.out 019.out 727.out 372.out 686.out 312.out 718.out 143.out 716.out 161.out 516.out 518.out 538.out 655.out 216.out 116.out 016.out 155.out 338.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 457.out 333.out 258.out 362.out 379.out 691.out 039.out 173.out 498.out 665.out 098.out 711.out 290.out 480.out 706.out 060.out 406.out 306.out 106.out 642.out 447.out 217.out 120.out 191.out 411.out 357.out 481.out 211.out 158.out 014.out 182.out 370.out 188.out 030.out 099.out 585.out 724.out 721.out 624.out 524.out 174.out 156.out 324.out 224.out 313.out 355.out 124.out 382.out 672.out 278.out 063.out 058.out 384.out 296.out 042.out 193.out 271.out 465.out 473.out 335.out 247.out 509.out 568.out 441.out 440.out 475.out 548.out 356.out 341.out 094.out 241.out 600.out 089.out 714.out 614.out 514.out 414.out 314.out 416.out 214.out 381.out 056.out 041.out 057.out 340.out 358.out 572.out 586.out 521.out 240.out 549.out 095.out 633.out 434.out 140.out 708.out 533.out 508.out 408.out 308.out 476.out 087.out 199.out 458.out 233.out 639.out 443.out 540.out 397.out 053.out 279.out 276.out 448.out 164.out 376.out 589.out 587.out 339.out 294.out 352.out 484.out 489.out 139.out 317.out 399.out 220.out 552.out 695.out 017.out 677.out 097.out 175.out 315.out 295.out 580.out 186.out 452.out 679.out 292.out 252.out 077.out 167.out 688.out 206.out 348.out 394.out 651.out 184.out 466.out 697.out 495.out 725.out 109.out 482.out 625.out 283.out 525.out 488.out 496.out 325.out 551.out 225.out 322.out 636.out 125.out 715.out 192.out 544.out 515.out 650.out 152.out 658.out 563.out 393.out 578.out 015.out 392.out 682.out 684.out 550.out 052.out 652.out 534.out 351.out 583.out 451.out 450.out 463.out 251.out 267.out 176.out 069.out 644.out 065.out 487.out 615.out 395.out 676.out 415.out 344.out 215.out 115.out 444.out 027.out 250.out 391.out 674.out 464.out 705.out 536.out 577.out 439.out 244.out 336.out 144.out 505.out 405.out 667.out 205.out 136.out 598.out 363.out 036.out 198.out 723.out 008.out 390.out 680.out 605.out 305.out 105.out 005.out 367.out 291.out 719.out 323.out 685.out 562.out 570.out 388.out 527.out 237.out 151.out 227.out 163.out 332.out 661.out 582.out 232.out 478.out 584.out 462.out 597.out 412.out 132.out 179.out 037.out 293.out 499.out 638.out 353.out 020.out 660.out 561.out 141.out 076.out 668.out 044.out 648.out 387.out 594.out 438.out 265.out 289.out 574.out 006.out 690.out 284.out 567.out 299.out 456.out 461.out 477.out 307.out 647.out 493.out 107.out 007.out 380.out 526.out 479.out 426.out 150.out 326.out 082.out 226.out 413.out 126.out 025.out 121.out 026.out 021.out 485.out 694.out 347.out 275.out 090.out 361.out 564.out 302.out 432.out 002.out 558.out 162.out 147.out 288.out 197.out 033.out 396.out 051.out 350.out 547.out 047.out 024.out 360.out 543.out 261.out 045.out 692.out 255.out 726.out 729.out 378.out 346.out 048.out 062.out 626.out 529.out 231.out 343.out 662.out 425.out 329.out 165.out 334.out 103.out 003.out 129.out 423.out 371.out 234.out 183.out 671.out 645.out 673.out 190.out 486.out 223.out 123.out 262.out 669.out 023.out 459.out 616.out 032.out 266.out 146.out 398.out 728.out 696.out 427.out 590.out 280.out 470.out 455.out 187.out 091.out 046.out 731.out 374.out 631.out 256.out 328.out 260.out 654.out 359.out 531.out 649.out 301.out 101.out 635.out 623.out 385.out 331.out 556.out 713.out 613.out 513.out 622.out 131.out 213.out 730.out 634.out 031.out 565.out 630.out 675.out 272.out 530.out 510.out 627.out 573.out 576.out 430.out 310.out 569.out 454.out 259.out 210.out 449.out 327.out 330.out 067.out 093.out 604.out 287.out 127.out 699.out 166.out 130.out 219.out 073.out 603.out 503.out 303.out 203.out 354.out 157.out 386.out 349.out 055.out 245.out 709.out 522.out 422.out 222.out 159.out 539.out 249.out 122.out 689.out 022.out 681.out 424.out 321.out 066.out 490.out 435.out 375.out 134.out 154.out 566.out 618.out 501.out 418.out 318.out 542.out 218.out 118.out 018.out 377.out 172.out 168.out 079.out 469.out 054.out 059.out 049.out 442.out 657.out 621.out 180.out 270.out 253.out 421.out 712.out 612.out 075.out 512.out 494.out 221.out 212.out 112.out 342.out 012.out 029.out 195.out 554.out 148.out 185.out 596.out 720.out 248.out 196.out 520.out 242.out 420.out 285.out 320.out 629.out 230.out 602.out 502.out 402.out 102.out 717.out 617.out 517.out 429.out 417.out 365.out 092.out 117.out 664.out 072.out 068.out 229.out 038.out 084.out 369.out 611.out 511.out 311.out 368.out 637.out 111.out 011.out 257.out 194.out 170.out 606.out 133.out 286.out 043.out 437.out 545.out 559.out 710.out 610.out 687.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 096.out 114.out 113.out 074.out 581.out 145.out 641.out 491.out 081.out 071.out 083.out 653.out 700.out 064.out 400.out 300.out 200.out 100.out 646.out 541.out 445.out 269.out 546.out 656.out 698.out 553.out 178.out 298.out 446.out 080.out 070.out 608.out 507.out 409.out 309.out 209.out 108.out 009.out 643.out 004.out 557.out 453.out 666.out 236.out 078.out 364.out 555.out 383.out 085.out 704.out 588.out 504.out 404.out 304.out 204.out 535.out 345.out 246.out 467.out 086.out 254.out 207.out 142.out 235.out 436.out 703.out 135.out 264.out 431.out 678.out 373.out 316.out 169.out 640.out 579.out 297.out 153.out 560.out 663.out 599.out /var/lib/xfstests/tests/generic 2023-10-16T13:01:20.521 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:01:20.524 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:01:22.455 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/nfs/ install 2023-10-16T13:01:22.456 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-10-16T13:01:22.464 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-10-16T13:01:22.473 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-10-16T13:01:22.481 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-10-16T13:01:22.490 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/ocfs2/ install 2023-10-16T13:01:22.491 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-10-16T13:01:22.500 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-10-16T13:01:22.508 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-10-16T13:01:22.517 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-10-16T13:01:22.525 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/overlay/ install 2023-10-16T13:01:22.527 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-10-16T13:01:22.536 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-10-16T13:01:22.807 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-10-16T13:01:22.818 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 003.out 018.out 024.out 077.out 069.out 020.out 102.out 014.out 023.out 013.out 031.out 015.out 117.out 082.out 072.out 068.out 063.out 048.out 062.out 038.out 052.out 042.out 075.out 110.out 067.out 029.out 111.out 055.out 112.out 066.out 073.out 078.out 030.out 058.out 104.out 017.out 002.out 043.out 053.out 036.out 116.out 016.out 101.out 010.out 001.out 022.out 074.out 004.out 103.out 115.out 057.out 113.out 114.out 081.out 026.out 071.out 061.out 025.out 051.out 011.out 041.out 047.out 100.out 064.out 007.out 028.out 076.out 079.out 054.out 059.out 008.out 049.out 032.out 039.out 046.out 021.out 105.out 005.out 107.out 065.out 108.out 080.out 070.out 060.out 050.out 027.out 106.out 009.out 006.out 037.out 044.out 012.out 109.out 033.out 045.out 040.out 056.out 035.out 019.out 034.out /var/lib/xfstests/tests/overlay 2023-10-16T13:01:23.088 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/perf/ install 2023-10-16T13:01:23.090 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-10-16T13:01:23.098 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-10-16T13:01:23.107 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-10-16T13:01:23.115 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-10-16T13:01:23.124 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/selftest/ install 2023-10-16T13:01:23.125 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-10-16T13:01:23.134 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-10-16T13:01:23.155 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-10-16T13:01:23.164 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-10-16T13:01:23.186 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/shared/ install 2023-10-16T13:01:23.187 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-10-16T13:01:23.196 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-10-16T13:01:23.210 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-10-16T13:01:23.218 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-10-16T13:01:23.232 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/tmpfs/ install 2023-10-16T13:01:23.234 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-10-16T13:01:23.242 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-10-16T13:01:23.251 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-10-16T13:01:23.259 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-10-16T13:01:23.268 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/udf/ install 2023-10-16T13:01:23.269 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-10-16T13:01:23.278 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-10-16T13:01:23.287 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-10-16T13:01:23.295 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-10-16T13:01:23.304 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pHbfHGg5qgxfstests-dev/tests/xfs/ install 2023-10-16T13:01:23.308 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-10-16T13:01:23.317 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-10-16T13:01:25.178 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-10-16T13:01:25.187 INFO:teuthology.orchestra.run.smithi124.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 295.out 497.out 337.out 385.out 082.out 270.out 460.out 149.out 759.out 502.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 018.out 593.out 571.out 243.out 592.out 282.out 267.out 728.out 468.out 799.out 284.out 528.out 769.out 428.out 507.out 407.out 228.out 128.out 171.out 183.out 273.out 017.out 492.out 109.out 559.out 506.out 195.out 732.out 268.out 275.out 600.out 113.out 532.out 591.out 281.out 471.out 723.out 255.out 013.out 371.out 319.out 467.out 523.out 119.out 775.out 727.out 372.out 165.out 229.out 103.out 003.out 129.out 131.out 383.out 738.out 260.out 718.out 143.out 716.out 161.out 516.out 518.out 416.out 026.out 116.out 043.out 155.out 338.out 238.out 500.out 138.out 189.out 263.out 184.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 047.out 772.out 258.out 379.out 322.out 039.out 430.out 173.out 222.out 742.out 098.out 426.out 290.out 480.out 060.out 406.out 306.out 141.out 106.out 006.out 167.out 191.out 542.out 211.out 442.out 188.out 099.out 177.out 721.out 174.out 156.out 771.out 324.out 224.out 313.out 124.out 278.out 058.out 741.out 384.out 042.out 193.out 392.out 768.out 399.out 473.out 770.out 709.out 247.out 568.out 364.out 209.out 441.out 440.out 009.out 740.out 356.out 197.out 341.out 094.out 241.out 501.out 089.out 540.out 514.out 414.out 314.out 214.out 381.out 147.out 041.out 340.out 793.out 358.out 572.out 586.out 240.out 549.out 092.out 439.out 434.out 140.out 708.out 766.out 508.out 408.out 308.out 208.out 737.out 040.out 304.out 349.out 254.out 537.out 059.out 086.out 249.out 335.out 142.out 235.out 436.out 575.out 253.out 715.out 533.out 264.out 431.out 784.out 433.out 036.out 316.out 169.out 035.out 579.out 457.out 297.out 393.out 333.out 599.out 476.out 087.out 199.out 739.out 233.out 752.out 736.out 443.out 773.out 053.out 749.out 279.out 133.out 711.out 458.out 164.out 589.out 587.out 339.out 577.out 294.out 352.out 484.out 498.out 489.out 139.out 774.out 790.out 552.out 781.out 357.out 065.out 097.out 175.out 186.out 452.out 069.out 252.out 751.out 376.out 724.out 206.out 778.out 190.out 794.out 348.out 466.out 248.out 725.out 785.out 750.out 525.out 496.out 325.out 257.out 225.out 125.out 789.out 192.out 296.out 152.out 563.out 246.out 551.out 015.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 534.out 351.out 276.out 451.out 425.out 450.out 744.out 251.out 444.out 487.out 762.out 395.out 515.out 415.out 315.out 215.out 115.out 597.out 027.out 250.out 344.out 051.out 536.out 030.out 244.out 336.out 028.out 150.out 144.out 505.out 342.out 136.out 598.out 005.out 176.out 198.out 008.out 390.out 178.out 405.out 305.out 205.out 105.out 367.out 291.out 437.out 044.out 719.out 323.out 519.out 363.out 562.out 382.out 570.out 388.out 527.out 158.out 019.out 237.out 151.out 760.out 227.out 163.out 332.out 796.out 582.out 232.out 584.out 462.out 220.out 412.out 132.out 179.out 037.out 293.out 499.out 112.out 748.out 020.out 786.out 063.out 561.out 076.out 465.out 014.out 758.out 387.out 594.out 438.out 265.out 289.out 574.out 755.out 548.out 299.out 419.out 521.out 581.out 595.out 461.out 477.out 307.out 726.out 107.out 007.out 448.out 262.out 380.out 093.out 479.out 547.out 326.out 226.out 747.out 126.out 025.out 121.out 447.out 761.out 580.out 021.out 485.out 347.out 077.out 090.out 361.out 564.out 788.out 066.out 455.out 432.out 002.out 585.out 162.out 288.out 050.out 396.out 446.out 350.out 354.out 429.out 187.out 360.out 543.out 261.out 734.out 045.out 292.out 482.out 729.out 104.out 048.out 062.out 529.out 231.out 343.out 503.out 526.out 329.out 486.out 223.out 123.out 023.out 459.out 032.out 798.out 277.out 373.out 146.out 398.out 168.out 427.out 590.out 280.out 470.out 491.out 767.out 016.out 046.out 488.out 731.out 782.out 374.out 583.out 285.out 127.out 328.out 359.out 531.out 301.out 101.out 266.out 331.out 791.out 743.out 556.out 713.out 081.out 024.out 513.out 213.out 730.out 095.out 031.out 565.out 182.out 272.out 530.out 754.out 573.out 576.out 569.out 454.out 259.out 449.out 327.out 330.out 067.out 493.out 010.out 287.out 230.out 166.out 130.out 219.out 073.out 370.out 135.out 303.out 203.out 345.out 355.out 386.out 560.out 055.out 334.out 245.out 522.out 787.out 745.out 422.out 394.out 539.out 524.out 122.out 234.out 022.out 424.out 779.out 490.out 435.out 353.out 423.out 134.out 154.out 271.out 064.out 418.out 318.out 218.out 118.out 757.out 377.out 172.out 079.out 469.out 054.out 049.out 765.out 776.out 456.out 180.out 378.out 421.out 712.out 403.out 321.out 057.out 512.out 494.out 221.out 312.out 212.out 538.out 256.out 012.out 764.out 283.out 554.out 397.out 185.out 596.out 720.out 481.out 196.out 520.out 242.out 420.out 478.out 320.out 555.out 120.out 153.out 402.out 302.out 102.out 717.out 517.out 417.out 317.out 365.out 217.out 117.out 475.out 072.out 068.out 474.out 038.out 084.out 056.out 369.out 511.out 148.out 411.out 029.out 311.out 368.out 111.out 011.out 783.out 194.out 170.out 286.out 756.out 545.out 714.out 157.out 710.out 510.out 413.out 410.out 310.out 210.out 401.out 201.out 001.out 495.out 362.out 114.out 753.out 074.out 145.out 797.out 464.out 091.out 746.out 083.out 800.out 777.out 400.out 300.out 200.out 100.out 375.out 541.out 445.out 269.out 546.out 780.out 553.out 763.out 298.out 567.out 080.out 070.out 509.out 409.out 309.out 207.out 108.out 346.out 391.out 004.out 557.out 453.out 236.out 078.out 159.out 566.out 735.out 085.out 588.out 504.out 404.out 558.out 204.out 535.out 795.out 733.out 544.out /var/lib/xfstests/tests/xfs 2023-10-16T13:01:27.083 INFO:teuthology.orchestra.run.smithi124.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-10-16T13:01:27.091 INFO:teuthology.orchestra.run.smithi124.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-10-16T13:01:27.100 INFO:teuthology.orchestra.run.smithi124.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-10-16T13:01:27.109 INFO:teuthology.orchestra.run.smithi124.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-10-16T13:01:27.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T13:01:27.120 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec ls tests/generic) 2023-10-16T13:01:27.139 INFO:teuthology.orchestra.run.smithi124.stdout:001 2023-10-16T13:01:27.139 INFO:teuthology.orchestra.run.smithi124.stdout:001.out 2023-10-16T13:01:27.139 INFO:teuthology.orchestra.run.smithi124.stdout:002 2023-10-16T13:01:27.139 INFO:teuthology.orchestra.run.smithi124.stdout:002.out 2023-10-16T13:01:27.140 INFO:teuthology.orchestra.run.smithi124.stdout:003 2023-10-16T13:01:27.140 INFO:teuthology.orchestra.run.smithi124.stdout:003.out 2023-10-16T13:01:27.140 INFO:teuthology.orchestra.run.smithi124.stdout:004 2023-10-16T13:01:27.140 INFO:teuthology.orchestra.run.smithi124.stdout:004.out 2023-10-16T13:01:27.141 INFO:teuthology.orchestra.run.smithi124.stdout:005 2023-10-16T13:01:27.141 INFO:teuthology.orchestra.run.smithi124.stdout:005.out 2023-10-16T13:01:27.141 INFO:teuthology.orchestra.run.smithi124.stdout:006 2023-10-16T13:01:27.141 INFO:teuthology.orchestra.run.smithi124.stdout:006.out 2023-10-16T13:01:27.141 INFO:teuthology.orchestra.run.smithi124.stdout:007 2023-10-16T13:01:27.141 INFO:teuthology.orchestra.run.smithi124.stdout:007.out 2023-10-16T13:01:27.142 INFO:teuthology.orchestra.run.smithi124.stdout:008 2023-10-16T13:01:27.142 INFO:teuthology.orchestra.run.smithi124.stdout:008.out 2023-10-16T13:01:27.142 INFO:teuthology.orchestra.run.smithi124.stdout:009 2023-10-16T13:01:27.142 INFO:teuthology.orchestra.run.smithi124.stdout:009.out 2023-10-16T13:01:27.142 INFO:teuthology.orchestra.run.smithi124.stdout:010 2023-10-16T13:01:27.143 INFO:teuthology.orchestra.run.smithi124.stdout:010.out 2023-10-16T13:01:27.143 INFO:teuthology.orchestra.run.smithi124.stdout:011 2023-10-16T13:01:27.143 INFO:teuthology.orchestra.run.smithi124.stdout:011.out 2023-10-16T13:01:27.143 INFO:teuthology.orchestra.run.smithi124.stdout:012 2023-10-16T13:01:27.143 INFO:teuthology.orchestra.run.smithi124.stdout:012.out 2023-10-16T13:01:27.144 INFO:teuthology.orchestra.run.smithi124.stdout:013 2023-10-16T13:01:27.144 INFO:teuthology.orchestra.run.smithi124.stdout:013.out 2023-10-16T13:01:27.144 INFO:teuthology.orchestra.run.smithi124.stdout:014 2023-10-16T13:01:27.144 INFO:teuthology.orchestra.run.smithi124.stdout:014.out 2023-10-16T13:01:27.144 INFO:teuthology.orchestra.run.smithi124.stdout:015 2023-10-16T13:01:27.145 INFO:teuthology.orchestra.run.smithi124.stdout:015.out 2023-10-16T13:01:27.145 INFO:teuthology.orchestra.run.smithi124.stdout:016 2023-10-16T13:01:27.145 INFO:teuthology.orchestra.run.smithi124.stdout:016.out 2023-10-16T13:01:27.145 INFO:teuthology.orchestra.run.smithi124.stdout:017 2023-10-16T13:01:27.145 INFO:teuthology.orchestra.run.smithi124.stdout:017.out 2023-10-16T13:01:27.146 INFO:teuthology.orchestra.run.smithi124.stdout:018 2023-10-16T13:01:27.146 INFO:teuthology.orchestra.run.smithi124.stdout:018.out 2023-10-16T13:01:27.146 INFO:teuthology.orchestra.run.smithi124.stdout:019 2023-10-16T13:01:27.146 INFO:teuthology.orchestra.run.smithi124.stdout:019.out 2023-10-16T13:01:27.146 INFO:teuthology.orchestra.run.smithi124.stdout:020 2023-10-16T13:01:27.147 INFO:teuthology.orchestra.run.smithi124.stdout:020.out 2023-10-16T13:01:27.147 INFO:teuthology.orchestra.run.smithi124.stdout:021 2023-10-16T13:01:27.147 INFO:teuthology.orchestra.run.smithi124.stdout:021.out 2023-10-16T13:01:27.147 INFO:teuthology.orchestra.run.smithi124.stdout:022 2023-10-16T13:01:27.147 INFO:teuthology.orchestra.run.smithi124.stdout:022.out 2023-10-16T13:01:27.148 INFO:teuthology.orchestra.run.smithi124.stdout:023 2023-10-16T13:01:27.148 INFO:teuthology.orchestra.run.smithi124.stdout:023.out 2023-10-16T13:01:27.148 INFO:teuthology.orchestra.run.smithi124.stdout:024 2023-10-16T13:01:27.148 INFO:teuthology.orchestra.run.smithi124.stdout:024.out 2023-10-16T13:01:27.148 INFO:teuthology.orchestra.run.smithi124.stdout:025 2023-10-16T13:01:27.149 INFO:teuthology.orchestra.run.smithi124.stdout:025.out 2023-10-16T13:01:27.149 INFO:teuthology.orchestra.run.smithi124.stdout:026 2023-10-16T13:01:27.149 INFO:teuthology.orchestra.run.smithi124.stdout:026.out 2023-10-16T13:01:27.149 INFO:teuthology.orchestra.run.smithi124.stdout:027 2023-10-16T13:01:27.149 INFO:teuthology.orchestra.run.smithi124.stdout:027.out 2023-10-16T13:01:27.149 INFO:teuthology.orchestra.run.smithi124.stdout:028 2023-10-16T13:01:27.150 INFO:teuthology.orchestra.run.smithi124.stdout:028.out 2023-10-16T13:01:27.150 INFO:teuthology.orchestra.run.smithi124.stdout:029 2023-10-16T13:01:27.150 INFO:teuthology.orchestra.run.smithi124.stdout:029.out 2023-10-16T13:01:27.150 INFO:teuthology.orchestra.run.smithi124.stdout:030 2023-10-16T13:01:27.150 INFO:teuthology.orchestra.run.smithi124.stdout:030.out 2023-10-16T13:01:27.151 INFO:teuthology.orchestra.run.smithi124.stdout:031 2023-10-16T13:01:27.151 INFO:teuthology.orchestra.run.smithi124.stdout:031.out 2023-10-16T13:01:27.151 INFO:teuthology.orchestra.run.smithi124.stdout:032 2023-10-16T13:01:27.151 INFO:teuthology.orchestra.run.smithi124.stdout:032.out 2023-10-16T13:01:27.151 INFO:teuthology.orchestra.run.smithi124.stdout:033 2023-10-16T13:01:27.152 INFO:teuthology.orchestra.run.smithi124.stdout:033.out 2023-10-16T13:01:27.152 INFO:teuthology.orchestra.run.smithi124.stdout:034 2023-10-16T13:01:27.152 INFO:teuthology.orchestra.run.smithi124.stdout:034.out 2023-10-16T13:01:27.152 INFO:teuthology.orchestra.run.smithi124.stdout:035 2023-10-16T13:01:27.152 INFO:teuthology.orchestra.run.smithi124.stdout:035.cfg 2023-10-16T13:01:27.153 INFO:teuthology.orchestra.run.smithi124.stdout:035.out.default 2023-10-16T13:01:27.153 INFO:teuthology.orchestra.run.smithi124.stdout:035.out.nfs 2023-10-16T13:01:27.153 INFO:teuthology.orchestra.run.smithi124.stdout:036 2023-10-16T13:01:27.153 INFO:teuthology.orchestra.run.smithi124.stdout:036.out 2023-10-16T13:01:27.153 INFO:teuthology.orchestra.run.smithi124.stdout:037 2023-10-16T13:01:27.154 INFO:teuthology.orchestra.run.smithi124.stdout:037.out 2023-10-16T13:01:27.154 INFO:teuthology.orchestra.run.smithi124.stdout:038 2023-10-16T13:01:27.154 INFO:teuthology.orchestra.run.smithi124.stdout:038.out 2023-10-16T13:01:27.154 INFO:teuthology.orchestra.run.smithi124.stdout:039 2023-10-16T13:01:27.154 INFO:teuthology.orchestra.run.smithi124.stdout:039.out 2023-10-16T13:01:27.155 INFO:teuthology.orchestra.run.smithi124.stdout:040 2023-10-16T13:01:27.155 INFO:teuthology.orchestra.run.smithi124.stdout:040.out 2023-10-16T13:01:27.155 INFO:teuthology.orchestra.run.smithi124.stdout:041 2023-10-16T13:01:27.155 INFO:teuthology.orchestra.run.smithi124.stdout:041.out 2023-10-16T13:01:27.155 INFO:teuthology.orchestra.run.smithi124.stdout:042 2023-10-16T13:01:27.156 INFO:teuthology.orchestra.run.smithi124.stdout:042.out 2023-10-16T13:01:27.156 INFO:teuthology.orchestra.run.smithi124.stdout:043 2023-10-16T13:01:27.156 INFO:teuthology.orchestra.run.smithi124.stdout:043.out 2023-10-16T13:01:27.156 INFO:teuthology.orchestra.run.smithi124.stdout:044 2023-10-16T13:01:27.156 INFO:teuthology.orchestra.run.smithi124.stdout:044.out 2023-10-16T13:01:27.157 INFO:teuthology.orchestra.run.smithi124.stdout:045 2023-10-16T13:01:27.157 INFO:teuthology.orchestra.run.smithi124.stdout:045.out 2023-10-16T13:01:27.157 INFO:teuthology.orchestra.run.smithi124.stdout:046 2023-10-16T13:01:27.157 INFO:teuthology.orchestra.run.smithi124.stdout:046.out 2023-10-16T13:01:27.157 INFO:teuthology.orchestra.run.smithi124.stdout:047 2023-10-16T13:01:27.157 INFO:teuthology.orchestra.run.smithi124.stdout:047.out 2023-10-16T13:01:27.158 INFO:teuthology.orchestra.run.smithi124.stdout:048 2023-10-16T13:01:27.158 INFO:teuthology.orchestra.run.smithi124.stdout:048.out 2023-10-16T13:01:27.158 INFO:teuthology.orchestra.run.smithi124.stdout:049 2023-10-16T13:01:27.158 INFO:teuthology.orchestra.run.smithi124.stdout:049.out 2023-10-16T13:01:27.158 INFO:teuthology.orchestra.run.smithi124.stdout:050 2023-10-16T13:01:27.159 INFO:teuthology.orchestra.run.smithi124.stdout:050.cfg 2023-10-16T13:01:27.159 INFO:teuthology.orchestra.run.smithi124.stdout:050.out.default 2023-10-16T13:01:27.159 INFO:teuthology.orchestra.run.smithi124.stdout:050.out.nojournal 2023-10-16T13:01:27.159 INFO:teuthology.orchestra.run.smithi124.stdout:050.out.xfsquota 2023-10-16T13:01:27.159 INFO:teuthology.orchestra.run.smithi124.stdout:051 2023-10-16T13:01:27.160 INFO:teuthology.orchestra.run.smithi124.stdout:051.out 2023-10-16T13:01:27.160 INFO:teuthology.orchestra.run.smithi124.stdout:052 2023-10-16T13:01:27.160 INFO:teuthology.orchestra.run.smithi124.stdout:052.out 2023-10-16T13:01:27.160 INFO:teuthology.orchestra.run.smithi124.stdout:053 2023-10-16T13:01:27.160 INFO:teuthology.orchestra.run.smithi124.stdout:053.out 2023-10-16T13:01:27.161 INFO:teuthology.orchestra.run.smithi124.stdout:054 2023-10-16T13:01:27.161 INFO:teuthology.orchestra.run.smithi124.stdout:054.out 2023-10-16T13:01:27.161 INFO:teuthology.orchestra.run.smithi124.stdout:055 2023-10-16T13:01:27.161 INFO:teuthology.orchestra.run.smithi124.stdout:055.out 2023-10-16T13:01:27.161 INFO:teuthology.orchestra.run.smithi124.stdout:056 2023-10-16T13:01:27.161 INFO:teuthology.orchestra.run.smithi124.stdout:056.out 2023-10-16T13:01:27.162 INFO:teuthology.orchestra.run.smithi124.stdout:057 2023-10-16T13:01:27.162 INFO:teuthology.orchestra.run.smithi124.stdout:057.out 2023-10-16T13:01:27.162 INFO:teuthology.orchestra.run.smithi124.stdout:058 2023-10-16T13:01:27.162 INFO:teuthology.orchestra.run.smithi124.stdout:058.out 2023-10-16T13:01:27.162 INFO:teuthology.orchestra.run.smithi124.stdout:059 2023-10-16T13:01:27.163 INFO:teuthology.orchestra.run.smithi124.stdout:059.out 2023-10-16T13:01:27.163 INFO:teuthology.orchestra.run.smithi124.stdout:060 2023-10-16T13:01:27.163 INFO:teuthology.orchestra.run.smithi124.stdout:060.out 2023-10-16T13:01:27.163 INFO:teuthology.orchestra.run.smithi124.stdout:061 2023-10-16T13:01:27.163 INFO:teuthology.orchestra.run.smithi124.stdout:061.out 2023-10-16T13:01:27.164 INFO:teuthology.orchestra.run.smithi124.stdout:062 2023-10-16T13:01:27.164 INFO:teuthology.orchestra.run.smithi124.stdout:062.out 2023-10-16T13:01:27.164 INFO:teuthology.orchestra.run.smithi124.stdout:063 2023-10-16T13:01:27.164 INFO:teuthology.orchestra.run.smithi124.stdout:063.out 2023-10-16T13:01:27.164 INFO:teuthology.orchestra.run.smithi124.stdout:064 2023-10-16T13:01:27.165 INFO:teuthology.orchestra.run.smithi124.stdout:064.out 2023-10-16T13:01:27.165 INFO:teuthology.orchestra.run.smithi124.stdout:065 2023-10-16T13:01:27.165 INFO:teuthology.orchestra.run.smithi124.stdout:065.out 2023-10-16T13:01:27.165 INFO:teuthology.orchestra.run.smithi124.stdout:066 2023-10-16T13:01:27.165 INFO:teuthology.orchestra.run.smithi124.stdout:066.out 2023-10-16T13:01:27.165 INFO:teuthology.orchestra.run.smithi124.stdout:067 2023-10-16T13:01:27.166 INFO:teuthology.orchestra.run.smithi124.stdout:067.out 2023-10-16T13:01:27.166 INFO:teuthology.orchestra.run.smithi124.stdout:068 2023-10-16T13:01:27.166 INFO:teuthology.orchestra.run.smithi124.stdout:068.out 2023-10-16T13:01:27.166 INFO:teuthology.orchestra.run.smithi124.stdout:069 2023-10-16T13:01:27.166 INFO:teuthology.orchestra.run.smithi124.stdout:069.out 2023-10-16T13:01:27.167 INFO:teuthology.orchestra.run.smithi124.stdout:070 2023-10-16T13:01:27.167 INFO:teuthology.orchestra.run.smithi124.stdout:070.out 2023-10-16T13:01:27.167 INFO:teuthology.orchestra.run.smithi124.stdout:071 2023-10-16T13:01:27.167 INFO:teuthology.orchestra.run.smithi124.stdout:071.out 2023-10-16T13:01:27.167 INFO:teuthology.orchestra.run.smithi124.stdout:072 2023-10-16T13:01:27.168 INFO:teuthology.orchestra.run.smithi124.stdout:072.out 2023-10-16T13:01:27.168 INFO:teuthology.orchestra.run.smithi124.stdout:073 2023-10-16T13:01:27.168 INFO:teuthology.orchestra.run.smithi124.stdout:073.out 2023-10-16T13:01:27.168 INFO:teuthology.orchestra.run.smithi124.stdout:074 2023-10-16T13:01:27.168 INFO:teuthology.orchestra.run.smithi124.stdout:074.out 2023-10-16T13:01:27.169 INFO:teuthology.orchestra.run.smithi124.stdout:075 2023-10-16T13:01:27.169 INFO:teuthology.orchestra.run.smithi124.stdout:075.out 2023-10-16T13:01:27.169 INFO:teuthology.orchestra.run.smithi124.stdout:076 2023-10-16T13:01:27.169 INFO:teuthology.orchestra.run.smithi124.stdout:076.out 2023-10-16T13:01:27.169 INFO:teuthology.orchestra.run.smithi124.stdout:077 2023-10-16T13:01:27.169 INFO:teuthology.orchestra.run.smithi124.stdout:077.out 2023-10-16T13:01:27.170 INFO:teuthology.orchestra.run.smithi124.stdout:078 2023-10-16T13:01:27.170 INFO:teuthology.orchestra.run.smithi124.stdout:078.out 2023-10-16T13:01:27.170 INFO:teuthology.orchestra.run.smithi124.stdout:079 2023-10-16T13:01:27.170 INFO:teuthology.orchestra.run.smithi124.stdout:079.out 2023-10-16T13:01:27.170 INFO:teuthology.orchestra.run.smithi124.stdout:080 2023-10-16T13:01:27.171 INFO:teuthology.orchestra.run.smithi124.stdout:080.out 2023-10-16T13:01:27.171 INFO:teuthology.orchestra.run.smithi124.stdout:081 2023-10-16T13:01:27.171 INFO:teuthology.orchestra.run.smithi124.stdout:081.out 2023-10-16T13:01:27.171 INFO:teuthology.orchestra.run.smithi124.stdout:082 2023-10-16T13:01:27.171 INFO:teuthology.orchestra.run.smithi124.stdout:082.out 2023-10-16T13:01:27.172 INFO:teuthology.orchestra.run.smithi124.stdout:083 2023-10-16T13:01:27.172 INFO:teuthology.orchestra.run.smithi124.stdout:083.out 2023-10-16T13:01:27.172 INFO:teuthology.orchestra.run.smithi124.stdout:084 2023-10-16T13:01:27.172 INFO:teuthology.orchestra.run.smithi124.stdout:084.out 2023-10-16T13:01:27.172 INFO:teuthology.orchestra.run.smithi124.stdout:085 2023-10-16T13:01:27.172 INFO:teuthology.orchestra.run.smithi124.stdout:085.out 2023-10-16T13:01:27.173 INFO:teuthology.orchestra.run.smithi124.stdout:086 2023-10-16T13:01:27.173 INFO:teuthology.orchestra.run.smithi124.stdout:086.out 2023-10-16T13:01:27.173 INFO:teuthology.orchestra.run.smithi124.stdout:087 2023-10-16T13:01:27.173 INFO:teuthology.orchestra.run.smithi124.stdout:087.out 2023-10-16T13:01:27.173 INFO:teuthology.orchestra.run.smithi124.stdout:088 2023-10-16T13:01:27.174 INFO:teuthology.orchestra.run.smithi124.stdout:088.out 2023-10-16T13:01:27.174 INFO:teuthology.orchestra.run.smithi124.stdout:089 2023-10-16T13:01:27.174 INFO:teuthology.orchestra.run.smithi124.stdout:089.out 2023-10-16T13:01:27.174 INFO:teuthology.orchestra.run.smithi124.stdout:090 2023-10-16T13:01:27.174 INFO:teuthology.orchestra.run.smithi124.stdout:090.out 2023-10-16T13:01:27.175 INFO:teuthology.orchestra.run.smithi124.stdout:091 2023-10-16T13:01:27.175 INFO:teuthology.orchestra.run.smithi124.stdout:091.out 2023-10-16T13:01:27.175 INFO:teuthology.orchestra.run.smithi124.stdout:092 2023-10-16T13:01:27.175 INFO:teuthology.orchestra.run.smithi124.stdout:092.out 2023-10-16T13:01:27.175 INFO:teuthology.orchestra.run.smithi124.stdout:093 2023-10-16T13:01:27.176 INFO:teuthology.orchestra.run.smithi124.stdout:093.out 2023-10-16T13:01:27.176 INFO:teuthology.orchestra.run.smithi124.stdout:094 2023-10-16T13:01:27.176 INFO:teuthology.orchestra.run.smithi124.stdout:094.out 2023-10-16T13:01:27.176 INFO:teuthology.orchestra.run.smithi124.stdout:095 2023-10-16T13:01:27.176 INFO:teuthology.orchestra.run.smithi124.stdout:095.out 2023-10-16T13:01:27.177 INFO:teuthology.orchestra.run.smithi124.stdout:096 2023-10-16T13:01:27.177 INFO:teuthology.orchestra.run.smithi124.stdout:096.out 2023-10-16T13:01:27.177 INFO:teuthology.orchestra.run.smithi124.stdout:097 2023-10-16T13:01:27.177 INFO:teuthology.orchestra.run.smithi124.stdout:097.out 2023-10-16T13:01:27.177 INFO:teuthology.orchestra.run.smithi124.stdout:098 2023-10-16T13:01:27.177 INFO:teuthology.orchestra.run.smithi124.stdout:098.out 2023-10-16T13:01:27.178 INFO:teuthology.orchestra.run.smithi124.stdout:099 2023-10-16T13:01:27.178 INFO:teuthology.orchestra.run.smithi124.stdout:099.out 2023-10-16T13:01:27.178 INFO:teuthology.orchestra.run.smithi124.stdout:100 2023-10-16T13:01:27.178 INFO:teuthology.orchestra.run.smithi124.stdout:100.out 2023-10-16T13:01:27.178 INFO:teuthology.orchestra.run.smithi124.stdout:101 2023-10-16T13:01:27.179 INFO:teuthology.orchestra.run.smithi124.stdout:101.out 2023-10-16T13:01:27.179 INFO:teuthology.orchestra.run.smithi124.stdout:102 2023-10-16T13:01:27.179 INFO:teuthology.orchestra.run.smithi124.stdout:102.out 2023-10-16T13:01:27.179 INFO:teuthology.orchestra.run.smithi124.stdout:103 2023-10-16T13:01:27.179 INFO:teuthology.orchestra.run.smithi124.stdout:103.out 2023-10-16T13:01:27.180 INFO:teuthology.orchestra.run.smithi124.stdout:104 2023-10-16T13:01:27.180 INFO:teuthology.orchestra.run.smithi124.stdout:104.out 2023-10-16T13:01:27.180 INFO:teuthology.orchestra.run.smithi124.stdout:105 2023-10-16T13:01:27.180 INFO:teuthology.orchestra.run.smithi124.stdout:105.out 2023-10-16T13:01:27.180 INFO:teuthology.orchestra.run.smithi124.stdout:106 2023-10-16T13:01:27.181 INFO:teuthology.orchestra.run.smithi124.stdout:106.out 2023-10-16T13:01:27.181 INFO:teuthology.orchestra.run.smithi124.stdout:107 2023-10-16T13:01:27.181 INFO:teuthology.orchestra.run.smithi124.stdout:107.out 2023-10-16T13:01:27.181 INFO:teuthology.orchestra.run.smithi124.stdout:108 2023-10-16T13:01:27.181 INFO:teuthology.orchestra.run.smithi124.stdout:108.out 2023-10-16T13:01:27.181 INFO:teuthology.orchestra.run.smithi124.stdout:109 2023-10-16T13:01:27.182 INFO:teuthology.orchestra.run.smithi124.stdout:109.out 2023-10-16T13:01:27.182 INFO:teuthology.orchestra.run.smithi124.stdout:110 2023-10-16T13:01:27.182 INFO:teuthology.orchestra.run.smithi124.stdout:110.out 2023-10-16T13:01:27.182 INFO:teuthology.orchestra.run.smithi124.stdout:111 2023-10-16T13:01:27.182 INFO:teuthology.orchestra.run.smithi124.stdout:111.out 2023-10-16T13:01:27.183 INFO:teuthology.orchestra.run.smithi124.stdout:112 2023-10-16T13:01:27.183 INFO:teuthology.orchestra.run.smithi124.stdout:112.out 2023-10-16T13:01:27.183 INFO:teuthology.orchestra.run.smithi124.stdout:113 2023-10-16T13:01:27.183 INFO:teuthology.orchestra.run.smithi124.stdout:113.out 2023-10-16T13:01:27.183 INFO:teuthology.orchestra.run.smithi124.stdout:114 2023-10-16T13:01:27.184 INFO:teuthology.orchestra.run.smithi124.stdout:114.out 2023-10-16T13:01:27.184 INFO:teuthology.orchestra.run.smithi124.stdout:115 2023-10-16T13:01:27.184 INFO:teuthology.orchestra.run.smithi124.stdout:115.out 2023-10-16T13:01:27.184 INFO:teuthology.orchestra.run.smithi124.stdout:116 2023-10-16T13:01:27.184 INFO:teuthology.orchestra.run.smithi124.stdout:116.out 2023-10-16T13:01:27.185 INFO:teuthology.orchestra.run.smithi124.stdout:117 2023-10-16T13:01:27.185 INFO:teuthology.orchestra.run.smithi124.stdout:117.out 2023-10-16T13:01:27.185 INFO:teuthology.orchestra.run.smithi124.stdout:118 2023-10-16T13:01:27.185 INFO:teuthology.orchestra.run.smithi124.stdout:118.out 2023-10-16T13:01:27.185 INFO:teuthology.orchestra.run.smithi124.stdout:119 2023-10-16T13:01:27.186 INFO:teuthology.orchestra.run.smithi124.stdout:119.out 2023-10-16T13:01:27.186 INFO:teuthology.orchestra.run.smithi124.stdout:120 2023-10-16T13:01:27.186 INFO:teuthology.orchestra.run.smithi124.stdout:120.out 2023-10-16T13:01:27.186 INFO:teuthology.orchestra.run.smithi124.stdout:121 2023-10-16T13:01:27.186 INFO:teuthology.orchestra.run.smithi124.stdout:121.out 2023-10-16T13:01:27.187 INFO:teuthology.orchestra.run.smithi124.stdout:122 2023-10-16T13:01:27.187 INFO:teuthology.orchestra.run.smithi124.stdout:122.out 2023-10-16T13:01:27.187 INFO:teuthology.orchestra.run.smithi124.stdout:123 2023-10-16T13:01:27.187 INFO:teuthology.orchestra.run.smithi124.stdout:123.out 2023-10-16T13:01:27.187 INFO:teuthology.orchestra.run.smithi124.stdout:124 2023-10-16T13:01:27.188 INFO:teuthology.orchestra.run.smithi124.stdout:124.out 2023-10-16T13:01:27.188 INFO:teuthology.orchestra.run.smithi124.stdout:125 2023-10-16T13:01:27.188 INFO:teuthology.orchestra.run.smithi124.stdout:125.out 2023-10-16T13:01:27.188 INFO:teuthology.orchestra.run.smithi124.stdout:126 2023-10-16T13:01:27.188 INFO:teuthology.orchestra.run.smithi124.stdout:126.out 2023-10-16T13:01:27.188 INFO:teuthology.orchestra.run.smithi124.stdout:127 2023-10-16T13:01:27.189 INFO:teuthology.orchestra.run.smithi124.stdout:127.out 2023-10-16T13:01:27.189 INFO:teuthology.orchestra.run.smithi124.stdout:128 2023-10-16T13:01:27.189 INFO:teuthology.orchestra.run.smithi124.stdout:128.out 2023-10-16T13:01:27.189 INFO:teuthology.orchestra.run.smithi124.stdout:129 2023-10-16T13:01:27.189 INFO:teuthology.orchestra.run.smithi124.stdout:129.out 2023-10-16T13:01:27.190 INFO:teuthology.orchestra.run.smithi124.stdout:130 2023-10-16T13:01:27.190 INFO:teuthology.orchestra.run.smithi124.stdout:130.out 2023-10-16T13:01:27.190 INFO:teuthology.orchestra.run.smithi124.stdout:131 2023-10-16T13:01:27.190 INFO:teuthology.orchestra.run.smithi124.stdout:131.out 2023-10-16T13:01:27.190 INFO:teuthology.orchestra.run.smithi124.stdout:132 2023-10-16T13:01:27.191 INFO:teuthology.orchestra.run.smithi124.stdout:132.out 2023-10-16T13:01:27.191 INFO:teuthology.orchestra.run.smithi124.stdout:133 2023-10-16T13:01:27.191 INFO:teuthology.orchestra.run.smithi124.stdout:133.out 2023-10-16T13:01:27.191 INFO:teuthology.orchestra.run.smithi124.stdout:134 2023-10-16T13:01:27.191 INFO:teuthology.orchestra.run.smithi124.stdout:134.out 2023-10-16T13:01:27.192 INFO:teuthology.orchestra.run.smithi124.stdout:135 2023-10-16T13:01:27.192 INFO:teuthology.orchestra.run.smithi124.stdout:135.out 2023-10-16T13:01:27.192 INFO:teuthology.orchestra.run.smithi124.stdout:136 2023-10-16T13:01:27.192 INFO:teuthology.orchestra.run.smithi124.stdout:136.out 2023-10-16T13:01:27.192 INFO:teuthology.orchestra.run.smithi124.stdout:137 2023-10-16T13:01:27.193 INFO:teuthology.orchestra.run.smithi124.stdout:137.out 2023-10-16T13:01:27.193 INFO:teuthology.orchestra.run.smithi124.stdout:138 2023-10-16T13:01:27.193 INFO:teuthology.orchestra.run.smithi124.stdout:138.out 2023-10-16T13:01:27.193 INFO:teuthology.orchestra.run.smithi124.stdout:139 2023-10-16T13:01:27.193 INFO:teuthology.orchestra.run.smithi124.stdout:139.out 2023-10-16T13:01:27.194 INFO:teuthology.orchestra.run.smithi124.stdout:140 2023-10-16T13:01:27.194 INFO:teuthology.orchestra.run.smithi124.stdout:140.out 2023-10-16T13:01:27.194 INFO:teuthology.orchestra.run.smithi124.stdout:141 2023-10-16T13:01:27.194 INFO:teuthology.orchestra.run.smithi124.stdout:141.out 2023-10-16T13:01:27.194 INFO:teuthology.orchestra.run.smithi124.stdout:142 2023-10-16T13:01:27.195 INFO:teuthology.orchestra.run.smithi124.stdout:142.out 2023-10-16T13:01:27.195 INFO:teuthology.orchestra.run.smithi124.stdout:143 2023-10-16T13:01:27.195 INFO:teuthology.orchestra.run.smithi124.stdout:143.out 2023-10-16T13:01:27.195 INFO:teuthology.orchestra.run.smithi124.stdout:144 2023-10-16T13:01:27.195 INFO:teuthology.orchestra.run.smithi124.stdout:144.out 2023-10-16T13:01:27.196 INFO:teuthology.orchestra.run.smithi124.stdout:145 2023-10-16T13:01:27.196 INFO:teuthology.orchestra.run.smithi124.stdout:145.out 2023-10-16T13:01:27.196 INFO:teuthology.orchestra.run.smithi124.stdout:146 2023-10-16T13:01:27.196 INFO:teuthology.orchestra.run.smithi124.stdout:146.out 2023-10-16T13:01:27.196 INFO:teuthology.orchestra.run.smithi124.stdout:147 2023-10-16T13:01:27.196 INFO:teuthology.orchestra.run.smithi124.stdout:147.out 2023-10-16T13:01:27.197 INFO:teuthology.orchestra.run.smithi124.stdout:148 2023-10-16T13:01:27.197 INFO:teuthology.orchestra.run.smithi124.stdout:148.out 2023-10-16T13:01:27.197 INFO:teuthology.orchestra.run.smithi124.stdout:149 2023-10-16T13:01:27.197 INFO:teuthology.orchestra.run.smithi124.stdout:149.out 2023-10-16T13:01:27.197 INFO:teuthology.orchestra.run.smithi124.stdout:150 2023-10-16T13:01:27.198 INFO:teuthology.orchestra.run.smithi124.stdout:150.out 2023-10-16T13:01:27.198 INFO:teuthology.orchestra.run.smithi124.stdout:151 2023-10-16T13:01:27.198 INFO:teuthology.orchestra.run.smithi124.stdout:151.out 2023-10-16T13:01:27.198 INFO:teuthology.orchestra.run.smithi124.stdout:152 2023-10-16T13:01:27.198 INFO:teuthology.orchestra.run.smithi124.stdout:152.out 2023-10-16T13:01:27.199 INFO:teuthology.orchestra.run.smithi124.stdout:153 2023-10-16T13:01:27.199 INFO:teuthology.orchestra.run.smithi124.stdout:153.out 2023-10-16T13:01:27.199 INFO:teuthology.orchestra.run.smithi124.stdout:154 2023-10-16T13:01:27.199 INFO:teuthology.orchestra.run.smithi124.stdout:154.out 2023-10-16T13:01:27.199 INFO:teuthology.orchestra.run.smithi124.stdout:155 2023-10-16T13:01:27.200 INFO:teuthology.orchestra.run.smithi124.stdout:155.out 2023-10-16T13:01:27.200 INFO:teuthology.orchestra.run.smithi124.stdout:156 2023-10-16T13:01:27.200 INFO:teuthology.orchestra.run.smithi124.stdout:156.out 2023-10-16T13:01:27.200 INFO:teuthology.orchestra.run.smithi124.stdout:157 2023-10-16T13:01:27.200 INFO:teuthology.orchestra.run.smithi124.stdout:157.out 2023-10-16T13:01:27.201 INFO:teuthology.orchestra.run.smithi124.stdout:158 2023-10-16T13:01:27.201 INFO:teuthology.orchestra.run.smithi124.stdout:158.out 2023-10-16T13:01:27.201 INFO:teuthology.orchestra.run.smithi124.stdout:159 2023-10-16T13:01:27.201 INFO:teuthology.orchestra.run.smithi124.stdout:159.out 2023-10-16T13:01:27.201 INFO:teuthology.orchestra.run.smithi124.stdout:160 2023-10-16T13:01:27.201 INFO:teuthology.orchestra.run.smithi124.stdout:160.out 2023-10-16T13:01:27.202 INFO:teuthology.orchestra.run.smithi124.stdout:161 2023-10-16T13:01:27.202 INFO:teuthology.orchestra.run.smithi124.stdout:161.out 2023-10-16T13:01:27.202 INFO:teuthology.orchestra.run.smithi124.stdout:162 2023-10-16T13:01:27.202 INFO:teuthology.orchestra.run.smithi124.stdout:162.out 2023-10-16T13:01:27.202 INFO:teuthology.orchestra.run.smithi124.stdout:163 2023-10-16T13:01:27.203 INFO:teuthology.orchestra.run.smithi124.stdout:163.out 2023-10-16T13:01:27.203 INFO:teuthology.orchestra.run.smithi124.stdout:164 2023-10-16T13:01:27.203 INFO:teuthology.orchestra.run.smithi124.stdout:164.out 2023-10-16T13:01:27.203 INFO:teuthology.orchestra.run.smithi124.stdout:165 2023-10-16T13:01:27.203 INFO:teuthology.orchestra.run.smithi124.stdout:165.out 2023-10-16T13:01:27.204 INFO:teuthology.orchestra.run.smithi124.stdout:166 2023-10-16T13:01:27.204 INFO:teuthology.orchestra.run.smithi124.stdout:166.out 2023-10-16T13:01:27.204 INFO:teuthology.orchestra.run.smithi124.stdout:167 2023-10-16T13:01:27.204 INFO:teuthology.orchestra.run.smithi124.stdout:167.out 2023-10-16T13:01:27.204 INFO:teuthology.orchestra.run.smithi124.stdout:168 2023-10-16T13:01:27.204 INFO:teuthology.orchestra.run.smithi124.stdout:168.out 2023-10-16T13:01:27.205 INFO:teuthology.orchestra.run.smithi124.stdout:169 2023-10-16T13:01:27.205 INFO:teuthology.orchestra.run.smithi124.stdout:169.out 2023-10-16T13:01:27.205 INFO:teuthology.orchestra.run.smithi124.stdout:170 2023-10-16T13:01:27.205 INFO:teuthology.orchestra.run.smithi124.stdout:170.out 2023-10-16T13:01:27.205 INFO:teuthology.orchestra.run.smithi124.stdout:171 2023-10-16T13:01:27.206 INFO:teuthology.orchestra.run.smithi124.stdout:171.out 2023-10-16T13:01:27.206 INFO:teuthology.orchestra.run.smithi124.stdout:172 2023-10-16T13:01:27.206 INFO:teuthology.orchestra.run.smithi124.stdout:172.out 2023-10-16T13:01:27.206 INFO:teuthology.orchestra.run.smithi124.stdout:173 2023-10-16T13:01:27.206 INFO:teuthology.orchestra.run.smithi124.stdout:173.out 2023-10-16T13:01:27.207 INFO:teuthology.orchestra.run.smithi124.stdout:174 2023-10-16T13:01:27.207 INFO:teuthology.orchestra.run.smithi124.stdout:174.out 2023-10-16T13:01:27.207 INFO:teuthology.orchestra.run.smithi124.stdout:175 2023-10-16T13:01:27.207 INFO:teuthology.orchestra.run.smithi124.stdout:175.out 2023-10-16T13:01:27.207 INFO:teuthology.orchestra.run.smithi124.stdout:176 2023-10-16T13:01:27.208 INFO:teuthology.orchestra.run.smithi124.stdout:176.out 2023-10-16T13:01:27.208 INFO:teuthology.orchestra.run.smithi124.stdout:177 2023-10-16T13:01:27.208 INFO:teuthology.orchestra.run.smithi124.stdout:177.out 2023-10-16T13:01:27.208 INFO:teuthology.orchestra.run.smithi124.stdout:178 2023-10-16T13:01:27.208 INFO:teuthology.orchestra.run.smithi124.stdout:178.out 2023-10-16T13:01:27.209 INFO:teuthology.orchestra.run.smithi124.stdout:179 2023-10-16T13:01:27.209 INFO:teuthology.orchestra.run.smithi124.stdout:179.out 2023-10-16T13:01:27.209 INFO:teuthology.orchestra.run.smithi124.stdout:180 2023-10-16T13:01:27.209 INFO:teuthology.orchestra.run.smithi124.stdout:180.out 2023-10-16T13:01:27.209 INFO:teuthology.orchestra.run.smithi124.stdout:181 2023-10-16T13:01:27.210 INFO:teuthology.orchestra.run.smithi124.stdout:181.out 2023-10-16T13:01:27.210 INFO:teuthology.orchestra.run.smithi124.stdout:182 2023-10-16T13:01:27.210 INFO:teuthology.orchestra.run.smithi124.stdout:182.out 2023-10-16T13:01:27.210 INFO:teuthology.orchestra.run.smithi124.stdout:183 2023-10-16T13:01:27.210 INFO:teuthology.orchestra.run.smithi124.stdout:183.out 2023-10-16T13:01:27.210 INFO:teuthology.orchestra.run.smithi124.stdout:184 2023-10-16T13:01:27.211 INFO:teuthology.orchestra.run.smithi124.stdout:184.out 2023-10-16T13:01:27.211 INFO:teuthology.orchestra.run.smithi124.stdout:185 2023-10-16T13:01:27.211 INFO:teuthology.orchestra.run.smithi124.stdout:185.out 2023-10-16T13:01:27.211 INFO:teuthology.orchestra.run.smithi124.stdout:186 2023-10-16T13:01:27.211 INFO:teuthology.orchestra.run.smithi124.stdout:186.out 2023-10-16T13:01:27.212 INFO:teuthology.orchestra.run.smithi124.stdout:187 2023-10-16T13:01:27.212 INFO:teuthology.orchestra.run.smithi124.stdout:187.out 2023-10-16T13:01:27.212 INFO:teuthology.orchestra.run.smithi124.stdout:188 2023-10-16T13:01:27.212 INFO:teuthology.orchestra.run.smithi124.stdout:188.out 2023-10-16T13:01:27.212 INFO:teuthology.orchestra.run.smithi124.stdout:189 2023-10-16T13:01:27.213 INFO:teuthology.orchestra.run.smithi124.stdout:189.out 2023-10-16T13:01:27.213 INFO:teuthology.orchestra.run.smithi124.stdout:190 2023-10-16T13:01:27.213 INFO:teuthology.orchestra.run.smithi124.stdout:190.out 2023-10-16T13:01:27.213 INFO:teuthology.orchestra.run.smithi124.stdout:191 2023-10-16T13:01:27.213 INFO:teuthology.orchestra.run.smithi124.stdout:191.out 2023-10-16T13:01:27.214 INFO:teuthology.orchestra.run.smithi124.stdout:192 2023-10-16T13:01:27.214 INFO:teuthology.orchestra.run.smithi124.stdout:192.out 2023-10-16T13:01:27.214 INFO:teuthology.orchestra.run.smithi124.stdout:193 2023-10-16T13:01:27.214 INFO:teuthology.orchestra.run.smithi124.stdout:193.out 2023-10-16T13:01:27.214 INFO:teuthology.orchestra.run.smithi124.stdout:194 2023-10-16T13:01:27.215 INFO:teuthology.orchestra.run.smithi124.stdout:194.out 2023-10-16T13:01:27.215 INFO:teuthology.orchestra.run.smithi124.stdout:195 2023-10-16T13:01:27.215 INFO:teuthology.orchestra.run.smithi124.stdout:195.out 2023-10-16T13:01:27.215 INFO:teuthology.orchestra.run.smithi124.stdout:196 2023-10-16T13:01:27.215 INFO:teuthology.orchestra.run.smithi124.stdout:196.out 2023-10-16T13:01:27.216 INFO:teuthology.orchestra.run.smithi124.stdout:197 2023-10-16T13:01:27.216 INFO:teuthology.orchestra.run.smithi124.stdout:197.out 2023-10-16T13:01:27.216 INFO:teuthology.orchestra.run.smithi124.stdout:198 2023-10-16T13:01:27.216 INFO:teuthology.orchestra.run.smithi124.stdout:198.out 2023-10-16T13:01:27.216 INFO:teuthology.orchestra.run.smithi124.stdout:199 2023-10-16T13:01:27.217 INFO:teuthology.orchestra.run.smithi124.stdout:199.out 2023-10-16T13:01:27.217 INFO:teuthology.orchestra.run.smithi124.stdout:200 2023-10-16T13:01:27.217 INFO:teuthology.orchestra.run.smithi124.stdout:200.out 2023-10-16T13:01:27.217 INFO:teuthology.orchestra.run.smithi124.stdout:201 2023-10-16T13:01:27.217 INFO:teuthology.orchestra.run.smithi124.stdout:201.out 2023-10-16T13:01:27.218 INFO:teuthology.orchestra.run.smithi124.stdout:202 2023-10-16T13:01:27.218 INFO:teuthology.orchestra.run.smithi124.stdout:202.out 2023-10-16T13:01:27.218 INFO:teuthology.orchestra.run.smithi124.stdout:203 2023-10-16T13:01:27.218 INFO:teuthology.orchestra.run.smithi124.stdout:203.out 2023-10-16T13:01:27.218 INFO:teuthology.orchestra.run.smithi124.stdout:204 2023-10-16T13:01:27.219 INFO:teuthology.orchestra.run.smithi124.stdout:204.out 2023-10-16T13:01:27.219 INFO:teuthology.orchestra.run.smithi124.stdout:205 2023-10-16T13:01:27.219 INFO:teuthology.orchestra.run.smithi124.stdout:205.out 2023-10-16T13:01:27.219 INFO:teuthology.orchestra.run.smithi124.stdout:206 2023-10-16T13:01:27.219 INFO:teuthology.orchestra.run.smithi124.stdout:206.out 2023-10-16T13:01:27.220 INFO:teuthology.orchestra.run.smithi124.stdout:207 2023-10-16T13:01:27.221 INFO:teuthology.orchestra.run.smithi124.stdout:207.out 2023-10-16T13:01:27.221 INFO:teuthology.orchestra.run.smithi124.stdout:208 2023-10-16T13:01:27.221 INFO:teuthology.orchestra.run.smithi124.stdout:208.out 2023-10-16T13:01:27.221 INFO:teuthology.orchestra.run.smithi124.stdout:209 2023-10-16T13:01:27.221 INFO:teuthology.orchestra.run.smithi124.stdout:209.out 2023-10-16T13:01:27.222 INFO:teuthology.orchestra.run.smithi124.stdout:210 2023-10-16T13:01:27.222 INFO:teuthology.orchestra.run.smithi124.stdout:210.out 2023-10-16T13:01:27.222 INFO:teuthology.orchestra.run.smithi124.stdout:211 2023-10-16T13:01:27.222 INFO:teuthology.orchestra.run.smithi124.stdout:211.out 2023-10-16T13:01:27.223 INFO:teuthology.orchestra.run.smithi124.stdout:212 2023-10-16T13:01:27.223 INFO:teuthology.orchestra.run.smithi124.stdout:212.out 2023-10-16T13:01:27.223 INFO:teuthology.orchestra.run.smithi124.stdout:213 2023-10-16T13:01:27.223 INFO:teuthology.orchestra.run.smithi124.stdout:213.out 2023-10-16T13:01:27.223 INFO:teuthology.orchestra.run.smithi124.stdout:214 2023-10-16T13:01:27.224 INFO:teuthology.orchestra.run.smithi124.stdout:214.out 2023-10-16T13:01:27.224 INFO:teuthology.orchestra.run.smithi124.stdout:215 2023-10-16T13:01:27.224 INFO:teuthology.orchestra.run.smithi124.stdout:215.out 2023-10-16T13:01:27.224 INFO:teuthology.orchestra.run.smithi124.stdout:216 2023-10-16T13:01:27.224 INFO:teuthology.orchestra.run.smithi124.stdout:216.out 2023-10-16T13:01:27.225 INFO:teuthology.orchestra.run.smithi124.stdout:217 2023-10-16T13:01:27.225 INFO:teuthology.orchestra.run.smithi124.stdout:217.out 2023-10-16T13:01:27.225 INFO:teuthology.orchestra.run.smithi124.stdout:218 2023-10-16T13:01:27.225 INFO:teuthology.orchestra.run.smithi124.stdout:218.out 2023-10-16T13:01:27.225 INFO:teuthology.orchestra.run.smithi124.stdout:219 2023-10-16T13:01:27.225 INFO:teuthology.orchestra.run.smithi124.stdout:219.out 2023-10-16T13:01:27.226 INFO:teuthology.orchestra.run.smithi124.stdout:220 2023-10-16T13:01:27.226 INFO:teuthology.orchestra.run.smithi124.stdout:220.out 2023-10-16T13:01:27.226 INFO:teuthology.orchestra.run.smithi124.stdout:221 2023-10-16T13:01:27.226 INFO:teuthology.orchestra.run.smithi124.stdout:221.out 2023-10-16T13:01:27.226 INFO:teuthology.orchestra.run.smithi124.stdout:222 2023-10-16T13:01:27.227 INFO:teuthology.orchestra.run.smithi124.stdout:222.out 2023-10-16T13:01:27.227 INFO:teuthology.orchestra.run.smithi124.stdout:223 2023-10-16T13:01:27.227 INFO:teuthology.orchestra.run.smithi124.stdout:223.out 2023-10-16T13:01:27.227 INFO:teuthology.orchestra.run.smithi124.stdout:224 2023-10-16T13:01:27.227 INFO:teuthology.orchestra.run.smithi124.stdout:224.out 2023-10-16T13:01:27.228 INFO:teuthology.orchestra.run.smithi124.stdout:225 2023-10-16T13:01:27.228 INFO:teuthology.orchestra.run.smithi124.stdout:225.out 2023-10-16T13:01:27.228 INFO:teuthology.orchestra.run.smithi124.stdout:226 2023-10-16T13:01:27.228 INFO:teuthology.orchestra.run.smithi124.stdout:226.out 2023-10-16T13:01:27.228 INFO:teuthology.orchestra.run.smithi124.stdout:227 2023-10-16T13:01:27.229 INFO:teuthology.orchestra.run.smithi124.stdout:227.out 2023-10-16T13:01:27.229 INFO:teuthology.orchestra.run.smithi124.stdout:228 2023-10-16T13:01:27.229 INFO:teuthology.orchestra.run.smithi124.stdout:228.out 2023-10-16T13:01:27.229 INFO:teuthology.orchestra.run.smithi124.stdout:229 2023-10-16T13:01:27.229 INFO:teuthology.orchestra.run.smithi124.stdout:229.out 2023-10-16T13:01:27.230 INFO:teuthology.orchestra.run.smithi124.stdout:230 2023-10-16T13:01:27.230 INFO:teuthology.orchestra.run.smithi124.stdout:230.out 2023-10-16T13:01:27.230 INFO:teuthology.orchestra.run.smithi124.stdout:231 2023-10-16T13:01:27.230 INFO:teuthology.orchestra.run.smithi124.stdout:231.out 2023-10-16T13:01:27.230 INFO:teuthology.orchestra.run.smithi124.stdout:232 2023-10-16T13:01:27.231 INFO:teuthology.orchestra.run.smithi124.stdout:232.out 2023-10-16T13:01:27.231 INFO:teuthology.orchestra.run.smithi124.stdout:233 2023-10-16T13:01:27.231 INFO:teuthology.orchestra.run.smithi124.stdout:233.out 2023-10-16T13:01:27.231 INFO:teuthology.orchestra.run.smithi124.stdout:234 2023-10-16T13:01:27.231 INFO:teuthology.orchestra.run.smithi124.stdout:234.out 2023-10-16T13:01:27.231 INFO:teuthology.orchestra.run.smithi124.stdout:235 2023-10-16T13:01:27.232 INFO:teuthology.orchestra.run.smithi124.stdout:235.out 2023-10-16T13:01:27.232 INFO:teuthology.orchestra.run.smithi124.stdout:236 2023-10-16T13:01:27.232 INFO:teuthology.orchestra.run.smithi124.stdout:236.out 2023-10-16T13:01:27.232 INFO:teuthology.orchestra.run.smithi124.stdout:237 2023-10-16T13:01:27.232 INFO:teuthology.orchestra.run.smithi124.stdout:237.out 2023-10-16T13:01:27.233 INFO:teuthology.orchestra.run.smithi124.stdout:238 2023-10-16T13:01:27.233 INFO:teuthology.orchestra.run.smithi124.stdout:238.out 2023-10-16T13:01:27.233 INFO:teuthology.orchestra.run.smithi124.stdout:239 2023-10-16T13:01:27.233 INFO:teuthology.orchestra.run.smithi124.stdout:239.out 2023-10-16T13:01:27.233 INFO:teuthology.orchestra.run.smithi124.stdout:240 2023-10-16T13:01:27.234 INFO:teuthology.orchestra.run.smithi124.stdout:240.out 2023-10-16T13:01:27.234 INFO:teuthology.orchestra.run.smithi124.stdout:241 2023-10-16T13:01:27.234 INFO:teuthology.orchestra.run.smithi124.stdout:241.out 2023-10-16T13:01:27.234 INFO:teuthology.orchestra.run.smithi124.stdout:242 2023-10-16T13:01:27.234 INFO:teuthology.orchestra.run.smithi124.stdout:242.out 2023-10-16T13:01:27.235 INFO:teuthology.orchestra.run.smithi124.stdout:243 2023-10-16T13:01:27.235 INFO:teuthology.orchestra.run.smithi124.stdout:243.out 2023-10-16T13:01:27.235 INFO:teuthology.orchestra.run.smithi124.stdout:244 2023-10-16T13:01:27.235 INFO:teuthology.orchestra.run.smithi124.stdout:244.out 2023-10-16T13:01:27.235 INFO:teuthology.orchestra.run.smithi124.stdout:245 2023-10-16T13:01:27.236 INFO:teuthology.orchestra.run.smithi124.stdout:245.out 2023-10-16T13:01:27.236 INFO:teuthology.orchestra.run.smithi124.stdout:246 2023-10-16T13:01:27.236 INFO:teuthology.orchestra.run.smithi124.stdout:246.out 2023-10-16T13:01:27.236 INFO:teuthology.orchestra.run.smithi124.stdout:247 2023-10-16T13:01:27.236 INFO:teuthology.orchestra.run.smithi124.stdout:247.out 2023-10-16T13:01:27.237 INFO:teuthology.orchestra.run.smithi124.stdout:248 2023-10-16T13:01:27.237 INFO:teuthology.orchestra.run.smithi124.stdout:248.out 2023-10-16T13:01:27.237 INFO:teuthology.orchestra.run.smithi124.stdout:249 2023-10-16T13:01:27.237 INFO:teuthology.orchestra.run.smithi124.stdout:249.out 2023-10-16T13:01:27.237 INFO:teuthology.orchestra.run.smithi124.stdout:250 2023-10-16T13:01:27.238 INFO:teuthology.orchestra.run.smithi124.stdout:250.out 2023-10-16T13:01:27.238 INFO:teuthology.orchestra.run.smithi124.stdout:251 2023-10-16T13:01:27.238 INFO:teuthology.orchestra.run.smithi124.stdout:251.out 2023-10-16T13:01:27.238 INFO:teuthology.orchestra.run.smithi124.stdout:252 2023-10-16T13:01:27.238 INFO:teuthology.orchestra.run.smithi124.stdout:252.out 2023-10-16T13:01:27.239 INFO:teuthology.orchestra.run.smithi124.stdout:253 2023-10-16T13:01:27.239 INFO:teuthology.orchestra.run.smithi124.stdout:253.out 2023-10-16T13:01:27.239 INFO:teuthology.orchestra.run.smithi124.stdout:254 2023-10-16T13:01:27.239 INFO:teuthology.orchestra.run.smithi124.stdout:254.out 2023-10-16T13:01:27.239 INFO:teuthology.orchestra.run.smithi124.stdout:255 2023-10-16T13:01:27.240 INFO:teuthology.orchestra.run.smithi124.stdout:255.out 2023-10-16T13:01:27.240 INFO:teuthology.orchestra.run.smithi124.stdout:256 2023-10-16T13:01:27.240 INFO:teuthology.orchestra.run.smithi124.stdout:256.out 2023-10-16T13:01:27.240 INFO:teuthology.orchestra.run.smithi124.stdout:257 2023-10-16T13:01:27.240 INFO:teuthology.orchestra.run.smithi124.stdout:257.out 2023-10-16T13:01:27.241 INFO:teuthology.orchestra.run.smithi124.stdout:258 2023-10-16T13:01:27.241 INFO:teuthology.orchestra.run.smithi124.stdout:258.out 2023-10-16T13:01:27.241 INFO:teuthology.orchestra.run.smithi124.stdout:259 2023-10-16T13:01:27.241 INFO:teuthology.orchestra.run.smithi124.stdout:259.out 2023-10-16T13:01:27.241 INFO:teuthology.orchestra.run.smithi124.stdout:260 2023-10-16T13:01:27.241 INFO:teuthology.orchestra.run.smithi124.stdout:260.out 2023-10-16T13:01:27.242 INFO:teuthology.orchestra.run.smithi124.stdout:261 2023-10-16T13:01:27.242 INFO:teuthology.orchestra.run.smithi124.stdout:261.out 2023-10-16T13:01:27.242 INFO:teuthology.orchestra.run.smithi124.stdout:262 2023-10-16T13:01:27.242 INFO:teuthology.orchestra.run.smithi124.stdout:262.out 2023-10-16T13:01:27.242 INFO:teuthology.orchestra.run.smithi124.stdout:263 2023-10-16T13:01:27.243 INFO:teuthology.orchestra.run.smithi124.stdout:263.out 2023-10-16T13:01:27.243 INFO:teuthology.orchestra.run.smithi124.stdout:264 2023-10-16T13:01:27.243 INFO:teuthology.orchestra.run.smithi124.stdout:264.out 2023-10-16T13:01:27.243 INFO:teuthology.orchestra.run.smithi124.stdout:265 2023-10-16T13:01:27.243 INFO:teuthology.orchestra.run.smithi124.stdout:265.out 2023-10-16T13:01:27.244 INFO:teuthology.orchestra.run.smithi124.stdout:266 2023-10-16T13:01:27.244 INFO:teuthology.orchestra.run.smithi124.stdout:266.out 2023-10-16T13:01:27.244 INFO:teuthology.orchestra.run.smithi124.stdout:267 2023-10-16T13:01:27.244 INFO:teuthology.orchestra.run.smithi124.stdout:267.out 2023-10-16T13:01:27.244 INFO:teuthology.orchestra.run.smithi124.stdout:268 2023-10-16T13:01:27.245 INFO:teuthology.orchestra.run.smithi124.stdout:268.out 2023-10-16T13:01:27.245 INFO:teuthology.orchestra.run.smithi124.stdout:269 2023-10-16T13:01:27.245 INFO:teuthology.orchestra.run.smithi124.stdout:269.out 2023-10-16T13:01:27.245 INFO:teuthology.orchestra.run.smithi124.stdout:270 2023-10-16T13:01:27.245 INFO:teuthology.orchestra.run.smithi124.stdout:270.out 2023-10-16T13:01:27.245 INFO:teuthology.orchestra.run.smithi124.stdout:271 2023-10-16T13:01:27.246 INFO:teuthology.orchestra.run.smithi124.stdout:271.out 2023-10-16T13:01:27.246 INFO:teuthology.orchestra.run.smithi124.stdout:272 2023-10-16T13:01:27.246 INFO:teuthology.orchestra.run.smithi124.stdout:272.out 2023-10-16T13:01:27.246 INFO:teuthology.orchestra.run.smithi124.stdout:273 2023-10-16T13:01:27.246 INFO:teuthology.orchestra.run.smithi124.stdout:273.out 2023-10-16T13:01:27.247 INFO:teuthology.orchestra.run.smithi124.stdout:274 2023-10-16T13:01:27.247 INFO:teuthology.orchestra.run.smithi124.stdout:274.out 2023-10-16T13:01:27.247 INFO:teuthology.orchestra.run.smithi124.stdout:275 2023-10-16T13:01:27.247 INFO:teuthology.orchestra.run.smithi124.stdout:275.out 2023-10-16T13:01:27.247 INFO:teuthology.orchestra.run.smithi124.stdout:276 2023-10-16T13:01:27.248 INFO:teuthology.orchestra.run.smithi124.stdout:276.out 2023-10-16T13:01:27.248 INFO:teuthology.orchestra.run.smithi124.stdout:277 2023-10-16T13:01:27.248 INFO:teuthology.orchestra.run.smithi124.stdout:277.out 2023-10-16T13:01:27.248 INFO:teuthology.orchestra.run.smithi124.stdout:278 2023-10-16T13:01:27.248 INFO:teuthology.orchestra.run.smithi124.stdout:278.out 2023-10-16T13:01:27.249 INFO:teuthology.orchestra.run.smithi124.stdout:279 2023-10-16T13:01:27.249 INFO:teuthology.orchestra.run.smithi124.stdout:279.out 2023-10-16T13:01:27.249 INFO:teuthology.orchestra.run.smithi124.stdout:280 2023-10-16T13:01:27.249 INFO:teuthology.orchestra.run.smithi124.stdout:280.out 2023-10-16T13:01:27.249 INFO:teuthology.orchestra.run.smithi124.stdout:281 2023-10-16T13:01:27.249 INFO:teuthology.orchestra.run.smithi124.stdout:281.out 2023-10-16T13:01:27.250 INFO:teuthology.orchestra.run.smithi124.stdout:282 2023-10-16T13:01:27.250 INFO:teuthology.orchestra.run.smithi124.stdout:282.out 2023-10-16T13:01:27.250 INFO:teuthology.orchestra.run.smithi124.stdout:283 2023-10-16T13:01:27.250 INFO:teuthology.orchestra.run.smithi124.stdout:283.out 2023-10-16T13:01:27.250 INFO:teuthology.orchestra.run.smithi124.stdout:284 2023-10-16T13:01:27.251 INFO:teuthology.orchestra.run.smithi124.stdout:284.out 2023-10-16T13:01:27.251 INFO:teuthology.orchestra.run.smithi124.stdout:285 2023-10-16T13:01:27.251 INFO:teuthology.orchestra.run.smithi124.stdout:285.out 2023-10-16T13:01:27.251 INFO:teuthology.orchestra.run.smithi124.stdout:286 2023-10-16T13:01:27.251 INFO:teuthology.orchestra.run.smithi124.stdout:286.out 2023-10-16T13:01:27.252 INFO:teuthology.orchestra.run.smithi124.stdout:287 2023-10-16T13:01:27.252 INFO:teuthology.orchestra.run.smithi124.stdout:287.out 2023-10-16T13:01:27.252 INFO:teuthology.orchestra.run.smithi124.stdout:288 2023-10-16T13:01:27.252 INFO:teuthology.orchestra.run.smithi124.stdout:288.out 2023-10-16T13:01:27.252 INFO:teuthology.orchestra.run.smithi124.stdout:289 2023-10-16T13:01:27.253 INFO:teuthology.orchestra.run.smithi124.stdout:289.out 2023-10-16T13:01:27.253 INFO:teuthology.orchestra.run.smithi124.stdout:290 2023-10-16T13:01:27.253 INFO:teuthology.orchestra.run.smithi124.stdout:290.out 2023-10-16T13:01:27.253 INFO:teuthology.orchestra.run.smithi124.stdout:291 2023-10-16T13:01:27.253 INFO:teuthology.orchestra.run.smithi124.stdout:291.out 2023-10-16T13:01:27.254 INFO:teuthology.orchestra.run.smithi124.stdout:292 2023-10-16T13:01:27.254 INFO:teuthology.orchestra.run.smithi124.stdout:292.out 2023-10-16T13:01:27.254 INFO:teuthology.orchestra.run.smithi124.stdout:293 2023-10-16T13:01:27.254 INFO:teuthology.orchestra.run.smithi124.stdout:293.out 2023-10-16T13:01:27.254 INFO:teuthology.orchestra.run.smithi124.stdout:294 2023-10-16T13:01:27.255 INFO:teuthology.orchestra.run.smithi124.stdout:294.out 2023-10-16T13:01:27.255 INFO:teuthology.orchestra.run.smithi124.stdout:295 2023-10-16T13:01:27.255 INFO:teuthology.orchestra.run.smithi124.stdout:295.out 2023-10-16T13:01:27.255 INFO:teuthology.orchestra.run.smithi124.stdout:296 2023-10-16T13:01:27.255 INFO:teuthology.orchestra.run.smithi124.stdout:296.out 2023-10-16T13:01:27.255 INFO:teuthology.orchestra.run.smithi124.stdout:297 2023-10-16T13:01:27.256 INFO:teuthology.orchestra.run.smithi124.stdout:297.out 2023-10-16T13:01:27.256 INFO:teuthology.orchestra.run.smithi124.stdout:298 2023-10-16T13:01:27.256 INFO:teuthology.orchestra.run.smithi124.stdout:298.out 2023-10-16T13:01:27.256 INFO:teuthology.orchestra.run.smithi124.stdout:299 2023-10-16T13:01:27.256 INFO:teuthology.orchestra.run.smithi124.stdout:299.out 2023-10-16T13:01:27.257 INFO:teuthology.orchestra.run.smithi124.stdout:300 2023-10-16T13:01:27.257 INFO:teuthology.orchestra.run.smithi124.stdout:300.out 2023-10-16T13:01:27.257 INFO:teuthology.orchestra.run.smithi124.stdout:301 2023-10-16T13:01:27.257 INFO:teuthology.orchestra.run.smithi124.stdout:301.out 2023-10-16T13:01:27.257 INFO:teuthology.orchestra.run.smithi124.stdout:302 2023-10-16T13:01:27.258 INFO:teuthology.orchestra.run.smithi124.stdout:302.out 2023-10-16T13:01:27.258 INFO:teuthology.orchestra.run.smithi124.stdout:303 2023-10-16T13:01:27.258 INFO:teuthology.orchestra.run.smithi124.stdout:303.out 2023-10-16T13:01:27.258 INFO:teuthology.orchestra.run.smithi124.stdout:304 2023-10-16T13:01:27.258 INFO:teuthology.orchestra.run.smithi124.stdout:304.out 2023-10-16T13:01:27.259 INFO:teuthology.orchestra.run.smithi124.stdout:305 2023-10-16T13:01:27.259 INFO:teuthology.orchestra.run.smithi124.stdout:305.out 2023-10-16T13:01:27.259 INFO:teuthology.orchestra.run.smithi124.stdout:306 2023-10-16T13:01:27.259 INFO:teuthology.orchestra.run.smithi124.stdout:306.out 2023-10-16T13:01:27.259 INFO:teuthology.orchestra.run.smithi124.stdout:307 2023-10-16T13:01:27.260 INFO:teuthology.orchestra.run.smithi124.stdout:307.out 2023-10-16T13:01:27.260 INFO:teuthology.orchestra.run.smithi124.stdout:308 2023-10-16T13:01:27.260 INFO:teuthology.orchestra.run.smithi124.stdout:308.out 2023-10-16T13:01:27.260 INFO:teuthology.orchestra.run.smithi124.stdout:309 2023-10-16T13:01:27.260 INFO:teuthology.orchestra.run.smithi124.stdout:309.out 2023-10-16T13:01:27.261 INFO:teuthology.orchestra.run.smithi124.stdout:310 2023-10-16T13:01:27.261 INFO:teuthology.orchestra.run.smithi124.stdout:310.out 2023-10-16T13:01:27.261 INFO:teuthology.orchestra.run.smithi124.stdout:311 2023-10-16T13:01:27.261 INFO:teuthology.orchestra.run.smithi124.stdout:311.out 2023-10-16T13:01:27.261 INFO:teuthology.orchestra.run.smithi124.stdout:312 2023-10-16T13:01:27.262 INFO:teuthology.orchestra.run.smithi124.stdout:312.out 2023-10-16T13:01:27.262 INFO:teuthology.orchestra.run.smithi124.stdout:313 2023-10-16T13:01:27.262 INFO:teuthology.orchestra.run.smithi124.stdout:313.out 2023-10-16T13:01:27.262 INFO:teuthology.orchestra.run.smithi124.stdout:314 2023-10-16T13:01:27.262 INFO:teuthology.orchestra.run.smithi124.stdout:314.out 2023-10-16T13:01:27.263 INFO:teuthology.orchestra.run.smithi124.stdout:315 2023-10-16T13:01:27.263 INFO:teuthology.orchestra.run.smithi124.stdout:315.out 2023-10-16T13:01:27.263 INFO:teuthology.orchestra.run.smithi124.stdout:316 2023-10-16T13:01:27.263 INFO:teuthology.orchestra.run.smithi124.stdout:316.out 2023-10-16T13:01:27.263 INFO:teuthology.orchestra.run.smithi124.stdout:317 2023-10-16T13:01:27.263 INFO:teuthology.orchestra.run.smithi124.stdout:317.out 2023-10-16T13:01:27.264 INFO:teuthology.orchestra.run.smithi124.stdout:318 2023-10-16T13:01:27.264 INFO:teuthology.orchestra.run.smithi124.stdout:318.out 2023-10-16T13:01:27.264 INFO:teuthology.orchestra.run.smithi124.stdout:319 2023-10-16T13:01:27.264 INFO:teuthology.orchestra.run.smithi124.stdout:319.out 2023-10-16T13:01:27.264 INFO:teuthology.orchestra.run.smithi124.stdout:320 2023-10-16T13:01:27.265 INFO:teuthology.orchestra.run.smithi124.stdout:320.out 2023-10-16T13:01:27.265 INFO:teuthology.orchestra.run.smithi124.stdout:321 2023-10-16T13:01:27.265 INFO:teuthology.orchestra.run.smithi124.stdout:321.out 2023-10-16T13:01:27.265 INFO:teuthology.orchestra.run.smithi124.stdout:322 2023-10-16T13:01:27.265 INFO:teuthology.orchestra.run.smithi124.stdout:322.out 2023-10-16T13:01:27.266 INFO:teuthology.orchestra.run.smithi124.stdout:323 2023-10-16T13:01:27.266 INFO:teuthology.orchestra.run.smithi124.stdout:323.out 2023-10-16T13:01:27.266 INFO:teuthology.orchestra.run.smithi124.stdout:324 2023-10-16T13:01:27.266 INFO:teuthology.orchestra.run.smithi124.stdout:324.out 2023-10-16T13:01:27.266 INFO:teuthology.orchestra.run.smithi124.stdout:325 2023-10-16T13:01:27.267 INFO:teuthology.orchestra.run.smithi124.stdout:325.out 2023-10-16T13:01:27.267 INFO:teuthology.orchestra.run.smithi124.stdout:326 2023-10-16T13:01:27.267 INFO:teuthology.orchestra.run.smithi124.stdout:326.out 2023-10-16T13:01:27.267 INFO:teuthology.orchestra.run.smithi124.stdout:327 2023-10-16T13:01:27.267 INFO:teuthology.orchestra.run.smithi124.stdout:327.out 2023-10-16T13:01:27.267 INFO:teuthology.orchestra.run.smithi124.stdout:328 2023-10-16T13:01:27.268 INFO:teuthology.orchestra.run.smithi124.stdout:328.out 2023-10-16T13:01:27.268 INFO:teuthology.orchestra.run.smithi124.stdout:329 2023-10-16T13:01:27.268 INFO:teuthology.orchestra.run.smithi124.stdout:329.out 2023-10-16T13:01:27.268 INFO:teuthology.orchestra.run.smithi124.stdout:330 2023-10-16T13:01:27.268 INFO:teuthology.orchestra.run.smithi124.stdout:330.out 2023-10-16T13:01:27.269 INFO:teuthology.orchestra.run.smithi124.stdout:331 2023-10-16T13:01:27.269 INFO:teuthology.orchestra.run.smithi124.stdout:331.out 2023-10-16T13:01:27.269 INFO:teuthology.orchestra.run.smithi124.stdout:332 2023-10-16T13:01:27.269 INFO:teuthology.orchestra.run.smithi124.stdout:332.out 2023-10-16T13:01:27.269 INFO:teuthology.orchestra.run.smithi124.stdout:333 2023-10-16T13:01:27.270 INFO:teuthology.orchestra.run.smithi124.stdout:333.out 2023-10-16T13:01:27.270 INFO:teuthology.orchestra.run.smithi124.stdout:334 2023-10-16T13:01:27.270 INFO:teuthology.orchestra.run.smithi124.stdout:334.out 2023-10-16T13:01:27.270 INFO:teuthology.orchestra.run.smithi124.stdout:335 2023-10-16T13:01:27.270 INFO:teuthology.orchestra.run.smithi124.stdout:335.out 2023-10-16T13:01:27.271 INFO:teuthology.orchestra.run.smithi124.stdout:336 2023-10-16T13:01:27.271 INFO:teuthology.orchestra.run.smithi124.stdout:336.out 2023-10-16T13:01:27.271 INFO:teuthology.orchestra.run.smithi124.stdout:337 2023-10-16T13:01:27.271 INFO:teuthology.orchestra.run.smithi124.stdout:337.out 2023-10-16T13:01:27.271 INFO:teuthology.orchestra.run.smithi124.stdout:338 2023-10-16T13:01:27.272 INFO:teuthology.orchestra.run.smithi124.stdout:338.out 2023-10-16T13:01:27.272 INFO:teuthology.orchestra.run.smithi124.stdout:339 2023-10-16T13:01:27.272 INFO:teuthology.orchestra.run.smithi124.stdout:339.out 2023-10-16T13:01:27.272 INFO:teuthology.orchestra.run.smithi124.stdout:340 2023-10-16T13:01:27.272 INFO:teuthology.orchestra.run.smithi124.stdout:340.out 2023-10-16T13:01:27.272 INFO:teuthology.orchestra.run.smithi124.stdout:341 2023-10-16T13:01:27.273 INFO:teuthology.orchestra.run.smithi124.stdout:341.out 2023-10-16T13:01:27.273 INFO:teuthology.orchestra.run.smithi124.stdout:342 2023-10-16T13:01:27.273 INFO:teuthology.orchestra.run.smithi124.stdout:342.out 2023-10-16T13:01:27.273 INFO:teuthology.orchestra.run.smithi124.stdout:343 2023-10-16T13:01:27.273 INFO:teuthology.orchestra.run.smithi124.stdout:343.out 2023-10-16T13:01:27.274 INFO:teuthology.orchestra.run.smithi124.stdout:344 2023-10-16T13:01:27.274 INFO:teuthology.orchestra.run.smithi124.stdout:344.out 2023-10-16T13:01:27.274 INFO:teuthology.orchestra.run.smithi124.stdout:345 2023-10-16T13:01:27.274 INFO:teuthology.orchestra.run.smithi124.stdout:345.out 2023-10-16T13:01:27.274 INFO:teuthology.orchestra.run.smithi124.stdout:346 2023-10-16T13:01:27.275 INFO:teuthology.orchestra.run.smithi124.stdout:346.out 2023-10-16T13:01:27.275 INFO:teuthology.orchestra.run.smithi124.stdout:347 2023-10-16T13:01:27.275 INFO:teuthology.orchestra.run.smithi124.stdout:347.out 2023-10-16T13:01:27.275 INFO:teuthology.orchestra.run.smithi124.stdout:348 2023-10-16T13:01:27.275 INFO:teuthology.orchestra.run.smithi124.stdout:348.out 2023-10-16T13:01:27.276 INFO:teuthology.orchestra.run.smithi124.stdout:349 2023-10-16T13:01:27.276 INFO:teuthology.orchestra.run.smithi124.stdout:349.out 2023-10-16T13:01:27.276 INFO:teuthology.orchestra.run.smithi124.stdout:350 2023-10-16T13:01:27.276 INFO:teuthology.orchestra.run.smithi124.stdout:350.out 2023-10-16T13:01:27.276 INFO:teuthology.orchestra.run.smithi124.stdout:351 2023-10-16T13:01:27.276 INFO:teuthology.orchestra.run.smithi124.stdout:351.out 2023-10-16T13:01:27.277 INFO:teuthology.orchestra.run.smithi124.stdout:352 2023-10-16T13:01:27.277 INFO:teuthology.orchestra.run.smithi124.stdout:352.out 2023-10-16T13:01:27.277 INFO:teuthology.orchestra.run.smithi124.stdout:353 2023-10-16T13:01:27.277 INFO:teuthology.orchestra.run.smithi124.stdout:353.out 2023-10-16T13:01:27.277 INFO:teuthology.orchestra.run.smithi124.stdout:354 2023-10-16T13:01:27.278 INFO:teuthology.orchestra.run.smithi124.stdout:354.out 2023-10-16T13:01:27.278 INFO:teuthology.orchestra.run.smithi124.stdout:355 2023-10-16T13:01:27.278 INFO:teuthology.orchestra.run.smithi124.stdout:355.out 2023-10-16T13:01:27.278 INFO:teuthology.orchestra.run.smithi124.stdout:356 2023-10-16T13:01:27.278 INFO:teuthology.orchestra.run.smithi124.stdout:356.out 2023-10-16T13:01:27.279 INFO:teuthology.orchestra.run.smithi124.stdout:357 2023-10-16T13:01:27.279 INFO:teuthology.orchestra.run.smithi124.stdout:357.out 2023-10-16T13:01:27.279 INFO:teuthology.orchestra.run.smithi124.stdout:358 2023-10-16T13:01:27.279 INFO:teuthology.orchestra.run.smithi124.stdout:358.out 2023-10-16T13:01:27.279 INFO:teuthology.orchestra.run.smithi124.stdout:359 2023-10-16T13:01:27.280 INFO:teuthology.orchestra.run.smithi124.stdout:359.out 2023-10-16T13:01:27.280 INFO:teuthology.orchestra.run.smithi124.stdout:360 2023-10-16T13:01:27.280 INFO:teuthology.orchestra.run.smithi124.stdout:360.out 2023-10-16T13:01:27.280 INFO:teuthology.orchestra.run.smithi124.stdout:361 2023-10-16T13:01:27.280 INFO:teuthology.orchestra.run.smithi124.stdout:361.out 2023-10-16T13:01:27.281 INFO:teuthology.orchestra.run.smithi124.stdout:362 2023-10-16T13:01:27.281 INFO:teuthology.orchestra.run.smithi124.stdout:362.out 2023-10-16T13:01:27.281 INFO:teuthology.orchestra.run.smithi124.stdout:363 2023-10-16T13:01:27.281 INFO:teuthology.orchestra.run.smithi124.stdout:363.out 2023-10-16T13:01:27.281 INFO:teuthology.orchestra.run.smithi124.stdout:364 2023-10-16T13:01:27.282 INFO:teuthology.orchestra.run.smithi124.stdout:364.out 2023-10-16T13:01:27.282 INFO:teuthology.orchestra.run.smithi124.stdout:365 2023-10-16T13:01:27.282 INFO:teuthology.orchestra.run.smithi124.stdout:365.out 2023-10-16T13:01:27.282 INFO:teuthology.orchestra.run.smithi124.stdout:366 2023-10-16T13:01:27.282 INFO:teuthology.orchestra.run.smithi124.stdout:366.out 2023-10-16T13:01:27.283 INFO:teuthology.orchestra.run.smithi124.stdout:367 2023-10-16T13:01:27.283 INFO:teuthology.orchestra.run.smithi124.stdout:367.out 2023-10-16T13:01:27.283 INFO:teuthology.orchestra.run.smithi124.stdout:368 2023-10-16T13:01:27.283 INFO:teuthology.orchestra.run.smithi124.stdout:368.out 2023-10-16T13:01:27.283 INFO:teuthology.orchestra.run.smithi124.stdout:369 2023-10-16T13:01:27.283 INFO:teuthology.orchestra.run.smithi124.stdout:369.out 2023-10-16T13:01:27.284 INFO:teuthology.orchestra.run.smithi124.stdout:370 2023-10-16T13:01:27.284 INFO:teuthology.orchestra.run.smithi124.stdout:370.out 2023-10-16T13:01:27.284 INFO:teuthology.orchestra.run.smithi124.stdout:371 2023-10-16T13:01:27.284 INFO:teuthology.orchestra.run.smithi124.stdout:371.out 2023-10-16T13:01:27.284 INFO:teuthology.orchestra.run.smithi124.stdout:372 2023-10-16T13:01:27.285 INFO:teuthology.orchestra.run.smithi124.stdout:372.out 2023-10-16T13:01:27.285 INFO:teuthology.orchestra.run.smithi124.stdout:373 2023-10-16T13:01:27.285 INFO:teuthology.orchestra.run.smithi124.stdout:373.out 2023-10-16T13:01:27.285 INFO:teuthology.orchestra.run.smithi124.stdout:374 2023-10-16T13:01:27.285 INFO:teuthology.orchestra.run.smithi124.stdout:374.out 2023-10-16T13:01:27.286 INFO:teuthology.orchestra.run.smithi124.stdout:375 2023-10-16T13:01:27.286 INFO:teuthology.orchestra.run.smithi124.stdout:375.out 2023-10-16T13:01:27.286 INFO:teuthology.orchestra.run.smithi124.stdout:376 2023-10-16T13:01:27.286 INFO:teuthology.orchestra.run.smithi124.stdout:376.out 2023-10-16T13:01:27.286 INFO:teuthology.orchestra.run.smithi124.stdout:377 2023-10-16T13:01:27.287 INFO:teuthology.orchestra.run.smithi124.stdout:377.out 2023-10-16T13:01:27.287 INFO:teuthology.orchestra.run.smithi124.stdout:378 2023-10-16T13:01:27.287 INFO:teuthology.orchestra.run.smithi124.stdout:378.out 2023-10-16T13:01:27.287 INFO:teuthology.orchestra.run.smithi124.stdout:379 2023-10-16T13:01:27.287 INFO:teuthology.orchestra.run.smithi124.stdout:379.out 2023-10-16T13:01:27.288 INFO:teuthology.orchestra.run.smithi124.stdout:380 2023-10-16T13:01:27.288 INFO:teuthology.orchestra.run.smithi124.stdout:380.out 2023-10-16T13:01:27.288 INFO:teuthology.orchestra.run.smithi124.stdout:381 2023-10-16T13:01:27.288 INFO:teuthology.orchestra.run.smithi124.stdout:381.out 2023-10-16T13:01:27.288 INFO:teuthology.orchestra.run.smithi124.stdout:382 2023-10-16T13:01:27.289 INFO:teuthology.orchestra.run.smithi124.stdout:382.out 2023-10-16T13:01:27.289 INFO:teuthology.orchestra.run.smithi124.stdout:383 2023-10-16T13:01:27.289 INFO:teuthology.orchestra.run.smithi124.stdout:383.out 2023-10-16T13:01:27.289 INFO:teuthology.orchestra.run.smithi124.stdout:384 2023-10-16T13:01:27.289 INFO:teuthology.orchestra.run.smithi124.stdout:384.out 2023-10-16T13:01:27.290 INFO:teuthology.orchestra.run.smithi124.stdout:385 2023-10-16T13:01:27.290 INFO:teuthology.orchestra.run.smithi124.stdout:385.out 2023-10-16T13:01:27.290 INFO:teuthology.orchestra.run.smithi124.stdout:386 2023-10-16T13:01:27.290 INFO:teuthology.orchestra.run.smithi124.stdout:386.out 2023-10-16T13:01:27.290 INFO:teuthology.orchestra.run.smithi124.stdout:387 2023-10-16T13:01:27.291 INFO:teuthology.orchestra.run.smithi124.stdout:387.out 2023-10-16T13:01:27.291 INFO:teuthology.orchestra.run.smithi124.stdout:388 2023-10-16T13:01:27.291 INFO:teuthology.orchestra.run.smithi124.stdout:388.out 2023-10-16T13:01:27.291 INFO:teuthology.orchestra.run.smithi124.stdout:389 2023-10-16T13:01:27.291 INFO:teuthology.orchestra.run.smithi124.stdout:389.out 2023-10-16T13:01:27.292 INFO:teuthology.orchestra.run.smithi124.stdout:390 2023-10-16T13:01:27.292 INFO:teuthology.orchestra.run.smithi124.stdout:390.out 2023-10-16T13:01:27.292 INFO:teuthology.orchestra.run.smithi124.stdout:391 2023-10-16T13:01:27.292 INFO:teuthology.orchestra.run.smithi124.stdout:391.out 2023-10-16T13:01:27.292 INFO:teuthology.orchestra.run.smithi124.stdout:392 2023-10-16T13:01:27.292 INFO:teuthology.orchestra.run.smithi124.stdout:392.out 2023-10-16T13:01:27.293 INFO:teuthology.orchestra.run.smithi124.stdout:393 2023-10-16T13:01:27.293 INFO:teuthology.orchestra.run.smithi124.stdout:393.out 2023-10-16T13:01:27.293 INFO:teuthology.orchestra.run.smithi124.stdout:394 2023-10-16T13:01:27.293 INFO:teuthology.orchestra.run.smithi124.stdout:394.out 2023-10-16T13:01:27.293 INFO:teuthology.orchestra.run.smithi124.stdout:395 2023-10-16T13:01:27.294 INFO:teuthology.orchestra.run.smithi124.stdout:395.out 2023-10-16T13:01:27.294 INFO:teuthology.orchestra.run.smithi124.stdout:396 2023-10-16T13:01:27.294 INFO:teuthology.orchestra.run.smithi124.stdout:396.out 2023-10-16T13:01:27.294 INFO:teuthology.orchestra.run.smithi124.stdout:397 2023-10-16T13:01:27.294 INFO:teuthology.orchestra.run.smithi124.stdout:397.out 2023-10-16T13:01:27.295 INFO:teuthology.orchestra.run.smithi124.stdout:398 2023-10-16T13:01:27.295 INFO:teuthology.orchestra.run.smithi124.stdout:398.out 2023-10-16T13:01:27.295 INFO:teuthology.orchestra.run.smithi124.stdout:399 2023-10-16T13:01:27.295 INFO:teuthology.orchestra.run.smithi124.stdout:399.out 2023-10-16T13:01:27.295 INFO:teuthology.orchestra.run.smithi124.stdout:400 2023-10-16T13:01:27.296 INFO:teuthology.orchestra.run.smithi124.stdout:400.out 2023-10-16T13:01:27.296 INFO:teuthology.orchestra.run.smithi124.stdout:401 2023-10-16T13:01:27.296 INFO:teuthology.orchestra.run.smithi124.stdout:401.out 2023-10-16T13:01:27.296 INFO:teuthology.orchestra.run.smithi124.stdout:402 2023-10-16T13:01:27.296 INFO:teuthology.orchestra.run.smithi124.stdout:402.out 2023-10-16T13:01:27.297 INFO:teuthology.orchestra.run.smithi124.stdout:403 2023-10-16T13:01:27.297 INFO:teuthology.orchestra.run.smithi124.stdout:403.out 2023-10-16T13:01:27.297 INFO:teuthology.orchestra.run.smithi124.stdout:404 2023-10-16T13:01:27.297 INFO:teuthology.orchestra.run.smithi124.stdout:404.out 2023-10-16T13:01:27.297 INFO:teuthology.orchestra.run.smithi124.stdout:405 2023-10-16T13:01:27.297 INFO:teuthology.orchestra.run.smithi124.stdout:405.out 2023-10-16T13:01:27.298 INFO:teuthology.orchestra.run.smithi124.stdout:406 2023-10-16T13:01:27.298 INFO:teuthology.orchestra.run.smithi124.stdout:406.out 2023-10-16T13:01:27.298 INFO:teuthology.orchestra.run.smithi124.stdout:407 2023-10-16T13:01:27.298 INFO:teuthology.orchestra.run.smithi124.stdout:407.out 2023-10-16T13:01:27.298 INFO:teuthology.orchestra.run.smithi124.stdout:408 2023-10-16T13:01:27.299 INFO:teuthology.orchestra.run.smithi124.stdout:408.out 2023-10-16T13:01:27.299 INFO:teuthology.orchestra.run.smithi124.stdout:409 2023-10-16T13:01:27.299 INFO:teuthology.orchestra.run.smithi124.stdout:409.out 2023-10-16T13:01:27.299 INFO:teuthology.orchestra.run.smithi124.stdout:410 2023-10-16T13:01:27.299 INFO:teuthology.orchestra.run.smithi124.stdout:410.out 2023-10-16T13:01:27.300 INFO:teuthology.orchestra.run.smithi124.stdout:411 2023-10-16T13:01:27.300 INFO:teuthology.orchestra.run.smithi124.stdout:411.out 2023-10-16T13:01:27.300 INFO:teuthology.orchestra.run.smithi124.stdout:412 2023-10-16T13:01:27.300 INFO:teuthology.orchestra.run.smithi124.stdout:412.out 2023-10-16T13:01:27.300 INFO:teuthology.orchestra.run.smithi124.stdout:413 2023-10-16T13:01:27.301 INFO:teuthology.orchestra.run.smithi124.stdout:413.out 2023-10-16T13:01:27.301 INFO:teuthology.orchestra.run.smithi124.stdout:414 2023-10-16T13:01:27.301 INFO:teuthology.orchestra.run.smithi124.stdout:414.out 2023-10-16T13:01:27.301 INFO:teuthology.orchestra.run.smithi124.stdout:415 2023-10-16T13:01:27.301 INFO:teuthology.orchestra.run.smithi124.stdout:415.out 2023-10-16T13:01:27.302 INFO:teuthology.orchestra.run.smithi124.stdout:416 2023-10-16T13:01:27.302 INFO:teuthology.orchestra.run.smithi124.stdout:416.out 2023-10-16T13:01:27.302 INFO:teuthology.orchestra.run.smithi124.stdout:417 2023-10-16T13:01:27.302 INFO:teuthology.orchestra.run.smithi124.stdout:417.out 2023-10-16T13:01:27.302 INFO:teuthology.orchestra.run.smithi124.stdout:418 2023-10-16T13:01:27.303 INFO:teuthology.orchestra.run.smithi124.stdout:418.out 2023-10-16T13:01:27.303 INFO:teuthology.orchestra.run.smithi124.stdout:419 2023-10-16T13:01:27.303 INFO:teuthology.orchestra.run.smithi124.stdout:419.out 2023-10-16T13:01:27.303 INFO:teuthology.orchestra.run.smithi124.stdout:420 2023-10-16T13:01:27.303 INFO:teuthology.orchestra.run.smithi124.stdout:420.out 2023-10-16T13:01:27.304 INFO:teuthology.orchestra.run.smithi124.stdout:421 2023-10-16T13:01:27.304 INFO:teuthology.orchestra.run.smithi124.stdout:421.out 2023-10-16T13:01:27.304 INFO:teuthology.orchestra.run.smithi124.stdout:422 2023-10-16T13:01:27.304 INFO:teuthology.orchestra.run.smithi124.stdout:422.out 2023-10-16T13:01:27.304 INFO:teuthology.orchestra.run.smithi124.stdout:423 2023-10-16T13:01:27.304 INFO:teuthology.orchestra.run.smithi124.stdout:423.out 2023-10-16T13:01:27.305 INFO:teuthology.orchestra.run.smithi124.stdout:424 2023-10-16T13:01:27.305 INFO:teuthology.orchestra.run.smithi124.stdout:424.out 2023-10-16T13:01:27.305 INFO:teuthology.orchestra.run.smithi124.stdout:425 2023-10-16T13:01:27.305 INFO:teuthology.orchestra.run.smithi124.stdout:425.out 2023-10-16T13:01:27.305 INFO:teuthology.orchestra.run.smithi124.stdout:426 2023-10-16T13:01:27.306 INFO:teuthology.orchestra.run.smithi124.stdout:426.out 2023-10-16T13:01:27.306 INFO:teuthology.orchestra.run.smithi124.stdout:427 2023-10-16T13:01:27.306 INFO:teuthology.orchestra.run.smithi124.stdout:427.out 2023-10-16T13:01:27.306 INFO:teuthology.orchestra.run.smithi124.stdout:428 2023-10-16T13:01:27.306 INFO:teuthology.orchestra.run.smithi124.stdout:428.out 2023-10-16T13:01:27.307 INFO:teuthology.orchestra.run.smithi124.stdout:429 2023-10-16T13:01:27.307 INFO:teuthology.orchestra.run.smithi124.stdout:429.out 2023-10-16T13:01:27.307 INFO:teuthology.orchestra.run.smithi124.stdout:430 2023-10-16T13:01:27.307 INFO:teuthology.orchestra.run.smithi124.stdout:430.out 2023-10-16T13:01:27.307 INFO:teuthology.orchestra.run.smithi124.stdout:431 2023-10-16T13:01:27.308 INFO:teuthology.orchestra.run.smithi124.stdout:431.out 2023-10-16T13:01:27.308 INFO:teuthology.orchestra.run.smithi124.stdout:432 2023-10-16T13:01:27.308 INFO:teuthology.orchestra.run.smithi124.stdout:432.out 2023-10-16T13:01:27.308 INFO:teuthology.orchestra.run.smithi124.stdout:433 2023-10-16T13:01:27.308 INFO:teuthology.orchestra.run.smithi124.stdout:433.out 2023-10-16T13:01:27.308 INFO:teuthology.orchestra.run.smithi124.stdout:434 2023-10-16T13:01:27.309 INFO:teuthology.orchestra.run.smithi124.stdout:434.out 2023-10-16T13:01:27.309 INFO:teuthology.orchestra.run.smithi124.stdout:435 2023-10-16T13:01:27.309 INFO:teuthology.orchestra.run.smithi124.stdout:435.out 2023-10-16T13:01:27.309 INFO:teuthology.orchestra.run.smithi124.stdout:436 2023-10-16T13:01:27.309 INFO:teuthology.orchestra.run.smithi124.stdout:436.out 2023-10-16T13:01:27.310 INFO:teuthology.orchestra.run.smithi124.stdout:437 2023-10-16T13:01:27.310 INFO:teuthology.orchestra.run.smithi124.stdout:437.out 2023-10-16T13:01:27.310 INFO:teuthology.orchestra.run.smithi124.stdout:438 2023-10-16T13:01:27.310 INFO:teuthology.orchestra.run.smithi124.stdout:438.out 2023-10-16T13:01:27.310 INFO:teuthology.orchestra.run.smithi124.stdout:439 2023-10-16T13:01:27.311 INFO:teuthology.orchestra.run.smithi124.stdout:439.out 2023-10-16T13:01:27.311 INFO:teuthology.orchestra.run.smithi124.stdout:440 2023-10-16T13:01:27.311 INFO:teuthology.orchestra.run.smithi124.stdout:440.out 2023-10-16T13:01:27.311 INFO:teuthology.orchestra.run.smithi124.stdout:441 2023-10-16T13:01:27.311 INFO:teuthology.orchestra.run.smithi124.stdout:441.out 2023-10-16T13:01:27.312 INFO:teuthology.orchestra.run.smithi124.stdout:442 2023-10-16T13:01:27.312 INFO:teuthology.orchestra.run.smithi124.stdout:442.out 2023-10-16T13:01:27.312 INFO:teuthology.orchestra.run.smithi124.stdout:443 2023-10-16T13:01:27.312 INFO:teuthology.orchestra.run.smithi124.stdout:443.out 2023-10-16T13:01:27.312 INFO:teuthology.orchestra.run.smithi124.stdout:444 2023-10-16T13:01:27.313 INFO:teuthology.orchestra.run.smithi124.stdout:444.out 2023-10-16T13:01:27.313 INFO:teuthology.orchestra.run.smithi124.stdout:445 2023-10-16T13:01:27.313 INFO:teuthology.orchestra.run.smithi124.stdout:445.out 2023-10-16T13:01:27.313 INFO:teuthology.orchestra.run.smithi124.stdout:446 2023-10-16T13:01:27.313 INFO:teuthology.orchestra.run.smithi124.stdout:446.out 2023-10-16T13:01:27.314 INFO:teuthology.orchestra.run.smithi124.stdout:447 2023-10-16T13:01:27.314 INFO:teuthology.orchestra.run.smithi124.stdout:447.out 2023-10-16T13:01:27.314 INFO:teuthology.orchestra.run.smithi124.stdout:448 2023-10-16T13:01:27.314 INFO:teuthology.orchestra.run.smithi124.stdout:448.out 2023-10-16T13:01:27.314 INFO:teuthology.orchestra.run.smithi124.stdout:449 2023-10-16T13:01:27.314 INFO:teuthology.orchestra.run.smithi124.stdout:449.out 2023-10-16T13:01:27.315 INFO:teuthology.orchestra.run.smithi124.stdout:450 2023-10-16T13:01:27.315 INFO:teuthology.orchestra.run.smithi124.stdout:450.out 2023-10-16T13:01:27.315 INFO:teuthology.orchestra.run.smithi124.stdout:451 2023-10-16T13:01:27.315 INFO:teuthology.orchestra.run.smithi124.stdout:451.out 2023-10-16T13:01:27.315 INFO:teuthology.orchestra.run.smithi124.stdout:452 2023-10-16T13:01:27.316 INFO:teuthology.orchestra.run.smithi124.stdout:452.out 2023-10-16T13:01:27.316 INFO:teuthology.orchestra.run.smithi124.stdout:453 2023-10-16T13:01:27.316 INFO:teuthology.orchestra.run.smithi124.stdout:453.out 2023-10-16T13:01:27.316 INFO:teuthology.orchestra.run.smithi124.stdout:454 2023-10-16T13:01:27.316 INFO:teuthology.orchestra.run.smithi124.stdout:454.out 2023-10-16T13:01:27.317 INFO:teuthology.orchestra.run.smithi124.stdout:455 2023-10-16T13:01:27.317 INFO:teuthology.orchestra.run.smithi124.stdout:455.out 2023-10-16T13:01:27.317 INFO:teuthology.orchestra.run.smithi124.stdout:456 2023-10-16T13:01:27.317 INFO:teuthology.orchestra.run.smithi124.stdout:456.out 2023-10-16T13:01:27.317 INFO:teuthology.orchestra.run.smithi124.stdout:457 2023-10-16T13:01:27.318 INFO:teuthology.orchestra.run.smithi124.stdout:457.out 2023-10-16T13:01:27.318 INFO:teuthology.orchestra.run.smithi124.stdout:458 2023-10-16T13:01:27.318 INFO:teuthology.orchestra.run.smithi124.stdout:458.out 2023-10-16T13:01:27.318 INFO:teuthology.orchestra.run.smithi124.stdout:459 2023-10-16T13:01:27.318 INFO:teuthology.orchestra.run.smithi124.stdout:459.out 2023-10-16T13:01:27.319 INFO:teuthology.orchestra.run.smithi124.stdout:460 2023-10-16T13:01:27.319 INFO:teuthology.orchestra.run.smithi124.stdout:460.out 2023-10-16T13:01:27.319 INFO:teuthology.orchestra.run.smithi124.stdout:461 2023-10-16T13:01:27.319 INFO:teuthology.orchestra.run.smithi124.stdout:461.out 2023-10-16T13:01:27.319 INFO:teuthology.orchestra.run.smithi124.stdout:462 2023-10-16T13:01:27.319 INFO:teuthology.orchestra.run.smithi124.stdout:462.out 2023-10-16T13:01:27.320 INFO:teuthology.orchestra.run.smithi124.stdout:463 2023-10-16T13:01:27.320 INFO:teuthology.orchestra.run.smithi124.stdout:463.out 2023-10-16T13:01:27.320 INFO:teuthology.orchestra.run.smithi124.stdout:464 2023-10-16T13:01:27.320 INFO:teuthology.orchestra.run.smithi124.stdout:464.out 2023-10-16T13:01:27.320 INFO:teuthology.orchestra.run.smithi124.stdout:465 2023-10-16T13:01:27.321 INFO:teuthology.orchestra.run.smithi124.stdout:465.out 2023-10-16T13:01:27.321 INFO:teuthology.orchestra.run.smithi124.stdout:466 2023-10-16T13:01:27.321 INFO:teuthology.orchestra.run.smithi124.stdout:466.out 2023-10-16T13:01:27.321 INFO:teuthology.orchestra.run.smithi124.stdout:467 2023-10-16T13:01:27.321 INFO:teuthology.orchestra.run.smithi124.stdout:467.out 2023-10-16T13:01:27.322 INFO:teuthology.orchestra.run.smithi124.stdout:468 2023-10-16T13:01:27.322 INFO:teuthology.orchestra.run.smithi124.stdout:468.out 2023-10-16T13:01:27.322 INFO:teuthology.orchestra.run.smithi124.stdout:469 2023-10-16T13:01:27.322 INFO:teuthology.orchestra.run.smithi124.stdout:469.out 2023-10-16T13:01:27.322 INFO:teuthology.orchestra.run.smithi124.stdout:470 2023-10-16T13:01:27.323 INFO:teuthology.orchestra.run.smithi124.stdout:470.out 2023-10-16T13:01:27.323 INFO:teuthology.orchestra.run.smithi124.stdout:471 2023-10-16T13:01:27.323 INFO:teuthology.orchestra.run.smithi124.stdout:471.out 2023-10-16T13:01:27.323 INFO:teuthology.orchestra.run.smithi124.stdout:472 2023-10-16T13:01:27.323 INFO:teuthology.orchestra.run.smithi124.stdout:472.out 2023-10-16T13:01:27.323 INFO:teuthology.orchestra.run.smithi124.stdout:473 2023-10-16T13:01:27.324 INFO:teuthology.orchestra.run.smithi124.stdout:473.out 2023-10-16T13:01:27.324 INFO:teuthology.orchestra.run.smithi124.stdout:474 2023-10-16T13:01:27.324 INFO:teuthology.orchestra.run.smithi124.stdout:474.out 2023-10-16T13:01:27.324 INFO:teuthology.orchestra.run.smithi124.stdout:475 2023-10-16T13:01:27.324 INFO:teuthology.orchestra.run.smithi124.stdout:475.out 2023-10-16T13:01:27.325 INFO:teuthology.orchestra.run.smithi124.stdout:476 2023-10-16T13:01:27.325 INFO:teuthology.orchestra.run.smithi124.stdout:476.out 2023-10-16T13:01:27.325 INFO:teuthology.orchestra.run.smithi124.stdout:477 2023-10-16T13:01:27.325 INFO:teuthology.orchestra.run.smithi124.stdout:477.out 2023-10-16T13:01:27.325 INFO:teuthology.orchestra.run.smithi124.stdout:478 2023-10-16T13:01:27.326 INFO:teuthology.orchestra.run.smithi124.stdout:478.out 2023-10-16T13:01:27.326 INFO:teuthology.orchestra.run.smithi124.stdout:479 2023-10-16T13:01:27.326 INFO:teuthology.orchestra.run.smithi124.stdout:479.out 2023-10-16T13:01:27.326 INFO:teuthology.orchestra.run.smithi124.stdout:480 2023-10-16T13:01:27.326 INFO:teuthology.orchestra.run.smithi124.stdout:480.out 2023-10-16T13:01:27.327 INFO:teuthology.orchestra.run.smithi124.stdout:481 2023-10-16T13:01:27.327 INFO:teuthology.orchestra.run.smithi124.stdout:481.out 2023-10-16T13:01:27.327 INFO:teuthology.orchestra.run.smithi124.stdout:482 2023-10-16T13:01:27.327 INFO:teuthology.orchestra.run.smithi124.stdout:482.out 2023-10-16T13:01:27.327 INFO:teuthology.orchestra.run.smithi124.stdout:483 2023-10-16T13:01:27.327 INFO:teuthology.orchestra.run.smithi124.stdout:483.out 2023-10-16T13:01:27.328 INFO:teuthology.orchestra.run.smithi124.stdout:484 2023-10-16T13:01:27.328 INFO:teuthology.orchestra.run.smithi124.stdout:484.out 2023-10-16T13:01:27.328 INFO:teuthology.orchestra.run.smithi124.stdout:485 2023-10-16T13:01:27.328 INFO:teuthology.orchestra.run.smithi124.stdout:485.out 2023-10-16T13:01:27.328 INFO:teuthology.orchestra.run.smithi124.stdout:486 2023-10-16T13:01:27.329 INFO:teuthology.orchestra.run.smithi124.stdout:486.out 2023-10-16T13:01:27.329 INFO:teuthology.orchestra.run.smithi124.stdout:487 2023-10-16T13:01:27.329 INFO:teuthology.orchestra.run.smithi124.stdout:487.out 2023-10-16T13:01:27.329 INFO:teuthology.orchestra.run.smithi124.stdout:488 2023-10-16T13:01:27.329 INFO:teuthology.orchestra.run.smithi124.stdout:488.out 2023-10-16T13:01:27.330 INFO:teuthology.orchestra.run.smithi124.stdout:489 2023-10-16T13:01:27.330 INFO:teuthology.orchestra.run.smithi124.stdout:489.out 2023-10-16T13:01:27.330 INFO:teuthology.orchestra.run.smithi124.stdout:490 2023-10-16T13:01:27.330 INFO:teuthology.orchestra.run.smithi124.stdout:490.out 2023-10-16T13:01:27.330 INFO:teuthology.orchestra.run.smithi124.stdout:491 2023-10-16T13:01:27.331 INFO:teuthology.orchestra.run.smithi124.stdout:491.out 2023-10-16T13:01:27.331 INFO:teuthology.orchestra.run.smithi124.stdout:492 2023-10-16T13:01:27.331 INFO:teuthology.orchestra.run.smithi124.stdout:492.out 2023-10-16T13:01:27.331 INFO:teuthology.orchestra.run.smithi124.stdout:493 2023-10-16T13:01:27.331 INFO:teuthology.orchestra.run.smithi124.stdout:493.out 2023-10-16T13:01:27.331 INFO:teuthology.orchestra.run.smithi124.stdout:494 2023-10-16T13:01:27.332 INFO:teuthology.orchestra.run.smithi124.stdout:494.out 2023-10-16T13:01:27.332 INFO:teuthology.orchestra.run.smithi124.stdout:495 2023-10-16T13:01:27.332 INFO:teuthology.orchestra.run.smithi124.stdout:495.out 2023-10-16T13:01:27.332 INFO:teuthology.orchestra.run.smithi124.stdout:496 2023-10-16T13:01:27.332 INFO:teuthology.orchestra.run.smithi124.stdout:496.out 2023-10-16T13:01:27.333 INFO:teuthology.orchestra.run.smithi124.stdout:497 2023-10-16T13:01:27.333 INFO:teuthology.orchestra.run.smithi124.stdout:497.out 2023-10-16T13:01:27.333 INFO:teuthology.orchestra.run.smithi124.stdout:498 2023-10-16T13:01:27.333 INFO:teuthology.orchestra.run.smithi124.stdout:498.out 2023-10-16T13:01:27.333 INFO:teuthology.orchestra.run.smithi124.stdout:499 2023-10-16T13:01:27.334 INFO:teuthology.orchestra.run.smithi124.stdout:499.out 2023-10-16T13:01:27.334 INFO:teuthology.orchestra.run.smithi124.stdout:500 2023-10-16T13:01:27.334 INFO:teuthology.orchestra.run.smithi124.stdout:500.out 2023-10-16T13:01:27.334 INFO:teuthology.orchestra.run.smithi124.stdout:501 2023-10-16T13:01:27.334 INFO:teuthology.orchestra.run.smithi124.stdout:501.out 2023-10-16T13:01:27.335 INFO:teuthology.orchestra.run.smithi124.stdout:502 2023-10-16T13:01:27.335 INFO:teuthology.orchestra.run.smithi124.stdout:502.out 2023-10-16T13:01:27.335 INFO:teuthology.orchestra.run.smithi124.stdout:503 2023-10-16T13:01:27.335 INFO:teuthology.orchestra.run.smithi124.stdout:503.out 2023-10-16T13:01:27.335 INFO:teuthology.orchestra.run.smithi124.stdout:504 2023-10-16T13:01:27.335 INFO:teuthology.orchestra.run.smithi124.stdout:504.out 2023-10-16T13:01:27.336 INFO:teuthology.orchestra.run.smithi124.stdout:505 2023-10-16T13:01:27.336 INFO:teuthology.orchestra.run.smithi124.stdout:505.out 2023-10-16T13:01:27.336 INFO:teuthology.orchestra.run.smithi124.stdout:506 2023-10-16T13:01:27.336 INFO:teuthology.orchestra.run.smithi124.stdout:506.out 2023-10-16T13:01:27.336 INFO:teuthology.orchestra.run.smithi124.stdout:507 2023-10-16T13:01:27.337 INFO:teuthology.orchestra.run.smithi124.stdout:507.out 2023-10-16T13:01:27.337 INFO:teuthology.orchestra.run.smithi124.stdout:508 2023-10-16T13:01:27.337 INFO:teuthology.orchestra.run.smithi124.stdout:508.out 2023-10-16T13:01:27.337 INFO:teuthology.orchestra.run.smithi124.stdout:509 2023-10-16T13:01:27.337 INFO:teuthology.orchestra.run.smithi124.stdout:509.out 2023-10-16T13:01:27.338 INFO:teuthology.orchestra.run.smithi124.stdout:510 2023-10-16T13:01:27.338 INFO:teuthology.orchestra.run.smithi124.stdout:510.out 2023-10-16T13:01:27.338 INFO:teuthology.orchestra.run.smithi124.stdout:511 2023-10-16T13:01:27.338 INFO:teuthology.orchestra.run.smithi124.stdout:511.out 2023-10-16T13:01:27.338 INFO:teuthology.orchestra.run.smithi124.stdout:512 2023-10-16T13:01:27.339 INFO:teuthology.orchestra.run.smithi124.stdout:512.out 2023-10-16T13:01:27.339 INFO:teuthology.orchestra.run.smithi124.stdout:513 2023-10-16T13:01:27.339 INFO:teuthology.orchestra.run.smithi124.stdout:513.out 2023-10-16T13:01:27.339 INFO:teuthology.orchestra.run.smithi124.stdout:514 2023-10-16T13:01:27.339 INFO:teuthology.orchestra.run.smithi124.stdout:514.out 2023-10-16T13:01:27.340 INFO:teuthology.orchestra.run.smithi124.stdout:515 2023-10-16T13:01:27.340 INFO:teuthology.orchestra.run.smithi124.stdout:515.out 2023-10-16T13:01:27.340 INFO:teuthology.orchestra.run.smithi124.stdout:516 2023-10-16T13:01:27.340 INFO:teuthology.orchestra.run.smithi124.stdout:516.out 2023-10-16T13:01:27.340 INFO:teuthology.orchestra.run.smithi124.stdout:517 2023-10-16T13:01:27.340 INFO:teuthology.orchestra.run.smithi124.stdout:517.out 2023-10-16T13:01:27.341 INFO:teuthology.orchestra.run.smithi124.stdout:518 2023-10-16T13:01:27.341 INFO:teuthology.orchestra.run.smithi124.stdout:518.out 2023-10-16T13:01:27.341 INFO:teuthology.orchestra.run.smithi124.stdout:519 2023-10-16T13:01:27.341 INFO:teuthology.orchestra.run.smithi124.stdout:519.out 2023-10-16T13:01:27.341 INFO:teuthology.orchestra.run.smithi124.stdout:520 2023-10-16T13:01:27.342 INFO:teuthology.orchestra.run.smithi124.stdout:520.out 2023-10-16T13:01:27.342 INFO:teuthology.orchestra.run.smithi124.stdout:521 2023-10-16T13:01:27.342 INFO:teuthology.orchestra.run.smithi124.stdout:521.out 2023-10-16T13:01:27.342 INFO:teuthology.orchestra.run.smithi124.stdout:522 2023-10-16T13:01:27.342 INFO:teuthology.orchestra.run.smithi124.stdout:522.out 2023-10-16T13:01:27.343 INFO:teuthology.orchestra.run.smithi124.stdout:523 2023-10-16T13:01:27.343 INFO:teuthology.orchestra.run.smithi124.stdout:523.out 2023-10-16T13:01:27.343 INFO:teuthology.orchestra.run.smithi124.stdout:524 2023-10-16T13:01:27.343 INFO:teuthology.orchestra.run.smithi124.stdout:524.out 2023-10-16T13:01:27.343 INFO:teuthology.orchestra.run.smithi124.stdout:525 2023-10-16T13:01:27.344 INFO:teuthology.orchestra.run.smithi124.stdout:525.out 2023-10-16T13:01:27.344 INFO:teuthology.orchestra.run.smithi124.stdout:526 2023-10-16T13:01:27.344 INFO:teuthology.orchestra.run.smithi124.stdout:526.out 2023-10-16T13:01:27.344 INFO:teuthology.orchestra.run.smithi124.stdout:527 2023-10-16T13:01:27.344 INFO:teuthology.orchestra.run.smithi124.stdout:527.out 2023-10-16T13:01:27.344 INFO:teuthology.orchestra.run.smithi124.stdout:528 2023-10-16T13:01:27.345 INFO:teuthology.orchestra.run.smithi124.stdout:528.out 2023-10-16T13:01:27.345 INFO:teuthology.orchestra.run.smithi124.stdout:529 2023-10-16T13:01:27.345 INFO:teuthology.orchestra.run.smithi124.stdout:529.out 2023-10-16T13:01:27.345 INFO:teuthology.orchestra.run.smithi124.stdout:530 2023-10-16T13:01:27.345 INFO:teuthology.orchestra.run.smithi124.stdout:530.out 2023-10-16T13:01:27.346 INFO:teuthology.orchestra.run.smithi124.stdout:531 2023-10-16T13:01:27.346 INFO:teuthology.orchestra.run.smithi124.stdout:531.out 2023-10-16T13:01:27.346 INFO:teuthology.orchestra.run.smithi124.stdout:532 2023-10-16T13:01:27.346 INFO:teuthology.orchestra.run.smithi124.stdout:532.out 2023-10-16T13:01:27.346 INFO:teuthology.orchestra.run.smithi124.stdout:533 2023-10-16T13:01:27.347 INFO:teuthology.orchestra.run.smithi124.stdout:533.out 2023-10-16T13:01:27.347 INFO:teuthology.orchestra.run.smithi124.stdout:534 2023-10-16T13:01:27.347 INFO:teuthology.orchestra.run.smithi124.stdout:534.out 2023-10-16T13:01:27.347 INFO:teuthology.orchestra.run.smithi124.stdout:535 2023-10-16T13:01:27.347 INFO:teuthology.orchestra.run.smithi124.stdout:535.out 2023-10-16T13:01:27.347 INFO:teuthology.orchestra.run.smithi124.stdout:536 2023-10-16T13:01:27.348 INFO:teuthology.orchestra.run.smithi124.stdout:536.out 2023-10-16T13:01:27.348 INFO:teuthology.orchestra.run.smithi124.stdout:537 2023-10-16T13:01:27.348 INFO:teuthology.orchestra.run.smithi124.stdout:537.out 2023-10-16T13:01:27.348 INFO:teuthology.orchestra.run.smithi124.stdout:538 2023-10-16T13:01:27.348 INFO:teuthology.orchestra.run.smithi124.stdout:538.out 2023-10-16T13:01:27.349 INFO:teuthology.orchestra.run.smithi124.stdout:539 2023-10-16T13:01:27.349 INFO:teuthology.orchestra.run.smithi124.stdout:539.out 2023-10-16T13:01:27.349 INFO:teuthology.orchestra.run.smithi124.stdout:540 2023-10-16T13:01:27.349 INFO:teuthology.orchestra.run.smithi124.stdout:540.out 2023-10-16T13:01:27.349 INFO:teuthology.orchestra.run.smithi124.stdout:541 2023-10-16T13:01:27.350 INFO:teuthology.orchestra.run.smithi124.stdout:541.out 2023-10-16T13:01:27.350 INFO:teuthology.orchestra.run.smithi124.stdout:542 2023-10-16T13:01:27.350 INFO:teuthology.orchestra.run.smithi124.stdout:542.out 2023-10-16T13:01:27.350 INFO:teuthology.orchestra.run.smithi124.stdout:543 2023-10-16T13:01:27.350 INFO:teuthology.orchestra.run.smithi124.stdout:543.out 2023-10-16T13:01:27.351 INFO:teuthology.orchestra.run.smithi124.stdout:544 2023-10-16T13:01:27.351 INFO:teuthology.orchestra.run.smithi124.stdout:544.out 2023-10-16T13:01:27.351 INFO:teuthology.orchestra.run.smithi124.stdout:545 2023-10-16T13:01:27.351 INFO:teuthology.orchestra.run.smithi124.stdout:545.out 2023-10-16T13:01:27.351 INFO:teuthology.orchestra.run.smithi124.stdout:546 2023-10-16T13:01:27.351 INFO:teuthology.orchestra.run.smithi124.stdout:546.out 2023-10-16T13:01:27.352 INFO:teuthology.orchestra.run.smithi124.stdout:547 2023-10-16T13:01:27.352 INFO:teuthology.orchestra.run.smithi124.stdout:547.out 2023-10-16T13:01:27.352 INFO:teuthology.orchestra.run.smithi124.stdout:548 2023-10-16T13:01:27.352 INFO:teuthology.orchestra.run.smithi124.stdout:548.out 2023-10-16T13:01:27.352 INFO:teuthology.orchestra.run.smithi124.stdout:549 2023-10-16T13:01:27.353 INFO:teuthology.orchestra.run.smithi124.stdout:549.out 2023-10-16T13:01:27.353 INFO:teuthology.orchestra.run.smithi124.stdout:550 2023-10-16T13:01:27.353 INFO:teuthology.orchestra.run.smithi124.stdout:550.out 2023-10-16T13:01:27.353 INFO:teuthology.orchestra.run.smithi124.stdout:551 2023-10-16T13:01:27.353 INFO:teuthology.orchestra.run.smithi124.stdout:551.out 2023-10-16T13:01:27.354 INFO:teuthology.orchestra.run.smithi124.stdout:552 2023-10-16T13:01:27.354 INFO:teuthology.orchestra.run.smithi124.stdout:552.out 2023-10-16T13:01:27.354 INFO:teuthology.orchestra.run.smithi124.stdout:553 2023-10-16T13:01:27.354 INFO:teuthology.orchestra.run.smithi124.stdout:553.out 2023-10-16T13:01:27.354 INFO:teuthology.orchestra.run.smithi124.stdout:554 2023-10-16T13:01:27.355 INFO:teuthology.orchestra.run.smithi124.stdout:554.out 2023-10-16T13:01:27.355 INFO:teuthology.orchestra.run.smithi124.stdout:555 2023-10-16T13:01:27.355 INFO:teuthology.orchestra.run.smithi124.stdout:555.out 2023-10-16T13:01:27.355 INFO:teuthology.orchestra.run.smithi124.stdout:556 2023-10-16T13:01:27.355 INFO:teuthology.orchestra.run.smithi124.stdout:556.out 2023-10-16T13:01:27.355 INFO:teuthology.orchestra.run.smithi124.stdout:557 2023-10-16T13:01:27.356 INFO:teuthology.orchestra.run.smithi124.stdout:557.out 2023-10-16T13:01:27.356 INFO:teuthology.orchestra.run.smithi124.stdout:558 2023-10-16T13:01:27.356 INFO:teuthology.orchestra.run.smithi124.stdout:558.out 2023-10-16T13:01:27.356 INFO:teuthology.orchestra.run.smithi124.stdout:559 2023-10-16T13:01:27.356 INFO:teuthology.orchestra.run.smithi124.stdout:559.out 2023-10-16T13:01:27.357 INFO:teuthology.orchestra.run.smithi124.stdout:560 2023-10-16T13:01:27.357 INFO:teuthology.orchestra.run.smithi124.stdout:560.out 2023-10-16T13:01:27.357 INFO:teuthology.orchestra.run.smithi124.stdout:561 2023-10-16T13:01:27.357 INFO:teuthology.orchestra.run.smithi124.stdout:561.out 2023-10-16T13:01:27.357 INFO:teuthology.orchestra.run.smithi124.stdout:562 2023-10-16T13:01:27.358 INFO:teuthology.orchestra.run.smithi124.stdout:562.out 2023-10-16T13:01:27.358 INFO:teuthology.orchestra.run.smithi124.stdout:563 2023-10-16T13:01:27.358 INFO:teuthology.orchestra.run.smithi124.stdout:563.out 2023-10-16T13:01:27.358 INFO:teuthology.orchestra.run.smithi124.stdout:564 2023-10-16T13:01:27.358 INFO:teuthology.orchestra.run.smithi124.stdout:564.out 2023-10-16T13:01:27.359 INFO:teuthology.orchestra.run.smithi124.stdout:565 2023-10-16T13:01:27.359 INFO:teuthology.orchestra.run.smithi124.stdout:565.out 2023-10-16T13:01:27.359 INFO:teuthology.orchestra.run.smithi124.stdout:566 2023-10-16T13:01:27.359 INFO:teuthology.orchestra.run.smithi124.stdout:566.out 2023-10-16T13:01:27.359 INFO:teuthology.orchestra.run.smithi124.stdout:567 2023-10-16T13:01:27.360 INFO:teuthology.orchestra.run.smithi124.stdout:567.out 2023-10-16T13:01:27.360 INFO:teuthology.orchestra.run.smithi124.stdout:568 2023-10-16T13:01:27.360 INFO:teuthology.orchestra.run.smithi124.stdout:568.out 2023-10-16T13:01:27.360 INFO:teuthology.orchestra.run.smithi124.stdout:569 2023-10-16T13:01:27.360 INFO:teuthology.orchestra.run.smithi124.stdout:569.out 2023-10-16T13:01:27.360 INFO:teuthology.orchestra.run.smithi124.stdout:570 2023-10-16T13:01:27.361 INFO:teuthology.orchestra.run.smithi124.stdout:570.out 2023-10-16T13:01:27.361 INFO:teuthology.orchestra.run.smithi124.stdout:571 2023-10-16T13:01:27.361 INFO:teuthology.orchestra.run.smithi124.stdout:571.out 2023-10-16T13:01:27.361 INFO:teuthology.orchestra.run.smithi124.stdout:572 2023-10-16T13:01:27.361 INFO:teuthology.orchestra.run.smithi124.stdout:572.out 2023-10-16T13:01:27.362 INFO:teuthology.orchestra.run.smithi124.stdout:573 2023-10-16T13:01:27.362 INFO:teuthology.orchestra.run.smithi124.stdout:573.out 2023-10-16T13:01:27.362 INFO:teuthology.orchestra.run.smithi124.stdout:574 2023-10-16T13:01:27.362 INFO:teuthology.orchestra.run.smithi124.stdout:574.out 2023-10-16T13:01:27.362 INFO:teuthology.orchestra.run.smithi124.stdout:575 2023-10-16T13:01:27.363 INFO:teuthology.orchestra.run.smithi124.stdout:575.out 2023-10-16T13:01:27.363 INFO:teuthology.orchestra.run.smithi124.stdout:576 2023-10-16T13:01:27.363 INFO:teuthology.orchestra.run.smithi124.stdout:576.out 2023-10-16T13:01:27.363 INFO:teuthology.orchestra.run.smithi124.stdout:577 2023-10-16T13:01:27.363 INFO:teuthology.orchestra.run.smithi124.stdout:577.out 2023-10-16T13:01:27.363 INFO:teuthology.orchestra.run.smithi124.stdout:578 2023-10-16T13:01:27.364 INFO:teuthology.orchestra.run.smithi124.stdout:578.out 2023-10-16T13:01:27.364 INFO:teuthology.orchestra.run.smithi124.stdout:579 2023-10-16T13:01:27.364 INFO:teuthology.orchestra.run.smithi124.stdout:579.out 2023-10-16T13:01:27.364 INFO:teuthology.orchestra.run.smithi124.stdout:580 2023-10-16T13:01:27.364 INFO:teuthology.orchestra.run.smithi124.stdout:580.out 2023-10-16T13:01:27.365 INFO:teuthology.orchestra.run.smithi124.stdout:581 2023-10-16T13:01:27.365 INFO:teuthology.orchestra.run.smithi124.stdout:581.out 2023-10-16T13:01:27.365 INFO:teuthology.orchestra.run.smithi124.stdout:582 2023-10-16T13:01:27.365 INFO:teuthology.orchestra.run.smithi124.stdout:582.out 2023-10-16T13:01:27.365 INFO:teuthology.orchestra.run.smithi124.stdout:583 2023-10-16T13:01:27.366 INFO:teuthology.orchestra.run.smithi124.stdout:583.out 2023-10-16T13:01:27.366 INFO:teuthology.orchestra.run.smithi124.stdout:584 2023-10-16T13:01:27.366 INFO:teuthology.orchestra.run.smithi124.stdout:584.out 2023-10-16T13:01:27.366 INFO:teuthology.orchestra.run.smithi124.stdout:585 2023-10-16T13:01:27.366 INFO:teuthology.orchestra.run.smithi124.stdout:585.out 2023-10-16T13:01:27.367 INFO:teuthology.orchestra.run.smithi124.stdout:586 2023-10-16T13:01:27.367 INFO:teuthology.orchestra.run.smithi124.stdout:586.out 2023-10-16T13:01:27.367 INFO:teuthology.orchestra.run.smithi124.stdout:587 2023-10-16T13:01:27.367 INFO:teuthology.orchestra.run.smithi124.stdout:587.out 2023-10-16T13:01:27.367 INFO:teuthology.orchestra.run.smithi124.stdout:588 2023-10-16T13:01:27.367 INFO:teuthology.orchestra.run.smithi124.stdout:588.out 2023-10-16T13:01:27.368 INFO:teuthology.orchestra.run.smithi124.stdout:589 2023-10-16T13:01:27.368 INFO:teuthology.orchestra.run.smithi124.stdout:589.out 2023-10-16T13:01:27.368 INFO:teuthology.orchestra.run.smithi124.stdout:590 2023-10-16T13:01:27.368 INFO:teuthology.orchestra.run.smithi124.stdout:590.out 2023-10-16T13:01:27.368 INFO:teuthology.orchestra.run.smithi124.stdout:591 2023-10-16T13:01:27.369 INFO:teuthology.orchestra.run.smithi124.stdout:591.out 2023-10-16T13:01:27.369 INFO:teuthology.orchestra.run.smithi124.stdout:592 2023-10-16T13:01:27.369 INFO:teuthology.orchestra.run.smithi124.stdout:592.out 2023-10-16T13:01:27.369 INFO:teuthology.orchestra.run.smithi124.stdout:593 2023-10-16T13:01:27.369 INFO:teuthology.orchestra.run.smithi124.stdout:593.out 2023-10-16T13:01:27.370 INFO:teuthology.orchestra.run.smithi124.stdout:594 2023-10-16T13:01:27.370 INFO:teuthology.orchestra.run.smithi124.stdout:594.out 2023-10-16T13:01:27.370 INFO:teuthology.orchestra.run.smithi124.stdout:595 2023-10-16T13:01:27.370 INFO:teuthology.orchestra.run.smithi124.stdout:595.out 2023-10-16T13:01:27.370 INFO:teuthology.orchestra.run.smithi124.stdout:596 2023-10-16T13:01:27.371 INFO:teuthology.orchestra.run.smithi124.stdout:596.out 2023-10-16T13:01:27.371 INFO:teuthology.orchestra.run.smithi124.stdout:597 2023-10-16T13:01:27.371 INFO:teuthology.orchestra.run.smithi124.stdout:597.out 2023-10-16T13:01:27.371 INFO:teuthology.orchestra.run.smithi124.stdout:598 2023-10-16T13:01:27.371 INFO:teuthology.orchestra.run.smithi124.stdout:598.out 2023-10-16T13:01:27.372 INFO:teuthology.orchestra.run.smithi124.stdout:599 2023-10-16T13:01:27.372 INFO:teuthology.orchestra.run.smithi124.stdout:599.out 2023-10-16T13:01:27.372 INFO:teuthology.orchestra.run.smithi124.stdout:600 2023-10-16T13:01:27.372 INFO:teuthology.orchestra.run.smithi124.stdout:600.out 2023-10-16T13:01:27.372 INFO:teuthology.orchestra.run.smithi124.stdout:601 2023-10-16T13:01:27.373 INFO:teuthology.orchestra.run.smithi124.stdout:601.out 2023-10-16T13:01:27.373 INFO:teuthology.orchestra.run.smithi124.stdout:602 2023-10-16T13:01:27.373 INFO:teuthology.orchestra.run.smithi124.stdout:602.out 2023-10-16T13:01:27.373 INFO:teuthology.orchestra.run.smithi124.stdout:603 2023-10-16T13:01:27.373 INFO:teuthology.orchestra.run.smithi124.stdout:603.out 2023-10-16T13:01:27.374 INFO:teuthology.orchestra.run.smithi124.stdout:604 2023-10-16T13:01:27.374 INFO:teuthology.orchestra.run.smithi124.stdout:604.out 2023-10-16T13:01:27.374 INFO:teuthology.orchestra.run.smithi124.stdout:605 2023-10-16T13:01:27.374 INFO:teuthology.orchestra.run.smithi124.stdout:605.out 2023-10-16T13:01:27.374 INFO:teuthology.orchestra.run.smithi124.stdout:606 2023-10-16T13:01:27.375 INFO:teuthology.orchestra.run.smithi124.stdout:606.out 2023-10-16T13:01:27.375 INFO:teuthology.orchestra.run.smithi124.stdout:607 2023-10-16T13:01:27.375 INFO:teuthology.orchestra.run.smithi124.stdout:607.out 2023-10-16T13:01:27.375 INFO:teuthology.orchestra.run.smithi124.stdout:608 2023-10-16T13:01:27.375 INFO:teuthology.orchestra.run.smithi124.stdout:608.out 2023-10-16T13:01:27.375 INFO:teuthology.orchestra.run.smithi124.stdout:609 2023-10-16T13:01:27.376 INFO:teuthology.orchestra.run.smithi124.stdout:609.out 2023-10-16T13:01:27.376 INFO:teuthology.orchestra.run.smithi124.stdout:610 2023-10-16T13:01:27.376 INFO:teuthology.orchestra.run.smithi124.stdout:610.out 2023-10-16T13:01:27.376 INFO:teuthology.orchestra.run.smithi124.stdout:611 2023-10-16T13:01:27.376 INFO:teuthology.orchestra.run.smithi124.stdout:611.out 2023-10-16T13:01:27.377 INFO:teuthology.orchestra.run.smithi124.stdout:612 2023-10-16T13:01:27.377 INFO:teuthology.orchestra.run.smithi124.stdout:612.out 2023-10-16T13:01:27.377 INFO:teuthology.orchestra.run.smithi124.stdout:613 2023-10-16T13:01:27.377 INFO:teuthology.orchestra.run.smithi124.stdout:613.out 2023-10-16T13:01:27.377 INFO:teuthology.orchestra.run.smithi124.stdout:614 2023-10-16T13:01:27.378 INFO:teuthology.orchestra.run.smithi124.stdout:614.out 2023-10-16T13:01:27.378 INFO:teuthology.orchestra.run.smithi124.stdout:615 2023-10-16T13:01:27.378 INFO:teuthology.orchestra.run.smithi124.stdout:615.out 2023-10-16T13:01:27.378 INFO:teuthology.orchestra.run.smithi124.stdout:616 2023-10-16T13:01:27.378 INFO:teuthology.orchestra.run.smithi124.stdout:616.out 2023-10-16T13:01:27.379 INFO:teuthology.orchestra.run.smithi124.stdout:617 2023-10-16T13:01:27.379 INFO:teuthology.orchestra.run.smithi124.stdout:617.out 2023-10-16T13:01:27.379 INFO:teuthology.orchestra.run.smithi124.stdout:618 2023-10-16T13:01:27.379 INFO:teuthology.orchestra.run.smithi124.stdout:618.out 2023-10-16T13:01:27.379 INFO:teuthology.orchestra.run.smithi124.stdout:619 2023-10-16T13:01:27.379 INFO:teuthology.orchestra.run.smithi124.stdout:619.out 2023-10-16T13:01:27.380 INFO:teuthology.orchestra.run.smithi124.stdout:620 2023-10-16T13:01:27.380 INFO:teuthology.orchestra.run.smithi124.stdout:620.out 2023-10-16T13:01:27.380 INFO:teuthology.orchestra.run.smithi124.stdout:621 2023-10-16T13:01:27.380 INFO:teuthology.orchestra.run.smithi124.stdout:621.out 2023-10-16T13:01:27.380 INFO:teuthology.orchestra.run.smithi124.stdout:622 2023-10-16T13:01:27.381 INFO:teuthology.orchestra.run.smithi124.stdout:622.out 2023-10-16T13:01:27.381 INFO:teuthology.orchestra.run.smithi124.stdout:623 2023-10-16T13:01:27.381 INFO:teuthology.orchestra.run.smithi124.stdout:623.out 2023-10-16T13:01:27.381 INFO:teuthology.orchestra.run.smithi124.stdout:624 2023-10-16T13:01:27.381 INFO:teuthology.orchestra.run.smithi124.stdout:624.out 2023-10-16T13:01:27.382 INFO:teuthology.orchestra.run.smithi124.stdout:625 2023-10-16T13:01:27.382 INFO:teuthology.orchestra.run.smithi124.stdout:625.out 2023-10-16T13:01:27.382 INFO:teuthology.orchestra.run.smithi124.stdout:626 2023-10-16T13:01:27.382 INFO:teuthology.orchestra.run.smithi124.stdout:626.out 2023-10-16T13:01:27.382 INFO:teuthology.orchestra.run.smithi124.stdout:627 2023-10-16T13:01:27.382 INFO:teuthology.orchestra.run.smithi124.stdout:627.out 2023-10-16T13:01:27.383 INFO:teuthology.orchestra.run.smithi124.stdout:628 2023-10-16T13:01:27.383 INFO:teuthology.orchestra.run.smithi124.stdout:628.out 2023-10-16T13:01:27.383 INFO:teuthology.orchestra.run.smithi124.stdout:629 2023-10-16T13:01:27.383 INFO:teuthology.orchestra.run.smithi124.stdout:629.out 2023-10-16T13:01:27.383 INFO:teuthology.orchestra.run.smithi124.stdout:630 2023-10-16T13:01:27.384 INFO:teuthology.orchestra.run.smithi124.stdout:630.out 2023-10-16T13:01:27.384 INFO:teuthology.orchestra.run.smithi124.stdout:631 2023-10-16T13:01:27.384 INFO:teuthology.orchestra.run.smithi124.stdout:631.out 2023-10-16T13:01:27.384 INFO:teuthology.orchestra.run.smithi124.stdout:632 2023-10-16T13:01:27.384 INFO:teuthology.orchestra.run.smithi124.stdout:632.out 2023-10-16T13:01:27.385 INFO:teuthology.orchestra.run.smithi124.stdout:633 2023-10-16T13:01:27.385 INFO:teuthology.orchestra.run.smithi124.stdout:633.out 2023-10-16T13:01:27.385 INFO:teuthology.orchestra.run.smithi124.stdout:634 2023-10-16T13:01:27.385 INFO:teuthology.orchestra.run.smithi124.stdout:634.out 2023-10-16T13:01:27.385 INFO:teuthology.orchestra.run.smithi124.stdout:635 2023-10-16T13:01:27.386 INFO:teuthology.orchestra.run.smithi124.stdout:635.out 2023-10-16T13:01:27.386 INFO:teuthology.orchestra.run.smithi124.stdout:636 2023-10-16T13:01:27.386 INFO:teuthology.orchestra.run.smithi124.stdout:636.out 2023-10-16T13:01:27.386 INFO:teuthology.orchestra.run.smithi124.stdout:637 2023-10-16T13:01:27.386 INFO:teuthology.orchestra.run.smithi124.stdout:637.out 2023-10-16T13:01:27.386 INFO:teuthology.orchestra.run.smithi124.stdout:638 2023-10-16T13:01:27.387 INFO:teuthology.orchestra.run.smithi124.stdout:638.out 2023-10-16T13:01:27.387 INFO:teuthology.orchestra.run.smithi124.stdout:639 2023-10-16T13:01:27.387 INFO:teuthology.orchestra.run.smithi124.stdout:639.out 2023-10-16T13:01:27.387 INFO:teuthology.orchestra.run.smithi124.stdout:640 2023-10-16T13:01:27.387 INFO:teuthology.orchestra.run.smithi124.stdout:640.out 2023-10-16T13:01:27.388 INFO:teuthology.orchestra.run.smithi124.stdout:641 2023-10-16T13:01:27.388 INFO:teuthology.orchestra.run.smithi124.stdout:641.out 2023-10-16T13:01:27.388 INFO:teuthology.orchestra.run.smithi124.stdout:642 2023-10-16T13:01:27.388 INFO:teuthology.orchestra.run.smithi124.stdout:642.out 2023-10-16T13:01:27.388 INFO:teuthology.orchestra.run.smithi124.stdout:643 2023-10-16T13:01:27.389 INFO:teuthology.orchestra.run.smithi124.stdout:643.out 2023-10-16T13:01:27.389 INFO:teuthology.orchestra.run.smithi124.stdout:644 2023-10-16T13:01:27.389 INFO:teuthology.orchestra.run.smithi124.stdout:644.out 2023-10-16T13:01:27.389 INFO:teuthology.orchestra.run.smithi124.stdout:645 2023-10-16T13:01:27.389 INFO:teuthology.orchestra.run.smithi124.stdout:645.out 2023-10-16T13:01:27.389 INFO:teuthology.orchestra.run.smithi124.stdout:646 2023-10-16T13:01:27.390 INFO:teuthology.orchestra.run.smithi124.stdout:646.out 2023-10-16T13:01:27.390 INFO:teuthology.orchestra.run.smithi124.stdout:647 2023-10-16T13:01:27.390 INFO:teuthology.orchestra.run.smithi124.stdout:647.out 2023-10-16T13:01:27.390 INFO:teuthology.orchestra.run.smithi124.stdout:648 2023-10-16T13:01:27.390 INFO:teuthology.orchestra.run.smithi124.stdout:648.out 2023-10-16T13:01:27.391 INFO:teuthology.orchestra.run.smithi124.stdout:649 2023-10-16T13:01:27.391 INFO:teuthology.orchestra.run.smithi124.stdout:649.out 2023-10-16T13:01:27.391 INFO:teuthology.orchestra.run.smithi124.stdout:650 2023-10-16T13:01:27.391 INFO:teuthology.orchestra.run.smithi124.stdout:650.out 2023-10-16T13:01:27.391 INFO:teuthology.orchestra.run.smithi124.stdout:651 2023-10-16T13:01:27.392 INFO:teuthology.orchestra.run.smithi124.stdout:651.out 2023-10-16T13:01:27.392 INFO:teuthology.orchestra.run.smithi124.stdout:652 2023-10-16T13:01:27.392 INFO:teuthology.orchestra.run.smithi124.stdout:652.out 2023-10-16T13:01:27.392 INFO:teuthology.orchestra.run.smithi124.stdout:653 2023-10-16T13:01:27.392 INFO:teuthology.orchestra.run.smithi124.stdout:653.out 2023-10-16T13:01:27.393 INFO:teuthology.orchestra.run.smithi124.stdout:654 2023-10-16T13:01:27.393 INFO:teuthology.orchestra.run.smithi124.stdout:654.out 2023-10-16T13:01:27.393 INFO:teuthology.orchestra.run.smithi124.stdout:655 2023-10-16T13:01:27.393 INFO:teuthology.orchestra.run.smithi124.stdout:655.out 2023-10-16T13:01:27.393 INFO:teuthology.orchestra.run.smithi124.stdout:656 2023-10-16T13:01:27.393 INFO:teuthology.orchestra.run.smithi124.stdout:656.out 2023-10-16T13:01:27.394 INFO:teuthology.orchestra.run.smithi124.stdout:657 2023-10-16T13:01:27.394 INFO:teuthology.orchestra.run.smithi124.stdout:657.out 2023-10-16T13:01:27.394 INFO:teuthology.orchestra.run.smithi124.stdout:658 2023-10-16T13:01:27.394 INFO:teuthology.orchestra.run.smithi124.stdout:658.out 2023-10-16T13:01:27.394 INFO:teuthology.orchestra.run.smithi124.stdout:659 2023-10-16T13:01:27.395 INFO:teuthology.orchestra.run.smithi124.stdout:659.out 2023-10-16T13:01:27.395 INFO:teuthology.orchestra.run.smithi124.stdout:660 2023-10-16T13:01:27.395 INFO:teuthology.orchestra.run.smithi124.stdout:660.out 2023-10-16T13:01:27.395 INFO:teuthology.orchestra.run.smithi124.stdout:661 2023-10-16T13:01:27.395 INFO:teuthology.orchestra.run.smithi124.stdout:661.out 2023-10-16T13:01:27.396 INFO:teuthology.orchestra.run.smithi124.stdout:662 2023-10-16T13:01:27.396 INFO:teuthology.orchestra.run.smithi124.stdout:662.out 2023-10-16T13:01:27.396 INFO:teuthology.orchestra.run.smithi124.stdout:663 2023-10-16T13:01:27.396 INFO:teuthology.orchestra.run.smithi124.stdout:663.out 2023-10-16T13:01:27.396 INFO:teuthology.orchestra.run.smithi124.stdout:664 2023-10-16T13:01:27.396 INFO:teuthology.orchestra.run.smithi124.stdout:664.out 2023-10-16T13:01:27.397 INFO:teuthology.orchestra.run.smithi124.stdout:665 2023-10-16T13:01:27.397 INFO:teuthology.orchestra.run.smithi124.stdout:665.out 2023-10-16T13:01:27.397 INFO:teuthology.orchestra.run.smithi124.stdout:666 2023-10-16T13:01:27.397 INFO:teuthology.orchestra.run.smithi124.stdout:666.out 2023-10-16T13:01:27.397 INFO:teuthology.orchestra.run.smithi124.stdout:667 2023-10-16T13:01:27.398 INFO:teuthology.orchestra.run.smithi124.stdout:667.out 2023-10-16T13:01:27.398 INFO:teuthology.orchestra.run.smithi124.stdout:668 2023-10-16T13:01:27.398 INFO:teuthology.orchestra.run.smithi124.stdout:668.out 2023-10-16T13:01:27.398 INFO:teuthology.orchestra.run.smithi124.stdout:669 2023-10-16T13:01:27.398 INFO:teuthology.orchestra.run.smithi124.stdout:669.out 2023-10-16T13:01:27.399 INFO:teuthology.orchestra.run.smithi124.stdout:670 2023-10-16T13:01:27.399 INFO:teuthology.orchestra.run.smithi124.stdout:670.out 2023-10-16T13:01:27.399 INFO:teuthology.orchestra.run.smithi124.stdout:671 2023-10-16T13:01:27.399 INFO:teuthology.orchestra.run.smithi124.stdout:671.out 2023-10-16T13:01:27.399 INFO:teuthology.orchestra.run.smithi124.stdout:672 2023-10-16T13:01:27.399 INFO:teuthology.orchestra.run.smithi124.stdout:672.out 2023-10-16T13:01:27.400 INFO:teuthology.orchestra.run.smithi124.stdout:673 2023-10-16T13:01:27.400 INFO:teuthology.orchestra.run.smithi124.stdout:673.out 2023-10-16T13:01:27.400 INFO:teuthology.orchestra.run.smithi124.stdout:674 2023-10-16T13:01:27.400 INFO:teuthology.orchestra.run.smithi124.stdout:674.out 2023-10-16T13:01:27.400 INFO:teuthology.orchestra.run.smithi124.stdout:675 2023-10-16T13:01:27.401 INFO:teuthology.orchestra.run.smithi124.stdout:675.out 2023-10-16T13:01:27.401 INFO:teuthology.orchestra.run.smithi124.stdout:676 2023-10-16T13:01:27.401 INFO:teuthology.orchestra.run.smithi124.stdout:676.out 2023-10-16T13:01:27.401 INFO:teuthology.orchestra.run.smithi124.stdout:677 2023-10-16T13:01:27.401 INFO:teuthology.orchestra.run.smithi124.stdout:677.out 2023-10-16T13:01:27.402 INFO:teuthology.orchestra.run.smithi124.stdout:678 2023-10-16T13:01:27.402 INFO:teuthology.orchestra.run.smithi124.stdout:678.out 2023-10-16T13:01:27.402 INFO:teuthology.orchestra.run.smithi124.stdout:679 2023-10-16T13:01:27.402 INFO:teuthology.orchestra.run.smithi124.stdout:679.out 2023-10-16T13:01:27.402 INFO:teuthology.orchestra.run.smithi124.stdout:680 2023-10-16T13:01:27.403 INFO:teuthology.orchestra.run.smithi124.stdout:680.out 2023-10-16T13:01:27.403 INFO:teuthology.orchestra.run.smithi124.stdout:681 2023-10-16T13:01:27.403 INFO:teuthology.orchestra.run.smithi124.stdout:681.out 2023-10-16T13:01:27.403 INFO:teuthology.orchestra.run.smithi124.stdout:682 2023-10-16T13:01:27.403 INFO:teuthology.orchestra.run.smithi124.stdout:682.out 2023-10-16T13:01:27.403 INFO:teuthology.orchestra.run.smithi124.stdout:683 2023-10-16T13:01:27.404 INFO:teuthology.orchestra.run.smithi124.stdout:683.out 2023-10-16T13:01:27.404 INFO:teuthology.orchestra.run.smithi124.stdout:684 2023-10-16T13:01:27.404 INFO:teuthology.orchestra.run.smithi124.stdout:684.out 2023-10-16T13:01:27.404 INFO:teuthology.orchestra.run.smithi124.stdout:685 2023-10-16T13:01:27.404 INFO:teuthology.orchestra.run.smithi124.stdout:685.out 2023-10-16T13:01:27.405 INFO:teuthology.orchestra.run.smithi124.stdout:686 2023-10-16T13:01:27.405 INFO:teuthology.orchestra.run.smithi124.stdout:686.out 2023-10-16T13:01:27.405 INFO:teuthology.orchestra.run.smithi124.stdout:687 2023-10-16T13:01:27.405 INFO:teuthology.orchestra.run.smithi124.stdout:687.out 2023-10-16T13:01:27.405 INFO:teuthology.orchestra.run.smithi124.stdout:688 2023-10-16T13:01:27.406 INFO:teuthology.orchestra.run.smithi124.stdout:688.out 2023-10-16T13:01:27.406 INFO:teuthology.orchestra.run.smithi124.stdout:689 2023-10-16T13:01:27.406 INFO:teuthology.orchestra.run.smithi124.stdout:689.out 2023-10-16T13:01:27.406 INFO:teuthology.orchestra.run.smithi124.stdout:690 2023-10-16T13:01:27.406 INFO:teuthology.orchestra.run.smithi124.stdout:690.out 2023-10-16T13:01:27.407 INFO:teuthology.orchestra.run.smithi124.stdout:691 2023-10-16T13:01:27.407 INFO:teuthology.orchestra.run.smithi124.stdout:691.out 2023-10-16T13:01:27.407 INFO:teuthology.orchestra.run.smithi124.stdout:692 2023-10-16T13:01:27.407 INFO:teuthology.orchestra.run.smithi124.stdout:692.out 2023-10-16T13:01:27.407 INFO:teuthology.orchestra.run.smithi124.stdout:693 2023-10-16T13:01:27.408 INFO:teuthology.orchestra.run.smithi124.stdout:693.out 2023-10-16T13:01:27.408 INFO:teuthology.orchestra.run.smithi124.stdout:694 2023-10-16T13:01:27.408 INFO:teuthology.orchestra.run.smithi124.stdout:694.out 2023-10-16T13:01:27.408 INFO:teuthology.orchestra.run.smithi124.stdout:695 2023-10-16T13:01:27.408 INFO:teuthology.orchestra.run.smithi124.stdout:695.out 2023-10-16T13:01:27.409 INFO:teuthology.orchestra.run.smithi124.stdout:696 2023-10-16T13:01:27.409 INFO:teuthology.orchestra.run.smithi124.stdout:696.out 2023-10-16T13:01:27.409 INFO:teuthology.orchestra.run.smithi124.stdout:697 2023-10-16T13:01:27.409 INFO:teuthology.orchestra.run.smithi124.stdout:697.out 2023-10-16T13:01:27.409 INFO:teuthology.orchestra.run.smithi124.stdout:698 2023-10-16T13:01:27.410 INFO:teuthology.orchestra.run.smithi124.stdout:698.out 2023-10-16T13:01:27.410 INFO:teuthology.orchestra.run.smithi124.stdout:699 2023-10-16T13:01:27.410 INFO:teuthology.orchestra.run.smithi124.stdout:699.out 2023-10-16T13:01:27.410 INFO:teuthology.orchestra.run.smithi124.stdout:700 2023-10-16T13:01:27.410 INFO:teuthology.orchestra.run.smithi124.stdout:700.out 2023-10-16T13:01:27.410 INFO:teuthology.orchestra.run.smithi124.stdout:701 2023-10-16T13:01:27.411 INFO:teuthology.orchestra.run.smithi124.stdout:701.out 2023-10-16T13:01:27.411 INFO:teuthology.orchestra.run.smithi124.stdout:702 2023-10-16T13:01:27.411 INFO:teuthology.orchestra.run.smithi124.stdout:702.out 2023-10-16T13:01:27.411 INFO:teuthology.orchestra.run.smithi124.stdout:703 2023-10-16T13:01:27.411 INFO:teuthology.orchestra.run.smithi124.stdout:703.out 2023-10-16T13:01:27.412 INFO:teuthology.orchestra.run.smithi124.stdout:704 2023-10-16T13:01:27.412 INFO:teuthology.orchestra.run.smithi124.stdout:704.out 2023-10-16T13:01:27.412 INFO:teuthology.orchestra.run.smithi124.stdout:705 2023-10-16T13:01:27.412 INFO:teuthology.orchestra.run.smithi124.stdout:705.out 2023-10-16T13:01:27.412 INFO:teuthology.orchestra.run.smithi124.stdout:706 2023-10-16T13:01:27.413 INFO:teuthology.orchestra.run.smithi124.stdout:706.out 2023-10-16T13:01:27.413 INFO:teuthology.orchestra.run.smithi124.stdout:707 2023-10-16T13:01:27.413 INFO:teuthology.orchestra.run.smithi124.stdout:707.out 2023-10-16T13:01:27.413 INFO:teuthology.orchestra.run.smithi124.stdout:708 2023-10-16T13:01:27.413 INFO:teuthology.orchestra.run.smithi124.stdout:708.out 2023-10-16T13:01:27.414 INFO:teuthology.orchestra.run.smithi124.stdout:709 2023-10-16T13:01:27.414 INFO:teuthology.orchestra.run.smithi124.stdout:709.out 2023-10-16T13:01:27.414 INFO:teuthology.orchestra.run.smithi124.stdout:710 2023-10-16T13:01:27.414 INFO:teuthology.orchestra.run.smithi124.stdout:710.out 2023-10-16T13:01:27.414 INFO:teuthology.orchestra.run.smithi124.stdout:711 2023-10-16T13:01:27.415 INFO:teuthology.orchestra.run.smithi124.stdout:711.out 2023-10-16T13:01:27.415 INFO:teuthology.orchestra.run.smithi124.stdout:712 2023-10-16T13:01:27.415 INFO:teuthology.orchestra.run.smithi124.stdout:712.out 2023-10-16T13:01:27.415 INFO:teuthology.orchestra.run.smithi124.stdout:713 2023-10-16T13:01:27.415 INFO:teuthology.orchestra.run.smithi124.stdout:713.out 2023-10-16T13:01:27.415 INFO:teuthology.orchestra.run.smithi124.stdout:714 2023-10-16T13:01:27.416 INFO:teuthology.orchestra.run.smithi124.stdout:714.out 2023-10-16T13:01:27.416 INFO:teuthology.orchestra.run.smithi124.stdout:715 2023-10-16T13:01:27.416 INFO:teuthology.orchestra.run.smithi124.stdout:715.out 2023-10-16T13:01:27.416 INFO:teuthology.orchestra.run.smithi124.stdout:716 2023-10-16T13:01:27.416 INFO:teuthology.orchestra.run.smithi124.stdout:716.out 2023-10-16T13:01:27.417 INFO:teuthology.orchestra.run.smithi124.stdout:717 2023-10-16T13:01:27.417 INFO:teuthology.orchestra.run.smithi124.stdout:717.out 2023-10-16T13:01:27.417 INFO:teuthology.orchestra.run.smithi124.stdout:718 2023-10-16T13:01:27.417 INFO:teuthology.orchestra.run.smithi124.stdout:718.out 2023-10-16T13:01:27.417 INFO:teuthology.orchestra.run.smithi124.stdout:719 2023-10-16T13:01:27.418 INFO:teuthology.orchestra.run.smithi124.stdout:719.out 2023-10-16T13:01:27.418 INFO:teuthology.orchestra.run.smithi124.stdout:720 2023-10-16T13:01:27.418 INFO:teuthology.orchestra.run.smithi124.stdout:720.out 2023-10-16T13:01:27.418 INFO:teuthology.orchestra.run.smithi124.stdout:721 2023-10-16T13:01:27.418 INFO:teuthology.orchestra.run.smithi124.stdout:721.out 2023-10-16T13:01:27.419 INFO:teuthology.orchestra.run.smithi124.stdout:722 2023-10-16T13:01:27.419 INFO:teuthology.orchestra.run.smithi124.stdout:722.out 2023-10-16T13:01:27.419 INFO:teuthology.orchestra.run.smithi124.stdout:723 2023-10-16T13:01:27.419 INFO:teuthology.orchestra.run.smithi124.stdout:723.out 2023-10-16T13:01:27.419 INFO:teuthology.orchestra.run.smithi124.stdout:724 2023-10-16T13:01:27.420 INFO:teuthology.orchestra.run.smithi124.stdout:724.out 2023-10-16T13:01:27.420 INFO:teuthology.orchestra.run.smithi124.stdout:725 2023-10-16T13:01:27.420 INFO:teuthology.orchestra.run.smithi124.stdout:725.out 2023-10-16T13:01:27.420 INFO:teuthology.orchestra.run.smithi124.stdout:726 2023-10-16T13:01:27.420 INFO:teuthology.orchestra.run.smithi124.stdout:726.out 2023-10-16T13:01:27.420 INFO:teuthology.orchestra.run.smithi124.stdout:727 2023-10-16T13:01:27.421 INFO:teuthology.orchestra.run.smithi124.stdout:727.out 2023-10-16T13:01:27.421 INFO:teuthology.orchestra.run.smithi124.stdout:728 2023-10-16T13:01:27.421 INFO:teuthology.orchestra.run.smithi124.stdout:728.out 2023-10-16T13:01:27.421 INFO:teuthology.orchestra.run.smithi124.stdout:729 2023-10-16T13:01:27.421 INFO:teuthology.orchestra.run.smithi124.stdout:729.out 2023-10-16T13:01:27.422 INFO:teuthology.orchestra.run.smithi124.stdout:730 2023-10-16T13:01:27.422 INFO:teuthology.orchestra.run.smithi124.stdout:730.out 2023-10-16T13:01:27.422 INFO:teuthology.orchestra.run.smithi124.stdout:731 2023-10-16T13:01:27.422 INFO:teuthology.orchestra.run.smithi124.stdout:731.out 2023-10-16T13:01:27.422 INFO:teuthology.orchestra.run.smithi124.stdout:group.list 2023-10-16T13:01:27.423 INFO:teuthology.orchestra.run.smithi124.stdout:Makefile 2023-10-16T13:01:27.423 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-10-16T13:01:27.643 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:01:27.647 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:01:27.647 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:01:27.648 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:01:27.648 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:01:32.678 INFO:teuthology.orchestra.run.smithi124.stdout:generic/001 5s 2023-10-16T13:01:32.683 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/001 2023-10-16T13:01:32.683 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:01:32.684 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:01:33.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:01:33.415 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-10-16T13:01:33.615 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:01:33.619 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:01:33.619 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:01:33.620 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:01:33.620 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:01:34.248 INFO:teuthology.orchestra.run.smithi124.stdout:generic/002 1s 2023-10-16T13:01:34.253 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/002 2023-10-16T13:01:34.253 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:01:34.255 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:01:34.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:01:34.324 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-10-16T13:01:34.531 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:01:34.535 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:01:34.535 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:01:34.536 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:01:34.536 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:01:34.857 INFO:teuthology.orchestra.run.smithi124.stdout:generic/003 [not run] atime not maintained by ceph 2023-10-16T13:01:34.861 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/003 2023-10-16T13:01:34.861 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/003 2023-10-16T13:01:34.862 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:01:34.863 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:01:34.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:01:34.888 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-10-16T13:01:35.087 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:01:35.091 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:01:35.091 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:01:35.092 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:01:35.092 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:01:35.433 INFO:teuthology.orchestra.run.smithi124.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-10-16T13:01:35.437 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/004 2023-10-16T13:01:35.437 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/004 2023-10-16T13:01:35.437 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:01:35.439 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:01:35.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:01:35.478 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-10-16T13:01:35.707 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:01:35.711 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:01:35.711 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:01:35.712 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:01:35.713 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:01:36.218 INFO:teuthology.orchestra.run.smithi124.stdout:generic/005 1s 2023-10-16T13:01:36.223 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/005 2023-10-16T13:01:36.223 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:01:36.225 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:01:36.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:01:36.329 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-10-16T13:01:36.545 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:01:36.548 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:01:36.549 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:01:36.550 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:01:36.550 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:01:50.604 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:01:50.607 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:02:01.674 INFO:teuthology.orchestra.run.smithi124.stdout:generic/006 25s 2023-10-16T13:02:01.679 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/006 2023-10-16T13:02:01.679 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:02:01.681 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:02:01.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:02:01.741 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-10-16T13:02:01.938 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:02:01.942 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:02:01.943 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:02:01.944 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:02:01.944 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:02:20.670 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:02:20.673 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:02:51.232 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:02:51.235 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:02:53.052 INFO:teuthology.orchestra.run.smithi124.stdout:generic/007 51s 2023-10-16T13:02:53.057 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/007 2023-10-16T13:02:53.057 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:02:53.059 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:02:53.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:02:53.130 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-10-16T13:02:53.353 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:02:53.357 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:02:53.358 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:02:53.358 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:02:53.358 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:02:53.757 INFO:teuthology.orchestra.run.smithi124.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-16T13:02:53.766 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/008 2023-10-16T13:02:53.766 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/008 2023-10-16T13:02:53.766 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:02:53.770 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:02:53.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:02:53.795 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-10-16T13:02:54.008 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:02:54.012 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:02:54.013 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:02:54.014 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:02:54.014 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:02:54.406 INFO:teuthology.orchestra.run.smithi124.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-16T13:02:54.410 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/009 2023-10-16T13:02:54.410 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/009 2023-10-16T13:02:54.411 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:02:54.412 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:02:54.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:02:54.443 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-10-16T13:02:54.648 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:02:54.652 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:02:54.652 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:02:54.653 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:02:54.653 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:02:54.960 INFO:teuthology.orchestra.run.smithi124.stdout:generic/010 [not run] /tmp/tmp.pHbfHGg5qgxfstests-dev/src/dbtest not built 2023-10-16T13:02:54.964 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/010 2023-10-16T13:02:54.964 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/010 2023-10-16T13:02:54.964 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:02:54.966 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:02:54.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:02:54.986 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-10-16T13:02:55.217 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:02:55.221 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:02:55.221 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:02:55.222 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:02:55.222 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:03:21.312 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:03:21.315 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:03:25.756 INFO:teuthology.orchestra.run.smithi124.stdout:generic/011 30s 2023-10-16T13:03:25.761 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/011 2023-10-16T13:03:25.761 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:03:25.763 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:03:25.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:03:25.987 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-10-16T13:03:26.295 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:03:26.299 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:03:26.299 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:03:26.300 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:03:26.300 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:03:26.708 INFO:teuthology.orchestra.run.smithi124.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T13:03:26.712 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/012 2023-10-16T13:03:26.712 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/012 2023-10-16T13:03:26.712 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:03:26.714 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:03:26.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:03:26.772 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-10-16T13:03:26.994 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:03:26.998 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:03:26.999 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:03:27.000 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:03:27.000 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:03:51.777 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:03:51.786 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:04:22.303 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:04:22.306 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:04:24.056 INFO:teuthology.orchestra.run.smithi124.stdout:generic/013 57s 2023-10-16T13:04:24.192 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/013 2023-10-16T13:04:24.192 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:04:24.194 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:04:24.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:04:24.232 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-10-16T13:04:24.552 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:04:24.557 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:04:24.557 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:04:24.558 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:04:24.558 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:04:52.607 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:04:52.612 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:05:22.723 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:05:22.726 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:05:52.848 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:05:52.852 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:06:22.944 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:06:22.969 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:06:53.039 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:06:53.051 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:07:23.454 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:07:23.457 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:07:53.865 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:07:53.868 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:08:24.170 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:08:24.173 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:08:54.510 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:08:54.516 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:09:00.099 INFO:teuthology.orchestra.run.smithi124.stdout:generic/014 276s 2023-10-16T13:09:00.158 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/014 2023-10-16T13:09:00.158 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:00.160 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:00.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:00.198 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-10-16T13:09:00.543 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:00.548 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:00.548 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:00.549 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:00.550 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:01.001 INFO:teuthology.orchestra.run.smithi124.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-16T13:09:01.006 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/015 2023-10-16T13:09:01.006 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/015 2023-10-16T13:09:01.006 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:01.008 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:01.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:01.036 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-10-16T13:09:01.354 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:01.367 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:01.368 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:01.369 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:01.369 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:02.025 INFO:teuthology.orchestra.run.smithi124.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T13:09:02.030 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/016 2023-10-16T13:09:02.031 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/016 2023-10-16T13:09:02.031 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:02.033 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:02.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:02.294 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-10-16T13:09:02.656 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:02.661 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:02.661 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:02.662 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:02.663 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:03.107 INFO:teuthology.orchestra.run.smithi124.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T13:09:03.112 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/017 2023-10-16T13:09:03.112 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/017 2023-10-16T13:09:03.113 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:03.114 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:03.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:03.161 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-10-16T13:09:03.451 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:03.460 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:03.460 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:03.461 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:03.462 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:04.055 INFO:teuthology.orchestra.run.smithi124.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-10-16T13:09:04.081 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/018 2023-10-16T13:09:04.081 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/018 2023-10-16T13:09:04.081 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:04.085 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:04.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:04.126 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-10-16T13:09:04.426 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:04.431 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:04.431 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:04.432 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:04.433 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:04.912 INFO:teuthology.orchestra.run.smithi124.stdout:generic/019 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T13:09:04.919 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/019 2023-10-16T13:09:04.919 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/019 2023-10-16T13:09:04.919 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:04.922 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:04.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:04.954 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-10-16T13:09:05.258 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:05.262 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:05.263 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:05.264 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:05.264 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:08.454 INFO:teuthology.orchestra.run.smithi124.stdout:generic/020 3s 2023-10-16T13:09:08.462 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/020 2023-10-16T13:09:08.462 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:08.464 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:08.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:08.799 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-10-16T13:09:09.144 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:09.148 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:09.148 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:09.149 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:09.149 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:09.730 INFO:teuthology.orchestra.run.smithi124.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T13:09:09.735 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/021 2023-10-16T13:09:09.736 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/021 2023-10-16T13:09:09.736 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:09.738 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:10.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:10.020 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-10-16T13:09:10.417 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:10.422 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:10.423 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:10.424 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:10.424 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:11.026 INFO:teuthology.orchestra.run.smithi124.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T13:09:11.032 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/022 2023-10-16T13:09:11.032 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/022 2023-10-16T13:09:11.033 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:11.035 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:11.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:11.301 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-10-16T13:09:11.689 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:11.696 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:11.697 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:11.698 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:11.698 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:13.610 INFO:teuthology.orchestra.run.smithi124.stdout:generic/023 2s 2023-10-16T13:09:13.618 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/023 2023-10-16T13:09:13.619 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:13.621 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:13.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:13.873 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-10-16T13:09:14.289 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:14.293 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:14.294 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:14.295 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:14.295 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:14.779 INFO:teuthology.orchestra.run.smithi124.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-10-16T13:09:14.783 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/024 2023-10-16T13:09:14.783 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/024 2023-10-16T13:09:14.783 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:14.785 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:15.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:15.098 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-10-16T13:09:15.397 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:15.404 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:15.405 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:15.407 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:15.407 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:15.884 INFO:teuthology.orchestra.run.smithi124.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-10-16T13:09:15.893 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/025 2023-10-16T13:09:15.893 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/025 2023-10-16T13:09:15.894 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:15.894 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:15.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:15.954 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-10-16T13:09:16.568 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:16.572 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:16.572 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:16.574 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:16.574 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:17.093 INFO:teuthology.orchestra.run.smithi124.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-10-16T13:09:17.097 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/026 2023-10-16T13:09:17.098 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/026 2023-10-16T13:09:17.098 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:17.100 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:17.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:17.140 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-10-16T13:09:17.497 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:17.505 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:17.505 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:17.506 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:17.506 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:17.986 INFO:teuthology.orchestra.run.smithi124.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-16T13:09:17.993 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/027 2023-10-16T13:09:17.994 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/027 2023-10-16T13:09:17.994 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:17.996 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:18.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:18.018 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-10-16T13:09:18.340 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:18.348 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:18.348 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:18.349 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:18.350 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:23.885 INFO:teuthology.orchestra.run.smithi124.stdout:generic/028 5s 2023-10-16T13:09:23.891 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/028 2023-10-16T13:09:23.891 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:23.893 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:23.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:23.922 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-10-16T13:09:24.220 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:24.227 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:24.227 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:24.228 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:24.228 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:24.603 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:09:24.609 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:09:29.442 INFO:teuthology.orchestra.run.smithi124.stdout:generic/029 5s 2023-10-16T13:09:29.448 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/029 2023-10-16T13:09:29.449 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:29.457 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:29.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:29.470 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-10-16T13:09:29.807 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:29.812 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:29.813 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:29.813 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:29.814 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:33.307 INFO:teuthology.orchestra.run.smithi124.stdout:generic/030 3s 2023-10-16T13:09:33.317 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/030 2023-10-16T13:09:33.317 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:33.319 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:33.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:33.330 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-10-16T13:09:33.657 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:33.662 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:33.662 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:33.663 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:33.664 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:34.203 INFO:teuthology.orchestra.run.smithi124.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-10-16T13:09:34.212 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/031 2023-10-16T13:09:34.212 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/031 2023-10-16T13:09:34.212 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:34.214 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:34.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:34.258 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-10-16T13:09:34.558 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:34.562 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:34.563 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:34.567 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:34.567 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:34.987 INFO:teuthology.orchestra.run.smithi124.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T13:09:34.992 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/032 2023-10-16T13:09:34.992 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/032 2023-10-16T13:09:34.992 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:34.996 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:35.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:35.035 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-10-16T13:09:35.369 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:35.373 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:35.374 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:35.374 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:35.375 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:35.899 INFO:teuthology.orchestra.run.smithi124.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-16T13:09:35.904 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/033 2023-10-16T13:09:35.904 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/033 2023-10-16T13:09:35.904 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:35.906 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:35.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:35.943 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-10-16T13:09:36.252 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:36.262 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:36.263 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:36.264 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:36.264 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:36.725 INFO:teuthology.orchestra.run.smithi124.stdout:generic/034 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T13:09:36.730 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/034 2023-10-16T13:09:36.730 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/034 2023-10-16T13:09:36.730 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:36.733 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:36.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:36.765 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-10-16T13:09:37.079 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:37.084 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:37.085 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:37.085 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:37.086 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:37.570 INFO:teuthology.orchestra.run.smithi124.stdout:generic/035 0s 2023-10-16T13:09:37.576 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/035 2023-10-16T13:09:37.577 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:37.579 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:37.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:37.694 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-10-16T13:09:38.247 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:38.251 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:38.252 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:38.252 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:38.252 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:48.862 INFO:teuthology.orchestra.run.smithi124.stdout:generic/036 10s 2023-10-16T13:09:48.867 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/036 2023-10-16T13:09:48.867 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:48.869 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:49.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:49.158 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-10-16T13:09:49.508 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:49.512 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:49.512 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:49.514 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:49.514 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:54.701 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:09:54.704 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:09:55.416 INFO:teuthology.orchestra.run.smithi124.stdout:generic/037 6s 2023-10-16T13:09:55.422 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/037 2023-10-16T13:09:55.422 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:55.424 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:55.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:55.438 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-10-16T13:09:55.735 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:55.748 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:55.748 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:55.749 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:55.749 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:56.240 INFO:teuthology.orchestra.run.smithi124.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T13:09:56.246 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/038 2023-10-16T13:09:56.247 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/038 2023-10-16T13:09:56.247 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:56.251 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:56.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:56.282 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-10-16T13:09:56.628 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:56.633 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:56.633 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:56.634 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:56.634 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:57.117 INFO:teuthology.orchestra.run.smithi124.stdout:generic/039 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T13:09:57.122 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/039 2023-10-16T13:09:57.123 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/039 2023-10-16T13:09:57.123 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:57.126 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:57.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:57.173 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-10-16T13:09:57.540 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:57.544 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:57.545 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:57.546 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:57.546 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:58.047 INFO:teuthology.orchestra.run.smithi124.stdout:generic/040 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T13:09:58.057 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/040 2023-10-16T13:09:58.057 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/040 2023-10-16T13:09:58.058 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:58.061 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:58.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:58.107 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-10-16T13:09:58.416 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:58.420 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:58.421 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:58.421 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:58.421 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:58.917 INFO:teuthology.orchestra.run.smithi124.stdout:generic/041 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T13:09:58.921 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/041 2023-10-16T13:09:58.921 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/041 2023-10-16T13:09:58.921 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:58.923 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:58.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:09:58.958 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-10-16T13:09:59.293 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:09:59.297 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:09:59.298 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:09:59.299 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:09:59.299 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:09:59.956 INFO:teuthology.orchestra.run.smithi124.stdout:generic/042 [not run] ceph does not support shutdown 2023-10-16T13:09:59.979 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/042 2023-10-16T13:09:59.979 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/042 2023-10-16T13:09:59.979 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:09:59.983 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:00.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:00.007 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-10-16T13:10:00.343 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:00.357 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:00.361 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:00.362 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:00.363 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:01.022 INFO:teuthology.orchestra.run.smithi124.stdout:generic/043 [not run] ceph does not support shutdown 2023-10-16T13:10:01.036 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/043 2023-10-16T13:10:01.037 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/043 2023-10-16T13:10:01.037 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:01.038 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:01.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:01.061 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-10-16T13:10:01.390 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:01.394 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:01.395 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:01.396 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:01.396 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:02.057 INFO:teuthology.orchestra.run.smithi124.stdout:generic/044 [not run] ceph does not support shutdown 2023-10-16T13:10:02.078 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/044 2023-10-16T13:10:02.079 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/044 2023-10-16T13:10:02.079 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:02.081 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:02.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:02.114 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-10-16T13:10:02.421 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:02.425 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:02.426 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:02.427 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:02.427 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:03.081 INFO:teuthology.orchestra.run.smithi124.stdout:generic/045 [not run] ceph does not support shutdown 2023-10-16T13:10:03.114 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/045 2023-10-16T13:10:03.114 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/045 2023-10-16T13:10:03.115 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:03.118 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:03.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:03.148 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-10-16T13:10:03.463 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:03.469 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:03.469 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:03.470 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:03.471 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:04.133 INFO:teuthology.orchestra.run.smithi124.stdout:generic/046 [not run] ceph does not support shutdown 2023-10-16T13:10:04.155 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/046 2023-10-16T13:10:04.155 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/046 2023-10-16T13:10:04.155 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:04.157 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:04.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:04.183 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-10-16T13:10:04.477 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:04.483 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:04.485 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:04.485 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:04.486 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:05.162 INFO:teuthology.orchestra.run.smithi124.stdout:generic/047 [not run] ceph does not support shutdown 2023-10-16T13:10:05.192 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/047 2023-10-16T13:10:05.192 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/047 2023-10-16T13:10:05.192 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:05.194 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:05.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:05.217 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-10-16T13:10:05.552 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:05.557 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:05.558 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:05.559 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:05.559 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:06.232 INFO:teuthology.orchestra.run.smithi124.stdout:generic/048 [not run] ceph does not support shutdown 2023-10-16T13:10:06.256 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/048 2023-10-16T13:10:06.256 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/048 2023-10-16T13:10:06.256 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:06.259 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:06.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:06.290 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-10-16T13:10:06.627 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:06.633 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:06.634 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:06.635 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:06.635 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:07.335 INFO:teuthology.orchestra.run.smithi124.stdout:generic/049 [not run] ceph does not support shutdown 2023-10-16T13:10:07.356 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/049 2023-10-16T13:10:07.357 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/049 2023-10-16T13:10:07.357 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:07.361 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:07.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:07.391 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-10-16T13:10:07.717 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:07.731 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:07.731 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:07.736 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:07.736 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:08.385 INFO:teuthology.orchestra.run.smithi124.stdout:generic/050 [not run] ceph does not support shutdown 2023-10-16T13:10:08.403 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/050 2023-10-16T13:10:08.403 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/050 2023-10-16T13:10:08.403 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:08.405 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:08.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:08.433 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-10-16T13:10:08.769 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:08.776 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:08.777 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:08.778 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:08.779 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:09.427 INFO:teuthology.orchestra.run.smithi124.stdout:generic/051 [not run] ceph does not support shutdown 2023-10-16T13:10:09.432 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/051 2023-10-16T13:10:09.432 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/051 2023-10-16T13:10:09.432 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:09.438 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:09.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:09.466 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-10-16T13:10:09.777 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:09.781 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:09.781 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:09.782 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:09.782 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:10.408 INFO:teuthology.orchestra.run.smithi124.stdout:generic/052 [not run] ceph does not support shutdown 2023-10-16T13:10:10.434 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/052 2023-10-16T13:10:10.435 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/052 2023-10-16T13:10:10.435 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:10.436 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:10.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:10.459 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-10-16T13:10:10.767 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:10.768 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:10.769 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:10.770 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:10.770 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:11.866 INFO:teuthology.orchestra.run.smithi124.stdout:generic/053 1s 2023-10-16T13:10:11.882 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/053 2023-10-16T13:10:11.883 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:11.890 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:11.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:11.900 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-10-16T13:10:12.226 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:12.230 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:12.231 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:12.232 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:12.232 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:12.916 INFO:teuthology.orchestra.run.smithi124.stdout:generic/054 [not run] ceph does not support shutdown 2023-10-16T13:10:12.947 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/054 2023-10-16T13:10:12.947 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/054 2023-10-16T13:10:12.947 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:12.952 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:12.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:12.977 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-10-16T13:10:13.280 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:13.284 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:13.284 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:13.286 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:13.286 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:13.878 INFO:teuthology.orchestra.run.smithi124.stdout:generic/055 [not run] ceph does not support shutdown 2023-10-16T13:10:13.904 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/055 2023-10-16T13:10:13.905 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/055 2023-10-16T13:10:13.905 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:13.907 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:13.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:13.943 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-10-16T13:10:14.277 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:14.281 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:14.282 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:14.283 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:14.283 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:14.774 INFO:teuthology.orchestra.run.smithi124.stdout:generic/056 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T13:10:14.779 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/056 2023-10-16T13:10:14.779 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/056 2023-10-16T13:10:14.779 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:14.781 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:14.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:14.822 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-10-16T13:10:15.150 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:15.155 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:15.156 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:15.157 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:15.157 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:15.657 INFO:teuthology.orchestra.run.smithi124.stdout:generic/057 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T13:10:15.662 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/057 2023-10-16T13:10:15.662 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/057 2023-10-16T13:10:15.663 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:15.665 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:15.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:15.696 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-10-16T13:10:16.044 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:16.063 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:16.064 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:16.064 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:16.065 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:16.678 INFO:teuthology.orchestra.run.smithi124.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T13:10:16.682 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/058 2023-10-16T13:10:16.682 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/058 2023-10-16T13:10:16.683 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:16.684 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:16.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:16.970 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-10-16T13:10:17.327 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:17.339 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:17.339 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:17.340 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:17.340 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:17.853 INFO:teuthology.orchestra.run.smithi124.stdout:generic/059 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T13:10:17.858 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/059 2023-10-16T13:10:17.859 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/059 2023-10-16T13:10:17.859 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:17.864 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:17.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:17.897 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-10-16T13:10:18.219 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:18.223 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:18.224 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:18.225 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:18.225 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:18.811 INFO:teuthology.orchestra.run.smithi124.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T13:10:18.814 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/060 2023-10-16T13:10:18.815 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/060 2023-10-16T13:10:18.815 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:18.820 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:19.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:19.013 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-10-16T13:10:19.452 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:19.456 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:19.457 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:19.458 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:19.458 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:20.014 INFO:teuthology.orchestra.run.smithi124.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T13:10:20.018 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/061 2023-10-16T13:10:20.019 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/061 2023-10-16T13:10:20.019 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:20.020 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:20.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:20.171 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-10-16T13:10:20.626 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:20.637 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:20.637 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:20.642 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:20.642 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:23.562 INFO:teuthology.orchestra.run.smithi124.stdout:generic/062 3s 2023-10-16T13:10:23.572 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/062 2023-10-16T13:10:23.572 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:23.576 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:23.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:23.590 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-10-16T13:10:23.901 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:23.907 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:23.908 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:23.908 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:23.909 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:24.579 INFO:teuthology.orchestra.run.smithi124.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T13:10:24.587 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/063 2023-10-16T13:10:24.588 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/063 2023-10-16T13:10:24.588 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:24.589 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:24.772 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:10:24.833 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:10:24.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:24.876 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-10-16T13:10:25.231 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:25.235 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:25.236 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:25.236 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:25.237 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:25.700 INFO:teuthology.orchestra.run.smithi124.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T13:10:25.705 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/064 2023-10-16T13:10:25.705 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/064 2023-10-16T13:10:25.705 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:25.711 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:25.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:25.758 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-10-16T13:10:26.067 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:26.071 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:26.072 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:26.073 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:26.073 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:26.571 INFO:teuthology.orchestra.run.smithi124.stdout:generic/065 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T13:10:26.575 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/065 2023-10-16T13:10:26.576 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/065 2023-10-16T13:10:26.576 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:26.578 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:26.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:26.617 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-10-16T13:10:26.947 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:26.951 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:26.953 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:26.954 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:26.954 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:27.467 INFO:teuthology.orchestra.run.smithi124.stdout:generic/066 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T13:10:27.472 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/066 2023-10-16T13:10:27.472 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/066 2023-10-16T13:10:27.472 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:27.478 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:27.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:27.509 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-10-16T13:10:27.847 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:27.860 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:27.861 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:27.862 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:27.862 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:28.480 INFO:teuthology.orchestra.run.smithi124.stdout:generic/067 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T13:10:28.497 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/067 2023-10-16T13:10:28.498 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/067 2023-10-16T13:10:28.498 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:28.498 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:28.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:28.531 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-10-16T13:10:28.856 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:28.866 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:28.867 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:28.870 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:28.870 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:29.439 INFO:teuthology.orchestra.run.smithi124.stdout:generic/068 [not run] ceph does not support freezing 2023-10-16T13:10:29.444 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/068 2023-10-16T13:10:29.444 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/068 2023-10-16T13:10:29.444 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:29.446 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:29.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:29.476 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-10-16T13:10:29.789 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:29.801 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:29.802 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:29.803 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:29.803 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:36.981 INFO:teuthology.orchestra.run.smithi124.stdout:generic/069 6s 2023-10-16T13:10:36.988 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/069 2023-10-16T13:10:36.988 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:10:36.990 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:37.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:10:37.001 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-10-16T13:10:37.319 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:10:37.326 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:10:37.326 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:10:37.328 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:10:37.328 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:10:55.028 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:10:55.031 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:11:09.709 INFO:teuthology.orchestra.run.smithi124.stdout:generic/070 32s 2023-10-16T13:11:09.716 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/070 2023-10-16T13:11:09.717 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:11:09.719 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:11:09.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:11:09.958 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-10-16T13:11:10.330 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:11:10.334 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:11:10.334 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:11:10.339 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:11:10.340 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:11:10.826 INFO:teuthology.orchestra.run.smithi124.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-10-16T13:11:10.830 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/071 2023-10-16T13:11:10.830 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/071 2023-10-16T13:11:10.830 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:11:10.833 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:11:10.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:11:10.864 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-10-16T13:11:11.235 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:11:11.240 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:11:11.240 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:11:11.241 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:11:11.242 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:11:11.857 INFO:teuthology.orchestra.run.smithi124.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-10-16T13:11:11.862 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/072 2023-10-16T13:11:11.862 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/072 2023-10-16T13:11:11.862 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:11:11.865 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:11:11.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:11:11.909 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-10-16T13:11:12.228 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:11:12.236 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:11:12.237 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:11:12.238 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:11:12.238 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:11:12.692 INFO:teuthology.orchestra.run.smithi124.stdout:generic/073 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T13:11:12.697 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/073 2023-10-16T13:11:12.697 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/073 2023-10-16T13:11:12.697 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:11:12.700 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:11:12.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:11:12.723 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-10-16T13:11:13.069 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:11:13.074 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:11:13.074 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:11:13.079 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:11:13.080 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:11:25.295 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:11:25.299 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:11:25.413 INFO:tasks.ceph.mds.b.smithi192.stderr:2023-10-16T13:11:25.410+0000 7f536d166700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 114060) UID: 0 2023-10-16T13:11:25.413 INFO:tasks.ceph.mds.d.smithi192.stderr:2023-10-16T13:11:25.410+0000 7f41d2517700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 114060) UID: 0 2023-10-16T13:11:31.985 INFO:teuthology.orchestra.run.smithi124.stdout:generic/074 18s 2023-10-16T13:11:31.990 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/074 2023-10-16T13:11:31.990 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:11:31.992 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:11:32.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:11:32.522 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-10-16T13:11:32.833 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:11:32.838 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:11:32.838 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:11:32.839 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:11:32.839 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:08.904 INFO:teuthology.orchestra.run.smithi124.stdout:generic/075 35s 2023-10-16T13:12:08.909 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/075 2023-10-16T13:12:08.910 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:12:08.912 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:09.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:12:09.217 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-10-16T13:12:09.543 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:12:09.547 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:12:09.548 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:12:09.550 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:12:09.551 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:09.978 INFO:teuthology.orchestra.run.smithi124.stdout:generic/076 [not run] require 172.21.15.124:6789:/scratch to be local device 2023-10-16T13:12:09.983 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/076 2023-10-16T13:12:09.983 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/076 2023-10-16T13:12:09.983 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:12:09.985 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:10.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:12:10.019 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-10-16T13:12:10.332 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:12:10.339 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:12:10.340 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:12:10.341 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:12:10.341 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:13.218 INFO:teuthology.orchestra.run.smithi124.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-16T13:12:13.227 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/077 2023-10-16T13:12:13.228 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/077 2023-10-16T13:12:13.228 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:12:13.231 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:13.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:12:13.374 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-10-16T13:12:13.887 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:12:13.893 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:12:13.894 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:12:13.895 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:12:13.895 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:14.457 INFO:teuthology.orchestra.run.smithi124.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-10-16T13:12:14.462 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/078 2023-10-16T13:12:14.463 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/078 2023-10-16T13:12:14.463 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:12:14.464 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:14.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:12:14.666 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-10-16T13:12:15.088 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:12:15.098 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:12:15.099 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:12:15.099 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:12:15.100 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:15.586 INFO:teuthology.orchestra.run.smithi124.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-10-16T13:12:15.590 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/079 2023-10-16T13:12:15.591 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/079 2023-10-16T13:12:15.591 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:12:15.593 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:15.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:12:15.634 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-10-16T13:12:15.939 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:12:15.951 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:12:15.954 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:12:15.955 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:12:15.956 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:18.452 INFO:teuthology.orchestra.run.smithi124.stdout:generic/080 2s 2023-10-16T13:12:18.456 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/080 2023-10-16T13:12:18.457 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:12:18.458 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:18.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:12:18.515 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-10-16T13:12:18.836 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:12:18.840 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:12:18.841 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:12:18.842 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:12:18.842 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:19.345 INFO:teuthology.orchestra.run.smithi124.stdout:generic/081 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T13:12:19.350 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/081 2023-10-16T13:12:19.350 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/081 2023-10-16T13:12:19.350 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:12:19.352 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:19.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:12:19.379 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-10-16T13:12:19.698 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:12:19.704 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:12:19.704 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:12:19.705 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:12:19.705 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:20.160 INFO:teuthology.orchestra.run.smithi124.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-16T13:12:20.167 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/082 2023-10-16T13:12:20.168 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/082 2023-10-16T13:12:20.168 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:12:20.170 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:20.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:12:20.207 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-10-16T13:12:20.504 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:12:20.509 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:12:20.510 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:12:20.511 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:12:20.511 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:20.978 INFO:teuthology.orchestra.run.smithi124.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-16T13:12:20.983 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/083 2023-10-16T13:12:20.983 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/083 2023-10-16T13:12:20.983 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:12:20.985 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:21.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:12:21.017 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-10-16T13:12:21.353 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:12:21.365 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:12:21.366 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:12:21.367 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:12:21.367 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:27.446 INFO:teuthology.orchestra.run.smithi124.stdout:generic/084 6s 2023-10-16T13:12:27.455 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/084 2023-10-16T13:12:27.455 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:12:27.457 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:27.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:12:27.473 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-10-16T13:12:27.770 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:12:27.774 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:12:27.778 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:12:27.778 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:12:27.778 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:28.232 INFO:teuthology.orchestra.run.smithi124.stdout:generic/085 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T13:12:28.238 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/085 2023-10-16T13:12:28.238 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/085 2023-10-16T13:12:28.238 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:12:28.240 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:28.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:12:28.267 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-10-16T13:12:28.613 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:12:28.620 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:12:28.621 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:12:28.621 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:12:28.622 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:29.098 INFO:teuthology.orchestra.run.smithi124.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T13:12:29.102 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/086 2023-10-16T13:12:29.103 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/086 2023-10-16T13:12:29.103 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:12:29.105 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:29.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:12:29.143 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-10-16T13:12:29.491 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:12:29.496 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:12:29.496 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:12:29.497 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:12:29.497 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:30.076 INFO:teuthology.orchestra.run.smithi124.stdout:generic/087 1s 2023-10-16T13:12:30.083 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/087 2023-10-16T13:12:30.083 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:12:30.086 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:30.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:12:30.437 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-10-16T13:12:30.763 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:12:30.768 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:12:30.768 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:12:30.769 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:12:30.769 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:31.253 INFO:teuthology.orchestra.run.smithi124.stdout:generic/088 0s 2023-10-16T13:12:31.268 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/088 2023-10-16T13:12:31.268 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:12:31.270 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:12:31.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:12:31.616 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-10-16T13:12:31.894 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:12:31.898 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:12:31.899 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:12:31.901 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:12:31.901 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:14:46.812 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:14:46.816 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:15:17.059 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:15:17.062 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:15:47.123 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:15:47.126 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:16:17.181 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:16:17.183 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:16:47.246 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:16:47.248 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:16:47.284 INFO:tasks.ceph.mds.d.smithi192.stderr:2023-10-16T13:16:47.281+0000 7f41d2517700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 114335) UID: 0 2023-10-16T13:16:47.284 INFO:tasks.ceph.mds.b.smithi192.stderr:2023-10-16T13:16:47.281+0000 7f536d166700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 114335) UID: 0 2023-10-16T13:19:40.008 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:19:40.012 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:20:10.121 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:20:10.175 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:20:41.014 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:20:41.018 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:20:41.057 INFO:tasks.ceph.mds.d.smithi192.stderr:2023-10-16T13:20:41.054+0000 7f41d2517700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 114443) UID: 0 2023-10-16T13:20:41.057 INFO:tasks.ceph.mds.b.smithi192.stderr:2023-10-16T13:20:41.054+0000 7f536d166700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 114443) UID: 0 2023-10-16T13:21:12.103 INFO:teuthology.orchestra.run.smithi124.stdout:generic/089 520s 2023-10-16T13:21:12.107 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/089 2023-10-16T13:21:12.107 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:21:12.109 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:21:14.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:21:14.657 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-10-16T13:21:14.909 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:21:14.913 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:21:14.914 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:21:14.914 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:21:14.915 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:21:15.896 INFO:teuthology.orchestra.run.smithi124.stdout:generic/090 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T13:21:15.902 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/090 2023-10-16T13:21:15.902 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/090 2023-10-16T13:21:15.902 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:21:15.905 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:21:15.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:21:15.999 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-10-16T13:21:16.367 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:21:16.370 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:21:16.371 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:21:16.372 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:21:16.372 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:00.337 INFO:teuthology.orchestra.run.smithi124.stdout:generic/091 104s 2023-10-16T13:23:00.342 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/091 2023-10-16T13:23:00.342 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:23:00.344 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:00.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:23:00.673 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-10-16T13:23:00.934 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:23:00.938 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:23:00.939 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:23:00.940 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:23:00.940 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:01.247 INFO:teuthology.orchestra.run.smithi124.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T13:23:01.251 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/092 2023-10-16T13:23:01.252 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/092 2023-10-16T13:23:01.252 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:23:01.253 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:01.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:23:01.282 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-10-16T13:23:01.483 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:23:01.487 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:23:01.487 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:23:01.488 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:23:01.488 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:01.976 INFO:teuthology.orchestra.run.smithi124.stdout:generic/093 0s 2023-10-16T13:23:01.981 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/093 2023-10-16T13:23:01.981 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:23:01.983 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:02.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:23:02.217 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-10-16T13:23:02.558 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:23:02.562 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:23:02.562 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:23:02.563 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:23:02.563 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:02.939 INFO:teuthology.orchestra.run.smithi124.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T13:23:02.943 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/094 2023-10-16T13:23:02.943 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/094 2023-10-16T13:23:02.944 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:23:02.945 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:03.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:23:03.246 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-10-16T13:23:03.510 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:23:03.514 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:23:03.514 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:23:03.515 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:23:03.516 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:16.613 INFO:teuthology.orchestra.run.smithi124.stdout:generic/095 13s 2023-10-16T13:23:16.618 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/095 2023-10-16T13:23:16.619 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:23:16.621 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:16.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:23:16.631 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-10-16T13:23:16.834 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:23:16.838 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:23:16.838 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:23:16.839 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:23:16.839 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:17.246 INFO:teuthology.orchestra.run.smithi124.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-16T13:23:17.250 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/096 2023-10-16T13:23:17.250 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/096 2023-10-16T13:23:17.251 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:23:17.252 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:17.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:23:17.276 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-10-16T13:23:17.477 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:23:17.481 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:23:17.482 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:23:17.483 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:23:17.483 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:18.314 INFO:teuthology.orchestra.run.smithi124.stdout:generic/097 1s 2023-10-16T13:23:18.319 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/097 2023-10-16T13:23:18.319 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:23:18.321 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:18.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:23:18.348 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-10-16T13:23:18.562 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:23:18.566 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:23:18.567 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:23:18.567 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:23:18.568 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:20.724 INFO:teuthology.orchestra.run.smithi124.stdout:generic/098 2s 2023-10-16T13:23:20.728 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/098 2023-10-16T13:23:20.729 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:23:20.730 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:20.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:23:20.739 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-10-16T13:23:20.948 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:23:20.952 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:23:20.952 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:23:20.953 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:23:20.953 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:21.847 INFO:teuthology.orchestra.run.smithi124.stdout:generic/099 0s 2023-10-16T13:23:21.852 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/099 2023-10-16T13:23:21.852 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:23:21.854 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:22.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:23:22.180 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-10-16T13:23:22.420 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:23:22.424 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:23:22.424 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:23:22.425 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:23:22.425 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:25.383 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:23:25.386 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:23:34.145 INFO:teuthology.orchestra.run.smithi124.stdout:generic/100 12s 2023-10-16T13:23:34.150 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/100 2023-10-16T13:23:34.150 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:23:34.152 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:38.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:23:38.241 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-10-16T13:23:38.586 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:23:38.590 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:23:38.590 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:23:38.591 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:23:38.591 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:38.926 INFO:teuthology.orchestra.run.smithi124.stdout:generic/101 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T13:23:38.930 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/101 2023-10-16T13:23:38.930 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/101 2023-10-16T13:23:38.931 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:23:38.932 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:38.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:23:38.957 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-10-16T13:23:39.157 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:23:39.160 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:23:39.161 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:23:39.162 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:23:39.162 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:39.490 INFO:teuthology.orchestra.run.smithi124.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-16T13:23:39.493 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/102 2023-10-16T13:23:39.494 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/102 2023-10-16T13:23:39.494 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:23:39.495 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:39.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:23:39.520 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-10-16T13:23:39.718 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:23:39.722 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:23:39.723 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:23:39.724 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:23:39.724 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:40.063 INFO:teuthology.orchestra.run.smithi124.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T13:23:40.067 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/103 2023-10-16T13:23:40.067 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/103 2023-10-16T13:23:40.068 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:23:40.069 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:40.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:23:40.314 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-10-16T13:23:40.658 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:23:40.662 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:23:40.662 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:23:40.663 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:23:40.663 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:40.979 INFO:teuthology.orchestra.run.smithi124.stdout:generic/104 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T13:23:40.983 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/104 2023-10-16T13:23:40.983 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/104 2023-10-16T13:23:40.983 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:23:40.985 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:41.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:23:41.012 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-10-16T13:23:41.228 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:23:41.232 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:23:41.233 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:23:41.234 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:23:41.234 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:42.177 INFO:teuthology.orchestra.run.smithi124.stdout:generic/105 1s 2023-10-16T13:23:42.192 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/105 2023-10-16T13:23:42.192 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:23:42.195 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:42.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:23:42.204 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-10-16T13:23:42.412 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:23:42.416 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:23:42.416 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:23:42.417 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:23:42.417 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:42.791 INFO:teuthology.orchestra.run.smithi124.stdout:generic/106 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T13:23:42.795 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/106 2023-10-16T13:23:42.795 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/106 2023-10-16T13:23:42.795 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:23:42.797 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:42.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:23:42.823 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-10-16T13:23:43.041 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:23:43.046 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:23:43.046 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:23:43.047 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:23:43.047 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:43.397 INFO:teuthology.orchestra.run.smithi124.stdout:generic/107 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T13:23:43.401 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/107 2023-10-16T13:23:43.401 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/107 2023-10-16T13:23:43.401 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:23:43.403 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:43.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:23:43.428 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-10-16T13:23:43.645 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:23:43.649 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:23:43.649 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:23:43.650 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:23:43.650 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:44.067 INFO:teuthology.orchestra.run.smithi124.stdout:generic/108 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T13:23:44.071 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/108 2023-10-16T13:23:44.071 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/108 2023-10-16T13:23:44.071 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:23:44.073 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:44.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:23:44.098 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-10-16T13:23:44.306 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:23:44.310 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:23:44.311 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:23:44.312 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:23:44.312 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:55.232 INFO:teuthology.orchestra.run.smithi124.stdout:generic/109 11s 2023-10-16T13:23:55.238 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/109 2023-10-16T13:23:55.238 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:23:55.240 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:23:55.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:23:55.266 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-10-16T13:23:55.521 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:23:55.524 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:23:56.221 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:23:56.225 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:23:56.226 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:23:56.227 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:23:56.227 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:24:18.351 INFO:teuthology.orchestra.run.smithi124.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T13:24:18.354 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/110 2023-10-16T13:24:18.355 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/110 2023-10-16T13:24:18.355 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:24:18.356 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:24:18.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:24:18.492 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-10-16T13:24:19.070 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:24:19.074 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:24:19.075 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:24:19.075 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:24:19.076 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:24:19.420 INFO:teuthology.orchestra.run.smithi124.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T13:24:19.423 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/111 2023-10-16T13:24:19.424 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/111 2023-10-16T13:24:19.424 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:24:19.426 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:24:19.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:24:19.750 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-10-16T13:24:20.057 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:24:20.061 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:24:20.061 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:24:20.062 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:24:20.062 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:24:25.572 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:24:25.575 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:24:36.328 INFO:teuthology.orchestra.run.smithi124.stdout:generic/112 16s 2023-10-16T13:24:36.333 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/112 2023-10-16T13:24:36.333 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:24:36.335 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:24:36.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:24:36.686 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-10-16T13:24:36.910 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:24:36.914 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:24:36.914 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:24:36.915 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:24:36.915 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:24:53.984 INFO:teuthology.orchestra.run.smithi124.stdout:generic/113 16s 2023-10-16T13:24:53.988 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/113 2023-10-16T13:24:53.988 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:24:53.990 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:24:54.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:24:54.284 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-10-16T13:24:54.703 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:24:54.707 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:24:54.708 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:24:54.709 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:24:54.709 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:24:55.090 INFO:teuthology.orchestra.run.smithi124.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-10-16T13:24:55.094 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/114 2023-10-16T13:24:55.094 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/114 2023-10-16T13:24:55.094 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:24:55.096 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:24:55.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:24:55.130 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-10-16T13:24:55.330 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:24:55.335 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:24:55.335 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:24:55.336 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:24:55.336 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:24:55.695 INFO:teuthology.orchestra.run.smithi124.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T13:24:55.699 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/115 2023-10-16T13:24:55.699 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/115 2023-10-16T13:24:55.699 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:24:55.701 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:24:55.880 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:24:55.917 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:24:55.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:24:55.946 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-10-16T13:24:56.287 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:24:56.291 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:24:56.292 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:24:56.292 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:24:56.293 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:24:56.652 INFO:teuthology.orchestra.run.smithi124.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T13:24:56.656 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/116 2023-10-16T13:24:56.656 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/116 2023-10-16T13:24:56.656 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:24:56.658 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:24:56.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:24:56.986 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-10-16T13:24:57.214 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:24:57.218 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:24:57.219 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:24:57.219 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:24:57.219 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:25:09.785 INFO:teuthology.orchestra.run.smithi124.stdout:generic/117 12s 2023-10-16T13:25:09.790 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/117 2023-10-16T13:25:09.790 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:25:09.792 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:25:09.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:25:09.802 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-10-16T13:25:10.034 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:25:10.038 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:25:10.039 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:25:10.040 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:25:10.040 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:25:10.829 INFO:teuthology.orchestra.run.smithi124.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T13:25:10.833 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/118 2023-10-16T13:25:10.834 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/118 2023-10-16T13:25:10.834 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:25:10.835 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:25:11.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:25:11.147 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-10-16T13:25:11.394 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:25:11.399 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:25:11.399 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:25:11.400 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:25:11.400 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:25:11.741 INFO:teuthology.orchestra.run.smithi124.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T13:25:11.745 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/119 2023-10-16T13:25:11.745 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/119 2023-10-16T13:25:11.745 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:25:11.747 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:25:12.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:25:12.025 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-10-16T13:25:12.295 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:25:12.298 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:25:12.299 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:25:12.300 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:25:12.300 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:25:12.635 INFO:teuthology.orchestra.run.smithi124.stdout:generic/120 [not run] atime not maintained by ceph 2023-10-16T13:25:12.639 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/120 2023-10-16T13:25:12.639 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/120 2023-10-16T13:25:12.639 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:25:12.641 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:25:12.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:25:12.670 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-10-16T13:25:12.900 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:25:12.904 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:25:12.904 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:25:12.905 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:25:12.906 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:25:13.258 INFO:teuthology.orchestra.run.smithi124.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-10-16T13:25:13.262 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/121 2023-10-16T13:25:13.262 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/121 2023-10-16T13:25:13.262 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:25:13.264 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:25:13.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:25:13.611 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-10-16T13:25:13.837 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:25:13.840 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:25:13.841 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:25:13.842 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:25:13.842 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:25:14.204 INFO:teuthology.orchestra.run.smithi124.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-10-16T13:25:14.207 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/122 2023-10-16T13:25:14.208 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/122 2023-10-16T13:25:14.208 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:25:14.210 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:25:14.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:25:14.555 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-10-16T13:25:14.779 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:25:14.783 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:25:14.783 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:25:14.784 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:25:14.785 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:25:15.306 INFO:teuthology.orchestra.run.smithi124.stdout:generic/123 1s 2023-10-16T13:25:15.310 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/123 2023-10-16T13:25:15.310 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:25:15.312 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:25:15.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:25:15.640 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-10-16T13:25:15.897 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:25:15.901 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:25:15.901 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:25:15.902 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:25:15.902 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:25:18.386 INFO:teuthology.orchestra.run.smithi124.stdout:generic/124 2s 2023-10-16T13:25:18.402 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/124 2023-10-16T13:25:18.402 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:25:18.404 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:25:18.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:25:18.731 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-10-16T13:25:19.254 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:25:19.258 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:25:19.258 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:25:19.259 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:25:19.259 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:25:26.402 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:25:26.406 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:25:56.501 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:25:56.504 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:26:20.773 INFO:teuthology.orchestra.run.smithi124.stdout:generic/125 61s 2023-10-16T13:26:20.779 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/125 2023-10-16T13:26:20.779 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:26:20.782 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:26:21.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:26:21.067 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-10-16T13:26:21.340 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:26:21.344 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:26:21.344 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:26:21.345 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:26:21.345 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:26:21.855 INFO:teuthology.orchestra.run.smithi124.stdout:generic/126 0s 2023-10-16T13:26:21.860 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/126 2023-10-16T13:26:21.860 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:26:21.862 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:26:22.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:26:22.236 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-10-16T13:26:22.458 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:26:22.463 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:26:22.463 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:26:22.464 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:26:22.464 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:26:26.598 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:26:26.601 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:26:56.655 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:26:56.658 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:27:26.744 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:27:26.748 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:27:57.085 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:27:57.088 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:28:27.148 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:28:27.151 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:28:57.229 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:28:57.244 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:29:27.344 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:29:27.347 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:29:57.991 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:29:57.994 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:30:28.047 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:30:28.051 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:30:58.119 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:30:58.123 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:31:28.184 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:31:28.187 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:31:58.389 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:31:58.392 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:32:28.462 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:32:28.465 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:32:58.519 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:32:58.522 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:33:28.575 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:33:28.578 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:33:58.680 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:33:58.683 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:34:28.913 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:34:28.916 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:34:58.985 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:34:58.989 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:35:29.138 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:35:29.141 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:35:59.229 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:35:59.232 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:36:29.745 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:36:29.748 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:36:33.912 INFO:teuthology.orchestra.run.smithi124.stdout:generic/127 611s 2023-10-16T13:36:33.920 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/127 2023-10-16T13:36:33.920 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:36:33.922 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:36:34.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:36:34.087 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-10-16T13:36:34.548 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:36:34.552 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:36:34.552 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:36:34.553 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:36:34.554 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:36:35.781 INFO:teuthology.orchestra.run.smithi124.stdout:generic/128 1s 2023-10-16T13:36:35.786 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/128 2023-10-16T13:36:35.786 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:36:35.788 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:36:35.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:36:35.797 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-10-16T13:36:36.004 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:36:36.008 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:36:36.008 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:36:36.009 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:36:36.009 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:36:59.818 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:36:59.826 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:36:59.902 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T13:36:59.897+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116572) UID: 0 2023-10-16T13:36:59.902 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T13:36:59.897+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116572) UID: 0 2023-10-16T13:36:59.903 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T13:36:59.898+0000 7f95afc78700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116572) UID: 0 2023-10-16T13:36:59.903 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T13:36:59.897+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116572) UID: 0 2023-10-16T13:40:54.817 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:40:54.820 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:41:25.895 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:41:25.913 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:41:56.025 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:41:56.035 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:42:26.163 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:42:26.195 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:42:56.273 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:42:56.280 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:42:56.401 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T13:42:56.397+0000 7f4322fa5700 -1 Fail to open '/proc/116748/cmdline' error = (2) No such file or directory 2023-10-16T13:42:56.401 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T13:42:56.397+0000 7f4322fa5700 -1 received signal: Hangup from (PID: 116748) UID: 0 2023-10-16T13:42:56.402 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T13:42:56.398+0000 7ff25cecf700 -1 Fail to open '/proc/116748/cmdline' error = (2) No such file or directory 2023-10-16T13:42:56.402 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T13:42:56.398+0000 7ff25cecf700 -1 received signal: Hangup from (PID: 116748) UID: 0 2023-10-16T13:42:56.403 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T13:42:56.393+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116748) UID: 0 2023-10-16T13:42:56.406 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T13:42:56.398+0000 7f95afc78700 -1 Fail to open '/proc/116748/cmdline' error = (2) No such file or directory 2023-10-16T13:42:56.407 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T13:42:56.398+0000 7f95afc78700 -1 received signal: Hangup from (PID: 116748) UID: 0 2023-10-16T13:47:29.413 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:47:29.421 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:47:29.570 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T13:47:29.567+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116809) UID: 0 2023-10-16T13:47:29.571 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T13:47:29.568+0000 7f5b62088700 -1 received signal: Hangup from (PID: 116809) UID: 0 2023-10-16T13:47:29.572 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T13:47:29.568+0000 7f95afc78700 -1 received signal: Hangup from (PID: 116809) UID: 0 2023-10-16T13:47:29.576 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T13:47:29.568+0000 7ff25cecf700 -1 received signal: Hangup from (PID: 116809) UID: 0 2023-10-16T13:47:29.606 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T13:47:29.602+0000 7f18f4d1b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 263463) UID: 0 2023-10-16T13:47:29.606 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T13:47:29.602+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 263463) UID: 0 2023-10-16T13:47:29.606 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T13:47:29.602+0000 7f3e3026f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 263463) UID: 0 2023-10-16T13:47:29.607 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T13:47:29.602+0000 7f9480ec4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 263463) UID: 0 2023-10-16T13:56:42.430 INFO:teuthology.orchestra.run.smithi124.stdout:generic/129 1206s 2023-10-16T13:56:42.833 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/129 2023-10-16T13:56:42.833 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:56:42.835 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:56:42.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:56:42.877 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-10-16T13:56:43.308 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:56:43.312 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:56:43.312 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:56:43.313 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:56:43.313 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:56:58.192 INFO:teuthology.orchestra.run.smithi124.stdout:generic/130 15s 2023-10-16T13:56:58.234 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/130 2023-10-16T13:56:58.234 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:56:58.238 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:56:58.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:56:58.248 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-10-16T13:56:58.529 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:56:58.533 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:56:58.534 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:56:58.534 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:56:58.535 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:57:00.327 INFO:teuthology.orchestra.run.smithi124.stdout:generic/131 2s 2023-10-16T13:57:00.435 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/131 2023-10-16T13:57:00.436 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:57:00.436 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:57:00.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:57:00.873 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-10-16T13:57:01.277 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:57:01.281 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:57:01.282 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:57:01.283 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:57:01.283 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:57:15.417 INFO:teuthology.orchestra.run.smithi124.stdout:generic/132 14s 2023-10-16T13:57:15.483 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/132 2023-10-16T13:57:15.483 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T13:57:15.485 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:57:15.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T13:57:15.494 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-10-16T13:57:15.717 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T13:57:15.721 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T13:57:15.722 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T13:57:15.723 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T13:57:15.723 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T13:59:10.092 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:59:10.095 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T13:59:10.149 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T13:59:10.145+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 266554) UID: 0 2023-10-16T13:59:10.150 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T13:59:10.145+0000 7f18f4d1b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 266554) UID: 0 2023-10-16T13:59:10.150 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T13:59:10.145+0000 7f9480ec4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 266554) UID: 0 2023-10-16T13:59:10.151 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T13:59:10.145+0000 7f3e3026f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 266554) UID: 0 2023-10-16T13:59:10.222 INFO:tasks.ceph.mds.b.smithi192.stderr:2023-10-16T13:59:10.219+0000 7f536d166700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 117564) UID: 0 2023-10-16T13:59:10.222 INFO:tasks.ceph.mds.d.smithi192.stderr:2023-10-16T13:59:10.219+0000 7f41d2517700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 117564) UID: 0 2023-10-16T14:01:17.329 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T14:01:17.325+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117596) UID: 0 2023-10-16T14:01:17.329 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T14:01:17.325+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117596) UID: 0 2023-10-16T14:01:17.330 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T14:01:17.325+0000 7f95afc78700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117596) UID: 0 2023-10-16T14:01:17.330 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T14:01:17.325+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117596) UID: 0 2023-10-16T14:01:56.890 INFO:teuthology.orchestra.run.smithi124.stdout:generic/133 281s 2023-10-16T14:01:56.894 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/133 2023-10-16T14:01:56.895 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:01:56.897 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:01:57.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:01:57.189 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-10-16T14:01:57.589 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:01:57.606 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:01:57.606 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:01:57.607 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:01:57.608 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:01:58.075 INFO:teuthology.orchestra.run.smithi124.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:01:58.079 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/134 2023-10-16T14:01:58.079 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/134 2023-10-16T14:01:58.079 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:01:58.081 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:01:58.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:01:58.446 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-10-16T14:01:58.657 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:01:58.661 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:01:58.661 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:01:58.662 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:01:58.663 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:01:59.793 INFO:teuthology.orchestra.run.smithi124.stdout:generic/135 1s 2023-10-16T14:01:59.798 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/135 2023-10-16T14:01:59.798 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:01:59.800 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:01:59.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:01:59.809 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-10-16T14:02:00.042 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:00.046 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:00.046 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:00.047 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:00.047 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:00.413 INFO:teuthology.orchestra.run.smithi124.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-10-16T14:02:00.417 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/136 2023-10-16T14:02:00.417 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/136 2023-10-16T14:02:00.418 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:00.419 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:00.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:00.726 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-10-16T14:02:01.008 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:01.012 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:01.013 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:01.014 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:01.014 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:01.391 INFO:teuthology.orchestra.run.smithi124.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:02:01.395 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/137 2023-10-16T14:02:01.395 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/137 2023-10-16T14:02:01.395 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:01.397 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:01.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:01.726 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-10-16T14:02:02.006 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:02.010 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:02.011 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:02.012 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:02.012 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:02.383 INFO:teuthology.orchestra.run.smithi124.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:02:02.387 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/138 2023-10-16T14:02:02.387 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/138 2023-10-16T14:02:02.388 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:02.389 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:02.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:02.737 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-10-16T14:02:02.973 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:02.977 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:02.977 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:02.978 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:02.978 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:03.352 INFO:teuthology.orchestra.run.smithi124.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:02:03.357 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/139 2023-10-16T14:02:03.357 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/139 2023-10-16T14:02:03.357 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:03.358 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:03.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:03.683 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-10-16T14:02:03.931 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:03.935 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:03.936 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:03.937 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:03.937 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:04.286 INFO:teuthology.orchestra.run.smithi124.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:02:04.290 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/140 2023-10-16T14:02:04.290 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/140 2023-10-16T14:02:04.290 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:04.292 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:04.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:04.385 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-10-16T14:02:04.888 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:04.892 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:04.893 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:04.894 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:04.894 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:05.478 INFO:teuthology.orchestra.run.smithi124.stdout:generic/141 0s 2023-10-16T14:02:05.483 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/141 2023-10-16T14:02:05.484 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:05.485 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:05.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:05.494 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-10-16T14:02:05.711 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:05.715 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:05.715 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:05.716 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:05.716 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:06.083 INFO:teuthology.orchestra.run.smithi124.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:02:06.087 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/142 2023-10-16T14:02:06.087 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/142 2023-10-16T14:02:06.087 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:06.089 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:06.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:06.405 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-10-16T14:02:06.676 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:06.680 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:06.680 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:06.681 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:06.682 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:07.050 INFO:teuthology.orchestra.run.smithi124.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:02:07.054 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/143 2023-10-16T14:02:07.054 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/143 2023-10-16T14:02:07.054 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:07.056 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:07.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:07.133 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-10-16T14:02:07.653 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:07.657 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:07.658 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:07.658 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:07.659 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:08.031 INFO:teuthology.orchestra.run.smithi124.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:02:08.035 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/144 2023-10-16T14:02:08.035 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/144 2023-10-16T14:02:08.035 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:08.037 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:08.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:08.352 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-10-16T14:02:08.625 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:08.629 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:08.629 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:08.630 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:08.630 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:08.992 INFO:teuthology.orchestra.run.smithi124.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:02:08.996 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/145 2023-10-16T14:02:08.997 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/145 2023-10-16T14:02:08.997 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:08.999 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:09.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:09.357 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-10-16T14:02:09.583 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:09.587 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:09.588 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:09.589 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:09.589 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:09.961 INFO:teuthology.orchestra.run.smithi124.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:02:09.966 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/146 2023-10-16T14:02:09.966 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/146 2023-10-16T14:02:09.967 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:09.967 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:10.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:10.320 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-10-16T14:02:10.568 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:10.572 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:10.573 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:10.573 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:10.573 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:10.931 INFO:teuthology.orchestra.run.smithi124.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:02:10.935 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/147 2023-10-16T14:02:10.935 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/147 2023-10-16T14:02:10.935 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:10.937 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:11.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:11.221 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-10-16T14:02:11.507 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:11.511 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:11.511 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:11.512 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:11.512 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:11.868 INFO:teuthology.orchestra.run.smithi124.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:02:11.872 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/148 2023-10-16T14:02:11.872 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/148 2023-10-16T14:02:11.872 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:11.874 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:12.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:12.140 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-10-16T14:02:12.452 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:12.456 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:12.457 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:12.457 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:12.458 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:12.813 INFO:teuthology.orchestra.run.smithi124.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:02:12.817 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/149 2023-10-16T14:02:12.817 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/149 2023-10-16T14:02:12.817 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:12.819 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:13.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:13.177 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-10-16T14:02:13.416 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:13.420 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:13.420 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:13.421 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:13.421 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:13.787 INFO:teuthology.orchestra.run.smithi124.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:02:13.791 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/150 2023-10-16T14:02:13.791 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/150 2023-10-16T14:02:13.791 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:13.793 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:14.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:14.119 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-10-16T14:02:14.367 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:14.371 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:14.372 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:14.373 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:14.373 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:14.753 INFO:teuthology.orchestra.run.smithi124.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:02:14.757 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/151 2023-10-16T14:02:14.757 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/151 2023-10-16T14:02:14.757 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:14.759 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:15.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:15.122 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-10-16T14:02:15.369 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:15.372 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:15.373 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:15.374 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:15.374 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:15.736 INFO:teuthology.orchestra.run.smithi124.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:02:15.740 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/152 2023-10-16T14:02:15.740 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/152 2023-10-16T14:02:15.740 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:15.742 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:16.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:16.050 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-10-16T14:02:16.389 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:16.393 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:16.393 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:16.394 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:16.395 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:16.769 INFO:teuthology.orchestra.run.smithi124.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:02:16.773 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/153 2023-10-16T14:02:16.773 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/153 2023-10-16T14:02:16.773 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:16.775 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:17.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:17.137 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-10-16T14:02:17.366 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:17.370 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:17.371 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:17.372 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:17.372 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:17.747 INFO:teuthology.orchestra.run.smithi124.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:02:17.751 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/154 2023-10-16T14:02:17.752 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/154 2023-10-16T14:02:17.752 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:17.753 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:18.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:18.089 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-10-16T14:02:18.333 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:18.337 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:18.338 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:18.339 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:18.339 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:18.702 INFO:teuthology.orchestra.run.smithi124.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:02:18.706 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/155 2023-10-16T14:02:18.707 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/155 2023-10-16T14:02:18.707 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:18.709 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:19.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:19.045 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-10-16T14:02:19.306 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:19.310 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:19.311 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:19.312 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:19.312 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:19.686 INFO:teuthology.orchestra.run.smithi124.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:02:19.690 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/156 2023-10-16T14:02:19.690 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/156 2023-10-16T14:02:19.691 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:19.692 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:19.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:19.977 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-10-16T14:02:20.273 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:20.277 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:20.278 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:20.278 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:20.279 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:20.642 INFO:teuthology.orchestra.run.smithi124.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:02:20.646 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/157 2023-10-16T14:02:20.646 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/157 2023-10-16T14:02:20.646 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:20.648 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:21.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:21.010 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-10-16T14:02:21.270 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:21.274 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:21.275 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:21.275 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:21.276 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:21.647 INFO:teuthology.orchestra.run.smithi124.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-10-16T14:02:21.653 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/158 2023-10-16T14:02:21.654 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/158 2023-10-16T14:02:21.654 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:21.654 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:21.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:21.996 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-10-16T14:02:22.258 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:22.262 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:22.263 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:22.264 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:22.264 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:22.659 INFO:teuthology.orchestra.run.smithi124.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-10-16T14:02:22.663 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/159 2023-10-16T14:02:22.664 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/159 2023-10-16T14:02:22.664 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:22.665 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:22.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:22.703 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-10-16T14:02:22.921 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:22.925 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:22.925 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:22.926 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:22.926 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:23.283 INFO:teuthology.orchestra.run.smithi124.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-10-16T14:02:23.287 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/160 2023-10-16T14:02:23.287 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/160 2023-10-16T14:02:23.288 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:23.289 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:23.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:23.328 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-10-16T14:02:23.544 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:23.549 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:23.549 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:23.550 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:23.550 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:24.431 INFO:teuthology.orchestra.run.smithi124.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:02:24.446 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/161 2023-10-16T14:02:24.447 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/161 2023-10-16T14:02:24.447 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:24.452 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:24.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:24.572 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-10-16T14:02:24.791 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:24.795 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:24.796 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:24.797 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:24.797 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:25.328 INFO:teuthology.orchestra.run.smithi124.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-10-16T14:02:25.586 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/162 2023-10-16T14:02:25.586 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/162 2023-10-16T14:02:25.586 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:25.679 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:25.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:25.756 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-10-16T14:02:25.962 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:25.966 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:25.966 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:25.967 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:25.967 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:26.496 INFO:teuthology.orchestra.run.smithi124.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-10-16T14:02:26.783 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/163 2023-10-16T14:02:26.784 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/163 2023-10-16T14:02:26.784 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:26.803 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:26.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:26.961 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-10-16T14:02:27.164 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:27.168 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:27.169 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:27.169 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:27.170 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:27.969 INFO:teuthology.orchestra.run.smithi124.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:02:27.975 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/164 2023-10-16T14:02:27.975 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/164 2023-10-16T14:02:27.975 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:27.994 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:28.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:28.187 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-10-16T14:02:28.395 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:28.399 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:28.400 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:28.401 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:28.401 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:29.193 INFO:teuthology.orchestra.run.smithi124.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:02:29.246 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/165 2023-10-16T14:02:29.246 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/165 2023-10-16T14:02:29.246 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:29.248 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:29.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:29.415 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-10-16T14:02:29.635 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:29.639 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:29.639 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:29.640 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:29.640 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:30.334 INFO:teuthology.orchestra.run.smithi124.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:02:30.347 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/166 2023-10-16T14:02:30.348 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/166 2023-10-16T14:02:30.348 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:30.352 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:30.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:30.611 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-10-16T14:02:30.804 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:30.808 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:30.809 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:30.810 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:30.810 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:31.436 INFO:teuthology.orchestra.run.smithi124.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:02:31.442 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/167 2023-10-16T14:02:31.442 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/167 2023-10-16T14:02:31.442 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:31.445 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:31.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:31.753 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-10-16T14:02:31.952 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:31.956 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:31.956 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:31.957 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:31.957 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:32.645 INFO:teuthology.orchestra.run.smithi124.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:02:32.651 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/168 2023-10-16T14:02:32.652 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/168 2023-10-16T14:02:32.652 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:32.654 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:32.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:32.974 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-10-16T14:02:33.190 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:33.194 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:33.195 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:33.196 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:33.196 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:33.940 INFO:teuthology.orchestra.run.smithi124.stdout:generic/169 0s 2023-10-16T14:02:33.945 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/169 2023-10-16T14:02:33.945 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:33.947 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:33.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:33.955 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-10-16T14:02:34.159 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:34.163 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:34.164 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:34.164 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:34.165 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:35.001 INFO:teuthology.orchestra.run.smithi124.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:02:35.028 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/170 2023-10-16T14:02:35.029 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/170 2023-10-16T14:02:35.029 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:35.034 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:35.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:35.147 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-10-16T14:02:35.349 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:35.353 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:35.353 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:35.354 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:35.355 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:36.163 INFO:teuthology.orchestra.run.smithi124.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:02:36.172 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/171 2023-10-16T14:02:36.172 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/171 2023-10-16T14:02:36.173 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:36.180 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:36.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:36.279 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-10-16T14:02:36.516 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:36.520 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:36.521 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:36.522 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:36.522 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:37.287 INFO:teuthology.orchestra.run.smithi124.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:02:37.303 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/172 2023-10-16T14:02:37.303 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/172 2023-10-16T14:02:37.303 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:37.387 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:37.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:37.488 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-10-16T14:02:37.717 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:37.721 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:37.721 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:37.722 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:37.722 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:38.574 INFO:teuthology.orchestra.run.smithi124.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:02:38.595 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/173 2023-10-16T14:02:38.595 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/173 2023-10-16T14:02:38.595 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:38.597 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:38.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:38.706 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-10-16T14:02:38.916 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:38.920 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:38.920 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:38.921 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:38.921 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:39.518 INFO:teuthology.orchestra.run.smithi124.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:02:39.524 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/174 2023-10-16T14:02:39.524 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/174 2023-10-16T14:02:39.524 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:39.527 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:39.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:39.860 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-10-16T14:02:40.059 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:40.063 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:40.063 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:40.064 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:40.064 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:40.786 INFO:teuthology.orchestra.run.smithi124.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:02:40.847 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/175 2023-10-16T14:02:40.847 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/175 2023-10-16T14:02:40.847 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:40.861 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:41.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:41.054 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-10-16T14:02:41.268 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:41.272 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:41.273 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:41.274 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:41.274 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:42.063 INFO:teuthology.orchestra.run.smithi124.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:02:42.121 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/176 2023-10-16T14:02:42.121 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/176 2023-10-16T14:02:42.121 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:42.125 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:42.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:42.255 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-10-16T14:02:42.476 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:42.480 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:42.480 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:42.481 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:42.482 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:42.985 INFO:teuthology.orchestra.run.smithi124.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T14:02:42.989 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/177 2023-10-16T14:02:42.990 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/177 2023-10-16T14:02:42.990 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:42.991 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:43.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:43.361 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-10-16T14:02:43.590 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:43.594 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:43.594 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:43.595 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:43.595 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:43.941 INFO:teuthology.orchestra.run.smithi124.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:02:43.945 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/178 2023-10-16T14:02:43.946 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/178 2023-10-16T14:02:43.946 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:43.947 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:44.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:44.174 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-10-16T14:02:44.547 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:44.551 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:44.551 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:44.552 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:44.552 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:44.903 INFO:teuthology.orchestra.run.smithi124.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:02:44.907 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/179 2023-10-16T14:02:44.908 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/179 2023-10-16T14:02:44.908 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:44.910 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:45.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:45.098 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-10-16T14:02:45.489 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:45.493 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:45.494 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:45.495 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:45.495 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:45.831 INFO:teuthology.orchestra.run.smithi124.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:02:45.835 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/180 2023-10-16T14:02:45.835 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/180 2023-10-16T14:02:45.835 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:45.837 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:46.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:46.045 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-10-16T14:02:46.419 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:46.423 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:46.424 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:46.425 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:46.425 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:46.738 INFO:teuthology.orchestra.run.smithi124.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:02:46.742 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/181 2023-10-16T14:02:46.742 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/181 2023-10-16T14:02:46.742 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:46.744 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:47.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:47.088 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-10-16T14:02:47.346 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:47.350 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:47.351 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:47.351 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:47.352 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:47.712 INFO:teuthology.orchestra.run.smithi124.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-10-16T14:02:47.715 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/182 2023-10-16T14:02:47.716 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/182 2023-10-16T14:02:47.716 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:47.718 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:48.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:48.056 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-10-16T14:02:48.291 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:48.295 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:48.295 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:48.296 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:48.296 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:49.128 INFO:teuthology.orchestra.run.smithi124.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:02:49.135 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/183 2023-10-16T14:02:49.135 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/183 2023-10-16T14:02:49.135 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:49.137 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:49.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:49.229 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-10-16T14:02:49.433 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:49.437 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:49.438 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:49.438 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:49.439 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:49.810 INFO:teuthology.orchestra.run.smithi124.stdout:generic/184 0s 2023-10-16T14:02:49.815 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/184 2023-10-16T14:02:49.815 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:49.817 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:49.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:49.849 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-10-16T14:02:50.049 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:50.053 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:50.054 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:50.055 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:50.055 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:50.735 INFO:teuthology.orchestra.run.smithi124.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:02:50.741 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/185 2023-10-16T14:02:50.742 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/185 2023-10-16T14:02:50.742 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:50.745 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:51.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:51.020 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-10-16T14:02:51.227 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:51.231 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:51.232 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:51.233 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:51.233 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:52.019 INFO:teuthology.orchestra.run.smithi124.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:02:52.099 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/186 2023-10-16T14:02:52.099 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/186 2023-10-16T14:02:52.099 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:52.103 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:52.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:52.195 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-10-16T14:02:52.400 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:52.405 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:52.405 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:52.406 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:52.406 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:53.229 INFO:teuthology.orchestra.run.smithi124.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:02:53.254 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/187 2023-10-16T14:02:53.255 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/187 2023-10-16T14:02:53.255 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:53.258 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:53.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:53.368 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-10-16T14:02:53.575 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:53.579 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:53.580 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:53.581 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:53.581 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:54.339 INFO:teuthology.orchestra.run.smithi124.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:02:54.391 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/188 2023-10-16T14:02:54.391 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/188 2023-10-16T14:02:54.391 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:54.432 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:54.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:54.544 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-10-16T14:02:54.752 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:54.756 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:54.756 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:54.757 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:54.757 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:55.574 INFO:teuthology.orchestra.run.smithi124.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:02:55.595 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/189 2023-10-16T14:02:55.595 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/189 2023-10-16T14:02:55.596 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:55.611 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:55.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:55.707 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-10-16T14:02:55.905 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:55.909 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:55.909 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:55.910 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:55.910 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:56.721 INFO:teuthology.orchestra.run.smithi124.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:02:56.740 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/190 2023-10-16T14:02:56.740 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/190 2023-10-16T14:02:56.741 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:56.751 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:56.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:56.821 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-10-16T14:02:57.063 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:57.068 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:57.069 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:57.069 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:57.069 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:57.824 INFO:teuthology.orchestra.run.smithi124.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:02:57.864 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/191 2023-10-16T14:02:57.865 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/191 2023-10-16T14:02:57.865 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:57.875 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:58.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:58.030 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-10-16T14:02:58.233 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:58.237 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:58.238 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:58.239 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:58.239 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:58.555 INFO:teuthology.orchestra.run.smithi124.stdout:generic/192 [not run] atime not maintained by ceph 2023-10-16T14:02:58.559 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/192 2023-10-16T14:02:58.560 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/192 2023-10-16T14:02:58.560 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:58.562 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:58.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:02:58.587 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-10-16T14:02:58.793 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:02:58.797 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:02:58.797 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:02:58.798 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:02:58.798 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:02:59.723 INFO:teuthology.orchestra.run.smithi124.stdout:generic/193 1s 2023-10-16T14:02:59.727 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/193 2023-10-16T14:02:59.727 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:02:59.729 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:00.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:03:00.078 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-10-16T14:03:00.326 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:03:00.330 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:03:00.331 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:03:00.332 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:03:00.332 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:01.243 INFO:teuthology.orchestra.run.smithi124.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:03:01.248 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/194 2023-10-16T14:03:01.248 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/194 2023-10-16T14:03:01.248 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:03:01.251 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:01.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:03:01.317 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-10-16T14:03:01.551 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:03:01.555 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:03:01.556 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:03:01.557 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:03:01.557 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:02.356 INFO:teuthology.orchestra.run.smithi124.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:03:02.378 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/195 2023-10-16T14:03:02.378 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/195 2023-10-16T14:03:02.379 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:03:02.382 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:02.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:03:02.556 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-10-16T14:03:02.757 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:03:02.761 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:03:02.762 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:03:02.762 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:03:02.763 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:03.477 INFO:teuthology.orchestra.run.smithi124.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:03:03.485 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/196 2023-10-16T14:03:03.485 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/196 2023-10-16T14:03:03.485 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:03:03.492 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:03.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:03:03.781 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-10-16T14:03:03.987 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:03:03.991 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:03:03.992 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:03:03.993 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:03:03.993 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:04.754 INFO:teuthology.orchestra.run.smithi124.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:03:04.827 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/197 2023-10-16T14:03:04.827 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/197 2023-10-16T14:03:04.827 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:03:04.842 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:04.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:03:04.990 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-10-16T14:03:05.191 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:03:05.195 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:03:05.196 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:03:05.197 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:03:05.197 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:05.918 INFO:teuthology.orchestra.run.smithi124.stdout:generic/198 0s 2023-10-16T14:03:05.967 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/198 2023-10-16T14:03:05.969 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:03:05.969 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:06.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:03:06.340 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-10-16T14:03:06.629 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:03:06.633 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:03:06.633 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:03:06.634 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:03:06.634 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:07.399 INFO:teuthology.orchestra.run.smithi124.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:03:07.455 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/199 2023-10-16T14:03:07.455 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/199 2023-10-16T14:03:07.455 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:03:07.459 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:07.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:03:07.620 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-10-16T14:03:07.831 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:03:07.835 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:03:07.835 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:03:07.836 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:03:07.836 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:08.630 INFO:teuthology.orchestra.run.smithi124.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:03:08.659 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/200 2023-10-16T14:03:08.660 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/200 2023-10-16T14:03:08.660 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:03:08.713 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:08.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:03:08.859 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-10-16T14:03:09.061 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:03:09.065 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:03:09.065 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:03:09.066 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:03:09.066 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:09.895 INFO:teuthology.orchestra.run.smithi124.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:03:09.954 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/201 2023-10-16T14:03:09.955 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/201 2023-10-16T14:03:09.955 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:03:09.959 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:10.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:03:10.072 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-10-16T14:03:10.304 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:03:10.308 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:03:10.308 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:03:10.309 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:03:10.309 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:11.192 INFO:teuthology.orchestra.run.smithi124.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:03:11.197 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/202 2023-10-16T14:03:11.198 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/202 2023-10-16T14:03:11.198 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:03:11.199 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:11.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:03:11.256 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-10-16T14:03:11.492 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:03:11.496 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:03:11.497 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:03:11.498 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:03:11.498 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:12.329 INFO:teuthology.orchestra.run.smithi124.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:03:12.359 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/203 2023-10-16T14:03:12.359 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/203 2023-10-16T14:03:12.360 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:03:12.365 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:12.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:03:12.507 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-10-16T14:03:12.721 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:03:12.723 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:03:12.724 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:03:12.725 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:03:12.725 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:14.668 INFO:teuthology.orchestra.run.smithi124.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-16T14:03:14.673 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/204 2023-10-16T14:03:14.673 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/204 2023-10-16T14:03:14.673 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:03:14.676 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:14.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:03:14.704 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-10-16T14:03:14.922 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:03:14.926 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:03:14.926 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:03:14.927 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:03:14.927 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:15.761 INFO:teuthology.orchestra.run.smithi124.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:03:15.771 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/205 2023-10-16T14:03:15.772 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/205 2023-10-16T14:03:15.772 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:03:15.774 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:15.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:03:15.851 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-10-16T14:03:16.052 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:03:16.056 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:03:16.056 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:03:16.057 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:03:16.057 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:16.927 INFO:teuthology.orchestra.run.smithi124.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:03:16.963 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/206 2023-10-16T14:03:16.963 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/206 2023-10-16T14:03:16.964 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:03:16.965 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:17.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:03:17.053 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-10-16T14:03:17.255 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:03:17.259 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:03:17.260 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:03:17.260 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:03:17.261 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:23.653 INFO:teuthology.orchestra.run.smithi124.stdout:generic/207 6s 2023-10-16T14:03:23.658 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/207 2023-10-16T14:03:23.658 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:03:23.660 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:03:23.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:03:23.759 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-10-16T14:03:24.236 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:03:24.240 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:03:24.241 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:03:24.242 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:03:24.242 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:04:53.155 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:04:53.161 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:05:23.257 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:05:23.261 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:05:53.321 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:05:53.325 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:06:23.812 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:06:23.820 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:06:23.863 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T14:06:23.861+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118560) UID: 0 2023-10-16T14:06:23.864 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T14:06:23.861+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118560) UID: 0 2023-10-16T14:06:23.864 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T14:06:23.861+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118560) UID: 0 2023-10-16T14:06:23.865 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T14:06:23.861+0000 7f95afc78700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118560) UID: 0 2023-10-16T14:06:44.817 INFO:teuthology.orchestra.run.smithi124.stdout:generic/208 200s 2023-10-16T14:06:44.821 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/208 2023-10-16T14:06:44.821 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:06:44.824 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:06:45.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:06:45.149 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-10-16T14:06:45.392 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:06:45.396 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:06:45.397 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:06:45.397 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:06:45.398 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:23.497 INFO:teuthology.orchestra.run.smithi124.stdout:generic/209 38s 2023-10-16T14:07:23.502 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/209 2023-10-16T14:07:23.503 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:23.505 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:23.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:23.639 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-10-16T14:07:24.137 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:24.141 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:24.141 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:24.142 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:24.142 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:24.623 INFO:teuthology.orchestra.run.smithi124.stdout:generic/210 0s 2023-10-16T14:07:24.627 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/210 2023-10-16T14:07:24.628 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:24.629 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:24.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:24.972 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-10-16T14:07:25.232 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:25.235 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:25.236 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:25.237 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:25.237 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:25.698 INFO:teuthology.orchestra.run.smithi124.stdout:generic/211 0s 2023-10-16T14:07:25.703 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/211 2023-10-16T14:07:25.703 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:25.705 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:25.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:25.742 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-10-16T14:07:25.941 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:25.945 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:25.946 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:25.947 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:25.947 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:26.339 INFO:teuthology.orchestra.run.smithi124.stdout:generic/212 0s 2023-10-16T14:07:26.344 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/212 2023-10-16T14:07:26.344 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:26.346 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:26.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:26.375 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-10-16T14:07:26.618 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:26.622 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:26.622 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:26.623 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:26.623 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:26.962 INFO:teuthology.orchestra.run.smithi124.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T14:07:26.966 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/213 2023-10-16T14:07:26.966 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/213 2023-10-16T14:07:26.967 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:26.968 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:26.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:26.996 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-10-16T14:07:27.198 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:27.202 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:27.203 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:27.204 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:27.204 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:27.553 INFO:teuthology.orchestra.run.smithi124.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T14:07:27.557 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/214 2023-10-16T14:07:27.557 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/214 2023-10-16T14:07:27.557 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:27.559 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:27.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:27.588 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-10-16T14:07:27.806 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:27.810 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:27.811 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:27.811 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:27.811 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:30.219 INFO:teuthology.orchestra.run.smithi124.stdout:generic/215 2s 2023-10-16T14:07:30.225 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/215 2023-10-16T14:07:30.225 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:30.227 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:30.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:30.273 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-10-16T14:07:30.490 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:30.494 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:30.495 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:30.496 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:30.496 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:31.348 INFO:teuthology.orchestra.run.smithi124.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:07:31.353 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/216 2023-10-16T14:07:31.354 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/216 2023-10-16T14:07:31.354 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:31.364 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:31.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:31.447 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-10-16T14:07:31.679 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:31.683 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:31.684 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:31.685 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:31.685 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:32.544 INFO:teuthology.orchestra.run.smithi124.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:07:32.564 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/217 2023-10-16T14:07:32.565 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/217 2023-10-16T14:07:32.565 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:32.587 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:32.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:32.665 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-10-16T14:07:32.866 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:32.870 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:32.871 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:32.872 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:32.872 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:33.681 INFO:teuthology.orchestra.run.smithi124.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:07:33.688 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/218 2023-10-16T14:07:33.688 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/218 2023-10-16T14:07:33.688 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:33.753 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:33.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:33.841 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-10-16T14:07:34.049 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:34.054 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:34.054 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:34.055 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:34.055 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:34.403 INFO:teuthology.orchestra.run.smithi124.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-16T14:07:34.407 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/219 2023-10-16T14:07:34.407 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/219 2023-10-16T14:07:34.407 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:34.409 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:34.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:34.429 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-10-16T14:07:34.634 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:34.638 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:34.638 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:34.639 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:34.639 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:35.308 INFO:teuthology.orchestra.run.smithi124.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:07:35.478 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/220 2023-10-16T14:07:35.478 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/220 2023-10-16T14:07:35.478 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:35.507 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:35.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:35.566 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-10-16T14:07:35.812 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:35.816 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:35.817 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:35.817 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:35.818 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:37.159 INFO:teuthology.orchestra.run.smithi124.stdout:generic/221 1s 2023-10-16T14:07:37.164 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/221 2023-10-16T14:07:37.165 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:37.166 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:37.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:37.196 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-10-16T14:07:37.397 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:37.402 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:37.402 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:37.403 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:37.403 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:38.227 INFO:teuthology.orchestra.run.smithi124.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:07:38.256 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/222 2023-10-16T14:07:38.257 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/222 2023-10-16T14:07:38.257 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:38.268 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:38.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:38.394 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-10-16T14:07:38.610 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:38.614 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:38.614 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:38.615 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:38.615 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:38.993 INFO:teuthology.orchestra.run.smithi124.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T14:07:38.997 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/223 2023-10-16T14:07:38.997 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/223 2023-10-16T14:07:38.997 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:38.999 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:39.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:39.026 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-10-16T14:07:39.244 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:39.248 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:39.249 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:39.250 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:39.251 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:39.579 INFO:teuthology.orchestra.run.smithi124.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-16T14:07:39.582 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/224 2023-10-16T14:07:39.583 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/224 2023-10-16T14:07:39.583 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:39.585 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:39.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:39.615 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-10-16T14:07:39.828 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:39.832 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:39.833 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:39.834 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:39.834 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:40.188 INFO:teuthology.orchestra.run.smithi124.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T14:07:40.192 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/225 2023-10-16T14:07:40.193 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/225 2023-10-16T14:07:40.193 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:40.194 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:40.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:40.522 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-10-16T14:07:40.786 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:40.790 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:40.791 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:40.792 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:40.792 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:41.166 INFO:teuthology.orchestra.run.smithi124.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-16T14:07:41.170 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/226 2023-10-16T14:07:41.171 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/226 2023-10-16T14:07:41.171 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:41.172 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:41.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:41.205 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-10-16T14:07:41.404 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:41.408 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:41.409 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:41.409 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:41.410 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:42.270 INFO:teuthology.orchestra.run.smithi124.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:07:42.277 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/227 2023-10-16T14:07:42.277 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/227 2023-10-16T14:07:42.277 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:42.279 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:42.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:42.370 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-10-16T14:07:42.588 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:42.592 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:42.593 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:42.594 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:42.594 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:42.927 INFO:teuthology.orchestra.run.smithi124.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T14:07:42.929 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/228 2023-10-16T14:07:42.929 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/228 2023-10-16T14:07:42.929 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:42.930 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:42.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:42.954 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-10-16T14:07:43.164 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:43.168 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:43.169 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:43.170 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:43.170 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:43.918 INFO:teuthology.orchestra.run.smithi124.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:07:43.971 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/229 2023-10-16T14:07:43.971 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/229 2023-10-16T14:07:43.972 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:43.992 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:44.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:44.136 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-10-16T14:07:44.348 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:44.352 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:44.352 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:44.353 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:44.353 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:44.675 INFO:teuthology.orchestra.run.smithi124.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-16T14:07:44.679 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/230 2023-10-16T14:07:44.679 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/230 2023-10-16T14:07:44.679 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:44.681 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:44.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:44.707 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-10-16T14:07:44.907 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:44.911 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:44.912 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:44.913 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:44.913 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:45.246 INFO:teuthology.orchestra.run.smithi124.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-16T14:07:45.250 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/231 2023-10-16T14:07:45.250 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/231 2023-10-16T14:07:45.250 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:45.252 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:45.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:45.273 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-10-16T14:07:45.500 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:45.504 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:45.505 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:45.506 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:45.506 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:45.840 INFO:teuthology.orchestra.run.smithi124.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-16T14:07:45.844 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/232 2023-10-16T14:07:45.844 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/232 2023-10-16T14:07:45.844 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:45.846 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:45.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:45.869 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-10-16T14:07:46.068 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:46.072 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:46.072 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:46.073 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:46.073 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:46.385 INFO:teuthology.orchestra.run.smithi124.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-16T14:07:46.389 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/233 2023-10-16T14:07:46.390 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/233 2023-10-16T14:07:46.390 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:46.391 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:46.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:46.414 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-10-16T14:07:46.618 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:46.622 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:46.622 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:46.623 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:46.623 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:46.940 INFO:teuthology.orchestra.run.smithi124.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-16T14:07:46.944 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/234 2023-10-16T14:07:46.945 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/234 2023-10-16T14:07:46.945 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:46.946 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:46.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:46.968 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-10-16T14:07:47.188 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:47.192 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:47.193 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:47.194 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:47.194 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:47.513 INFO:teuthology.orchestra.run.smithi124.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-16T14:07:47.517 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/235 2023-10-16T14:07:47.517 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/235 2023-10-16T14:07:47.517 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:47.519 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:47.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:47.540 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-10-16T14:07:47.772 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:47.776 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:47.777 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:47.778 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:47.778 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:49.202 INFO:teuthology.orchestra.run.smithi124.stdout:generic/236 1s 2023-10-16T14:07:49.208 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/236 2023-10-16T14:07:49.209 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:49.211 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:49.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:49.594 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-10-16T14:07:49.815 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:49.819 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:49.820 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:49.820 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:49.821 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:50.272 INFO:teuthology.orchestra.run.smithi124.stdout:generic/237 0s 2023-10-16T14:07:50.277 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/237 2023-10-16T14:07:50.277 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:50.279 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:50.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:50.638 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-10-16T14:07:50.879 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:50.883 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:50.884 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:50.884 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:50.884 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:51.731 INFO:teuthology.orchestra.run.smithi124.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:07:51.742 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/238 2023-10-16T14:07:51.743 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/238 2023-10-16T14:07:51.743 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:07:51.757 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:07:51.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:07:51.867 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-10-16T14:07:52.067 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:07:52.071 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:07:52.071 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:07:52.072 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:07:52.072 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:09:52.053 INFO:teuthology.orchestra.run.smithi124.stdout:generic/239 120s 2023-10-16T14:09:52.057 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/239 2023-10-16T14:09:52.058 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:09:52.059 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:09:52.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:09:52.374 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-10-16T14:09:52.639 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:09:52.643 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:09:52.644 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:09:52.644 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:09:52.645 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:09:53.349 INFO:teuthology.orchestra.run.smithi124.stdout:generic/240 1s 2023-10-16T14:09:53.354 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/240 2023-10-16T14:09:53.354 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:09:53.356 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:09:53.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:09:53.724 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-10-16T14:09:53.954 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:09:53.958 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:09:53.958 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:09:53.959 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:09:53.959 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:09:58.472 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:09:58.474 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:10:28.596 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:10:28.599 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:10:58.736 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:10:58.739 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:11:07.076 INFO:teuthology.orchestra.run.smithi124.stdout:generic/241 73s 2023-10-16T14:11:07.080 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/241 2023-10-16T14:11:07.080 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:11:07.082 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:09.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:11:09.879 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-10-16T14:11:10.194 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:11:10.198 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:11:10.199 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:11:10.199 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:11:10.200 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:11.873 INFO:teuthology.orchestra.run.smithi124.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:11:11.908 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/242 2023-10-16T14:11:11.909 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/242 2023-10-16T14:11:11.909 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:11:11.912 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:12.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:11:12.017 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-10-16T14:11:12.538 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:11:12.548 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:11:12.549 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:11:12.550 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:11:12.550 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:13.452 INFO:teuthology.orchestra.run.smithi124.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:11:13.461 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/243 2023-10-16T14:11:13.462 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/243 2023-10-16T14:11:13.462 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:11:13.464 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:13.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:11:13.559 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-10-16T14:11:13.777 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:11:13.780 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:11:13.781 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:11:13.782 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:11:13.782 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:14.107 INFO:teuthology.orchestra.run.smithi124.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-16T14:11:14.111 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/244 2023-10-16T14:11:14.112 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/244 2023-10-16T14:11:14.112 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:11:14.113 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:14.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:11:14.133 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-10-16T14:11:14.333 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:11:14.337 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:11:14.338 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:11:14.338 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:11:14.339 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:14.760 INFO:teuthology.orchestra.run.smithi124.stdout:generic/245 0s 2023-10-16T14:11:14.764 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/245 2023-10-16T14:11:14.765 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:11:14.766 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:15.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:11:15.093 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-10-16T14:11:15.366 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:11:15.370 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:11:15.370 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:11:15.371 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:11:15.371 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:15.756 INFO:teuthology.orchestra.run.smithi124.stdout:generic/246 0s 2023-10-16T14:11:15.761 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/246 2023-10-16T14:11:15.761 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:11:15.763 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:16.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:11:16.098 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-10-16T14:11:16.353 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:11:16.359 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:11:16.359 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:11:16.360 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:11:16.360 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:21.789 INFO:teuthology.orchestra.run.smithi124.stdout:generic/247 5s 2023-10-16T14:11:21.840 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/247 2023-10-16T14:11:21.840 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:11:21.842 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:21.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:11:21.851 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-10-16T14:11:22.056 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:11:22.060 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:11:22.061 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:11:22.062 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:11:22.062 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:22.426 INFO:teuthology.orchestra.run.smithi124.stdout:generic/248 0s 2023-10-16T14:11:22.430 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/248 2023-10-16T14:11:22.431 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:11:22.433 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:22.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:11:22.479 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-10-16T14:11:22.686 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:11:22.689 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:11:22.690 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:11:22.691 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:11:22.691 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:23.259 INFO:teuthology.orchestra.run.smithi124.stdout:generic/249 1s 2023-10-16T14:11:23.263 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/249 2023-10-16T14:11:23.264 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:11:23.265 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:23.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:11:23.631 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-10-16T14:11:23.898 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:11:23.902 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:11:23.903 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:11:23.904 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:11:23.904 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:24.280 INFO:teuthology.orchestra.run.smithi124.stdout:generic/250 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T14:11:24.285 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/250 2023-10-16T14:11:24.285 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/250 2023-10-16T14:11:24.285 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:11:24.287 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:24.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:11:24.311 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-10-16T14:11:24.512 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:11:24.517 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:11:24.517 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:11:24.518 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:11:24.518 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:25.002 INFO:teuthology.orchestra.run.smithi124.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:11:25.018 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/251 2023-10-16T14:11:25.018 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/251 2023-10-16T14:11:25.018 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:11:25.020 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:25.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:11:25.054 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-10-16T14:11:25.258 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:11:25.261 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:11:25.262 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:11:25.263 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:11:25.263 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:25.616 INFO:teuthology.orchestra.run.smithi124.stdout:generic/252 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T14:11:25.620 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/252 2023-10-16T14:11:25.620 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/252 2023-10-16T14:11:25.620 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:11:25.622 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:25.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:11:25.641 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-10-16T14:11:25.862 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:11:25.866 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:11:25.866 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:11:25.867 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:11:25.867 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:26.560 INFO:teuthology.orchestra.run.smithi124.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:11:26.749 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/253 2023-10-16T14:11:26.749 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/253 2023-10-16T14:11:26.749 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:11:26.754 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:26.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:11:26.795 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-10-16T14:11:26.998 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:11:27.006 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:11:27.006 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:11:27.006 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:11:27.007 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:27.804 INFO:teuthology.orchestra.run.smithi124.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:11:27.880 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/254 2023-10-16T14:11:27.881 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/254 2023-10-16T14:11:27.881 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:11:27.883 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:27.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:11:27.932 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-10-16T14:11:28.134 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:11:28.138 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:11:28.138 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:11:28.139 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:11:28.139 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:28.575 INFO:teuthology.orchestra.run.smithi124.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T14:11:28.579 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/255 2023-10-16T14:11:28.579 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/255 2023-10-16T14:11:28.579 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:11:28.581 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:28.861 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:11:28.904 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:11:28.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:11:28.949 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-10-16T14:11:29.175 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:11:29.179 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:11:29.179 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:11:29.180 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:11:29.181 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:29.827 INFO:teuthology.orchestra.run.smithi124.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-16T14:11:29.831 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/256 2023-10-16T14:11:29.832 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/256 2023-10-16T14:11:29.832 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:11:29.834 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:29.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:11:29.863 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-10-16T14:11:30.067 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:11:30.071 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:11:30.071 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:11:30.072 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:11:30.072 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:30.972 INFO:teuthology.orchestra.run.smithi124.stdout:generic/257 0s 2023-10-16T14:11:30.977 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/257 2023-10-16T14:11:30.977 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:11:30.981 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:31.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:11:31.410 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-10-16T14:11:31.734 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:11:31.738 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:11:31.738 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:11:31.739 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:11:31.739 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:32.056 INFO:teuthology.orchestra.run.smithi124.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-10-16T14:11:32.060 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/258 2023-10-16T14:11:32.060 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/258 2023-10-16T14:11:32.060 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:11:32.062 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:32.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:11:32.093 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-10-16T14:11:32.297 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:11:32.301 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:11:32.301 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:11:32.302 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:11:32.302 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:33.113 INFO:teuthology.orchestra.run.smithi124.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:11:33.131 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/259 2023-10-16T14:11:33.131 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/259 2023-10-16T14:11:33.132 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:11:33.181 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:33.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:11:33.298 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-10-16T14:11:33.501 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:11:33.505 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:11:33.505 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:11:33.506 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:11:33.506 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:33.998 INFO:teuthology.orchestra.run.smithi124.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:11:34.025 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/260 2023-10-16T14:11:34.025 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/260 2023-10-16T14:11:34.026 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:11:34.027 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:34.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:11:34.050 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-10-16T14:11:34.254 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:11:34.259 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:11:34.259 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:11:34.260 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:11:34.260 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:34.955 INFO:teuthology.orchestra.run.smithi124.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:11:34.961 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/261 2023-10-16T14:11:34.961 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/261 2023-10-16T14:11:34.961 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:11:35.079 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:35.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:11:35.182 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-10-16T14:11:35.399 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:11:35.403 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:11:35.404 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:11:35.404 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:11:35.405 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:36.286 INFO:teuthology.orchestra.run.smithi124.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:11:36.304 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/262 2023-10-16T14:11:36.304 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/262 2023-10-16T14:11:36.304 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:11:36.311 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:36.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:11:36.425 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-10-16T14:11:36.658 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:11:36.662 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:11:36.663 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:11:36.664 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:11:36.664 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:11:59.055 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:11:59.058 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:12:14.496 INFO:teuthology.orchestra.run.smithi124.stdout:generic/263 38s 2023-10-16T14:12:14.500 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/263 2023-10-16T14:12:14.501 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:14.502 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:14.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:14.834 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-10-16T14:12:15.082 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:15.086 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:15.087 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:15.088 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:15.088 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:15.920 INFO:teuthology.orchestra.run.smithi124.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:15.950 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/264 2023-10-16T14:12:15.951 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/264 2023-10-16T14:12:15.951 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:15.958 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:16.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:16.014 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-10-16T14:12:16.220 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:16.223 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:16.224 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:16.225 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:16.225 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:17.070 INFO:teuthology.orchestra.run.smithi124.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:17.090 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/265 2023-10-16T14:12:17.090 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/265 2023-10-16T14:12:17.090 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:17.094 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:17.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:17.181 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-10-16T14:12:17.411 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:17.415 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:17.416 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:17.417 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:17.417 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:18.262 INFO:teuthology.orchestra.run.smithi124.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:18.268 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/266 2023-10-16T14:12:18.269 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/266 2023-10-16T14:12:18.269 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:18.281 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:18.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:18.357 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-10-16T14:12:18.556 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:18.560 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:18.560 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:18.561 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:18.561 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:19.418 INFO:teuthology.orchestra.run.smithi124.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:19.423 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/267 2023-10-16T14:12:19.424 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/267 2023-10-16T14:12:19.424 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:19.426 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:19.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:19.492 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-10-16T14:12:19.698 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:19.702 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:19.703 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:19.703 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:19.704 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:20.535 INFO:teuthology.orchestra.run.smithi124.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:20.567 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/268 2023-10-16T14:12:20.568 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/268 2023-10-16T14:12:20.568 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:20.572 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:20.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:20.624 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-10-16T14:12:20.837 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:20.840 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:20.841 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:20.842 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:20.842 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:21.161 INFO:teuthology.orchestra.run.smithi124.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-16T14:12:21.165 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/269 2023-10-16T14:12:21.165 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/269 2023-10-16T14:12:21.165 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:21.167 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:21.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:21.192 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-10-16T14:12:21.404 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:21.409 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:21.410 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:21.410 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:21.410 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:21.727 INFO:teuthology.orchestra.run.smithi124.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-16T14:12:21.731 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/270 2023-10-16T14:12:21.731 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/270 2023-10-16T14:12:21.731 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:21.733 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:21.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:21.753 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-10-16T14:12:21.954 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:21.958 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:21.959 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:21.959 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:21.960 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:22.707 INFO:teuthology.orchestra.run.smithi124.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:22.717 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/271 2023-10-16T14:12:22.717 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/271 2023-10-16T14:12:22.718 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:22.721 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:22.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:22.863 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-10-16T14:12:23.071 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:23.075 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:23.075 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:23.076 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:23.076 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:23.907 INFO:teuthology.orchestra.run.smithi124.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:23.952 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/272 2023-10-16T14:12:23.952 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/272 2023-10-16T14:12:23.952 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:23.958 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:24.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:24.015 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-10-16T14:12:24.229 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:24.233 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:24.234 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:24.235 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:24.235 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:24.585 INFO:teuthology.orchestra.run.smithi124.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-16T14:12:24.589 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/273 2023-10-16T14:12:24.589 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/273 2023-10-16T14:12:24.589 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:24.591 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:24.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:24.615 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-10-16T14:12:24.844 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:24.848 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:24.848 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:24.849 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:24.849 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:25.180 INFO:teuthology.orchestra.run.smithi124.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-10-16T14:12:25.184 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/274 2023-10-16T14:12:25.184 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/274 2023-10-16T14:12:25.184 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:25.186 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:25.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:25.221 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-10-16T14:12:25.439 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:25.443 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:25.443 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:25.444 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:25.444 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:25.779 INFO:teuthology.orchestra.run.smithi124.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-16T14:12:25.783 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/275 2023-10-16T14:12:25.783 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/275 2023-10-16T14:12:25.783 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:25.785 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:25.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:25.810 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-10-16T14:12:26.029 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:26.034 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:26.034 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:26.035 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:26.035 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:26.862 INFO:teuthology.orchestra.run.smithi124.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:26.891 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/276 2023-10-16T14:12:26.892 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/276 2023-10-16T14:12:26.892 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:26.903 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:26.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:26.982 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-10-16T14:12:27.191 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:27.195 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:27.196 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:27.196 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:27.197 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:27.562 INFO:teuthology.orchestra.run.smithi124.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-10-16T14:12:27.566 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/277 2023-10-16T14:12:27.566 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/277 2023-10-16T14:12:27.566 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:27.568 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:27.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:27.599 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-10-16T14:12:27.814 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:27.818 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:27.818 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:27.819 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:27.819 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:28.626 INFO:teuthology.orchestra.run.smithi124.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:28.699 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/278 2023-10-16T14:12:28.700 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/278 2023-10-16T14:12:28.700 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:28.709 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:28.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:28.798 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-10-16T14:12:29.003 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:29.008 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:29.008 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:29.009 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:29.009 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:29.190 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:12:29.193 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:12:29.873 INFO:teuthology.orchestra.run.smithi124.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:29.880 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/279 2023-10-16T14:12:29.880 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/279 2023-10-16T14:12:29.880 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:29.885 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:29.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:29.946 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-10-16T14:12:30.157 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:30.161 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:30.161 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:30.162 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:30.162 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:30.498 INFO:teuthology.orchestra.run.smithi124.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-16T14:12:30.502 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/280 2023-10-16T14:12:30.502 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/280 2023-10-16T14:12:30.502 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:30.504 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:30.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:30.530 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-10-16T14:12:30.740 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:30.744 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:30.745 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:30.746 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:30.746 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:31.570 INFO:teuthology.orchestra.run.smithi124.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:31.618 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/281 2023-10-16T14:12:31.618 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/281 2023-10-16T14:12:31.618 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:31.636 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:31.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:31.686 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-10-16T14:12:31.920 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:31.924 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:31.925 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:31.925 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:31.926 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:32.776 INFO:teuthology.orchestra.run.smithi124.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:32.782 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/282 2023-10-16T14:12:32.782 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/282 2023-10-16T14:12:32.782 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:32.785 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:32.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:32.877 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-10-16T14:12:33.097 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:33.101 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:33.102 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:33.103 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:33.103 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:33.910 INFO:teuthology.orchestra.run.smithi124.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:34.012 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/283 2023-10-16T14:12:34.012 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/283 2023-10-16T14:12:34.013 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:34.013 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:34.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:34.069 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-10-16T14:12:34.275 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:34.279 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:34.279 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:34.280 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:34.280 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:35.066 INFO:teuthology.orchestra.run.smithi124.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:35.134 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/284 2023-10-16T14:12:35.134 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/284 2023-10-16T14:12:35.134 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:35.150 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:35.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:35.203 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-10-16T14:12:35.407 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:35.411 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:35.411 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:35.412 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:35.412 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:36.936 INFO:teuthology.orchestra.run.smithi124.stdout:generic/285 1s 2023-10-16T14:12:36.956 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/285 2023-10-16T14:12:36.956 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:36.958 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:37.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:37.422 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-10-16T14:12:37.855 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:37.860 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:37.861 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:37.862 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:37.862 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:38.365 INFO:teuthology.orchestra.run.smithi124.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T14:12:38.370 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/286 2023-10-16T14:12:38.370 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/286 2023-10-16T14:12:38.371 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:38.377 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:38.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:38.425 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-10-16T14:12:38.770 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:38.774 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:38.775 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:38.776 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:38.776 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:39.745 INFO:teuthology.orchestra.run.smithi124.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:39.758 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/287 2023-10-16T14:12:39.759 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/287 2023-10-16T14:12:39.759 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:39.769 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:39.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:39.935 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-10-16T14:12:40.264 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:40.268 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:40.269 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:40.270 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:40.270 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:40.919 INFO:teuthology.orchestra.run.smithi124.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:40.946 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/288 2023-10-16T14:12:40.946 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/288 2023-10-16T14:12:40.946 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:40.948 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:40.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:40.985 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-10-16T14:12:41.328 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:41.333 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:41.333 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:41.334 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:41.334 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:42.426 INFO:teuthology.orchestra.run.smithi124.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:42.441 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/289 2023-10-16T14:12:42.441 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/289 2023-10-16T14:12:42.441 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:42.444 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:42.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:42.522 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-10-16T14:12:42.900 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:42.903 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:42.904 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:42.905 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:42.905 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:43.539 INFO:teuthology.orchestra.run.smithi124.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:43.763 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/290 2023-10-16T14:12:43.764 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/290 2023-10-16T14:12:43.764 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:43.769 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:43.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:43.821 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-10-16T14:12:44.034 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:44.038 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:44.039 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:44.040 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:44.040 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:44.900 INFO:teuthology.orchestra.run.smithi124.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:44.941 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/291 2023-10-16T14:12:44.941 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/291 2023-10-16T14:12:44.941 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:44.953 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:44.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:44.988 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-10-16T14:12:45.190 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:45.193 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:45.194 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:45.195 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:45.195 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:45.949 INFO:teuthology.orchestra.run.smithi124.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:45.960 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/292 2023-10-16T14:12:45.960 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/292 2023-10-16T14:12:45.961 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:45.963 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:46.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:46.114 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-10-16T14:12:46.332 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:46.337 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:46.337 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:46.338 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:46.338 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:47.137 INFO:teuthology.orchestra.run.smithi124.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:47.166 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/293 2023-10-16T14:12:47.166 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/293 2023-10-16T14:12:47.166 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:47.208 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:47.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:47.298 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-10-16T14:12:47.526 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:47.531 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:47.531 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:47.532 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:47.532 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:48.415 INFO:teuthology.orchestra.run.smithi124.stdout:generic/294 1s 2023-10-16T14:12:48.440 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/294 2023-10-16T14:12:48.440 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:48.443 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:48.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:48.453 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-10-16T14:12:48.674 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:48.678 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:48.678 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:48.679 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:48.679 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:49.534 INFO:teuthology.orchestra.run.smithi124.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:49.541 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/295 2023-10-16T14:12:49.541 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/295 2023-10-16T14:12:49.542 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:49.545 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:49.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:49.645 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-10-16T14:12:49.855 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:49.859 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:49.859 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:49.860 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:49.861 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:50.708 INFO:teuthology.orchestra.run.smithi124.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:50.713 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/296 2023-10-16T14:12:50.714 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/296 2023-10-16T14:12:50.714 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:50.716 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:50.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:50.791 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-10-16T14:12:51.025 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:51.029 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:51.029 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:51.030 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:51.030 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:51.914 INFO:teuthology.orchestra.run.smithi124.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:51.950 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/297 2023-10-16T14:12:51.950 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/297 2023-10-16T14:12:51.951 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:51.953 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:51.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:51.984 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-10-16T14:12:52.187 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:52.191 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:52.192 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:52.193 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:52.193 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:53.061 INFO:teuthology.orchestra.run.smithi124.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:53.078 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/298 2023-10-16T14:12:53.078 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/298 2023-10-16T14:12:53.079 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:53.081 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:53.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:53.132 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-10-16T14:12:53.342 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:53.346 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:53.346 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:53.347 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:53.347 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:53.737 INFO:teuthology.orchestra.run.smithi124.stdout:generic/299 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T14:12:53.741 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/299 2023-10-16T14:12:53.742 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/299 2023-10-16T14:12:53.742 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:53.743 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:53.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:53.771 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-10-16T14:12:53.978 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:53.982 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:53.983 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:53.984 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:53.984 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:54.386 INFO:teuthology.orchestra.run.smithi124.stdout:generic/300 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T14:12:54.390 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/300 2023-10-16T14:12:54.391 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/300 2023-10-16T14:12:54.391 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:54.393 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:54.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:54.423 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-10-16T14:12:54.630 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:54.634 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:54.635 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:54.635 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:54.636 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:55.463 INFO:teuthology.orchestra.run.smithi124.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:55.502 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/301 2023-10-16T14:12:55.502 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/301 2023-10-16T14:12:55.502 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:55.505 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:55.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:55.566 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-10-16T14:12:55.772 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:55.776 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:55.777 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:55.777 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:55.778 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:56.556 INFO:teuthology.orchestra.run.smithi124.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:56.668 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/302 2023-10-16T14:12:56.668 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/302 2023-10-16T14:12:56.668 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:56.692 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:56.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:56.731 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-10-16T14:12:56.944 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:56.948 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:56.948 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:56.949 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:56.949 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:57.328 INFO:teuthology.orchestra.run.smithi124.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:12:57.333 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/303 2023-10-16T14:12:57.333 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/303 2023-10-16T14:12:57.333 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:57.335 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:57.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:57.695 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-10-16T14:12:57.942 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:57.946 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:57.946 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:57.947 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:57.947 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:58.326 INFO:teuthology.orchestra.run.smithi124.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-10-16T14:12:58.329 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/304 2023-10-16T14:12:58.330 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/304 2023-10-16T14:12:58.330 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:58.332 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:58.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:58.722 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-10-16T14:12:58.961 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:12:58.965 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:12:58.965 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:12:58.966 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:12:58.966 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:59.349 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:12:59.352 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:12:59.702 INFO:teuthology.orchestra.run.smithi124.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:12:59.766 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/305 2023-10-16T14:12:59.767 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/305 2023-10-16T14:12:59.767 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:12:59.769 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:12:59.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:12:59.857 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-10-16T14:13:00.088 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:13:00.092 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:13:00.092 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:13:00.093 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:13:00.093 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:13:00.970 INFO:teuthology.orchestra.run.smithi124.stdout:generic/306 0s 2023-10-16T14:13:01.027 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/306 2023-10-16T14:13:01.028 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:13:01.030 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:13:01.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:13:01.466 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-10-16T14:13:01.724 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:13:01.728 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:13:01.728 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:13:01.729 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:13:01.729 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:13:03.521 INFO:teuthology.orchestra.run.smithi124.stdout:generic/307 2s 2023-10-16T14:13:03.527 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/307 2023-10-16T14:13:03.527 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:13:03.529 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:13:03.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:13:03.540 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-10-16T14:13:03.758 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:13:03.762 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:13:03.762 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:13:03.763 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:13:03.763 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:13:04.135 INFO:teuthology.orchestra.run.smithi124.stdout:generic/308 1s 2023-10-16T14:13:04.140 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/308 2023-10-16T14:13:04.140 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:13:04.142 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:13:04.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:13:04.169 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-10-16T14:13:04.373 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:13:04.377 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:13:04.377 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:13:04.378 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:13:04.378 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:13:05.768 INFO:teuthology.orchestra.run.smithi124.stdout:generic/309 1s 2023-10-16T14:13:05.774 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/309 2023-10-16T14:13:05.774 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:13:05.776 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:13:05.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:13:05.984 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-10-16T14:13:06.409 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:13:06.413 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:13:06.414 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:13:06.415 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:13:06.415 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:13:29.489 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:13:29.492 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:13:59.561 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:13:59.564 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:14:23.256 INFO:teuthology.orchestra.run.smithi124.stdout:generic/310 77s 2023-10-16T14:14:23.261 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/310 2023-10-16T14:14:23.261 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:14:23.263 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:23.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:14:23.665 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-10-16T14:14:24.066 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:14:24.070 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:14:24.071 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:14:24.071 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:14:24.072 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:24.460 INFO:teuthology.orchestra.run.smithi124.stdout:generic/311 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T14:14:24.463 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/311 2023-10-16T14:14:24.464 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/311 2023-10-16T14:14:24.464 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:14:24.466 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:24.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:14:24.494 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-10-16T14:14:24.712 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:14:24.716 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:14:24.717 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:14:24.718 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:14:24.718 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:25.044 INFO:teuthology.orchestra.run.smithi124.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T14:14:25.048 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/312 2023-10-16T14:14:25.048 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/312 2023-10-16T14:14:25.049 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:14:25.050 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:25.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:14:25.081 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-10-16T14:14:25.291 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:14:25.296 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:14:25.296 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:14:25.297 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:14:25.297 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:29.675 INFO:teuthology.orchestra.run.smithi124.stdout:generic/313 4s 2023-10-16T14:14:29.681 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/313 2023-10-16T14:14:29.681 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:14:29.683 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:29.708 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:14:29.711 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:14:29.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:14:29.717 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-10-16T14:14:29.985 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:14:29.989 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:14:29.989 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:14:29.990 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:14:29.991 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:30.518 INFO:teuthology.orchestra.run.smithi124.stdout:generic/314 0s 2023-10-16T14:14:30.523 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/314 2023-10-16T14:14:30.523 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:14:30.525 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:30.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:14:30.550 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-10-16T14:14:30.767 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:14:30.771 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:14:30.771 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:14:30.772 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:14:30.772 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:31.095 INFO:teuthology.orchestra.run.smithi124.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-10-16T14:14:31.099 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/315 2023-10-16T14:14:31.099 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/315 2023-10-16T14:14:31.100 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:14:31.102 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:31.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:14:31.135 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-10-16T14:14:31.366 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:14:31.370 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:14:31.371 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:14:31.371 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:14:31.372 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:31.833 INFO:teuthology.orchestra.run.smithi124.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T14:14:31.837 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/316 2023-10-16T14:14:31.837 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/316 2023-10-16T14:14:31.838 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:14:31.839 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:32.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:14:32.180 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-10-16T14:14:32.446 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:14:32.450 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:14:32.450 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:14:32.451 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:14:32.451 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:33.526 INFO:teuthology.orchestra.run.smithi124.stdout:generic/317 1s 2023-10-16T14:14:33.531 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/317 2023-10-16T14:14:33.531 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:14:33.533 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:33.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:14:33.542 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-10-16T14:14:33.775 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:14:33.779 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:14:33.780 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:14:33.781 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:14:33.781 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:34.608 INFO:teuthology.orchestra.run.smithi124.stdout:generic/318 1s 2023-10-16T14:14:34.613 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/318 2023-10-16T14:14:34.613 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:14:34.615 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:34.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:14:34.624 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-10-16T14:14:34.841 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:14:34.845 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:14:34.845 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:14:34.846 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:14:34.846 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:35.410 INFO:teuthology.orchestra.run.smithi124.stdout:generic/319 0s 2023-10-16T14:14:35.414 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/319 2023-10-16T14:14:35.415 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:14:35.416 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:35.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:14:35.425 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-10-16T14:14:35.654 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:14:35.659 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:14:35.659 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:14:35.660 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:14:35.660 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:35.983 INFO:teuthology.orchestra.run.smithi124.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-16T14:14:35.987 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/320 2023-10-16T14:14:35.988 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/320 2023-10-16T14:14:35.988 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:14:35.990 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:36.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:14:36.015 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-10-16T14:14:36.249 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:14:36.253 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:14:36.253 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:14:36.254 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:14:36.255 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:36.590 INFO:teuthology.orchestra.run.smithi124.stdout:generic/321 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T14:14:36.594 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/321 2023-10-16T14:14:36.595 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/321 2023-10-16T14:14:36.595 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:14:36.597 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:36.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:14:36.622 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-10-16T14:14:36.839 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:14:36.843 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:14:36.844 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:14:36.845 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:14:36.845 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:37.174 INFO:teuthology.orchestra.run.smithi124.stdout:generic/322 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T14:14:37.179 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/322 2023-10-16T14:14:37.179 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/322 2023-10-16T14:14:37.179 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:14:37.180 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:37.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:14:37.202 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-10-16T14:14:37.435 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:14:37.439 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:14:37.440 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:14:37.441 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:14:37.441 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:14:59.772 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:14:59.775 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:15:29.868 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:15:29.871 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:15:29.911 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T14:15:29.908+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118966) UID: 0 2023-10-16T14:15:29.912 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T14:15:29.908+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118966) UID: 0 2023-10-16T14:15:29.912 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T14:15:29.908+0000 7f95afc78700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118966) UID: 0 2023-10-16T14:15:29.913 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T14:15:29.909+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118966) UID: 0 2023-10-16T14:16:38.279 INFO:teuthology.orchestra.run.smithi124.stdout:generic/323 121s 2023-10-16T14:16:38.283 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/323 2023-10-16T14:16:38.283 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:16:38.285 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:38.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:16:38.603 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-10-16T14:16:38.887 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:16:38.890 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:16:38.891 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:16:38.892 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:16:38.892 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:39.224 INFO:teuthology.orchestra.run.smithi124.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-10-16T14:16:39.228 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/324 2023-10-16T14:16:39.228 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/324 2023-10-16T14:16:39.228 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:16:39.230 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:39.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:16:39.253 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-10-16T14:16:39.488 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:16:39.491 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:16:39.492 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:16:39.493 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:16:39.493 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:39.836 INFO:teuthology.orchestra.run.smithi124.stdout:generic/325 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T14:16:39.840 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/325 2023-10-16T14:16:39.840 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/325 2023-10-16T14:16:39.840 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:16:39.842 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:39.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:16:39.868 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-10-16T14:16:40.075 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:16:40.079 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:16:40.080 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:16:40.080 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:16:40.081 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:40.897 INFO:teuthology.orchestra.run.smithi124.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:16:40.905 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/326 2023-10-16T14:16:40.905 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/326 2023-10-16T14:16:40.905 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:16:40.909 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:40.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:16:40.995 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-10-16T14:16:41.214 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:16:41.218 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:16:41.219 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:16:41.220 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:16:41.220 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:41.935 INFO:teuthology.orchestra.run.smithi124.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:16:42.069 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/327 2023-10-16T14:16:42.069 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/327 2023-10-16T14:16:42.069 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:16:42.072 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:42.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:16:42.176 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-10-16T14:16:42.379 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:16:42.383 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:16:42.384 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:16:42.385 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:16:42.385 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:43.247 INFO:teuthology.orchestra.run.smithi124.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:16:43.265 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/328 2023-10-16T14:16:43.265 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/328 2023-10-16T14:16:43.265 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:16:43.266 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:43.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:16:43.333 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-10-16T14:16:43.538 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:16:43.542 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:16:43.543 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:16:43.544 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:16:43.544 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:44.417 INFO:teuthology.orchestra.run.smithi124.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:16:44.453 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/329 2023-10-16T14:16:44.454 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/329 2023-10-16T14:16:44.454 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:16:44.457 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:44.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:16:44.505 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-10-16T14:16:44.707 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:16:44.710 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:16:44.711 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:16:44.712 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:16:44.712 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:45.539 INFO:teuthology.orchestra.run.smithi124.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:16:45.577 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/330 2023-10-16T14:16:45.578 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/330 2023-10-16T14:16:45.578 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:16:45.582 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:45.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:16:45.629 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-10-16T14:16:45.839 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:16:45.843 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:16:45.843 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:16:45.844 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:16:45.845 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:46.569 INFO:teuthology.orchestra.run.smithi124.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:16:46.587 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/331 2023-10-16T14:16:46.587 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/331 2023-10-16T14:16:46.587 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:16:46.590 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:46.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:16:46.772 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-10-16T14:16:47.009 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:16:47.013 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:16:47.014 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:16:47.014 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:16:47.015 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:47.668 INFO:teuthology.orchestra.run.smithi124.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:16:47.734 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/332 2023-10-16T14:16:47.734 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/332 2023-10-16T14:16:47.734 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:16:47.737 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:47.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:16:47.889 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-10-16T14:16:48.149 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:16:48.153 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:16:48.154 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:16:48.155 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:16:48.155 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:48.918 INFO:teuthology.orchestra.run.smithi124.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:16:48.950 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/333 2023-10-16T14:16:48.950 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/333 2023-10-16T14:16:48.951 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:16:48.995 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:49.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:16:49.060 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-10-16T14:16:49.294 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:16:49.298 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:16:49.299 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:16:49.300 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:16:49.300 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:50.087 INFO:teuthology.orchestra.run.smithi124.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:16:50.093 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/334 2023-10-16T14:16:50.093 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/334 2023-10-16T14:16:50.094 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:16:50.146 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:50.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:16:50.208 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-10-16T14:16:50.434 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:16:50.438 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:16:50.439 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:16:50.440 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:16:50.440 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:50.772 INFO:teuthology.orchestra.run.smithi124.stdout:generic/335 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T14:16:50.777 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/335 2023-10-16T14:16:50.777 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/335 2023-10-16T14:16:50.777 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:16:50.779 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:50.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:16:50.805 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-10-16T14:16:51.013 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:16:51.017 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:16:51.018 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:16:51.018 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:16:51.019 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:51.365 INFO:teuthology.orchestra.run.smithi124.stdout:generic/336 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T14:16:51.369 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/336 2023-10-16T14:16:51.369 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/336 2023-10-16T14:16:51.369 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:16:51.371 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:51.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:16:51.404 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-10-16T14:16:51.607 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:16:51.611 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:16:51.611 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:16:51.612 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:16:51.612 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:52.213 INFO:teuthology.orchestra.run.smithi124.stdout:generic/337 1s 2023-10-16T14:16:52.217 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/337 2023-10-16T14:16:52.218 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:16:52.220 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:52.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:16:52.228 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-10-16T14:16:52.439 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:16:52.443 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:16:52.444 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:16:52.444 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:16:52.445 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:52.789 INFO:teuthology.orchestra.run.smithi124.stdout:generic/338 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T14:16:52.793 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/338 2023-10-16T14:16:52.793 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/338 2023-10-16T14:16:52.794 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:16:52.795 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:16:52.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:16:52.824 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-10-16T14:16:53.024 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:16:53.028 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:16:53.028 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:16:53.029 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:16:53.030 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:17:49.637 INFO:teuthology.orchestra.run.smithi124.stdout:generic/339 56s 2023-10-16T14:17:49.649 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/339 2023-10-16T14:17:49.649 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:17:49.651 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:17:49.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:17:49.661 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-10-16T14:17:49.874 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:17:49.878 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:17:49.879 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:17:49.880 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:17:49.880 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:17:52.839 INFO:teuthology.orchestra.run.smithi124.stdout:generic/340 2s 2023-10-16T14:17:53.068 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/340 2023-10-16T14:17:53.068 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:17:53.077 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:17:53.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:17:53.110 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-10-16T14:17:53.338 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:17:53.342 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:17:53.343 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:17:53.343 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:17:53.344 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:17:53.802 INFO:teuthology.orchestra.run.smithi124.stdout:generic/341 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T14:17:53.807 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/341 2023-10-16T14:17:53.807 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/341 2023-10-16T14:17:53.807 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:17:53.814 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:17:53.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:17:53.850 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-10-16T14:17:54.112 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:17:54.116 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:17:54.117 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:17:54.118 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:17:54.118 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:17:54.429 INFO:teuthology.orchestra.run.smithi124.stdout:generic/342 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T14:17:54.433 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/342 2023-10-16T14:17:54.433 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/342 2023-10-16T14:17:54.433 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:17:54.435 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:17:54.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:17:54.462 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-10-16T14:17:54.679 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:17:54.683 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:17:54.684 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:17:54.684 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:17:54.685 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:17:55.028 INFO:teuthology.orchestra.run.smithi124.stdout:generic/343 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T14:17:55.032 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/343 2023-10-16T14:17:55.032 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/343 2023-10-16T14:17:55.033 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:17:55.034 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:17:55.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:17:55.064 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-10-16T14:17:55.296 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:17:55.301 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:17:55.301 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:17:55.302 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:17:55.302 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:00.407 INFO:teuthology.orchestra.run.smithi124.stdout:generic/344 5s 2023-10-16T14:18:00.419 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/344 2023-10-16T14:18:00.419 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:00.423 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:00.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:00.440 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-10-16T14:18:00.848 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:00.852 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:00.852 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:00.853 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:00.853 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:06.667 INFO:teuthology.orchestra.run.smithi124.stdout:generic/345 5s 2023-10-16T14:18:06.678 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/345 2023-10-16T14:18:06.679 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:06.681 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:06.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:06.699 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-10-16T14:18:07.035 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:07.042 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:07.043 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:07.044 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:07.044 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:10.656 INFO:teuthology.orchestra.run.smithi124.stdout:generic/346 3s 2023-10-16T14:18:10.664 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/346 2023-10-16T14:18:10.665 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:10.667 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:10.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:10.676 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-10-16T14:18:11.048 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:11.054 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:11.055 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:11.056 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:11.056 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:11.532 INFO:teuthology.orchestra.run.smithi124.stdout:generic/347 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T14:18:11.536 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/347 2023-10-16T14:18:11.536 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/347 2023-10-16T14:18:11.536 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:11.538 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:11.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:11.559 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-10-16T14:18:11.760 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:11.763 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:11.764 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:11.765 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:11.765 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:12.092 INFO:teuthology.orchestra.run.smithi124.stdout:generic/348 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T14:18:12.096 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/348 2023-10-16T14:18:12.096 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/348 2023-10-16T14:18:12.096 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:12.098 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:12.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:12.123 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-10-16T14:18:12.329 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:12.334 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:12.334 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:12.335 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:12.335 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:12.752 INFO:teuthology.orchestra.run.smithi124.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-16T14:18:12.756 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/349 2023-10-16T14:18:12.756 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/349 2023-10-16T14:18:12.756 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:12.758 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:12.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:12.791 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-10-16T14:18:12.997 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:13.001 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:13.002 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:13.002 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:13.003 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:13.847 INFO:teuthology.orchestra.run.smithi124.stdout:generic/350 0s 2023-10-16T14:18:13.852 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/350 2023-10-16T14:18:13.852 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:13.854 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:13.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:13.863 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-10-16T14:18:14.095 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:14.099 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:14.099 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:14.100 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:14.100 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:14.451 INFO:teuthology.orchestra.run.smithi124.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T14:18:14.455 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/351 2023-10-16T14:18:14.455 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/351 2023-10-16T14:18:14.455 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:14.457 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:14.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:14.482 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-10-16T14:18:14.678 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:14.681 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:14.682 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:14.683 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:14.683 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:15.453 INFO:teuthology.orchestra.run.smithi124.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:18:15.490 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/352 2023-10-16T14:18:15.490 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/352 2023-10-16T14:18:15.490 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:15.493 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:15.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:15.589 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-10-16T14:18:15.805 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:15.809 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:15.810 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:15.810 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:15.811 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:16.611 INFO:teuthology.orchestra.run.smithi124.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:18:16.659 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/353 2023-10-16T14:18:16.660 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/353 2023-10-16T14:18:16.660 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:16.671 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:16.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:16.731 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-10-16T14:18:16.934 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:16.938 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:16.938 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:16.939 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:16.939 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:21.842 INFO:teuthology.orchestra.run.smithi124.stdout:generic/354 4s 2023-10-16T14:18:21.855 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/354 2023-10-16T14:18:21.855 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:21.858 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:21.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:21.868 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-10-16T14:18:22.082 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:22.087 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:22.087 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:22.088 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:22.088 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:22.865 INFO:teuthology.orchestra.run.smithi124.stdout:generic/355 0s 2023-10-16T14:18:22.879 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/355 2023-10-16T14:18:22.880 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:22.887 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:23.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:23.295 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-10-16T14:18:23.742 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:23.746 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:23.747 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:23.748 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:23.748 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:24.432 INFO:teuthology.orchestra.run.smithi124.stdout:generic/356 [not run] swapfiles are not supported 2023-10-16T14:18:24.436 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/356 2023-10-16T14:18:24.436 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/356 2023-10-16T14:18:24.437 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:24.438 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:24.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:24.459 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-10-16T14:18:24.678 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:24.681 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:24.682 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:24.683 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:24.683 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:25.229 INFO:teuthology.orchestra.run.smithi124.stdout:generic/357 [not run] swapfiles are not supported 2023-10-16T14:18:25.233 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/357 2023-10-16T14:18:25.233 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/357 2023-10-16T14:18:25.233 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:25.235 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:25.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:25.259 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-10-16T14:18:25.490 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:25.494 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:25.494 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:25.495 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:25.495 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:26.336 INFO:teuthology.orchestra.run.smithi124.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:18:26.391 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/358 2023-10-16T14:18:26.391 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/358 2023-10-16T14:18:26.391 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:26.393 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:26.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:26.424 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-10-16T14:18:26.636 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:26.640 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:26.641 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:26.642 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:26.642 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:27.475 INFO:teuthology.orchestra.run.smithi124.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:18:27.527 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/359 2023-10-16T14:18:27.527 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/359 2023-10-16T14:18:27.527 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:27.529 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:27.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:27.561 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-10-16T14:18:27.780 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:27.785 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:27.786 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:27.786 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:27.786 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:28.175 INFO:teuthology.orchestra.run.smithi124.stdout:generic/360 0s 2023-10-16T14:18:28.179 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/360 2023-10-16T14:18:28.180 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:28.181 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:28.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:28.213 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-10-16T14:18:28.418 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:28.423 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:28.423 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:28.424 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:28.424 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:28.768 INFO:teuthology.orchestra.run.smithi124.stdout:generic/361 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T14:18:28.771 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/361 2023-10-16T14:18:28.772 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/361 2023-10-16T14:18:28.772 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:28.774 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:28.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:28.804 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-10-16T14:18:28.998 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:29.002 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:29.003 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:29.004 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:29.004 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:29.317 INFO:teuthology.orchestra.run.smithi124.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-10-16T14:18:29.321 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/362 2023-10-16T14:18:29.321 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/362 2023-10-16T14:18:29.322 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:29.323 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:29.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:29.351 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-10-16T14:18:29.557 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:29.561 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:29.562 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:29.563 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:29.563 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:29.891 INFO:teuthology.orchestra.run.smithi124.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-10-16T14:18:29.895 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/363 2023-10-16T14:18:29.895 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/363 2023-10-16T14:18:29.895 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:29.897 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:29.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:29.920 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-10-16T14:18:30.141 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:30.145 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:30.146 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:30.146 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:30.147 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:30.492 INFO:teuthology.orchestra.run.smithi124.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-10-16T14:18:30.496 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/364 2023-10-16T14:18:30.496 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/364 2023-10-16T14:18:30.496 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:30.498 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:30.526 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:30.527 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-10-16T14:18:30.728 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:30.732 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:30.733 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:30.733 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:30.734 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:31.054 INFO:teuthology.orchestra.run.smithi124.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-10-16T14:18:31.057 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/365 2023-10-16T14:18:31.058 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/365 2023-10-16T14:18:31.058 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:31.060 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:31.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:31.077 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-10-16T14:18:31.307 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:31.311 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:31.312 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:31.313 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:31.313 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:31.620 INFO:teuthology.orchestra.run.smithi124.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-10-16T14:18:31.624 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/366 2023-10-16T14:18:31.624 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/366 2023-10-16T14:18:31.624 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:31.626 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:31.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:31.646 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-10-16T14:18:31.877 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:31.881 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:31.881 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:31.882 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:31.882 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:32.204 INFO:teuthology.orchestra.run.smithi124.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-10-16T14:18:32.208 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/367 2023-10-16T14:18:32.208 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/367 2023-10-16T14:18:32.208 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:32.210 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:32.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:32.230 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-10-16T14:18:32.440 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:32.444 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:32.445 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:32.445 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:32.446 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:32.751 INFO:teuthology.orchestra.run.smithi124.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-10-16T14:18:32.755 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/368 2023-10-16T14:18:32.755 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/368 2023-10-16T14:18:32.755 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:32.757 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:32.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:32.797 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-10-16T14:18:33.016 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:33.020 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:33.021 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:33.022 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:33.022 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:33.337 INFO:teuthology.orchestra.run.smithi124.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-10-16T14:18:33.341 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/369 2023-10-16T14:18:33.341 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/369 2023-10-16T14:18:33.341 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:33.343 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:33.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:33.368 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-10-16T14:18:33.569 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:33.573 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:33.574 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:33.575 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:33.575 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:33.906 INFO:teuthology.orchestra.run.smithi124.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-10-16T14:18:33.910 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/370 2023-10-16T14:18:33.910 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/370 2023-10-16T14:18:33.910 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:33.912 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:33.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:33.937 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-10-16T14:18:34.156 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:34.161 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:34.161 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:34.162 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:34.162 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:34.502 INFO:teuthology.orchestra.run.smithi124.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T14:18:34.506 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/371 2023-10-16T14:18:34.506 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/371 2023-10-16T14:18:34.506 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:34.508 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:34.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:34.542 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-10-16T14:18:34.758 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:34.761 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:34.762 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:34.763 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:34.763 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:35.615 INFO:teuthology.orchestra.run.smithi124.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:18:35.623 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/372 2023-10-16T14:18:35.623 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/372 2023-10-16T14:18:35.623 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:35.667 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:35.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:35.694 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-10-16T14:18:35.925 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:35.929 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:35.929 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:35.930 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:35.931 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:36.606 INFO:teuthology.orchestra.run.smithi124.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:18:36.610 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/373 2023-10-16T14:18:36.610 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/373 2023-10-16T14:18:36.610 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:36.681 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:36.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:36.928 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-10-16T14:18:37.151 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:37.155 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:37.156 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:37.156 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:37.157 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:37.665 INFO:teuthology.orchestra.run.smithi124.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-10-16T14:18:37.918 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/374 2023-10-16T14:18:37.918 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/374 2023-10-16T14:18:37.918 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:37.962 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:38.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:38.074 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-10-16T14:18:38.279 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:38.282 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:38.283 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:38.284 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:38.284 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:38.702 INFO:teuthology.orchestra.run.smithi124.stdout:generic/375 0s 2023-10-16T14:18:38.706 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/375 2023-10-16T14:18:38.707 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:38.708 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:39.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:39.030 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-10-16T14:18:39.339 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:39.342 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:39.343 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:39.344 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:39.344 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:39.672 INFO:teuthology.orchestra.run.smithi124.stdout:generic/376 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T14:18:39.676 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/376 2023-10-16T14:18:39.677 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/376 2023-10-16T14:18:39.677 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:39.678 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:39.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:39.705 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-10-16T14:18:39.907 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:39.911 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:39.912 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:39.912 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:39.913 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:40.476 INFO:teuthology.orchestra.run.smithi124.stdout:generic/377 0s 2023-10-16T14:18:40.481 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/377 2023-10-16T14:18:40.481 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:40.483 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:40.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:40.492 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-10-16T14:18:40.702 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:40.706 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:40.707 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:40.708 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:40.708 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:41.171 INFO:teuthology.orchestra.run.smithi124.stdout:generic/378 1s 2023-10-16T14:18:41.176 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/378 2023-10-16T14:18:41.176 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:41.178 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:41.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:41.529 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-10-16T14:18:41.796 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:41.800 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:41.801 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:41.802 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:41.802 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:42.134 INFO:teuthology.orchestra.run.smithi124.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-16T14:18:42.138 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/379 2023-10-16T14:18:42.138 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/379 2023-10-16T14:18:42.138 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:42.140 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:42.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:42.163 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-10-16T14:18:42.363 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:42.367 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:42.368 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:42.368 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:42.369 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:42.676 INFO:teuthology.orchestra.run.smithi124.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-16T14:18:42.681 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/380 2023-10-16T14:18:42.681 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/380 2023-10-16T14:18:42.681 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:42.683 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:42.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:42.708 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-10-16T14:18:42.909 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:42.913 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:42.913 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:42.914 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:42.914 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:43.228 INFO:teuthology.orchestra.run.smithi124.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-16T14:18:43.232 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/381 2023-10-16T14:18:43.233 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/381 2023-10-16T14:18:43.233 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:43.234 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:43.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:43.262 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-10-16T14:18:43.465 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:43.469 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:43.470 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:43.470 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:43.471 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:43.782 INFO:teuthology.orchestra.run.smithi124.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-16T14:18:43.785 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/382 2023-10-16T14:18:43.786 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/382 2023-10-16T14:18:43.786 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:43.787 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:43.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:43.809 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-10-16T14:18:44.021 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:44.025 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:44.025 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:44.026 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:44.026 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:44.366 INFO:teuthology.orchestra.run.smithi124.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-16T14:18:44.369 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/383 2023-10-16T14:18:44.370 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/383 2023-10-16T14:18:44.370 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:44.372 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:44.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:44.398 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-10-16T14:18:44.610 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:44.614 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:44.614 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:44.615 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:44.615 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:44.952 INFO:teuthology.orchestra.run.smithi124.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-16T14:18:44.956 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/384 2023-10-16T14:18:44.956 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/384 2023-10-16T14:18:44.956 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:44.958 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:44.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:44.991 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-10-16T14:18:45.197 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:45.201 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:45.201 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:45.202 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:45.203 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:45.549 INFO:teuthology.orchestra.run.smithi124.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-16T14:18:45.553 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/385 2023-10-16T14:18:45.553 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/385 2023-10-16T14:18:45.553 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:45.555 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:45.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:45.576 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-10-16T14:18:45.785 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:45.790 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:45.790 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:45.791 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:45.792 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:46.133 INFO:teuthology.orchestra.run.smithi124.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-16T14:18:46.137 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/386 2023-10-16T14:18:46.138 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/386 2023-10-16T14:18:46.138 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:46.139 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:46.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:46.166 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-10-16T14:18:46.366 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:46.370 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:46.370 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:46.371 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:46.371 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:47.246 INFO:teuthology.orchestra.run.smithi124.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:18:47.289 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/387 2023-10-16T14:18:47.289 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/387 2023-10-16T14:18:47.290 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:47.296 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:47.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:47.324 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-10-16T14:18:47.539 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:47.544 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:47.544 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:47.545 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:47.545 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:47.878 INFO:teuthology.orchestra.run.smithi124.stdout:generic/388 [not run] require 172.21.15.124:6789:/scratch to be local device 2023-10-16T14:18:47.882 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/388 2023-10-16T14:18:47.883 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/388 2023-10-16T14:18:47.883 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:47.884 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:47.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:47.907 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-10-16T14:18:48.127 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:48.131 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:48.132 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:48.132 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:48.133 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:48.453 INFO:teuthology.orchestra.run.smithi124.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-10-16T14:18:48.457 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/389 2023-10-16T14:18:48.457 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/389 2023-10-16T14:18:48.458 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:48.459 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:48.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:48.485 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-10-16T14:18:48.697 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:48.701 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:48.702 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:48.703 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:48.703 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:49.019 INFO:teuthology.orchestra.run.smithi124.stdout:generic/390 [not run] ceph does not support freezing 2023-10-16T14:18:49.023 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:18:49.024 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/390 2023-10-16T14:18:49.024 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/390 2023-10-16T14:18:49.024 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:49.026 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:18:49.027 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:49.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:49.049 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-10-16T14:18:49.290 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:49.295 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:49.295 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:49.296 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:49.296 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:49.621 INFO:teuthology.orchestra.run.smithi124.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T14:18:49.625 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/391 2023-10-16T14:18:49.625 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/391 2023-10-16T14:18:49.626 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:49.627 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:49.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:49.657 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-10-16T14:18:49.854 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:49.858 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:49.858 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:49.859 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:49.859 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:50.328 INFO:teuthology.orchestra.run.smithi124.stdout:generic/392 [not run] ceph does not support shutdown 2023-10-16T14:18:50.363 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/392 2023-10-16T14:18:50.363 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/392 2023-10-16T14:18:50.364 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:50.365 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:50.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:50.389 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-10-16T14:18:50.608 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:50.612 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:50.612 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:50.613 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:50.613 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:51.595 INFO:teuthology.orchestra.run.smithi124.stdout:generic/393 1s 2023-10-16T14:18:51.600 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/393 2023-10-16T14:18:51.600 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:51.602 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:51.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:51.612 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-10-16T14:18:51.827 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:51.831 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:51.832 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:51.833 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:51.833 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:52.182 INFO:teuthology.orchestra.run.smithi124.stdout:generic/394 0s 2023-10-16T14:18:52.187 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/394 2023-10-16T14:18:52.187 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:52.189 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:52.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:52.508 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-10-16T14:18:52.903 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:52.907 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:52.907 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:52.908 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:52.909 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:53.664 INFO:teuthology.orchestra.run.smithi124.stdout:generic/395 [not run] kernel does not support ceph encryption 2023-10-16T14:18:53.690 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/395 2023-10-16T14:18:53.690 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/395 2023-10-16T14:18:53.691 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:53.692 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:53.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:53.720 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-10-16T14:18:54.036 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:54.043 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:54.044 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:54.044 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:54.044 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:54.564 INFO:teuthology.orchestra.run.smithi124.stdout:generic/396 [not run] kernel does not support ceph encryption 2023-10-16T14:18:54.587 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/396 2023-10-16T14:18:54.587 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/396 2023-10-16T14:18:54.587 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:54.589 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:54.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:54.611 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-10-16T14:18:54.813 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:54.817 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:54.818 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:54.819 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:54.819 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:55.366 INFO:teuthology.orchestra.run.smithi124.stdout:generic/397 [not run] kernel does not support ceph encryption 2023-10-16T14:18:55.390 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/397 2023-10-16T14:18:55.390 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/397 2023-10-16T14:18:55.391 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:55.392 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:55.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:55.418 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-10-16T14:18:55.623 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:55.628 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:55.628 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:55.629 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:55.629 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:56.128 INFO:teuthology.orchestra.run.smithi124.stdout:generic/398 [not run] kernel does not support ceph encryption 2023-10-16T14:18:56.150 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/398 2023-10-16T14:18:56.151 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/398 2023-10-16T14:18:56.151 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:56.152 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:56.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:56.175 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-10-16T14:18:56.375 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:56.379 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:56.379 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:56.380 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:56.380 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:56.935 INFO:teuthology.orchestra.run.smithi124.stdout:generic/399 [not run] kernel does not support ceph encryption 2023-10-16T14:18:56.960 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/399 2023-10-16T14:18:56.960 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/399 2023-10-16T14:18:56.961 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:56.962 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:56.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:56.988 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-10-16T14:18:57.204 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:57.208 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:57.209 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:57.210 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:57.210 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:57.531 INFO:teuthology.orchestra.run.smithi124.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-16T14:18:57.535 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/400 2023-10-16T14:18:57.536 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/400 2023-10-16T14:18:57.536 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:57.537 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:57.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:57.570 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-10-16T14:18:57.785 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:57.789 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:57.789 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:57.790 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:57.790 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:58.731 INFO:teuthology.orchestra.run.smithi124.stdout:generic/401 1s 2023-10-16T14:18:58.762 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/401 2023-10-16T14:18:58.762 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:58.764 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:58.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:58.774 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-10-16T14:18:58.998 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:59.002 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:59.003 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:59.004 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:59.004 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:59.510 INFO:teuthology.orchestra.run.smithi124.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-10-16T14:18:59.542 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/402 2023-10-16T14:18:59.542 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/402 2023-10-16T14:18:59.542 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:18:59.544 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:18:59.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:18:59.577 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-10-16T14:18:59.809 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:18:59.813 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:18:59.813 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:18:59.814 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:18:59.814 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:00.513 INFO:teuthology.orchestra.run.smithi124.stdout:generic/403 0s 2023-10-16T14:19:00.517 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/403 2023-10-16T14:19:00.518 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:19:00.520 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:00.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:19:00.528 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-10-16T14:19:00.731 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:19:00.735 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:19:00.736 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:19:00.736 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:19:00.737 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:01.085 INFO:teuthology.orchestra.run.smithi124.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T14:19:01.089 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/404 2023-10-16T14:19:01.089 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/404 2023-10-16T14:19:01.089 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:19:01.091 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:01.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:19:01.118 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-10-16T14:19:01.330 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:19:01.334 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:19:01.334 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:19:01.335 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:19:01.335 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:01.696 INFO:teuthology.orchestra.run.smithi124.stdout:generic/405 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T14:19:01.700 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/405 2023-10-16T14:19:01.700 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/405 2023-10-16T14:19:01.701 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:19:01.702 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:01.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:19:01.724 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-10-16T14:19:01.928 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:19:01.931 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:19:01.932 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:19:01.933 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:19:01.933 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:03.709 INFO:teuthology.orchestra.run.smithi124.stdout:generic/406 1s 2023-10-16T14:19:03.713 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/406 2023-10-16T14:19:03.714 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:19:03.716 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:03.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:19:03.724 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-10-16T14:19:03.956 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:19:03.960 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:19:03.961 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:19:03.961 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:19:03.962 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:04.336 INFO:teuthology.orchestra.run.smithi124.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:19:04.340 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/407 2023-10-16T14:19:04.340 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/407 2023-10-16T14:19:04.340 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:19:04.342 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:04.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:19:04.564 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-10-16T14:19:04.992 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:19:04.996 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:19:04.997 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:19:04.997 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:19:04.997 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:05.371 INFO:teuthology.orchestra.run.smithi124.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-10-16T14:19:05.375 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/408 2023-10-16T14:19:05.375 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/408 2023-10-16T14:19:05.375 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:19:05.377 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:05.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:19:05.749 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-10-16T14:19:05.995 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:19:05.999 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:19:05.999 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:19:06.000 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:19:06.001 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:06.313 INFO:teuthology.orchestra.run.smithi124.stdout:generic/409 [not run] require 172.21.15.124:6789:/scratch to be local device 2023-10-16T14:19:06.317 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/409 2023-10-16T14:19:06.317 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/409 2023-10-16T14:19:06.317 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:19:06.319 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:06.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:19:06.338 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-10-16T14:19:06.551 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:19:06.555 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:19:06.556 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:19:06.557 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:19:06.557 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:06.896 INFO:teuthology.orchestra.run.smithi124.stdout:generic/410 [not run] require 172.21.15.124:6789:/scratch to be local device 2023-10-16T14:19:06.900 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/410 2023-10-16T14:19:06.901 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/410 2023-10-16T14:19:06.901 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:19:06.902 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:06.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:19:06.928 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-10-16T14:19:07.129 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:19:07.133 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:19:07.134 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:19:07.134 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:19:07.135 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:07.446 INFO:teuthology.orchestra.run.smithi124.stdout:generic/411 [not run] require 172.21.15.124:6789:/scratch to be local device 2023-10-16T14:19:07.450 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/411 2023-10-16T14:19:07.450 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/411 2023-10-16T14:19:07.451 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:19:07.452 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:07.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:19:07.479 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-10-16T14:19:07.696 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:19:07.700 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:19:07.701 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:19:07.702 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:19:07.702 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:08.605 INFO:teuthology.orchestra.run.smithi124.stdout:generic/412 1s 2023-10-16T14:19:08.645 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/412 2023-10-16T14:19:08.646 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:19:08.648 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:08.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:19:08.657 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-10-16T14:19:08.874 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:19:08.878 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:19:08.879 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:19:08.879 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:19:08.880 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:09.315 INFO:teuthology.orchestra.run.smithi124.stdout:generic/413 [not run] mount 172.21.15.124:6789:/scratch with dax failed 2023-10-16T14:19:09.320 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/413 2023-10-16T14:19:09.321 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/413 2023-10-16T14:19:09.321 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:19:09.322 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:09.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:19:09.352 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-10-16T14:19:09.557 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:19:09.561 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:19:09.561 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:19:09.562 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:19:09.562 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:10.443 INFO:teuthology.orchestra.run.smithi124.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:19:10.450 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/414 2023-10-16T14:19:10.450 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/414 2023-10-16T14:19:10.450 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:19:10.455 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:10.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:19:10.482 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-10-16T14:19:10.691 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:19:10.699 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:19:10.700 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:19:10.700 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:19:10.700 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:11.554 INFO:teuthology.orchestra.run.smithi124.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:19:11.579 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/415 2023-10-16T14:19:11.580 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/415 2023-10-16T14:19:11.580 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:19:11.597 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:11.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:19:11.658 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-10-16T14:19:11.866 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:19:11.870 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:19:11.871 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:19:11.872 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:19:11.872 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:12.186 INFO:teuthology.orchestra.run.smithi124.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-16T14:19:12.190 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/416 2023-10-16T14:19:12.190 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/416 2023-10-16T14:19:12.191 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:19:12.192 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:12.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:19:12.228 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-10-16T14:19:12.444 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:19:12.449 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:19:12.449 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:19:12.451 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:19:12.451 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:12.950 INFO:teuthology.orchestra.run.smithi124.stdout:generic/417 [not run] ceph does not support shutdown 2023-10-16T14:19:12.973 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/417 2023-10-16T14:19:12.973 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/417 2023-10-16T14:19:12.974 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:19:12.978 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:12.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:19:12.997 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-10-16T14:19:13.228 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:19:13.232 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:19:13.233 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:19:13.234 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:19:13.234 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:13.594 INFO:teuthology.orchestra.run.smithi124.stdout:generic/418 [not run] require 172.21.15.124:6789:/test to be valid block disk 2023-10-16T14:19:13.598 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/418 2023-10-16T14:19:13.599 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/418 2023-10-16T14:19:13.599 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:19:13.601 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:13.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:19:13.633 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-10-16T14:19:13.842 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:19:13.846 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:19:13.846 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:19:13.847 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:19:13.847 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:14.386 INFO:teuthology.orchestra.run.smithi124.stdout:generic/419 [not run] kernel does not support ceph encryption 2023-10-16T14:19:14.407 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/419 2023-10-16T14:19:14.408 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/419 2023-10-16T14:19:14.408 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:19:14.409 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:14.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:19:14.430 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-10-16T14:19:14.664 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:19:14.668 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:19:14.669 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:19:14.669 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:19:14.670 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:15.122 INFO:teuthology.orchestra.run.smithi124.stdout:generic/420 1s 2023-10-16T14:19:15.126 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/420 2023-10-16T14:19:15.127 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:19:15.128 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:15.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:19:15.493 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-10-16T14:19:15.725 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:19:15.729 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:19:15.730 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:19:15.730 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:19:15.731 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:16.265 INFO:teuthology.orchestra.run.smithi124.stdout:generic/421 [not run] kernel does not support ceph encryption 2023-10-16T14:19:16.286 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/421 2023-10-16T14:19:16.287 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/421 2023-10-16T14:19:16.287 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:19:16.288 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:16.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:19:16.314 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-10-16T14:19:16.521 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:19:16.525 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:19:16.525 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:19:16.526 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:19:16.526 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:16.887 INFO:teuthology.orchestra.run.smithi124.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-10-16T14:19:16.891 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/422 2023-10-16T14:19:16.892 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/422 2023-10-16T14:19:16.892 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:19:16.894 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:16.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:19:16.924 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-10-16T14:19:17.123 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:19:17.127 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:19:17.127 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:19:17.128 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:19:17.128 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:17.534 INFO:teuthology.orchestra.run.smithi124.stdout:generic/423 0s 2023-10-16T14:19:17.538 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/423 2023-10-16T14:19:17.539 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:19:17.541 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:17.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:19:17.866 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-10-16T14:19:18.141 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:19:18.145 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:19:18.145 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:19:18.146 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:19:18.146 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:18.488 INFO:teuthology.orchestra.run.smithi124.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-10-16T14:19:18.492 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/424 2023-10-16T14:19:18.492 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/424 2023-10-16T14:19:18.493 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:19:18.494 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:18.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:19:18.526 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-10-16T14:19:18.746 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:19:18.751 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:19:18.751 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:19:18.752 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:19:18.752 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:19.111 INFO:teuthology.orchestra.run.smithi124.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-10-16T14:19:19.115 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/425 2023-10-16T14:19:19.115 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/425 2023-10-16T14:19:19.115 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:19:19.117 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:19.152 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:19:19.182 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:19:19.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:19:19.470 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-10-16T14:19:19.718 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:19:19.722 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:19:19.723 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:19:19.724 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:19:19.724 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:19:49.583 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:19:49.686 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:20:00.342 INFO:teuthology.orchestra.run.smithi124.stdout:generic/426 41s 2023-10-16T14:20:00.459 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/426 2023-10-16T14:20:00.459 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:20:00.476 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:20:00.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:20:00.906 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-10-16T14:20:01.885 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:20:01.889 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:20:01.889 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:20:01.890 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:20:01.890 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:20:02.357 INFO:teuthology.orchestra.run.smithi124.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-16T14:20:02.360 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/427 2023-10-16T14:20:02.361 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/427 2023-10-16T14:20:02.361 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:20:02.363 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:20:02.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:20:02.394 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-10-16T14:20:02.595 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:20:02.599 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:20:02.599 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:20:02.600 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:20:02.600 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:20:02.958 INFO:teuthology.orchestra.run.smithi124.stdout:generic/428 0s 2023-10-16T14:20:02.963 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/428 2023-10-16T14:20:02.963 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:20:02.965 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:20:02.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:20:02.994 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-10-16T14:20:03.195 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:20:03.199 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:20:03.200 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:20:03.200 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:20:03.201 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:20:03.733 INFO:teuthology.orchestra.run.smithi124.stdout:generic/429 [not run] kernel does not support ceph encryption 2023-10-16T14:20:03.749 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/429 2023-10-16T14:20:03.749 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/429 2023-10-16T14:20:03.750 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:20:03.751 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:20:03.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:20:03.780 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-10-16T14:20:03.982 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:20:03.986 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:20:03.987 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:20:03.988 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:20:03.988 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:20:04.453 INFO:teuthology.orchestra.run.smithi124.stdout:generic/430 0s 2023-10-16T14:20:04.457 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/430 2023-10-16T14:20:04.458 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:20:04.459 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:20:04.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:20:04.756 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-10-16T14:20:05.057 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:20:05.061 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:20:05.062 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:20:05.062 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:20:05.063 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:20:05.487 INFO:teuthology.orchestra.run.smithi124.stdout:generic/431 0s 2023-10-16T14:20:05.491 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/431 2023-10-16T14:20:05.492 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:20:05.494 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:20:05.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:20:05.851 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-10-16T14:20:06.096 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:20:06.100 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:20:06.100 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:20:06.101 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:20:06.101 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:20:06.529 INFO:teuthology.orchestra.run.smithi124.stdout:generic/432 0s 2023-10-16T14:20:06.534 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/432 2023-10-16T14:20:06.535 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:20:06.536 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:20:06.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:20:06.855 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-10-16T14:20:07.152 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:20:07.156 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:20:07.156 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:20:07.157 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:20:07.157 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:20:07.545 INFO:teuthology.orchestra.run.smithi124.stdout:generic/433 0s 2023-10-16T14:20:07.550 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/433 2023-10-16T14:20:07.550 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:20:07.552 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:20:07.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:20:07.848 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-10-16T14:20:08.144 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:20:08.148 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:20:08.148 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:20:08.149 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:20:08.150 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:20:08.573 INFO:teuthology.orchestra.run.smithi124.stdout:generic/434 0s 2023-10-16T14:20:08.578 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/434 2023-10-16T14:20:08.578 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:20:08.580 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:20:08.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:20:08.888 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-10-16T14:20:09.181 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:20:09.185 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:20:09.186 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:20:09.186 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:20:09.187 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:20:09.704 INFO:teuthology.orchestra.run.smithi124.stdout:generic/435 [not run] kernel does not support ceph encryption 2023-10-16T14:20:09.719 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/435 2023-10-16T14:20:09.719 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/435 2023-10-16T14:20:09.719 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:20:09.721 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:20:09.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:20:09.746 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-10-16T14:20:09.959 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:20:09.963 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:20:09.963 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:20:09.964 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:20:09.964 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:20:10.627 INFO:teuthology.orchestra.run.smithi124.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T14:20:10.631 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/436 2023-10-16T14:20:10.632 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/436 2023-10-16T14:20:10.632 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:20:10.633 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:20:10.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:20:11.000 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-10-16T14:20:11.224 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:20:11.228 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:20:11.229 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:20:11.229 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:20:11.230 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:20:12.191 INFO:teuthology.orchestra.run.smithi124.stdout:generic/437 1s 2023-10-16T14:20:12.195 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/437 2023-10-16T14:20:12.196 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:20:12.197 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:20:12.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:20:12.236 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-10-16T14:20:12.440 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:20:12.444 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:20:12.444 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:20:12.445 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:20:12.445 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:20:20.332 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:20:20.335 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:20:50.497 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:20:50.500 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:21:16.173 INFO:teuthology.orchestra.run.smithi124.stdout:generic/438 64s 2023-10-16T14:21:16.177 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/438 2023-10-16T14:21:16.178 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:21:16.180 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:16.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:21:16.214 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-10-16T14:21:16.434 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:21:16.438 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:21:16.439 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:21:16.439 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:21:16.440 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:17.593 INFO:teuthology.orchestra.run.smithi124.stdout:generic/439 1s 2023-10-16T14:21:17.598 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/439 2023-10-16T14:21:17.599 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:21:17.600 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:17.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:21:17.635 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-10-16T14:21:17.876 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:21:17.880 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:21:17.881 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:21:17.882 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:21:17.882 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:18.426 INFO:teuthology.orchestra.run.smithi124.stdout:generic/440 [not run] kernel does not support ceph encryption 2023-10-16T14:21:18.454 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/440 2023-10-16T14:21:18.454 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/440 2023-10-16T14:21:18.454 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:21:18.456 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:18.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:21:18.487 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-10-16T14:21:18.692 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:21:18.696 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:21:18.697 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:21:18.697 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:21:18.698 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:19.129 INFO:teuthology.orchestra.run.smithi124.stdout:generic/441 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T14:21:19.133 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/441 2023-10-16T14:21:19.133 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/441 2023-10-16T14:21:19.133 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:21:19.135 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:19.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:21:19.156 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-10-16T14:21:19.394 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:21:19.398 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:21:19.399 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:21:19.399 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:21:19.400 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:19.734 INFO:teuthology.orchestra.run.smithi124.stdout:generic/442 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T14:21:19.739 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/442 2023-10-16T14:21:19.739 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/442 2023-10-16T14:21:19.739 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:21:19.740 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:19.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:21:19.769 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-10-16T14:21:19.998 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:21:20.003 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:21:20.003 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:21:20.004 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:21:20.004 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:20.386 INFO:teuthology.orchestra.run.smithi124.stdout:generic/443 0s 2023-10-16T14:21:20.390 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/443 2023-10-16T14:21:20.391 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:21:20.393 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:20.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:21:20.422 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-10-16T14:21:20.663 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:21:20.668 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:21:20.668 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:21:20.669 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:21:20.669 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:20.861 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:21:20.863 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:21:21.099 INFO:teuthology.orchestra.run.smithi124.stdout:generic/444 1s 2023-10-16T14:21:21.104 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/444 2023-10-16T14:21:21.104 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:21:21.106 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:21.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:21:21.150 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-10-16T14:21:21.353 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:21:21.357 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:21:21.357 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:21:21.358 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:21:21.358 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:22.120 INFO:teuthology.orchestra.run.smithi124.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T14:21:22.124 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/445 2023-10-16T14:21:22.125 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/445 2023-10-16T14:21:22.125 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:21:22.127 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:22.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:21:22.488 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-10-16T14:21:22.702 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:21:22.706 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:21:22.707 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:21:22.707 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:21:22.708 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:41.699 INFO:teuthology.orchestra.run.smithi124.stdout:generic/446 19s 2023-10-16T14:21:41.705 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/446 2023-10-16T14:21:41.706 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:21:41.708 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:41.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:21:41.717 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-10-16T14:21:41.918 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:21:41.922 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:21:41.923 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:21:41.924 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:21:41.924 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:42.795 INFO:teuthology.orchestra.run.smithi124.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:21:42.842 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/447 2023-10-16T14:21:42.843 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/447 2023-10-16T14:21:42.843 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:21:42.846 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:42.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:21:42.916 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-10-16T14:21:43.126 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:21:43.130 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:21:43.130 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:21:43.131 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:21:43.131 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:44.330 INFO:teuthology.orchestra.run.smithi124.stdout:generic/448 1s 2023-10-16T14:21:44.335 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/448 2023-10-16T14:21:44.335 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:21:44.337 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:44.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:21:44.676 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-10-16T14:21:44.958 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:21:44.962 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:21:44.962 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:21:44.963 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:21:44.963 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:45.352 INFO:teuthology.orchestra.run.smithi124.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-16T14:21:45.356 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/449 2023-10-16T14:21:45.357 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/449 2023-10-16T14:21:45.357 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:21:45.358 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:45.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:21:45.701 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-10-16T14:21:45.938 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:21:45.942 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:21:45.942 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:21:45.943 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:21:45.943 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:46.651 INFO:teuthology.orchestra.run.smithi124.stdout:generic/450 0s 2023-10-16T14:21:46.656 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/450 2023-10-16T14:21:46.656 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:21:46.658 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:46.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:21:46.991 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-10-16T14:21:47.244 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:21:47.248 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:21:47.248 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:21:47.249 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:21:47.249 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:21:50.972 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:21:50.975 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:22:17.791 INFO:teuthology.orchestra.run.smithi124.stdout:generic/451 30s 2023-10-16T14:22:17.796 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/451 2023-10-16T14:22:17.796 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:22:17.798 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:18.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:22:18.010 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-10-16T14:22:18.368 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:22:18.372 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:22:18.372 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:22:18.373 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:22:18.373 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:18.963 INFO:teuthology.orchestra.run.smithi124.stdout:generic/452 0s 2023-10-16T14:22:18.968 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/452 2023-10-16T14:22:18.968 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:22:18.970 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:18.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:22:18.979 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-10-16T14:22:19.200 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:22:19.204 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:22:19.204 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:22:19.205 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:22:19.205 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:19.538 INFO:teuthology.orchestra.run.smithi124.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-10-16T14:22:19.542 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/453 2023-10-16T14:22:19.543 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/453 2023-10-16T14:22:19.543 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:22:19.544 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:19.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:22:19.575 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-10-16T14:22:19.781 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:22:19.785 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:22:19.785 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:22:19.787 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:22:19.787 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:20.161 INFO:teuthology.orchestra.run.smithi124.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-10-16T14:22:20.165 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/454 2023-10-16T14:22:20.165 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/454 2023-10-16T14:22:20.165 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:22:20.167 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:20.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:22:20.207 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-10-16T14:22:20.410 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:22:20.414 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:22:20.415 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:22:20.416 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:22:20.416 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:20.829 INFO:teuthology.orchestra.run.smithi124.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2023-10-16T14:22:20.833 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/455 2023-10-16T14:22:20.833 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/455 2023-10-16T14:22:20.834 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:22:20.835 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:20.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:22:20.874 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-10-16T14:22:21.079 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:22:21.086 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:22:21.086 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:22:21.086 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:22:21.086 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:21.087 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:22:21.089 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:22:21.439 INFO:teuthology.orchestra.run.smithi124.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T14:22:21.443 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/456 2023-10-16T14:22:21.443 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/456 2023-10-16T14:22:21.444 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:22:21.445 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:21.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:22:21.484 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-10-16T14:22:21.695 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:22:21.699 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:22:21.700 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:22:21.701 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:22:21.701 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:22.625 INFO:teuthology.orchestra.run.smithi124.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:22:22.629 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/457 2023-10-16T14:22:22.630 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/457 2023-10-16T14:22:22.630 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:22:22.632 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:22.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:22:22.682 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-10-16T14:22:22.906 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:22:22.910 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:22:22.911 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:22:22.911 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:22:22.912 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:23.749 INFO:teuthology.orchestra.run.smithi124.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T14:22:23.847 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/458 2023-10-16T14:22:23.847 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/458 2023-10-16T14:22:23.848 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:22:23.850 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:23.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:22:23.885 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-10-16T14:22:24.121 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:22:24.124 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:22:24.125 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:22:24.126 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:22:24.126 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:24.662 INFO:teuthology.orchestra.run.smithi124.stdout:generic/459 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T14:22:24.666 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/459 2023-10-16T14:22:24.666 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/459 2023-10-16T14:22:24.666 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:22:24.668 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:24.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:22:24.702 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-10-16T14:22:24.913 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:22:24.917 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:22:24.917 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:22:24.918 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:22:24.918 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:27.024 INFO:teuthology.orchestra.run.smithi124.stdout:generic/460 1s 2023-10-16T14:22:27.029 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/460 2023-10-16T14:22:27.030 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:22:27.031 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:27.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:22:27.040 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-10-16T14:22:27.244 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:22:27.248 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:22:27.248 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:22:27.249 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:22:27.250 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:27.770 INFO:teuthology.orchestra.run.smithi124.stdout:generic/461 [not run] ceph does not support shutdown 2023-10-16T14:22:27.774 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/461 2023-10-16T14:22:27.774 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/461 2023-10-16T14:22:27.775 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:22:27.776 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:27.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:22:27.796 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-10-16T14:22:28.087 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:22:28.091 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:22:28.091 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:22:28.093 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:22:28.093 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:28.652 INFO:teuthology.orchestra.run.smithi124.stdout:generic/462 [not run] mount 172.21.15.124:6789:/scratch with dax failed 2023-10-16T14:22:28.656 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/462 2023-10-16T14:22:28.656 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/462 2023-10-16T14:22:28.656 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:22:28.658 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:28.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:22:28.689 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-10-16T14:22:28.892 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:22:28.896 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:22:28.896 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:22:28.897 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:22:28.897 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:29.273 INFO:teuthology.orchestra.run.smithi124.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-10-16T14:22:29.277 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/463 2023-10-16T14:22:29.277 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/463 2023-10-16T14:22:29.277 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:22:29.279 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:29.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:22:29.582 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-10-16T14:22:29.896 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:22:29.900 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:22:29.901 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:22:29.902 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:22:29.902 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:22:51.233 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:22:51.237 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:22:51.354 INFO:tasks.ceph.mds.b.smithi192.stderr:2023-10-16T14:22:51.351+0000 7f536d166700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 119936) UID: 0 2023-10-16T14:22:51.355 INFO:tasks.ceph.mds.d.smithi192.stderr:2023-10-16T14:22:51.352+0000 7f41d2517700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 119936) UID: 0 2023-10-16T14:22:51.548 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T14:22:51.543+0000 7f3e3026f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 536885) UID: 0 2023-10-16T14:22:51.553 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T14:22:51.549+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 536885) UID: 0 2023-10-16T14:22:51.553 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T14:22:51.548+0000 7f18f4d1b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 536885) UID: 0 2023-10-16T14:22:51.555 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T14:22:51.548+0000 7f9480ec4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 536885) UID: 0 2023-10-16T14:23:27.041 INFO:teuthology.orchestra.run.smithi124.stdout:generic/464 57s 2023-10-16T14:23:27.046 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/464 2023-10-16T14:23:27.046 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:23:27.048 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:23:27.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:23:27.059 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-10-16T14:23:27.313 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:23:27.317 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:23:27.317 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:23:27.318 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:23:27.318 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:23:32.249 INFO:teuthology.orchestra.run.smithi124.stdout:generic/465 5s 2023-10-16T14:23:32.259 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/465 2023-10-16T14:23:32.259 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:23:32.261 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:23:32.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:23:32.270 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-10-16T14:23:32.538 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:23:32.542 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:23:32.543 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:23:32.544 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:23:32.544 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:23:32.929 INFO:teuthology.orchestra.run.smithi124.stdout:generic/466 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T14:23:32.933 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/466 2023-10-16T14:23:32.933 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/466 2023-10-16T14:23:32.933 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:23:32.935 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:23:32.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:23:32.966 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-10-16T14:23:33.176 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:23:33.180 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:23:33.180 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:23:33.181 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:23:33.181 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:24:34.503 INFO:teuthology.orchestra.run.smithi124.stdout:generic/467 61s 2023-10-16T14:24:34.948 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/467 2023-10-16T14:24:34.949 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:24:34.969 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:24:35.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:24:35.495 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-10-16T14:24:39.407 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:24:39.411 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:24:39.412 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:24:39.412 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:24:39.413 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:24:40.223 INFO:teuthology.orchestra.run.smithi124.stdout:generic/468 [not run] ceph does not support shutdown 2023-10-16T14:24:40.239 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/468 2023-10-16T14:24:40.240 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/468 2023-10-16T14:24:40.240 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:24:40.242 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:24:40.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:24:40.267 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-10-16T14:24:40.491 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:24:40.495 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:24:40.495 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:24:40.496 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:24:40.496 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:24:40.912 INFO:teuthology.orchestra.run.smithi124.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-10-16T14:24:40.916 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/469 2023-10-16T14:24:40.916 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/469 2023-10-16T14:24:40.916 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:24:40.918 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:24:40.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:24:40.953 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-10-16T14:24:41.170 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:24:41.174 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:24:41.175 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:24:41.176 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:24:41.176 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:24:41.726 INFO:teuthology.orchestra.run.smithi124.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-10-16T14:24:41.730 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/470 2023-10-16T14:24:41.730 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/470 2023-10-16T14:24:41.730 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:24:41.732 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:24:41.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:24:41.763 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-10-16T14:24:41.978 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:24:41.981 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:24:41.982 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:24:41.983 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:24:41.983 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:25:27.850 INFO:teuthology.orchestra.run.smithi124.stdout:generic/471 45s 2023-10-16T14:25:27.862 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/471 2023-10-16T14:25:27.862 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:25:27.865 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:25:28.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:25:28.278 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-10-16T14:25:28.808 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:25:28.815 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:25:28.816 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:25:28.821 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:25:28.821 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:25:29.663 INFO:teuthology.orchestra.run.smithi124.stdout:generic/472 [not run] swapfiles are not supported 2023-10-16T14:25:29.667 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/472 2023-10-16T14:25:29.667 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/472 2023-10-16T14:25:29.667 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:25:29.669 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:25:29.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:25:29.698 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-10-16T14:25:29.934 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:25:29.937 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:25:29.938 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:25:29.939 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:25:29.939 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:25:30.340 INFO:teuthology.orchestra.run.smithi124.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T14:25:30.344 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/473 2023-10-16T14:25:30.345 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/473 2023-10-16T14:25:30.345 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:25:30.347 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:25:30.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:25:30.385 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-10-16T14:25:30.605 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:25:30.609 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:25:30.610 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:25:30.611 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:25:30.611 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:25:31.139 INFO:teuthology.orchestra.run.smithi124.stdout:generic/474 [not run] ceph does not support shutdown 2023-10-16T14:25:31.158 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/474 2023-10-16T14:25:31.158 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/474 2023-10-16T14:25:31.159 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:25:31.160 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:25:31.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:25:31.189 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-10-16T14:25:31.408 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:25:31.412 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:25:31.412 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:25:31.413 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:25:31.414 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:25:31.794 INFO:teuthology.orchestra.run.smithi124.stdout:generic/475 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T14:25:31.798 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/475 2023-10-16T14:25:31.798 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/475 2023-10-16T14:25:31.798 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T14:25:31.800 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:25:31.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:25:31.829 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-10-16T14:25:32.034 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T14:25:32.038 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T14:25:32.039 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T14:25:32.040 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T14:25:32.040 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T14:25:48.349 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:25:48.437 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:26:18.901 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:26:18.913 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:26:49.028 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:26:49.031 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:27:19.344 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:27:19.347 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:27:49.433 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:27:49.439 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:28:20.258 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:28:20.261 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:28:50.869 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:28:50.885 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:28:51.054 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T14:28:51.051+0000 7f18f4d1b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 628037) UID: 0 2023-10-16T14:28:51.055 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T14:28:51.051+0000 7f9480ec4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 628037) UID: 0 2023-10-16T14:28:51.055 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T14:28:51.050+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 628037) UID: 0 2023-10-16T14:28:51.059 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T14:28:51.051+0000 7f3e3026f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 628037) UID: 0 2023-10-16T14:28:51.134 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T14:28:51.130+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120486) UID: 0 2023-10-16T14:28:51.134 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T14:28:51.130+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120486) UID: 0 2023-10-16T14:28:51.135 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T14:28:51.130+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120486) UID: 0 2023-10-16T14:28:51.142 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T14:28:51.133+0000 7f95afc78700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120486) UID: 0 2023-10-16T14:33:28.504 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:33:28.526 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:33:59.068 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:33:59.072 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:34:29.359 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:34:29.364 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:34:59.563 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:34:59.567 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:35:29.687 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:35:29.696 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:35:59.862 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:35:59.966 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:36:30.225 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:36:30.231 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:37:00.375 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:37:00.379 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:37:30.693 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:37:30.705 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:37:30.910 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T14:37:30.907+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120882) UID: 0 2023-10-16T14:37:30.913 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T14:37:30.910+0000 7f95afc78700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120882) UID: 0 2023-10-16T14:37:30.913 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T14:37:30.910+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120882) UID: 0 2023-10-16T14:37:30.915 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T14:37:30.912+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120882) UID: 0 2023-10-16T14:41:34.845 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:41:34.923 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:41:35.179 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T14:41:35.175+0000 7f9480ec4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 628534) UID: 0 2023-10-16T14:41:35.179 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T14:41:35.175+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 628534) UID: 0 2023-10-16T14:41:35.185 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T14:41:35.181+0000 7f18f4d1b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 628534) UID: 0 2023-10-16T14:41:35.189 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T14:41:35.181+0000 7f3e3026f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 628534) UID: 0 2023-10-16T14:41:35.567 INFO:tasks.ceph.mds.d.smithi192.stderr:2023-10-16T14:41:35.564+0000 7f41d2517700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 120955) UID: 0 2023-10-16T14:41:35.570 INFO:tasks.ceph.mds.b.smithi192.stderr:2023-10-16T14:41:35.564+0000 7f536d166700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 120955) UID: 0 2023-10-16T14:46:20.831 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T14:46:20.828+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121024) UID: 0 2023-10-16T14:46:20.854 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T14:46:20.828+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121024) UID: 0 2023-10-16T14:46:20.855 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T14:46:20.828+0000 7f95afc78700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121024) UID: 0 2023-10-16T14:46:20.855 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T14:46:20.828+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121024) UID: 0 2023-10-16T14:51:50.555 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:51:50.592 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:51:51.107 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T14:51:51.105+0000 7f18f4d1b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 628917) UID: 0 2023-10-16T14:51:51.108 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T14:51:51.105+0000 7f9480ec4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 628917) UID: 0 2023-10-16T14:51:51.108 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T14:51:51.105+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 628917) UID: 0 2023-10-16T14:51:51.112 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T14:51:51.110+0000 7f3e3026f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 628917) UID: 0 2023-10-16T14:51:51.329 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T14:51:51.326+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121101) UID: 0 2023-10-16T14:51:51.332 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T14:51:51.329+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121101) UID: 0 2023-10-16T14:51:51.332 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T14:51:51.329+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121101) UID: 0 2023-10-16T14:51:51.338 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T14:51:51.335+0000 7f95afc78700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121101) UID: 0 2023-10-16T14:59:36.585 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:59:36.601 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:59:36.712 INFO:tasks.ceph.mds.b.smithi192.stderr:2023-10-16T14:59:36.710+0000 7f536d166700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 121228) UID: 0 2023-10-16T14:59:36.714 INFO:tasks.ceph.mds.d.smithi192.stderr:2023-10-16T14:59:36.708+0000 7f41d2517700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 121228) UID: 0 2023-10-16T14:59:37.290 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T14:59:37.287+0000 7f3e3026f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 629020) UID: 0 2023-10-16T14:59:37.291 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T14:59:37.288+0000 7f9480ec4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 629020) UID: 0 2023-10-16T14:59:37.291 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T14:59:37.288+0000 7f18f4d1b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 629020) UID: 0 2023-10-16T14:59:37.292 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T14:59:37.288+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 629020) UID: 0 2023-10-16T15:04:45.632 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T15:04:45.629+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121297) UID: 0 2023-10-16T15:04:45.633 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T15:04:45.629+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121297) UID: 0 2023-10-16T15:04:45.633 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T15:04:45.630+0000 7f95afc78700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121297) UID: 0 2023-10-16T15:04:45.634 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T15:04:45.629+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121297) UID: 0 2023-10-16T15:10:38.376 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:10:38.379 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:10:39.050 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T15:10:39.048+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121380) UID: 0 2023-10-16T15:10:39.056 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T15:10:39.054+0000 7f95afc78700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121380) UID: 0 2023-10-16T15:10:39.063 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T15:10:39.054+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121380) UID: 0 2023-10-16T15:10:39.063 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T15:10:39.049+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121380) UID: 0 2023-10-16T15:15:23.235 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:15:23.238 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:15:23.280 INFO:tasks.ceph.mds.d.smithi192.stderr:2023-10-16T15:15:23.278+0000 7f41d2517700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 121461) UID: 0 2023-10-16T15:15:23.281 INFO:tasks.ceph.mds.b.smithi192.stderr:2023-10-16T15:15:23.278+0000 7f536d166700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 121461) UID: 0 2023-10-16T15:20:26.211 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T15:20:26.192+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121551) UID: 0 2023-10-16T15:20:26.212 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T15:20:26.196+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121551) UID: 0 2023-10-16T15:20:26.212 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T15:20:26.196+0000 7f95afc78700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121551) UID: 0 2023-10-16T15:20:26.216 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T15:20:26.209+0000 7f5b62088700 -1 Fail to open '/proc/121551/cmdline' error = (2) No such file or directory 2023-10-16T15:20:26.216 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T15:20:26.209+0000 7f5b62088700 -1 received signal: Hangup from (PID: 121551) UID: 0 2023-10-16T15:24:38.518 INFO:teuthology.orchestra.run.smithi124.stdout:generic/476 3546s 2023-10-16T15:24:38.537 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/476 2023-10-16T15:24:38.538 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:24:38.540 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:24:38.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:24:38.553 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-10-16T15:24:53.981 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:24:53.986 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:24:53.986 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:24:53.987 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:24:53.987 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:26:08.018 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:26:08.022 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:26:08.194 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T15:26:08.192+0000 7f18f4d1b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 629707) UID: 0 2023-10-16T15:26:08.196 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T15:26:08.194+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 629707) UID: 0 2023-10-16T15:26:08.196 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T15:26:08.195+0000 7f9480ec4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 629707) UID: 0 2023-10-16T15:26:08.197 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T15:26:08.192+0000 7f3e3026f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 629707) UID: 0 2023-10-16T15:26:08.207 INFO:tasks.ceph.mds.d.smithi192.stderr:2023-10-16T15:26:08.205+0000 7f41d2517700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 121630) UID: 0 2023-10-16T15:26:08.207 INFO:tasks.ceph.mds.b.smithi192.stderr:2023-10-16T15:26:08.205+0000 7f536d166700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 121630) UID: 0 2023-10-16T15:35:16.203 INFO:teuthology.orchestra.run.smithi124.stdout:generic/477 33s 2023-10-16T15:35:16.287 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/477 2023-10-16T15:35:16.288 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:16.294 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:16.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:16.417 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-10-16T15:35:17.578 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:17.583 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:17.585 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:17.586 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:17.586 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:28.807 INFO:teuthology.orchestra.run.smithi124.stdout:generic/478 11s 2023-10-16T15:35:28.813 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/478 2023-10-16T15:35:28.813 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:28.816 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:28.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:28.860 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-10-16T15:35:29.179 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:29.184 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:29.185 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:29.186 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:29.186 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:29.779 INFO:teuthology.orchestra.run.smithi124.stdout:generic/479 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T15:35:29.784 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/479 2023-10-16T15:35:29.784 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/479 2023-10-16T15:35:29.784 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:29.786 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:29.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:29.830 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-10-16T15:35:30.176 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:30.186 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:30.186 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:30.187 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:30.188 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:30.707 INFO:teuthology.orchestra.run.smithi124.stdout:generic/480 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T15:35:30.711 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/480 2023-10-16T15:35:30.711 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/480 2023-10-16T15:35:30.712 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:30.713 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:30.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:30.756 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-10-16T15:35:31.088 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:31.092 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:31.093 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:31.094 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:31.094 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:31.616 INFO:teuthology.orchestra.run.smithi124.stdout:generic/481 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T15:35:31.620 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/481 2023-10-16T15:35:31.620 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/481 2023-10-16T15:35:31.621 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:31.627 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:31.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:31.660 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-10-16T15:35:31.967 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:31.975 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:31.976 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:31.977 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:31.977 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:32.546 INFO:teuthology.orchestra.run.smithi124.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2023-10-16T15:35:32.552 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/482 2023-10-16T15:35:32.552 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/482 2023-10-16T15:35:32.552 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:32.554 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:32.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:32.594 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-10-16T15:35:32.912 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:32.922 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:32.923 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:32.925 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:32.925 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:33.440 INFO:teuthology.orchestra.run.smithi124.stdout:generic/483 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T15:35:33.445 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/483 2023-10-16T15:35:33.445 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/483 2023-10-16T15:35:33.445 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:33.450 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:33.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:33.474 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-10-16T15:35:33.826 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:33.830 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:33.831 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:33.832 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:33.833 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:34.289 INFO:teuthology.orchestra.run.smithi124.stdout:generic/484 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T15:35:34.294 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/484 2023-10-16T15:35:34.294 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/484 2023-10-16T15:35:34.294 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:34.296 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:34.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:34.329 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-10-16T15:35:34.641 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:34.647 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:34.647 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:34.648 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:34.648 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:35.204 INFO:teuthology.orchestra.run.smithi124.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-10-16T15:35:35.209 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/485 2023-10-16T15:35:35.209 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/485 2023-10-16T15:35:35.209 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:35.214 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:35.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:35.257 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-10-16T15:35:35.609 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:35.614 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:35.614 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:35.615 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:35.616 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:36.482 INFO:teuthology.orchestra.run.smithi124.stdout:generic/486 1s 2023-10-16T15:35:36.487 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/486 2023-10-16T15:35:36.487 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:36.489 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:36.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:36.502 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-10-16T15:35:36.823 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:36.829 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:36.829 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:36.833 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:36.833 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:37.354 INFO:teuthology.orchestra.run.smithi124.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2023-10-16T15:35:37.358 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/487 2023-10-16T15:35:37.359 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/487 2023-10-16T15:35:37.359 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:37.361 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:37.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:37.394 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-10-16T15:35:37.738 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:37.750 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:37.750 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:37.751 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:37.752 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:38.243 INFO:teuthology.orchestra.run.smithi124.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-16T15:35:38.247 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/488 2023-10-16T15:35:38.247 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/488 2023-10-16T15:35:38.248 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:38.250 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:38.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:38.281 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-10-16T15:35:38.604 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:38.610 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:38.610 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:38.611 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:38.611 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:39.101 INFO:teuthology.orchestra.run.smithi124.stdout:generic/489 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T15:35:39.104 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/489 2023-10-16T15:35:39.105 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/489 2023-10-16T15:35:39.105 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:39.106 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:39.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:39.136 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-10-16T15:35:39.446 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:39.457 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:39.458 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:39.461 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:39.461 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:41.802 INFO:teuthology.orchestra.run.smithi124.stdout:generic/490 2s 2023-10-16T15:35:41.813 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/490 2023-10-16T15:35:41.813 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:41.815 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:42.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:42.129 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-10-16T15:35:42.594 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:42.598 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:42.599 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:42.600 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:42.600 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:42.810 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:35:42.818 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:35:42.878 INFO:tasks.ceph.mds.b.smithi192.stderr:2023-10-16T15:35:42.876+0000 7f536d166700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 121733) UID: 0 2023-10-16T15:35:42.879 INFO:tasks.ceph.mds.d.smithi192.stderr:2023-10-16T15:35:42.876+0000 7f41d2517700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 121733) UID: 0 2023-10-16T15:35:43.084 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T15:35:43.082+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 637807) UID: 0 2023-10-16T15:35:43.085 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T15:35:43.082+0000 7f3e3026f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 637807) UID: 0 2023-10-16T15:35:43.085 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T15:35:43.082+0000 7f18f4d1b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 637807) UID: 0 2023-10-16T15:35:43.085 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T15:35:43.082+0000 7f9480ec4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 637807) UID: 0 2023-10-16T15:35:43.284 INFO:teuthology.orchestra.run.smithi124.stdout:generic/491 [not run] ceph does not support freezing 2023-10-16T15:35:43.287 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/491 2023-10-16T15:35:43.287 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/491 2023-10-16T15:35:43.287 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:43.290 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:43.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:43.318 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-10-16T15:35:43.719 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:43.724 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:43.727 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:43.728 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:43.728 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:44.312 INFO:teuthology.orchestra.run.smithi124.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2023-10-16T15:35:44.316 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/492 2023-10-16T15:35:44.316 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/492 2023-10-16T15:35:44.316 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:44.319 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:44.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:44.354 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-10-16T15:35:44.780 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:44.785 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:44.786 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:44.788 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:44.788 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:45.830 INFO:teuthology.orchestra.run.smithi124.stdout:generic/493 [not run] swapfiles are not supported 2023-10-16T15:35:45.834 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/493 2023-10-16T15:35:45.835 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/493 2023-10-16T15:35:45.835 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:45.837 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:45.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:45.885 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-10-16T15:35:46.298 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:46.303 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:46.303 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:46.304 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:46.304 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:47.210 INFO:teuthology.orchestra.run.smithi124.stdout:generic/494 [not run] swapfiles are not supported 2023-10-16T15:35:47.215 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/494 2023-10-16T15:35:47.215 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/494 2023-10-16T15:35:47.215 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:47.217 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:47.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:47.260 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-10-16T15:35:47.608 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:47.613 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:47.613 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:47.614 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:47.614 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:48.537 INFO:teuthology.orchestra.run.smithi124.stdout:generic/495 [not run] swapfiles are not supported 2023-10-16T15:35:48.546 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/495 2023-10-16T15:35:48.547 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/495 2023-10-16T15:35:48.547 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:48.553 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:48.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:48.604 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-10-16T15:35:49.010 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:49.017 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:49.018 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:49.022 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:49.022 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:50.033 INFO:teuthology.orchestra.run.smithi124.stdout:generic/496 [not run] swapfiles are not supported 2023-10-16T15:35:50.037 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/496 2023-10-16T15:35:50.037 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/496 2023-10-16T15:35:50.037 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:50.039 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:50.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:50.097 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-10-16T15:35:50.499 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:50.503 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:50.503 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:50.504 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:50.504 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:51.512 INFO:teuthology.orchestra.run.smithi124.stdout:generic/497 [not run] swapfiles are not supported 2023-10-16T15:35:51.516 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/497 2023-10-16T15:35:51.517 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/497 2023-10-16T15:35:51.517 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:51.519 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:51.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:51.569 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-10-16T15:35:51.972 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:51.995 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:51.997 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:51.998 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:51.998 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:52.609 INFO:teuthology.orchestra.run.smithi124.stdout:generic/498 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T15:35:52.615 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/498 2023-10-16T15:35:52.615 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/498 2023-10-16T15:35:52.615 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:52.617 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:52.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:52.689 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-10-16T15:35:53.115 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:53.123 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:53.124 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:53.125 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:53.125 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:53.729 INFO:teuthology.orchestra.run.smithi124.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-10-16T15:35:53.734 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/499 2023-10-16T15:35:53.734 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/499 2023-10-16T15:35:53.734 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:53.736 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:53.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:53.797 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-10-16T15:35:54.140 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:54.153 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:54.156 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:54.158 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:54.158 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:54.767 INFO:teuthology.orchestra.run.smithi124.stdout:generic/500 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T15:35:54.771 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/500 2023-10-16T15:35:54.771 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/500 2023-10-16T15:35:54.771 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:54.781 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:54.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:54.825 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-10-16T15:35:55.248 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:55.254 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:55.255 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:55.256 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:55.256 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:56.470 INFO:teuthology.orchestra.run.smithi124.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T15:35:56.477 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/501 2023-10-16T15:35:56.478 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/501 2023-10-16T15:35:56.478 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:56.504 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:56.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:56.635 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-10-16T15:35:57.041 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:57.045 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:57.047 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:57.048 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:57.048 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:57.628 INFO:teuthology.orchestra.run.smithi124.stdout:generic/502 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T15:35:57.632 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/502 2023-10-16T15:35:57.633 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/502 2023-10-16T15:35:57.633 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:57.635 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:57.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:57.711 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-10-16T15:35:58.157 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:58.162 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:58.163 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:58.165 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:58.165 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:58.806 INFO:teuthology.orchestra.run.smithi124.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T15:35:58.811 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/503 2023-10-16T15:35:58.811 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/503 2023-10-16T15:35:58.811 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:58.814 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:58.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:35:58.878 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-10-16T15:35:59.302 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:35:59.308 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:35:59.308 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:35:59.309 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:35:59.309 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:35:59.968 INFO:teuthology.orchestra.run.smithi124.stdout:generic/504 0s 2023-10-16T15:35:59.975 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/504 2023-10-16T15:35:59.976 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:35:59.978 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:00.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:36:00.028 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-10-16T15:36:00.471 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:36:00.477 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:36:00.477 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:36:00.481 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:36:00.481 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:01.279 INFO:teuthology.orchestra.run.smithi124.stdout:generic/505 [not run] ceph does not support shutdown 2023-10-16T15:36:01.306 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/505 2023-10-16T15:36:01.306 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/505 2023-10-16T15:36:01.307 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:36:01.309 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:01.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:36:01.360 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-10-16T15:36:01.798 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:36:01.815 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:36:01.815 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:36:01.826 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:36:01.826 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:02.331 INFO:teuthology.orchestra.run.smithi124.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-16T15:36:02.336 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/506 2023-10-16T15:36:02.336 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/506 2023-10-16T15:36:02.336 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:36:02.338 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:02.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:36:02.385 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-10-16T15:36:02.800 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:36:02.801 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:36:02.801 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:36:02.802 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:36:02.802 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:03.427 INFO:teuthology.orchestra.run.smithi124.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-10-16T15:36:03.433 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/507 2023-10-16T15:36:03.433 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/507 2023-10-16T15:36:03.433 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:36:03.435 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:03.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:36:03.482 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-10-16T15:36:03.851 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:36:03.870 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:36:03.870 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:36:03.871 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:36:03.872 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:04.488 INFO:teuthology.orchestra.run.smithi124.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2023-10-16T15:36:04.493 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/508 2023-10-16T15:36:04.493 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/508 2023-10-16T15:36:04.493 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:36:04.495 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:04.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:36:04.544 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-10-16T15:36:04.983 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:36:04.988 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:36:04.989 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:36:04.989 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:36:04.990 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:05.548 INFO:teuthology.orchestra.run.smithi124.stdout:generic/509 [not run] O_TMPFILE is not supported 2023-10-16T15:36:05.555 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/509 2023-10-16T15:36:05.555 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/509 2023-10-16T15:36:05.555 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:36:05.557 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:05.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:36:05.603 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-10-16T15:36:05.993 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:36:06.005 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:36:06.006 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:36:06.006 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:36:06.006 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:06.645 INFO:teuthology.orchestra.run.smithi124.stdout:generic/510 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T15:36:06.652 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/510 2023-10-16T15:36:06.652 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/510 2023-10-16T15:36:06.652 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:36:06.654 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:06.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:36:06.688 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-10-16T15:36:07.098 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:36:07.105 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:36:07.106 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:36:07.107 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:36:07.107 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:07.695 INFO:teuthology.orchestra.run.smithi124.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-10-16T15:36:07.702 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/511 2023-10-16T15:36:07.702 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/511 2023-10-16T15:36:07.703 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:36:07.711 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:07.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:36:07.779 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-10-16T15:36:08.186 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:36:08.191 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:36:08.192 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:36:08.193 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:36:08.193 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:08.815 INFO:teuthology.orchestra.run.smithi124.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T15:36:08.822 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/512 2023-10-16T15:36:08.822 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/512 2023-10-16T15:36:08.823 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:36:08.825 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:08.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:36:08.873 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-10-16T15:36:09.277 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:36:09.289 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:36:09.289 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:36:09.294 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:36:09.294 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:10.568 INFO:teuthology.orchestra.run.smithi124.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T15:36:10.575 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/513 2023-10-16T15:36:10.575 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/513 2023-10-16T15:36:10.575 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:36:10.580 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:10.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:36:10.666 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-10-16T15:36:11.018 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:36:11.022 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:36:11.023 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:36:11.024 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:36:11.024 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:12.388 INFO:teuthology.orchestra.run.smithi124.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T15:36:12.435 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/514 2023-10-16T15:36:12.435 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/514 2023-10-16T15:36:12.436 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:36:12.446 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:12.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:36:12.559 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-10-16T15:36:12.937 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:36:12.941 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:36:12.942 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:36:12.944 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:36:12.944 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:14.243 INFO:teuthology.orchestra.run.smithi124.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T15:36:14.327 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/515 2023-10-16T15:36:14.328 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/515 2023-10-16T15:36:14.328 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:36:14.334 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:14.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:36:14.402 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-10-16T15:36:14.730 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:36:14.735 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:36:14.735 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:36:14.736 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:36:14.736 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:15.398 INFO:teuthology.orchestra.run.smithi124.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2023-10-16T15:36:15.403 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/516 2023-10-16T15:36:15.403 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/516 2023-10-16T15:36:15.403 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:36:15.405 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:15.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:36:15.795 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-10-16T15:36:16.291 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:36:16.301 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:36:16.302 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:36:16.303 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:36:16.303 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:17.058 INFO:teuthology.orchestra.run.smithi124.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-10-16T15:36:17.325 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/517 2023-10-16T15:36:17.325 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/517 2023-10-16T15:36:17.325 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:36:17.336 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:17.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:36:17.586 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-10-16T15:36:18.010 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:36:18.015 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:36:18.016 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:36:18.017 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:36:18.017 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:19.245 INFO:teuthology.orchestra.run.smithi124.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T15:36:19.256 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/518 2023-10-16T15:36:19.257 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/518 2023-10-16T15:36:19.257 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:36:19.269 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:19.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:36:19.497 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-10-16T15:36:19.926 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:36:19.931 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:36:19.932 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:36:19.933 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:36:19.933 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:20.594 INFO:teuthology.orchestra.run.smithi124.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2023-10-16T15:36:20.605 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/519 2023-10-16T15:36:20.605 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/519 2023-10-16T15:36:20.605 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:36:20.607 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:20.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:36:21.000 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-10-16T15:36:21.429 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:36:21.442 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:36:21.444 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:36:21.445 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:36:21.446 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:22.094 INFO:teuthology.orchestra.run.smithi124.stdout:generic/520 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T15:36:22.103 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/520 2023-10-16T15:36:22.104 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/520 2023-10-16T15:36:22.104 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T15:36:22.106 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:36:22.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:36:22.155 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-10-16T15:36:22.622 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T15:36:22.626 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T15:36:22.627 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T15:36:22.635 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T15:36:22.635 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T15:38:45.541 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T15:38:45.538+0000 7f95afc78700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121761) UID: 0 2023-10-16T15:38:45.541 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T15:38:45.538+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121761) UID: 0 2023-10-16T15:38:45.542 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T15:38:45.537+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121761) UID: 0 2023-10-16T15:38:45.544 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T15:38:45.538+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121761) UID: 0 2023-10-16T15:45:42.038 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:45:42.047 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:46:12.226 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:46:12.229 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:46:42.371 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:46:42.374 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:47:12.662 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:47:12.668 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:47:42.742 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:47:42.745 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:48:12.890 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:48:12.892 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:48:43.072 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:48:43.075 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:49:13.228 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:49:13.231 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:49:43.317 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:49:43.322 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:50:13.450 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:50:13.452 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:50:43.595 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:50:43.597 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:51:13.741 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:51:13.744 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:51:44.144 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:51:44.146 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:51:44.194 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T15:51:44.192+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122158) UID: 0 2023-10-16T15:51:44.195 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T15:51:44.193+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122158) UID: 0 2023-10-16T15:51:44.195 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T15:51:44.193+0000 7f95afc78700 -1 Fail to open '/proc/122158/cmdline' error = (2) No such file or directory 2023-10-16T15:51:44.195 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T15:51:44.193+0000 7f95afc78700 -1 received signal: Hangup from (PID: 122158) UID: 0 2023-10-16T15:51:44.196 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T15:51:44.192+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122158) UID: 0 2023-10-16T15:55:04.748 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:55:04.753 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:55:04.810 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T15:55:04.808+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122214) UID: 0 2023-10-16T15:55:04.810 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T15:55:04.808+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122214) UID: 0 2023-10-16T15:55:04.811 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T15:55:04.809+0000 7f95afc78700 -1 Fail to open '/proc/122214/cmdline' error = (2) No such file or directory 2023-10-16T15:55:04.811 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T15:55:04.809+0000 7f95afc78700 -1 received signal: Hangup from (PID: 122214) UID: 0 2023-10-16T15:55:04.813 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T15:55:04.809+0000 7f5b62088700 -1 Fail to open '/proc/122214/cmdline' error = (2) No such file or directory 2023-10-16T15:55:04.814 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T15:55:04.809+0000 7f5b62088700 -1 received signal: Hangup from (PID: 122214) UID: 0 2023-10-16T15:58:36.372 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:58:36.378 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:58:36.764 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T15:58:36.763+0000 7f3e3026f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 652736) UID: 0 2023-10-16T15:58:36.765 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T15:58:36.763+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 652736) UID: 0 2023-10-16T15:58:36.766 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T15:58:36.765+0000 7f18f4d1b700 -1 Fail to open '/proc/652736/cmdline' error = (2) No such file or directory 2023-10-16T15:58:36.766 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T15:58:36.765+0000 7f18f4d1b700 -1 received signal: Hangup from (PID: 652736) UID: 0 2023-10-16T15:58:36.767 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T15:58:36.765+0000 7f9480ec4700 -1 Fail to open '/proc/652736/cmdline' error = (2) No such file or directory 2023-10-16T15:58:36.767 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T15:58:36.765+0000 7f9480ec4700 -1 received signal: Hangup from (PID: 652736) UID: 0 2023-10-16T16:02:16.812 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:02:16.816 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:02:16.870 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T16:02:16.868+0000 7f18f4d1b700 -1 Fail to open '/proc/652809/cmdline' error = (2) No such file or directory 2023-10-16T16:02:16.871 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T16:02:16.868+0000 7f18f4d1b700 -1 received signal: Hangup from (PID: 652809) UID: 0 2023-10-16T16:02:16.871 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T16:02:16.868+0000 7f3e3026f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 652809) UID: 0 2023-10-16T16:02:16.872 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T16:02:16.867+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 652809) UID: 0 2023-10-16T16:02:16.872 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T16:02:16.867+0000 7f9480ec4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 652809) UID: 0 2023-10-16T16:05:29.287 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:05:29.290 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:05:59.386 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:05:59.389 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:06:29.477 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:06:29.480 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:06:59.637 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:06:59.641 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:07:00.620 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T16:07:00.618+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122453) UID: 0 2023-10-16T16:07:00.626 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T16:07:00.625+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122453) UID: 0 2023-10-16T16:07:00.632 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T16:07:00.624+0000 7f95afc78700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122453) UID: 0 2023-10-16T16:07:00.632 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T16:07:00.624+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122453) UID: 0 2023-10-16T16:10:28.943 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:10:28.947 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:10:59.085 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:10:59.092 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:11:29.264 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:11:29.267 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:11:59.376 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:11:59.378 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:12:29.504 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:12:29.507 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:12:59.638 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:12:59.641 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:13:29.739 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:13:29.742 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:13:59.860 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:13:59.865 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:14:29.989 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:14:29.992 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:15:00.097 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:15:00.100 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:15:00.154 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T16:15:00.152+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 653219) UID: 0 2023-10-16T16:15:00.154 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T16:15:00.152+0000 7f9480ec4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 653219) UID: 0 2023-10-16T16:15:00.155 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T16:15:00.152+0000 7f3e3026f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 653219) UID: 0 2023-10-16T16:15:00.157 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T16:15:00.152+0000 7f18f4d1b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 653219) UID: 0 2023-10-16T16:18:22.451 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:18:22.455 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:18:52.764 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:18:52.767 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:18:52.902 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T16:18:52.900+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 653289) UID: 0 2023-10-16T16:18:52.903 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T16:18:52.901+0000 7f3e3026f700 -1 received signal: Hangup from (PID: 653289) UID: 0 2023-10-16T16:18:52.904 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T16:18:52.901+0000 7f9480ec4700 -1 received signal: Hangup from (PID: 653289) UID: 0 2023-10-16T16:18:52.907 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T16:18:52.901+0000 7f18f4d1b700 -1 received signal: Hangup from (PID: 653289) UID: 0 2023-10-16T16:22:03.970 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:22:03.974 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:22:34.052 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:22:34.055 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:23:04.132 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:23:04.135 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:23:04.181 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T16:23:04.179+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 653403) UID: 0 2023-10-16T16:23:04.182 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T16:23:04.179+0000 7f18f4d1b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 653403) UID: 0 2023-10-16T16:23:04.183 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T16:23:04.179+0000 7f3e3026f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 653403) UID: 0 2023-10-16T16:23:04.183 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T16:23:04.179+0000 7f9480ec4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 653403) UID: 0 2023-10-16T16:26:21.454 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:26:21.460 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:26:51.744 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:26:51.749 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:26:51.801 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T16:26:51.800+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122992) UID: 0 2023-10-16T16:26:51.802 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T16:26:51.800+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122992) UID: 0 2023-10-16T16:26:51.802 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T16:26:51.800+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122992) UID: 0 2023-10-16T16:26:51.803 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T16:26:51.800+0000 7f95afc78700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122992) UID: 0 2023-10-16T16:33:00.262 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:33:00.265 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:33:30.369 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:33:30.375 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:34:00.506 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:34:00.509 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:34:30.814 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:34:30.818 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:35:00.886 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:35:00.897 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:35:31.026 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:35:31.029 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:35:31.097 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T16:35:31.095+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123203) UID: 0 2023-10-16T16:35:31.097 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T16:35:31.095+0000 7f95afc78700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123203) UID: 0 2023-10-16T16:35:31.098 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T16:35:31.095+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123203) UID: 0 2023-10-16T16:35:31.098 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T16:35:31.095+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123203) UID: 0 2023-10-16T16:38:58.157 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:38:58.160 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:38:58.222 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T16:38:58.219+0000 7f18f4d1b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 653734) UID: 0 2023-10-16T16:38:58.222 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T16:38:58.219+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 653734) UID: 0 2023-10-16T16:38:58.223 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T16:38:58.219+0000 7f3e3026f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 653734) UID: 0 2023-10-16T16:38:58.223 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T16:38:58.219+0000 7f9480ec4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 653734) UID: 0 2023-10-16T16:38:58.242 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T16:38:58.240+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123252) UID: 0 2023-10-16T16:38:58.242 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T16:38:58.240+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123252) UID: 0 2023-10-16T16:38:58.243 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T16:38:58.240+0000 7f95afc78700 -1 received signal: Hangup from (PID: 123252) UID: 0 2023-10-16T16:38:58.243 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T16:38:58.240+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123252) UID: 0 2023-10-16T16:42:27.581 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:42:27.584 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:42:58.436 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:42:58.439 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:43:28.819 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:43:28.824 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:43:59.236 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:43:59.239 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:44:29.344 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:44:29.347 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:44:59.925 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:44:59.929 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:45:30.021 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:45:30.024 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:46:00.170 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:46:00.173 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:46:30.328 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:46:30.331 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:47:00.421 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:47:00.426 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:47:30.502 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:47:30.505 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:48:01.295 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:48:01.297 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:48:01.352 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T16:48:01.350+0000 7f18f4d1b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 654070) UID: 0 2023-10-16T16:48:01.354 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T16:48:01.350+0000 7f9480ec4700 -1 Fail to open '/proc/654070/cmdline' error = (2) No such file or directory 2023-10-16T16:48:01.354 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T16:48:01.350+0000 7f9480ec4700 -1 received signal: Hangup from (PID: 654070) UID: 0 2023-10-16T16:48:01.355 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T16:48:01.353+0000 7f3e3026f700 -1 Fail to open '/proc/654070/cmdline' error = (2) No such file or directory 2023-10-16T16:48:01.355 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T16:48:01.353+0000 7f3e3026f700 -1 received signal: Hangup from (PID: 654070) UID: 0 2023-10-16T16:48:01.356 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T16:48:01.349+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 654070) UID: 0 2023-10-16T16:51:12.384 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:51:12.388 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:51:42.557 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:51:42.563 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:52:12.660 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:52:12.663 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:52:43.093 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:52:43.096 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:53:13.478 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:53:13.481 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:53:43.566 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:53:43.568 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:54:13.707 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:54:13.710 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:54:43.789 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:54:43.792 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:55:13.902 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:55:13.905 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:55:44.342 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:55:44.345 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:56:14.417 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:56:14.421 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:56:44.582 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:56:44.585 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:57:14.648 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:57:14.651 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:57:44.774 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:57:44.777 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:57:44.907 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T16:57:44.905+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123969) UID: 0 2023-10-16T16:57:44.907 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T16:57:44.905+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123969) UID: 0 2023-10-16T16:57:44.908 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T16:57:44.905+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123969) UID: 0 2023-10-16T16:57:44.908 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T16:57:44.905+0000 7f95afc78700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123969) UID: 0 2023-10-16T17:01:04.633 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:01:04.636 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:01:34.798 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:01:34.804 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:02:04.897 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:02:04.900 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:02:04.947 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T17:02:04.944+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 654568) UID: 0 2023-10-16T17:02:04.947 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T17:02:04.945+0000 7f3e3026f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 654568) UID: 0 2023-10-16T17:02:04.948 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T17:02:04.944+0000 7f18f4d1b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 654568) UID: 0 2023-10-16T17:02:04.948 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T17:02:04.945+0000 7f9480ec4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 654568) UID: 0 2023-10-16T17:05:16.964 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:05:16.967 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:05:17.041 INFO:tasks.ceph.mds.d.smithi192.stderr:2023-10-16T17:05:17.038+0000 7f41d2517700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 124141) UID: 0 2023-10-16T17:05:17.042 INFO:tasks.ceph.mds.b.smithi192.stderr:2023-10-16T17:05:17.038+0000 7f536d166700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 124141) UID: 0 2023-10-16T17:05:17.221 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T17:05:17.220+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 654620) UID: 0 2023-10-16T17:05:17.223 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T17:05:17.222+0000 7f9480ec4700 -1 Fail to open '/proc/654620/cmdline' error = (2) No such file or directory 2023-10-16T17:05:17.223 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T17:05:17.222+0000 7f9480ec4700 -1 received signal: Hangup from (PID: 654620) UID: 0 2023-10-16T17:05:17.224 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T17:05:17.223+0000 7f18f4d1b700 -1 Fail to open '/proc/654620/cmdline' error = (2) No such file or directory 2023-10-16T17:05:17.225 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T17:05:17.223+0000 7f18f4d1b700 -1 received signal: Hangup from (PID: 654620) UID: 0 2023-10-16T17:05:17.225 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T17:05:17.223+0000 7f3e3026f700 -1 Fail to open '/proc/654620/cmdline' error = (2) No such file or directory 2023-10-16T17:05:17.225 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T17:05:17.223+0000 7f3e3026f700 -1 received signal: Hangup from (PID: 654620) UID: 0 2023-10-16T17:08:01.534 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T17:08:01.532+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124161) UID: 0 2023-10-16T17:08:01.535 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T17:08:01.533+0000 7f5b62088700 -1 Fail to open '/proc/124161/cmdline' error = (2) No such file or directory 2023-10-16T17:08:01.535 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T17:08:01.533+0000 7f5b62088700 -1 received signal: Hangup from (PID: 124161) UID: 0 2023-10-16T17:08:01.535 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T17:08:01.534+0000 7f95afc78700 -1 Fail to open '/proc/124161/cmdline' error = (2) No such file or directory 2023-10-16T17:08:01.536 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T17:08:01.534+0000 7f95afc78700 -1 received signal: Hangup from (PID: 124161) UID: 0 2023-10-16T17:08:01.540 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T17:08:01.538+0000 7ff25cecf700 -1 Fail to open '/proc/124161/cmdline' error = (2) No such file or directory 2023-10-16T17:08:01.540 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T17:08:01.538+0000 7ff25cecf700 -1 received signal: Hangup from (PID: 124161) UID: 0 2023-10-16T17:11:54.650 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:11:54.653 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:12:07.660 INFO:teuthology.orchestra.run.smithi124.stdout:generic/521 5745s 2023-10-16T17:12:07.680 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/521 2023-10-16T17:12:07.680 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T17:12:07.683 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T17:12:08.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:12:08.069 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-10-16T17:12:08.674 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T17:12:08.686 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T17:12:08.687 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T17:12:08.687 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T17:12:08.688 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T17:12:25.430 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:12:25.433 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:12:55.512 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:12:55.515 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:12:55.563 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T17:12:55.560+0000 7f9480ec4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 655237) UID: 0 2023-10-16T17:12:55.563 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T17:12:55.561+0000 7f3e3026f700 -1 Fail to open '/proc/655237/cmdline' error = (2) No such file or directory 2023-10-16T17:12:55.564 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T17:12:55.561+0000 7f3e3026f700 -1 received signal: Hangup from (PID: 655237) UID: 0 2023-10-16T17:12:55.566 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T17:12:55.562+0000 7f18f4d1b700 -1 Fail to open '/proc/655237/cmdline' error = (2) No such file or directory 2023-10-16T17:12:55.566 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T17:12:55.562+0000 7f18f4d1b700 -1 received signal: Hangup from (PID: 655237) UID: 0 2023-10-16T17:12:55.567 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T17:12:55.560+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 655237) UID: 0 2023-10-16T17:16:15.947 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:16:15.949 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:16:15.996 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T17:16:15.995+0000 7f3e3026f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 655295) UID: 0 2023-10-16T17:16:15.997 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T17:16:15.996+0000 7f4702f32700 -1 received signal: Hangup from (PID: 655295) UID: 0 2023-10-16T17:16:15.997 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T17:16:15.995+0000 7f18f4d1b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 655295) UID: 0 2023-10-16T17:16:15.998 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T17:16:15.998+0000 7f9480ec4700 -1 received signal: Hangup from (PID: 655295) UID: 0 2023-10-16T17:16:16.081 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T17:16:16.079+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124329) UID: 0 2023-10-16T17:16:16.082 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T17:16:16.080+0000 7f5b62088700 -1 received signal: Hangup from (PID: 124329) UID: 0 2023-10-16T17:16:16.082 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T17:16:16.080+0000 7f95afc78700 -1 received signal: Hangup from (PID: 124329) UID: 0 2023-10-16T17:16:16.084 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T17:16:16.082+0000 7ff25cecf700 -1 received signal: Hangup from (PID: 124329) UID: 0 2023-10-16T17:19:37.150 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:19:37.153 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:20:07.372 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:20:07.376 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:20:37.471 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:20:37.474 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:21:07.788 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:21:07.790 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:21:37.939 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:21:37.942 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:22:08.019 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:22:08.025 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:22:38.153 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:22:38.156 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:23:08.267 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:23:08.269 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:23:08.313 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T17:23:08.312+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124564) UID: 0 2023-10-16T17:23:08.314 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T17:23:08.312+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124564) UID: 0 2023-10-16T17:23:08.314 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T17:23:08.313+0000 7ff25cecf700 -1 Fail to open '/proc/124564/cmdline' error = (2) No such file or directory 2023-10-16T17:23:08.314 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T17:23:08.313+0000 7ff25cecf700 -1 received signal: Hangup from (PID: 124564) UID: 0 2023-10-16T17:23:08.315 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T17:23:08.314+0000 7f95afc78700 -1 Fail to open '/proc/124564/cmdline' error = (2) No such file or directory 2023-10-16T17:23:08.315 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T17:23:08.314+0000 7f95afc78700 -1 received signal: Hangup from (PID: 124564) UID: 0 2023-10-16T17:26:34.332 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:26:34.335 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:27:04.518 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:27:04.522 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:27:34.981 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:27:34.984 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:28:05.051 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:28:05.054 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:28:35.194 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:28:35.197 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:29:05.302 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:29:05.304 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:29:05.384 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T17:29:05.383+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124937) UID: 0 2023-10-16T17:29:05.385 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T17:29:05.383+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124937) UID: 0 2023-10-16T17:29:05.385 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T17:29:05.383+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124937) UID: 0 2023-10-16T17:29:05.389 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T17:29:05.388+0000 7f95afc78700 -1 Fail to open '/proc/124937/cmdline' error = (2) No such file or directory 2023-10-16T17:29:05.389 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T17:29:05.388+0000 7f95afc78700 -1 received signal: Hangup from (PID: 124937) UID: 0 2023-10-16T17:32:28.978 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:32:28.981 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:33:00.171 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:33:00.177 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:33:30.262 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:33:30.265 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:34:00.615 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:34:00.618 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:34:30.692 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:34:30.695 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:35:00.798 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:35:00.809 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:35:31.269 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:35:31.272 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:36:01.349 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:36:01.352 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:36:31.480 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:36:31.483 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:37:01.826 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:37:01.829 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:37:31.892 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:37:31.895 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:38:02.002 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:38:02.005 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:38:02.083 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T17:38:02.081+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125265) UID: 0 2023-10-16T17:38:02.083 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T17:38:02.081+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125265) UID: 0 2023-10-16T17:38:02.084 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T17:38:02.081+0000 7f95afc78700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125265) UID: 0 2023-10-16T17:38:02.088 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T17:38:02.082+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125265) UID: 0 2023-10-16T17:41:25.432 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:41:25.435 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:41:25.491 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T17:41:25.490+0000 7f3e3026f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 656088) UID: 0 2023-10-16T17:41:25.491 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T17:41:25.491+0000 7f18f4d1b700 -1 received signal: Hangup from (PID: 656088) UID: 0 2023-10-16T17:41:25.492 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T17:41:25.492+0000 7f4702f32700 -1 Fail to open '/proc/656088/cmdline' error = (2) No such file or directory 2023-10-16T17:41:25.492 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T17:41:25.492+0000 7f4702f32700 -1 received signal: Hangup from (PID: 656088) UID: 0 2023-10-16T17:41:25.493 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T17:41:25.492+0000 7f9480ec4700 -1 Fail to open '/proc/656088/cmdline' error = (2) No such file or directory 2023-10-16T17:41:25.493 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T17:41:25.492+0000 7f9480ec4700 -1 received signal: Hangup from (PID: 656088) UID: 0 2023-10-16T17:44:49.396 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:44:49.400 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:44:49.466 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T17:44:49.465+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 656137) UID: 0 2023-10-16T17:44:49.467 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T17:44:49.465+0000 7f9480ec4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 656137) UID: 0 2023-10-16T17:44:49.468 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T17:44:49.465+0000 7f3e3026f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 656137) UID: 0 2023-10-16T17:44:49.468 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T17:44:49.465+0000 7f18f4d1b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 656137) UID: 0 2023-10-16T17:48:09.491 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:48:09.495 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:48:39.571 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:48:39.574 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:49:09.657 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:49:09.663 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:49:39.802 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:49:39.805 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:50:09.910 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:50:09.913 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:50:40.283 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:50:40.286 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:51:10.373 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:51:10.378 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:51:40.526 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:51:40.532 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:51:40.589 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T17:51:40.588+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 656373) UID: 0 2023-10-16T17:51:40.590 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T17:51:40.588+0000 7f9480ec4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 656373) UID: 0 2023-10-16T17:51:40.590 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T17:51:40.589+0000 7f18f4d1b700 -1 received signal: Hangup from (PID: 656373) UID: 0 2023-10-16T17:51:40.590 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T17:51:40.589+0000 7f3e3026f700 -1 received signal: Hangup from (PID: 656373) UID: 0 2023-10-16T17:54:50.126 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:54:50.129 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:54:50.843 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T17:54:50.841+0000 7f18f4d1b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 656422) UID: 0 2023-10-16T17:54:50.843 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T17:54:50.843+0000 7f3e3026f700 -1 received signal: Hangup from (PID: 656422) UID: 0 2023-10-16T17:54:50.844 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T17:54:50.843+0000 7f9480ec4700 -1 received signal: Hangup from (PID: 656422) UID: 0 2023-10-16T17:54:50.845 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T17:54:50.844+0000 7f4702f32700 -1 received signal: Hangup from (PID: 656422) UID: 0 2023-10-16T17:58:17.021 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:58:17.030 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:58:47.219 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:58:47.224 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:59:17.308 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:59:17.315 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:59:47.408 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:59:47.411 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:00:17.561 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:00:17.564 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:00:17.726 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T18:00:17.725+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125810) UID: 0 2023-10-16T18:00:17.726 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T18:00:17.725+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125810) UID: 0 2023-10-16T18:00:17.727 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T18:00:17.725+0000 7f95afc78700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125810) UID: 0 2023-10-16T18:00:17.727 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T18:00:17.727+0000 7ff25cecf700 -1 Fail to open '/proc/125810/cmdline' error = (2) No such file or directory 2023-10-16T18:00:17.727 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T18:00:17.727+0000 7ff25cecf700 -1 received signal: Hangup from (PID: 125810) UID: 0 2023-10-16T18:03:37.502 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:03:37.505 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:03:37.582 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T18:03:37.581+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125871) UID: 0 2023-10-16T18:03:37.583 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T18:03:37.582+0000 7ff25cecf700 -1 Fail to open '/proc/125871/cmdline' error = (2) No such file or directory 2023-10-16T18:03:37.583 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T18:03:37.582+0000 7ff25cecf700 -1 received signal: Hangup from (PID: 125871) UID: 0 2023-10-16T18:03:37.584 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T18:03:37.581+0000 7f5b62088700 -1 Fail to open '/proc/125871/cmdline' error = (2) No such file or directory 2023-10-16T18:03:37.585 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T18:03:37.581+0000 7f5b62088700 -1 received signal: Hangup from (PID: 125871) UID: 0 2023-10-16T18:03:37.585 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T18:03:37.582+0000 7f95afc78700 -1 Fail to open '/proc/125871/cmdline' error = (2) No such file or directory 2023-10-16T18:03:37.585 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T18:03:37.582+0000 7f95afc78700 -1 received signal: Hangup from (PID: 125871) UID: 0 2023-10-16T18:07:04.161 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:07:04.165 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:07:34.332 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:07:34.335 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:07:34.389 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T18:07:34.389+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125951) UID: 0 2023-10-16T18:07:34.389 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T18:07:34.389+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125951) UID: 0 2023-10-16T18:07:34.390 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T18:07:34.389+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125951) UID: 0 2023-10-16T18:07:34.390 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T18:07:34.390+0000 7f95afc78700 -1 Fail to open '/proc/125951/cmdline' error = (2) No such file or directory 2023-10-16T18:07:34.390 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T18:07:34.390+0000 7f95afc78700 -1 received signal: Hangup from (PID: 125951) UID: 0 2023-10-16T18:10:55.682 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:10:55.685 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:10:55.765 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T18:10:55.764+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126005) UID: 0 2023-10-16T18:10:55.765 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T18:10:55.764+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126005) UID: 0 2023-10-16T18:10:55.766 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T18:10:55.764+0000 7f95afc78700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126005) UID: 0 2023-10-16T18:10:55.766 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T18:10:55.764+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126005) UID: 0 2023-10-16T18:10:55.860 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T18:10:55.859+0000 7f9480ec4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 656768) UID: 0 2023-10-16T18:10:55.861 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T18:10:55.859+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 656768) UID: 0 2023-10-16T18:10:55.862 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T18:10:55.859+0000 7f3e3026f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 656768) UID: 0 2023-10-16T18:10:55.867 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T18:10:55.865+0000 7f18f4d1b700 -1 Fail to open '/proc/656768/cmdline' error = (2) No such file or directory 2023-10-16T18:10:55.867 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T18:10:55.865+0000 7f18f4d1b700 -1 received signal: Hangup from (PID: 656768) UID: 0 2023-10-16T18:14:35.139 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:14:35.143 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:14:35.421 INFO:tasks.ceph.mds.d.smithi192.stderr:2023-10-16T18:14:35.418+0000 7f41d2517700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 126064) UID: 0 2023-10-16T18:14:35.421 INFO:tasks.ceph.mds.b.smithi192.stderr:2023-10-16T18:14:35.418+0000 7f536d166700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 126064) UID: 0 2023-10-16T18:16:34.264 INFO:teuthology.orchestra.run.smithi124.stdout:generic/522 3866s 2023-10-16T18:16:34.294 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/522 2023-10-16T18:16:34.294 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:16:34.296 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:34.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:16:34.356 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-10-16T18:16:34.895 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:16:34.899 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:16:34.899 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:16:34.900 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:16:34.900 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:35.858 INFO:teuthology.orchestra.run.smithi124.stdout:generic/523 0s 2023-10-16T18:16:35.869 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/523 2023-10-16T18:16:35.869 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:16:35.875 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:35.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:16:35.885 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-10-16T18:16:36.218 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:16:36.223 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:16:36.223 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:16:36.224 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:16:36.224 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:42.321 INFO:teuthology.orchestra.run.smithi124.stdout:generic/524 6s 2023-10-16T18:16:42.327 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/524 2023-10-16T18:16:42.327 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:16:42.329 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:42.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:16:42.338 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-10-16T18:16:42.634 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:16:42.638 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:16:42.639 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:16:42.640 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:16:42.640 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:43.423 INFO:teuthology.orchestra.run.smithi124.stdout:generic/525 [not run] filesystem does not support huge file size 2023-10-16T18:16:43.445 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/525 2023-10-16T18:16:43.445 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/525 2023-10-16T18:16:43.445 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:16:43.448 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:43.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:16:43.492 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-10-16T18:16:43.848 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:16:43.852 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:16:43.853 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:16:43.854 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:16:43.854 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:44.467 INFO:teuthology.orchestra.run.smithi124.stdout:generic/526 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T18:16:44.472 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/526 2023-10-16T18:16:44.473 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/526 2023-10-16T18:16:44.473 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:16:44.476 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:44.526 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:16:44.526 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-10-16T18:16:44.842 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:16:44.846 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:16:44.847 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:16:44.848 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:16:44.848 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:45.343 INFO:teuthology.orchestra.run.smithi124.stdout:generic/527 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T18:16:45.353 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/527 2023-10-16T18:16:45.354 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/527 2023-10-16T18:16:45.354 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:16:45.356 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:45.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:16:45.410 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-10-16T18:16:45.768 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:16:45.773 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:16:45.773 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:16:45.777 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:16:45.777 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:46.316 INFO:teuthology.orchestra.run.smithi124.stdout:generic/528 0s 2023-10-16T18:16:46.322 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/528 2023-10-16T18:16:46.322 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:16:46.326 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:46.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:16:46.643 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-10-16T18:16:47.039 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:16:47.043 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:16:47.043 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:16:47.044 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:16:47.044 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:47.972 INFO:teuthology.orchestra.run.smithi124.stdout:generic/529 0s 2023-10-16T18:16:47.983 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/529 2023-10-16T18:16:47.983 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:16:47.986 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:47.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:16:47.997 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-10-16T18:16:48.335 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:16:48.339 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:16:48.340 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:16:48.341 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:16:48.341 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:49.181 INFO:teuthology.orchestra.run.smithi124.stdout:generic/530 [not run] ceph does not support shutdown 2023-10-16T18:16:49.208 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/530 2023-10-16T18:16:49.208 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/530 2023-10-16T18:16:49.208 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:16:49.210 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:49.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:16:49.260 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-10-16T18:16:49.616 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:16:49.625 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:16:49.625 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:16:49.626 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:16:49.626 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:50.144 INFO:teuthology.orchestra.run.smithi124.stdout:generic/531 [not run] O_TMPFILE is not supported 2023-10-16T18:16:50.152 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/531 2023-10-16T18:16:50.152 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/531 2023-10-16T18:16:50.153 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:16:50.155 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:50.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:16:50.194 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-10-16T18:16:50.552 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:16:50.558 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:16:50.559 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:16:50.560 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:16:50.560 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:51.247 INFO:teuthology.orchestra.run.smithi124.stdout:generic/532 1s 2023-10-16T18:16:51.255 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/532 2023-10-16T18:16:51.255 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:16:51.257 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:51.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:16:51.324 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-10-16T18:16:51.631 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:16:51.636 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:16:51.637 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:16:51.638 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:16:51.638 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:53.008 INFO:teuthology.orchestra.run.smithi124.stdout:generic/533 2s 2023-10-16T18:16:53.014 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/533 2023-10-16T18:16:53.014 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:16:53.019 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:53.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:16:53.065 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-10-16T18:16:53.382 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:16:53.387 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:16:53.388 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:16:53.389 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:16:53.389 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:53.953 INFO:teuthology.orchestra.run.smithi124.stdout:generic/534 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T18:16:53.958 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/534 2023-10-16T18:16:53.958 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/534 2023-10-16T18:16:53.958 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:16:53.960 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:53.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:16:53.992 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-10-16T18:16:54.321 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:16:54.325 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:16:54.326 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:16:54.327 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:16:54.327 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:54.760 INFO:teuthology.orchestra.run.smithi124.stdout:generic/535 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T18:16:54.765 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/535 2023-10-16T18:16:54.765 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/535 2023-10-16T18:16:54.766 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:16:54.767 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:54.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:16:54.811 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-10-16T18:16:55.138 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:16:55.142 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:16:55.143 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:16:55.144 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:16:55.144 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:55.781 INFO:teuthology.orchestra.run.smithi124.stdout:generic/536 [not run] ceph does not support shutdown 2023-10-16T18:16:55.807 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/536 2023-10-16T18:16:55.807 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/536 2023-10-16T18:16:55.807 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:16:55.813 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:55.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:16:55.843 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-10-16T18:16:56.179 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:16:56.183 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:16:56.184 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:16:56.185 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:16:56.185 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:56.869 INFO:teuthology.orchestra.run.smithi124.stdout:generic/537 [not run] FSTRIM not supported 2023-10-16T18:16:56.893 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/537 2023-10-16T18:16:56.894 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/537 2023-10-16T18:16:56.894 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:16:56.897 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:16:56.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:16:56.926 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-10-16T18:16:57.225 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:16:57.230 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:16:57.230 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:16:57.231 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:16:57.231 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:17:56.910 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:17:56.913 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:18:27.058 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:18:27.061 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:18:57.400 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:18:57.403 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:19:27.494 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:19:27.496 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:19:57.588 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:19:57.591 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:20:28.040 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:20:28.043 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:20:58.142 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:20:58.145 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:21:28.293 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:21:28.297 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:21:58.395 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:21:58.398 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:22:28.488 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:22:28.491 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:22:58.920 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:22:58.928 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:23:29.042 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:23:29.045 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:23:59.141 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:23:59.144 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:24:29.290 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:24:29.293 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:24:29.372 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T18:24:29.372+0000 7f3e3026f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 670987) UID: 0 2023-10-16T18:24:29.373 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T18:24:29.373+0000 7f9480ec4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 670987) UID: 0 2023-10-16T18:24:29.373 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T18:24:29.373+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 670987) UID: 0 2023-10-16T18:24:29.374 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T18:24:29.375+0000 7f18f4d1b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 670987) UID: 0 2023-10-16T18:26:20.749 INFO:teuthology.orchestra.run.smithi124.stdout:generic/538 563s 2023-10-16T18:26:20.791 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/538 2023-10-16T18:26:20.791 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:26:20.794 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:21.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:26:21.401 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-10-16T18:26:21.860 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:26:21.874 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:26:21.875 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:26:21.876 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:26:21.876 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:24.822 INFO:teuthology.orchestra.run.smithi124.stdout:generic/539 2s 2023-10-16T18:26:24.832 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/539 2023-10-16T18:26:24.833 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:26:24.835 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:25.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:26:25.078 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-10-16T18:26:25.718 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:26:25.754 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:26:25.758 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:26:25.760 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:26:25.760 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:27.283 INFO:teuthology.orchestra.run.smithi124.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T18:26:27.292 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/540 2023-10-16T18:26:27.292 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/540 2023-10-16T18:26:27.292 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:26:27.297 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:27.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:26:27.462 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-10-16T18:26:27.870 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:26:27.879 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:26:27.879 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:26:27.881 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:26:27.881 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:29.131 INFO:teuthology.orchestra.run.smithi124.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T18:26:29.184 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/541 2023-10-16T18:26:29.184 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/541 2023-10-16T18:26:29.184 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:26:29.187 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:29.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:26:29.283 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-10-16T18:26:29.779 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:26:29.791 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:26:29.797 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:26:29.801 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:26:29.801 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:31.074 INFO:teuthology.orchestra.run.smithi124.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T18:26:31.081 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/542 2023-10-16T18:26:31.082 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/542 2023-10-16T18:26:31.082 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:26:31.086 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:31.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:26:31.259 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-10-16T18:26:31.749 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:26:31.766 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:26:31.767 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:26:31.772 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:26:31.772 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:33.072 INFO:teuthology.orchestra.run.smithi124.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T18:26:33.110 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/543 2023-10-16T18:26:33.110 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/543 2023-10-16T18:26:33.110 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:26:33.151 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:33.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:26:33.202 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-10-16T18:26:33.668 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:26:33.679 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:26:33.679 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:26:33.680 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:26:33.681 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:34.937 INFO:teuthology.orchestra.run.smithi124.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2023-10-16T18:26:34.978 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/544 2023-10-16T18:26:34.978 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/544 2023-10-16T18:26:34.978 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:26:34.981 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:35.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:26:35.068 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-10-16T18:26:35.470 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:26:35.488 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:26:35.488 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:26:35.489 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:26:35.490 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:36.243 INFO:teuthology.orchestra.run.smithi124.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-10-16T18:26:36.250 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/545 2023-10-16T18:26:36.251 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/545 2023-10-16T18:26:36.251 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:26:36.252 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:36.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:26:36.333 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-10-16T18:26:36.793 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:26:36.803 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:26:36.803 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:26:36.804 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:26:36.804 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:37.482 INFO:teuthology.orchestra.run.smithi124.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-16T18:26:37.488 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/546 2023-10-16T18:26:37.488 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/546 2023-10-16T18:26:37.489 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:26:37.493 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:37.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:26:37.558 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-10-16T18:26:38.001 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:26:38.012 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:26:38.012 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:26:38.013 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:26:38.014 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:38.577 INFO:teuthology.orchestra.run.smithi124.stdout:generic/547 [not run] require 172.21.15.124:6789:/scratch to be valid block disk 2023-10-16T18:26:38.582 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/547 2023-10-16T18:26:38.582 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/547 2023-10-16T18:26:38.582 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:26:38.585 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:38.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:26:38.626 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-10-16T18:26:39.036 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:26:39.051 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:26:39.052 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:26:39.052 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:26:39.053 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:39.971 INFO:teuthology.orchestra.run.smithi124.stdout:generic/548 [not run] kernel does not support ceph encryption 2023-10-16T18:26:40.000 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/548 2023-10-16T18:26:40.000 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/548 2023-10-16T18:26:40.001 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:26:40.003 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:40.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:26:40.040 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-10-16T18:26:40.494 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:26:40.498 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:26:40.498 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:26:40.506 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:26:40.506 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:41.368 INFO:teuthology.orchestra.run.smithi124.stdout:generic/549 [not run] kernel does not support ceph encryption 2023-10-16T18:26:41.393 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/549 2023-10-16T18:26:41.393 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/549 2023-10-16T18:26:41.394 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:26:41.395 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:41.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:26:41.429 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-10-16T18:26:41.808 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:26:41.813 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:26:41.813 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:26:41.828 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:26:41.828 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:42.762 INFO:teuthology.orchestra.run.smithi124.stdout:generic/550 [not run] kernel does not support ceph encryption 2023-10-16T18:26:42.797 INFO:teuthology.orchestra.run.smithi124.stdout:Ran: generic/550 2023-10-16T18:26:42.797 INFO:teuthology.orchestra.run.smithi124.stdout:Not run: generic/550 2023-10-16T18:26:42.798 INFO:teuthology.orchestra.run.smithi124.stdout:Passed all 1 tests 2023-10-16T18:26:42.801 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:26:42.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T18:26:42.836 DEBUG:teuthology.orchestra.run.smithi124:> (cd /tmp/tmp.pHbfHGg5qgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-10-16T18:26:43.289 INFO:teuthology.orchestra.run.smithi124.stdout:FSTYP -- ceph 2023-10-16T18:26:43.293 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM -- Linux/x86_64 smithi124 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-10-16T18:26:43.294 INFO:teuthology.orchestra.run.smithi124.stdout:MKFS_OPTIONS -- 172.21.15.124:6789:/scratch 2023-10-16T18:26:43.295 INFO:teuthology.orchestra.run.smithi124.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBQMy1lwcnCCxAAcR4AGHa901OPBlJ3lf1Wdg== -o context=system_u:object_r:root_t:s0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch 2023-10-16T18:26:43.295 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:27:53.075 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:27:53.079 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:27:53.321 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T18:27:53.320+0000 7f18f4d1b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 679951) UID: 0 2023-10-16T18:27:53.321 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T18:27:53.319+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 679951) UID: 0 2023-10-16T18:27:53.322 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T18:27:53.320+0000 7f3e3026f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 679951) UID: 0 2023-10-16T18:27:53.322 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T18:27:53.321+0000 7f9480ec4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 679951) UID: 0 2023-10-16T18:31:43.008 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:31:43.012 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:31:43.262 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T18:31:43.259+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128440) UID: 0 2023-10-16T18:31:43.262 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T18:31:43.259+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128440) UID: 0 2023-10-16T18:31:43.263 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T18:31:43.259+0000 7f95afc78700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128440) UID: 0 2023-10-16T18:31:43.263 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T18:31:43.259+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128440) UID: 0 2023-10-16T18:35:31.352 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:35:31.356 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:36:01.523 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:36:01.527 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:36:32.019 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:36:32.022 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:37:02.288 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:37:02.290 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:37:32.659 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:37:32.662 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:38:02.722 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:38:02.726 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:38:02.798 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T18:38:02.797+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128912) UID: 0 2023-10-16T18:38:02.798 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T18:38:02.797+0000 7f95afc78700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128912) UID: 0 2023-10-16T18:38:02.799 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T18:38:02.797+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128912) UID: 0 2023-10-16T18:38:02.803 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T18:38:02.802+0000 7ff25cecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128912) UID: 0 2023-10-16T18:41:24.052 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:41:24.056 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:41:24.215 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T18:41:24.214+0000 7f18f4d1b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 682176) UID: 0 2023-10-16T18:41:24.216 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T18:41:24.214+0000 7f4702f32700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 682176) UID: 0 2023-10-16T18:41:24.216 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T18:41:24.214+0000 7f9480ec4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 682176) UID: 0 2023-10-16T18:41:24.217 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T18:41:24.214+0000 7f3e3026f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 682176) UID: 0 2023-10-16T18:42:02.000 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T18:42:01.999+0000 7ff2532a6700 -1 bdev(0x560abb696000 /var/lib/ceph/osd/ceph-5/block) _aio_thread got r=-28 ((28) No space left on device) 2023-10-16T18:42:02.154 INFO:tasks.ceph.osd.5.smithi192.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6730-g4ba8a190/rpm/el8/BUILD/ceph-18.0.0-6730-g4ba8a190/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7ff2532a6700 time 2023-10-16T18:42:02.035531+0000 2023-10-16T18:42:02.155 INFO:tasks.ceph.osd.5.smithi192.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6730-g4ba8a190/rpm/el8/BUILD/ceph-18.0.0-6730-g4ba8a190/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-10-16T18:42:02.155 INFO:tasks.ceph.osd.5.smithi192.stderr: ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev) 2023-10-16T18:42:02.155 INFO:tasks.ceph.osd.5.smithi192.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x560ab7656821] 2023-10-16T18:42:02.155 INFO:tasks.ceph.osd.5.smithi192.stderr: 2: (KernelDevice::_aio_thread()+0x1686) [0x560ab82babc6] 2023-10-16T18:42:02.155 INFO:tasks.ceph.osd.5.smithi192.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x560ab82c05e1] 2023-10-16T18:42:02.156 INFO:tasks.ceph.osd.5.smithi192.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7ff2655cc1cf] 2023-10-16T18:42:02.156 INFO:tasks.ceph.osd.5.smithi192.stderr: 5: clone() 2023-10-16T18:42:02.157 INFO:tasks.ceph.osd.5.smithi192.stderr:*** Caught signal (Aborted) ** 2023-10-16T18:42:02.158 INFO:tasks.ceph.osd.5.smithi192.stderr: in thread 7ff2532a6700 thread_name:bstore_aio 2023-10-16T18:42:02.158 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T18:42:02.153+0000 7ff2532a6700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6730-g4ba8a190/rpm/el8/BUILD/ceph-18.0.0-6730-g4ba8a190/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7ff2532a6700 time 2023-10-16T18:42:02.035531+0000 2023-10-16T18:42:02.158 INFO:tasks.ceph.osd.5.smithi192.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6730-g4ba8a190/rpm/el8/BUILD/ceph-18.0.0-6730-g4ba8a190/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-10-16T18:42:02.158 INFO:tasks.ceph.osd.5.smithi192.stderr: 2023-10-16T18:42:02.158 INFO:tasks.ceph.osd.5.smithi192.stderr: ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev) 2023-10-16T18:42:02.159 INFO:tasks.ceph.osd.5.smithi192.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x560ab7656821] 2023-10-16T18:42:02.159 INFO:tasks.ceph.osd.5.smithi192.stderr: 2: (KernelDevice::_aio_thread()+0x1686) [0x560ab82babc6] 2023-10-16T18:42:02.159 INFO:tasks.ceph.osd.5.smithi192.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x560ab82c05e1] 2023-10-16T18:42:02.159 INFO:tasks.ceph.osd.5.smithi192.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7ff2655cc1cf] 2023-10-16T18:42:02.159 INFO:tasks.ceph.osd.5.smithi192.stderr: 5: clone() 2023-10-16T18:42:02.159 INFO:tasks.ceph.osd.5.smithi192.stderr: 2023-10-16T18:42:02.160 INFO:tasks.ceph.osd.5.smithi192.stderr: ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev) 2023-10-16T18:42:02.160 INFO:tasks.ceph.osd.5.smithi192.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7ff2655d6ce0] 2023-10-16T18:42:02.160 INFO:tasks.ceph.osd.5.smithi192.stderr: 2: gsignal() 2023-10-16T18:42:02.160 INFO:tasks.ceph.osd.5.smithi192.stderr: 3: abort() 2023-10-16T18:42:02.160 INFO:tasks.ceph.osd.5.smithi192.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x560ab76568e1] 2023-10-16T18:42:02.161 INFO:tasks.ceph.osd.5.smithi192.stderr: 5: (KernelDevice::_aio_thread()+0x1686) [0x560ab82babc6] 2023-10-16T18:42:02.161 INFO:tasks.ceph.osd.5.smithi192.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x560ab82c05e1] 2023-10-16T18:42:02.161 INFO:tasks.ceph.osd.5.smithi192.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7ff2655cc1cf] 2023-10-16T18:42:02.161 INFO:tasks.ceph.osd.5.smithi192.stderr: 8: clone() 2023-10-16T18:42:02.180 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-16T18:42:02.180+0000 7ff2532a6700 -1 *** Caught signal (Aborted) ** 2023-10-16T18:42:02.181 INFO:tasks.ceph.osd.5.smithi192.stderr: in thread 7ff2532a6700 thread_name:bstore_aio 2023-10-16T18:42:02.181 INFO:tasks.ceph.osd.5.smithi192.stderr: 2023-10-16T18:42:02.181 INFO:tasks.ceph.osd.5.smithi192.stderr: ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev) 2023-10-16T18:42:02.181 INFO:tasks.ceph.osd.5.smithi192.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7ff2655d6ce0] 2023-10-16T18:42:02.181 INFO:tasks.ceph.osd.5.smithi192.stderr: 2: gsignal() 2023-10-16T18:42:02.182 INFO:tasks.ceph.osd.5.smithi192.stderr: 3: abort() 2023-10-16T18:42:02.182 INFO:tasks.ceph.osd.5.smithi192.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x560ab76568e1] 2023-10-16T18:42:02.182 INFO:tasks.ceph.osd.5.smithi192.stderr: 5: (KernelDevice::_aio_thread()+0x1686) [0x560ab82babc6] 2023-10-16T18:42:02.182 INFO:tasks.ceph.osd.5.smithi192.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x560ab82c05e1] 2023-10-16T18:42:02.182 INFO:tasks.ceph.osd.5.smithi192.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7ff2655cc1cf] 2023-10-16T18:42:02.183 INFO:tasks.ceph.osd.5.smithi192.stderr: 8: clone() 2023-10-16T18:42:02.183 INFO:tasks.ceph.osd.5.smithi192.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-16T18:42:02.183 INFO:tasks.ceph.osd.5.smithi192.stderr: 2023-10-16T18:42:02.188 INFO:tasks.ceph.osd.5.smithi192.stderr: -5227> 2023-10-16T18:42:02.153+0000 7ff2532a6700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6730-g4ba8a190/rpm/el8/BUILD/ceph-18.0.0-6730-g4ba8a190/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7ff2532a6700 time 2023-10-16T18:42:02.035531+0000 2023-10-16T18:42:02.189 INFO:tasks.ceph.osd.5.smithi192.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6730-g4ba8a190/rpm/el8/BUILD/ceph-18.0.0-6730-g4ba8a190/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-10-16T18:42:02.189 INFO:tasks.ceph.osd.5.smithi192.stderr: 2023-10-16T18:42:02.189 INFO:tasks.ceph.osd.5.smithi192.stderr: ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev) 2023-10-16T18:42:02.189 INFO:tasks.ceph.osd.5.smithi192.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x560ab7656821] 2023-10-16T18:42:02.189 INFO:tasks.ceph.osd.5.smithi192.stderr: 2: (KernelDevice::_aio_thread()+0x1686) [0x560ab82babc6] 2023-10-16T18:42:02.190 INFO:tasks.ceph.osd.5.smithi192.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x560ab82c05e1] 2023-10-16T18:42:02.190 INFO:tasks.ceph.osd.5.smithi192.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7ff2655cc1cf] 2023-10-16T18:42:02.190 INFO:tasks.ceph.osd.5.smithi192.stderr: 5: clone() 2023-10-16T18:42:02.190 INFO:tasks.ceph.osd.5.smithi192.stderr: 2023-10-16T18:42:02.194 INFO:tasks.ceph.osd.5.smithi192.stderr: 0> 2023-10-16T18:42:02.180+0000 7ff2532a6700 -1 *** Caught signal (Aborted) ** 2023-10-16T18:42:02.194 INFO:tasks.ceph.osd.5.smithi192.stderr: in thread 7ff2532a6700 thread_name:bstore_aio 2023-10-16T18:42:02.195 INFO:tasks.ceph.osd.5.smithi192.stderr: 2023-10-16T18:42:02.195 INFO:tasks.ceph.osd.5.smithi192.stderr: ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev) 2023-10-16T18:42:02.195 INFO:tasks.ceph.osd.5.smithi192.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7ff2655d6ce0] 2023-10-16T18:42:02.195 INFO:tasks.ceph.osd.5.smithi192.stderr: 2: gsignal() 2023-10-16T18:42:02.195 INFO:tasks.ceph.osd.5.smithi192.stderr: 3: abort() 2023-10-16T18:42:02.196 INFO:tasks.ceph.osd.5.smithi192.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x560ab76568e1] 2023-10-16T18:42:02.196 INFO:tasks.ceph.osd.5.smithi192.stderr: 5: (KernelDevice::_aio_thread()+0x1686) [0x560ab82babc6] 2023-10-16T18:42:02.196 INFO:tasks.ceph.osd.5.smithi192.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x560ab82c05e1] 2023-10-16T18:42:02.196 INFO:tasks.ceph.osd.5.smithi192.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7ff2655cc1cf] 2023-10-16T18:42:02.196 INFO:tasks.ceph.osd.5.smithi192.stderr: 8: clone() 2023-10-16T18:42:02.196 INFO:tasks.ceph.osd.5.smithi192.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-16T18:42:02.197 INFO:tasks.ceph.osd.5.smithi192.stderr: 2023-10-16T18:42:02.201 INFO:tasks.ceph.osd.5.smithi192.stderr: -5229> 2023-10-16T18:42:02.153+0000 7ff2532a6700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6730-g4ba8a190/rpm/el8/BUILD/ceph-18.0.0-6730-g4ba8a190/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7ff2532a6700 time 2023-10-16T18:42:02.035531+0000 2023-10-16T18:42:02.201 INFO:tasks.ceph.osd.5.smithi192.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6730-g4ba8a190/rpm/el8/BUILD/ceph-18.0.0-6730-g4ba8a190/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-10-16T18:42:02.201 INFO:tasks.ceph.osd.5.smithi192.stderr: 2023-10-16T18:42:02.202 INFO:tasks.ceph.osd.5.smithi192.stderr: ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev) 2023-10-16T18:42:02.202 INFO:tasks.ceph.osd.5.smithi192.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x560ab7656821] 2023-10-16T18:42:02.202 INFO:tasks.ceph.osd.5.smithi192.stderr: 2: (KernelDevice::_aio_thread()+0x1686) [0x560ab82babc6] 2023-10-16T18:42:02.202 INFO:tasks.ceph.osd.5.smithi192.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x560ab82c05e1] 2023-10-16T18:42:02.202 INFO:tasks.ceph.osd.5.smithi192.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7ff2655cc1cf] 2023-10-16T18:42:02.203 INFO:tasks.ceph.osd.5.smithi192.stderr: 5: clone() 2023-10-16T18:42:02.203 INFO:tasks.ceph.osd.5.smithi192.stderr: 2023-10-16T18:42:02.209 INFO:tasks.ceph.osd.5.smithi192.stderr: -2> 2023-10-16T18:42:02.180+0000 7ff2532a6700 -1 *** Caught signal (Aborted) ** 2023-10-16T18:42:02.209 INFO:tasks.ceph.osd.5.smithi192.stderr: in thread 7ff2532a6700 thread_name:bstore_aio 2023-10-16T18:42:02.210 INFO:tasks.ceph.osd.5.smithi192.stderr: 2023-10-16T18:42:02.210 INFO:tasks.ceph.osd.5.smithi192.stderr: ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev) 2023-10-16T18:42:02.210 INFO:tasks.ceph.osd.5.smithi192.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7ff2655d6ce0] 2023-10-16T18:42:02.210 INFO:tasks.ceph.osd.5.smithi192.stderr: 2: gsignal() 2023-10-16T18:42:02.210 INFO:tasks.ceph.osd.5.smithi192.stderr: 3: abort() 2023-10-16T18:42:02.211 INFO:tasks.ceph.osd.5.smithi192.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x560ab76568e1] 2023-10-16T18:42:02.211 INFO:tasks.ceph.osd.5.smithi192.stderr: 5: (KernelDevice::_aio_thread()+0x1686) [0x560ab82babc6] 2023-10-16T18:42:02.211 INFO:tasks.ceph.osd.5.smithi192.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x560ab82c05e1] 2023-10-16T18:42:02.211 INFO:tasks.ceph.osd.5.smithi192.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7ff2655cc1cf] 2023-10-16T18:42:02.211 INFO:tasks.ceph.osd.5.smithi192.stderr: 8: clone() 2023-10-16T18:42:02.211 INFO:tasks.ceph.osd.5.smithi192.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-16T18:42:02.212 INFO:tasks.ceph.osd.5.smithi192.stderr: 2023-10-16T18:42:02.376 INFO:tasks.ceph.osd.5.smithi192.stderr:daemon-helper: command failed with exit status 5 2023-10-16T18:42:03.748 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-10-16T18:42:10.358 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~7s 2023-10-16T18:42:16.970 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~13s 2023-10-16T18:42:23.582 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~20s 2023-10-16T18:42:30.194 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~26s 2023-10-16T18:42:36.807 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~33s 2023-10-16T18:42:43.420 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~40s 2023-10-16T18:42:50.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~46s 2023-10-16T18:42:56.643 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~53s 2023-10-16T18:43:03.256 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~60s 2023-10-16T18:43:09.869 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~66s 2023-10-16T18:43:13.093 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T18:43:13.092+0000 7f947729b700 -1 bdev(0x561b2fa84000 /var/lib/ceph/osd/ceph-3/block) _aio_thread got r=-28 ((28) No space left on device) 2023-10-16T18:43:13.245 INFO:tasks.ceph.osd.3.smithi124.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6730-g4ba8a190/rpm/el8/BUILD/ceph-18.0.0-6730-g4ba8a190/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f947729b700 time 2023-10-16T18:43:13.160334+0000 2023-10-16T18:43:13.246 INFO:tasks.ceph.osd.3.smithi124.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6730-g4ba8a190/rpm/el8/BUILD/ceph-18.0.0-6730-g4ba8a190/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-10-16T18:43:13.246 INFO:tasks.ceph.osd.3.smithi124.stderr: ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev) 2023-10-16T18:43:13.246 INFO:tasks.ceph.osd.3.smithi124.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x561b2c2f5821] 2023-10-16T18:43:13.246 INFO:tasks.ceph.osd.3.smithi124.stderr: 2: (KernelDevice::_aio_thread()+0x1686) [0x561b2cf59bc6] 2023-10-16T18:43:13.247 INFO:tasks.ceph.osd.3.smithi124.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x561b2cf5f5e1] 2023-10-16T18:43:13.247 INFO:tasks.ceph.osd.3.smithi124.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f94895c11cf] 2023-10-16T18:43:13.247 INFO:tasks.ceph.osd.3.smithi124.stderr: 5: clone() 2023-10-16T18:43:13.248 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T18:43:13.245+0000 7f947729b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6730-g4ba8a190/rpm/el8/BUILD/ceph-18.0.0-6730-g4ba8a190/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f947729b700 time 2023-10-16T18:43:13.160334+0000 2023-10-16T18:43:13.248 INFO:tasks.ceph.osd.3.smithi124.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6730-g4ba8a190/rpm/el8/BUILD/ceph-18.0.0-6730-g4ba8a190/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-10-16T18:43:13.248 INFO:tasks.ceph.osd.3.smithi124.stderr: 2023-10-16T18:43:13.248 INFO:tasks.ceph.osd.3.smithi124.stderr: ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev) 2023-10-16T18:43:13.248 INFO:tasks.ceph.osd.3.smithi124.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x561b2c2f5821] 2023-10-16T18:43:13.249 INFO:tasks.ceph.osd.3.smithi124.stderr: 2: (KernelDevice::_aio_thread()+0x1686) [0x561b2cf59bc6] 2023-10-16T18:43:13.249 INFO:tasks.ceph.osd.3.smithi124.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x561b2cf5f5e1] 2023-10-16T18:43:13.249 INFO:tasks.ceph.osd.3.smithi124.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f94895c11cf] 2023-10-16T18:43:13.249 INFO:tasks.ceph.osd.3.smithi124.stderr: 5: clone() 2023-10-16T18:43:13.249 INFO:tasks.ceph.osd.3.smithi124.stderr: 2023-10-16T18:43:13.250 INFO:tasks.ceph.osd.3.smithi124.stderr:*** Caught signal (Aborted) ** 2023-10-16T18:43:13.250 INFO:tasks.ceph.osd.3.smithi124.stderr: in thread 7f947729b700 thread_name:bstore_aio 2023-10-16T18:43:13.250 INFO:tasks.ceph.osd.3.smithi124.stderr: ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev) 2023-10-16T18:43:13.251 INFO:tasks.ceph.osd.3.smithi124.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f94895cbce0] 2023-10-16T18:43:13.251 INFO:tasks.ceph.osd.3.smithi124.stderr: 2: gsignal() 2023-10-16T18:43:13.251 INFO:tasks.ceph.osd.3.smithi124.stderr: 3: abort() 2023-10-16T18:43:13.251 INFO:tasks.ceph.osd.3.smithi124.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x561b2c2f58e1] 2023-10-16T18:43:13.251 INFO:tasks.ceph.osd.3.smithi124.stderr: 5: (KernelDevice::_aio_thread()+0x1686) [0x561b2cf59bc6] 2023-10-16T18:43:13.252 INFO:tasks.ceph.osd.3.smithi124.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x561b2cf5f5e1] 2023-10-16T18:43:13.252 INFO:tasks.ceph.osd.3.smithi124.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f94895c11cf] 2023-10-16T18:43:13.252 INFO:tasks.ceph.osd.3.smithi124.stderr: 8: clone() 2023-10-16T18:43:13.503 INFO:tasks.ceph.osd.3.smithi124.stderr:2023-10-16T18:43:13.503+0000 7f947729b700 -1 *** Caught signal (Aborted) ** 2023-10-16T18:43:13.504 INFO:tasks.ceph.osd.3.smithi124.stderr: in thread 7f947729b700 thread_name:bstore_aio 2023-10-16T18:43:13.504 INFO:tasks.ceph.osd.3.smithi124.stderr: 2023-10-16T18:43:13.504 INFO:tasks.ceph.osd.3.smithi124.stderr: ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev) 2023-10-16T18:43:13.504 INFO:tasks.ceph.osd.3.smithi124.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f94895cbce0] 2023-10-16T18:43:13.505 INFO:tasks.ceph.osd.3.smithi124.stderr: 2: gsignal() 2023-10-16T18:43:13.505 INFO:tasks.ceph.osd.3.smithi124.stderr: 3: abort() 2023-10-16T18:43:13.505 INFO:tasks.ceph.osd.3.smithi124.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x561b2c2f58e1] 2023-10-16T18:43:13.505 INFO:tasks.ceph.osd.3.smithi124.stderr: 5: (KernelDevice::_aio_thread()+0x1686) [0x561b2cf59bc6] 2023-10-16T18:43:13.506 INFO:tasks.ceph.osd.3.smithi124.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x561b2cf5f5e1] 2023-10-16T18:43:13.506 INFO:tasks.ceph.osd.3.smithi124.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f94895c11cf] 2023-10-16T18:43:13.506 INFO:tasks.ceph.osd.3.smithi124.stderr: 8: clone() 2023-10-16T18:43:13.506 INFO:tasks.ceph.osd.3.smithi124.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-16T18:43:13.506 INFO:tasks.ceph.osd.3.smithi124.stderr: 2023-10-16T18:43:13.512 INFO:tasks.ceph.osd.3.smithi124.stderr: -7248> 2023-10-16T18:43:13.092+0000 7f947729b700 -1 bdev(0x561b2fa84000 /var/lib/ceph/osd/ceph-3/block) _aio_thread got r=-28 ((28) No space left on device) 2023-10-16T18:43:13.522 INFO:tasks.ceph.osd.3.smithi124.stderr: -273> 2023-10-16T18:43:13.245+0000 7f947729b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6730-g4ba8a190/rpm/el8/BUILD/ceph-18.0.0-6730-g4ba8a190/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f947729b700 time 2023-10-16T18:43:13.160334+0000 2023-10-16T18:43:13.523 INFO:tasks.ceph.osd.3.smithi124.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6730-g4ba8a190/rpm/el8/BUILD/ceph-18.0.0-6730-g4ba8a190/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-10-16T18:43:13.523 INFO:tasks.ceph.osd.3.smithi124.stderr: 2023-10-16T18:43:13.523 INFO:tasks.ceph.osd.3.smithi124.stderr: ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev) 2023-10-16T18:43:13.523 INFO:tasks.ceph.osd.3.smithi124.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x561b2c2f5821] 2023-10-16T18:43:13.523 INFO:tasks.ceph.osd.3.smithi124.stderr: 2: (KernelDevice::_aio_thread()+0x1686) [0x561b2cf59bc6] 2023-10-16T18:43:13.524 INFO:tasks.ceph.osd.3.smithi124.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x561b2cf5f5e1] 2023-10-16T18:43:13.524 INFO:tasks.ceph.osd.3.smithi124.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f94895c11cf] 2023-10-16T18:43:13.524 INFO:tasks.ceph.osd.3.smithi124.stderr: 5: clone() 2023-10-16T18:43:13.524 INFO:tasks.ceph.osd.3.smithi124.stderr: 2023-10-16T18:43:13.524 INFO:tasks.ceph.osd.3.smithi124.stderr: 0> 2023-10-16T18:43:13.503+0000 7f947729b700 -1 *** Caught signal (Aborted) ** 2023-10-16T18:43:13.525 INFO:tasks.ceph.osd.3.smithi124.stderr: in thread 7f947729b700 thread_name:bstore_aio 2023-10-16T18:43:13.525 INFO:tasks.ceph.osd.3.smithi124.stderr: 2023-10-16T18:43:13.525 INFO:tasks.ceph.osd.3.smithi124.stderr: ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev) 2023-10-16T18:43:13.525 INFO:tasks.ceph.osd.3.smithi124.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f94895cbce0] 2023-10-16T18:43:13.525 INFO:tasks.ceph.osd.3.smithi124.stderr: 2: gsignal() 2023-10-16T18:43:13.526 INFO:tasks.ceph.osd.3.smithi124.stderr: 3: abort() 2023-10-16T18:43:13.526 INFO:tasks.ceph.osd.3.smithi124.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x561b2c2f58e1] 2023-10-16T18:43:13.526 INFO:tasks.ceph.osd.3.smithi124.stderr: 5: (KernelDevice::_aio_thread()+0x1686) [0x561b2cf59bc6] 2023-10-16T18:43:13.526 INFO:tasks.ceph.osd.3.smithi124.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x561b2cf5f5e1] 2023-10-16T18:43:13.526 INFO:tasks.ceph.osd.3.smithi124.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f94895c11cf] 2023-10-16T18:43:13.527 INFO:tasks.ceph.osd.3.smithi124.stderr: 8: clone() 2023-10-16T18:43:13.527 INFO:tasks.ceph.osd.3.smithi124.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-16T18:43:13.527 INFO:tasks.ceph.osd.3.smithi124.stderr: 2023-10-16T18:43:13.527 INFO:tasks.ceph.osd.3.smithi124.stderr: -7261> 2023-10-16T18:43:13.092+0000 7f947729b700 -1 bdev(0x561b2fa84000 /var/lib/ceph/osd/ceph-3/block) _aio_thread got r=-28 ((28) No space left on device) 2023-10-16T18:43:13.538 INFO:tasks.ceph.osd.3.smithi124.stderr: -286> 2023-10-16T18:43:13.245+0000 7f947729b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6730-g4ba8a190/rpm/el8/BUILD/ceph-18.0.0-6730-g4ba8a190/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f947729b700 time 2023-10-16T18:43:13.160334+0000 2023-10-16T18:43:13.539 INFO:tasks.ceph.osd.3.smithi124.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6730-g4ba8a190/rpm/el8/BUILD/ceph-18.0.0-6730-g4ba8a190/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-10-16T18:43:13.539 INFO:tasks.ceph.osd.3.smithi124.stderr: 2023-10-16T18:43:13.539 INFO:tasks.ceph.osd.3.smithi124.stderr: ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev) 2023-10-16T18:43:13.539 INFO:tasks.ceph.osd.3.smithi124.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x561b2c2f5821] 2023-10-16T18:43:13.540 INFO:tasks.ceph.osd.3.smithi124.stderr: 2: (KernelDevice::_aio_thread()+0x1686) [0x561b2cf59bc6] 2023-10-16T18:43:13.540 INFO:tasks.ceph.osd.3.smithi124.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x561b2cf5f5e1] 2023-10-16T18:43:13.540 INFO:tasks.ceph.osd.3.smithi124.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f94895c11cf] 2023-10-16T18:43:13.540 INFO:tasks.ceph.osd.3.smithi124.stderr: 5: clone() 2023-10-16T18:43:13.540 INFO:tasks.ceph.osd.3.smithi124.stderr: 2023-10-16T18:43:13.541 INFO:tasks.ceph.osd.3.smithi124.stderr: -13> 2023-10-16T18:43:13.503+0000 7f947729b700 -1 *** Caught signal (Aborted) ** 2023-10-16T18:43:13.541 INFO:tasks.ceph.osd.3.smithi124.stderr: in thread 7f947729b700 thread_name:bstore_aio 2023-10-16T18:43:13.541 INFO:tasks.ceph.osd.3.smithi124.stderr: 2023-10-16T18:43:13.542 INFO:tasks.ceph.osd.3.smithi124.stderr: ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev) 2023-10-16T18:43:13.542 INFO:tasks.ceph.osd.3.smithi124.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f94895cbce0] 2023-10-16T18:43:13.542 INFO:tasks.ceph.osd.3.smithi124.stderr: 2: gsignal() 2023-10-16T18:43:13.542 INFO:tasks.ceph.osd.3.smithi124.stderr: 3: abort() 2023-10-16T18:43:13.542 INFO:tasks.ceph.osd.3.smithi124.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x561b2c2f58e1] 2023-10-16T18:43:13.543 INFO:tasks.ceph.osd.3.smithi124.stderr: 5: (KernelDevice::_aio_thread()+0x1686) [0x561b2cf59bc6] 2023-10-16T18:43:13.543 INFO:tasks.ceph.osd.3.smithi124.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x561b2cf5f5e1] 2023-10-16T18:43:13.543 INFO:tasks.ceph.osd.3.smithi124.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f94895c11cf] 2023-10-16T18:43:13.543 INFO:tasks.ceph.osd.3.smithi124.stderr: 8: clone() 2023-10-16T18:43:13.543 INFO:tasks.ceph.osd.3.smithi124.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-16T18:43:13.544 INFO:tasks.ceph.osd.3.smithi124.stderr: 2023-10-16T18:43:13.685 INFO:tasks.ceph.osd.3.smithi124.stderr:daemon-helper: command failed with exit status 5 2023-10-16T18:43:16.380 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-10-16T18:43:16.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~73s 2023-10-16T18:43:22.893 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~7s 2023-10-16T18:43:22.894 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~79s 2023-10-16T18:43:29.405 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~13s 2023-10-16T18:43:29.406 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~86s 2023-10-16T18:43:35.917 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~20s 2023-10-16T18:43:35.918 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~92s 2023-10-16T18:43:42.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~26s 2023-10-16T18:43:42.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~99s 2023-10-16T18:43:48.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~33s 2023-10-16T18:43:48.941 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~105s 2023-10-16T18:43:55.452 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~39s 2023-10-16T18:43:55.453 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~112s 2023-10-16T18:44:01.965 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~46s 2023-10-16T18:44:01.966 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~118s 2023-10-16T18:44:08.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~52s 2023-10-16T18:44:08.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~125s 2023-10-16T18:44:14.990 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~59s 2023-10-16T18:44:14.990 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~131s 2023-10-16T18:44:21.501 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~65s 2023-10-16T18:44:21.502 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~138s 2023-10-16T18:44:28.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~72s 2023-10-16T18:44:28.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~144s 2023-10-16T18:44:34.525 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~78s 2023-10-16T18:44:34.526 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~151s 2023-10-16T18:44:41.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~85s 2023-10-16T18:44:41.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~157s 2023-10-16T18:44:47.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~91s 2023-10-16T18:44:47.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~164s 2023-10-16T18:44:54.055 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~98s 2023-10-16T18:44:54.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~170s 2023-10-16T18:45:00.565 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~104s 2023-10-16T18:45:00.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~177s 2023-10-16T18:45:07.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~111s 2023-10-16T18:45:07.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~183s 2023-10-16T18:45:13.585 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~117s 2023-10-16T18:45:13.585 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~190s 2023-10-16T18:45:20.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~124s 2023-10-16T18:45:20.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~196s 2023-10-16T18:45:26.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~130s 2023-10-16T18:45:26.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~203s 2023-10-16T18:45:33.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~137s 2023-10-16T18:45:33.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~209s 2023-10-16T18:45:39.623 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~143s 2023-10-16T18:45:39.624 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~216s 2023-10-16T18:45:46.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~150s 2023-10-16T18:45:46.134 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~222s 2023-10-16T18:45:52.644 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~156s 2023-10-16T18:45:52.644 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~229s 2023-10-16T18:45:59.153 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~163s 2023-10-16T18:45:59.154 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~236s 2023-10-16T18:46:05.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~169s 2023-10-16T18:46:05.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~242s 2023-10-16T18:46:12.178 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~176s 2023-10-16T18:46:12.178 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~249s 2023-10-16T18:46:18.691 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~182s 2023-10-16T18:46:18.691 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~255s 2023-10-16T18:46:25.203 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~189s 2023-10-16T18:46:25.204 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~262s 2023-10-16T18:46:31.716 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~195s 2023-10-16T18:46:31.716 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~268s 2023-10-16T18:46:35.696 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:46:35.700 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:46:35.824 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T18:46:35.823+0000 7f4322fa5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129281) UID: 0 2023-10-16T18:46:35.825 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T18:46:35.823+0000 7f95afc78700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129281) UID: 0 2023-10-16T18:46:35.825 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T18:46:35.823+0000 7f5b62088700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129281) UID: 0 2023-10-16T18:46:38.228 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~202s 2023-10-16T18:46:38.229 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~275s 2023-10-16T18:46:44.741 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~208s 2023-10-16T18:46:44.741 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~281s 2023-10-16T18:46:51.253 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~215s 2023-10-16T18:46:51.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~288s 2023-10-16T18:46:57.765 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~221s 2023-10-16T18:46:57.766 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~294s 2023-10-16T18:47:04.277 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~228s 2023-10-16T18:47:04.278 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~301s 2023-10-16T18:47:04.278 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-10-16T18:47:04.278 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T18:47:04.279 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T18:47:04.392 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T18:47:04.393 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T18:47:04.454 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T18:47:04.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.801+0000 7fe2021fc700 1 Processor -- start 2023-10-16T18:47:04.801 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.801+0000 7fe2021fc700 1 -- start start 2023-10-16T18:47:04.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.802+0000 7fe2021fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1fc152470 0x7fe1fc0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:04.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.802+0000 7fe2021fc700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe1fc0cb8d0 0x7fe1fc0b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:04.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.802+0000 7fe2021fc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe1fc0b3240 0x7fe1fc0b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:04.804 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.802+0000 7fe2021fc700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1fc0b36d0 con 0x7fe1fc0cb8d0 2023-10-16T18:47:04.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.802+0000 7fe2021fc700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1fc071200 con 0x7fe1fc0b3240 2023-10-16T18:47:04.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.802+0000 7fe2021fc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc070d70 con 0x7fe1fc152470 2023-10-16T18:47:04.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.802+0000 7fe1faffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe1fc0cb8d0 0x7fe1fc0b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:04.805 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.802+0000 7fe1faffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe1fc0cb8d0 0x7fe1fc0b2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:39182/0 (socket says 172.21.15.124:39182) 2023-10-16T18:47:04.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.802+0000 7fe1faffd700 1 -- 172.21.15.124:0/1881941166 learned_addr learned my addr 172.21.15.124:0/1881941166 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T18:47:04.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.802+0000 7fe1fbfff700 1 --2- 172.21.15.124:0/1881941166 >> v2:172.21.15.192:3300/0 conn(0x7fe1fc0b3240 0x7fe1fc0b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:04.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.802+0000 7fe1fb7fe700 1 --2- 172.21.15.124:0/1881941166 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1fc152470 0x7fe1fc0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:04.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.802+0000 7fe1faffd700 1 -- 172.21.15.124:0/1881941166 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1fc152470 msgr2=0x7fe1fc0cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T18:47:04.806 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.802+0000 7fe1faffd700 1 --2- 172.21.15.124:0/1881941166 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1fc152470 0x7fe1fc0cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:04.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.802+0000 7fe1faffd700 1 -- 172.21.15.124:0/1881941166 >> v2:172.21.15.192:3300/0 conn(0x7fe1fc0b3240 msgr2=0x7fe1fc0b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T18:47:04.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.802+0000 7fe1faffd700 1 --2- 172.21.15.124:0/1881941166 >> v2:172.21.15.192:3300/0 conn(0x7fe1fc0b3240 0x7fe1fc0b60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:04.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.802+0000 7fe1faffd700 1 -- 172.21.15.124:0/1881941166 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1fc070440 con 0x7fe1fc0cb8d0 2023-10-16T18:47:04.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.802+0000 7fe1faffd700 1 --2- 172.21.15.124:0/1881941166 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1fc0cb8d0 0x7fe1fc0b2d00 secure :-1 s=READY pgs=2643 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc0cb860 tx=0x7fe1f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95eeeb4e99b0ec7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T18:47:04.807 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.803+0000 7fe1fa7fc700 1 -- 172.21.15.124:0/1881941166 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0011830 con 0x7fe1fc0cb8d0 2023-10-16T18:47:04.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.803+0000 7fe1fa7fc700 1 -- 172.21.15.124:0/1881941166 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f0011990 con 0x7fe1fc0cb8d0 2023-10-16T18:47:04.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.803+0000 7fe1fa7fc700 1 -- 172.21.15.124:0/1881941166 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0011d20 con 0x7fe1fc0cb8d0 2023-10-16T18:47:04.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.803+0000 7fe2021fc700 1 -- 172.21.15.124:0/1881941166 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1fc0cb8d0 msgr2=0x7fe1fc0b2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:04.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.803+0000 7fe2021fc700 1 --2- 172.21.15.124:0/1881941166 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1fc0cb8d0 0x7fe1fc0b2d00 secure :-1 s=READY pgs=2643 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc0cb860 tx=0x7fe1f0009bd0 comp rx=0 tx=0).stop 2023-10-16T18:47:04.808 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.803+0000 7fe2021fc700 1 -- 172.21.15.124:0/1881941166 shutdown_connections 2023-10-16T18:47:04.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.803+0000 7fe2021fc700 1 --2- 172.21.15.124:0/1881941166 >> v2:172.21.15.192:3300/0 conn(0x7fe1fc0b3240 0x7fe1fc0b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:04.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.803+0000 7fe2021fc700 1 --2- 172.21.15.124:0/1881941166 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1fc152470 0x7fe1fc0cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:04.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.803+0000 7fe2021fc700 1 --2- 172.21.15.124:0/1881941166 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1fc0cb8d0 0x7fe1fc0b2d00 unknown :-1 s=CLOSED pgs=2643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:04.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.803+0000 7fe2021fc700 1 -- 172.21.15.124:0/1881941166 >> 172.21.15.124:0/1881941166 conn(0x7fe1fc0cdd00 msgr2=0x7fe1fc0ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T18:47:04.809 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.803+0000 7fe2021fc700 1 -- 172.21.15.124:0/1881941166 shutdown_connections 2023-10-16T18:47:04.810 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.803+0000 7fe2021fc700 1 -- 172.21.15.124:0/1881941166 wait complete. 2023-10-16T18:47:04.812 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.805+0000 7fe2021fc700 1 Processor -- start 2023-10-16T18:47:04.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.805+0000 7fe2021fc700 1 -- start start 2023-10-16T18:47:04.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.806+0000 7fe2021fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1fc0b3240 0x7fe1fc0c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:04.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.806+0000 7fe2021fc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1fc0cb8d0 0x7fe1fc0c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:04.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.806+0000 7fe2021fc700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1fc152470 0x7fe1fc151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:04.813 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.806+0000 7fe2021fc700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc0c56b0 con 0x7fe1fc152470 2023-10-16T18:47:04.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.806+0000 7fe2021fc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc0c5990 con 0x7fe1fc0cb8d0 2023-10-16T18:47:04.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.806+0000 7fe2021fc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc0c5c70 con 0x7fe1fc0b3240 2023-10-16T18:47:04.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.806+0000 7fe1fbfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1fc152470 0x7fe1fc151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:04.814 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.806+0000 7fe1fbfff700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1fc152470 0x7fe1fc151310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:39192/0 (socket says 172.21.15.124:39192) 2023-10-16T18:47:04.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.806+0000 7fe1fbfff700 1 -- 172.21.15.124:0/3240664497 learned_addr learned my addr 172.21.15.124:0/3240664497 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T18:47:04.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.806+0000 7fe1faffd700 1 --2- 172.21.15.124:0/3240664497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1fc0cb8d0 0x7fe1fc0c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:04.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.806+0000 7fe1fb7fe700 1 --2- 172.21.15.124:0/3240664497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1fc0b3240 0x7fe1fc0c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:04.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.807+0000 7fe1fbfff700 1 -- 172.21.15.124:0/3240664497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1fc0b3240 msgr2=0x7fe1fc0c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:04.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.807+0000 7fe1fbfff700 1 --2- 172.21.15.124:0/3240664497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1fc0b3240 0x7fe1fc0c4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:04.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.807+0000 7fe1fbfff700 1 -- 172.21.15.124:0/3240664497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1fc0cb8d0 msgr2=0x7fe1fc0c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:04.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.807+0000 7fe1fbfff700 1 --2- 172.21.15.124:0/3240664497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1fc0cb8d0 0x7fe1fc0c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:04.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.807+0000 7fe1fbfff700 1 -- 172.21.15.124:0/3240664497 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f0009550 con 0x7fe1fc152470 2023-10-16T18:47:04.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.807+0000 7fe1fbfff700 1 --2- 172.21.15.124:0/3240664497 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1fc152470 0x7fe1fc151310 secure :-1 s=READY pgs=2644 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400eed0 tx=0x7fe1f400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T18:47:04.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.807+0000 7fe1e3fff700 1 -- 172.21.15.124:0/3240664497 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4010040 con 0x7fe1fc152470 2023-10-16T18:47:04.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.807+0000 7fe1e3fff700 1 -- 172.21.15.124:0/3240664497 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f400b9f0 con 0x7fe1fc152470 2023-10-16T18:47:04.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.807+0000 7fe1e3fff700 1 -- 172.21.15.124:0/3240664497 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f400bda0 con 0x7fe1fc152470 2023-10-16T18:47:04.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.807+0000 7fe2021fc700 1 -- 172.21.15.124:0/3240664497 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1fc0c5f50 con 0x7fe1fc152470 2023-10-16T18:47:04.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.807+0000 7fe2021fc700 1 -- 172.21.15.124:0/3240664497 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1fc0c6750 con 0x7fe1fc152470 2023-10-16T18:47:04.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.808+0000 7fe2021fc700 1 -- 172.21.15.124:0/3240664497 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1fc0c6470 con 0x7fe1fc152470 2023-10-16T18:47:04.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.808+0000 7fe1e3fff700 1 -- 172.21.15.124:0/3240664497 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe1f4014400 con 0x7fe1fc152470 2023-10-16T18:47:04.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.809+0000 7fe1e3fff700 1 --2- 172.21.15.124:0/3240664497 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe1e806af00 0x7fe1e806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:04.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.809+0000 7fe1fb7fe700 1 --2- 172.21.15.124:0/3240664497 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe1e806af00 0x7fe1e806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:04.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.809+0000 7fe1e3fff700 1 -- 172.21.15.124:0/3240664497 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe1f40899b0 con 0x7fe1fc152470 2023-10-16T18:47:04.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.809+0000 7fe1fb7fe700 1 --2- 172.21.15.124:0/3240664497 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe1e806af00 0x7fe1e806d3c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009be0 tx=0x7fe1ec009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T18:47:04.819 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:04.814+0000 7fe1e3fff700 1 -- 172.21.15.124:0/3240664497 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe1f4054990 con 0x7fe1fc152470 2023-10-16T18:47:05.005 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.005+0000 7fe2021fc700 1 -- 172.21.15.124:0/3240664497 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1fc04ebb0 con 0x7fe1fc152470 2023-10-16T18:47:05.006 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.006+0000 7fe1e3fff700 1 -- 172.21.15.124:0/3240664497 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+16702 (secure 0 0 0) 0x7fe1f4018090 con 0x7fe1fc152470 2023-10-16T18:47:05.007 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-16T18:47:05.008 INFO:teuthology.orchestra.run.smithi124.stdout:{"epoch":44,"fsid":"4cfd077b-2400-4ae1-a7e8-14265fee7113","created":"2023-10-16T12:58:26.663189+0000","modified":"2023-10-16T18:43:15.135616+0000","last_up_change":"2023-10-16T18:43:14.128395+0000","last_in_change":"2023-10-16T12:58:29.146912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T12:58:38.667813+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-16T13:00:02.825330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"error_message":"pool 5 has some PGs where all OSDs are with primary_affinity 0 (at least pg 5.16), read balance score may not be reliable","score_acting":0,"score_stable":0}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-16T13:00:03.997396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"error_message":"pool 6 has some PGs where all OSDs are with primary_affinity 0 (at least pg 6.7), read balance score may not be reliable","score_acting":0,"score_stable":0}}],"osds":[{"osd":0,"uuid":"3fd9beed-b818-4b0c-a1c8-b86cceb9ad7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6801","nonce":930055859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6803","nonce":930055859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6807","nonce":930055859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":930055859},{"type":"v1","addr":"172.21.15.124:6805","nonce":930055859}]},"public_addr":"172.21.15.124:6801/930055859","cluster_addr":"172.21.15.124:6803/930055859","heartbeat_back_addr":"172.21.15.124:6807/930055859","heartbeat_front_addr":"172.21.15.124:6805/930055859","state":["exists","up"]},{"osd":1,"uuid":"deb906c8-57d9-4abe-917b-2d1589d96b0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6809","nonce":1996055598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6811","nonce":1996055598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6815","nonce":1996055598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6812","nonce":1996055598},{"type":"v1","addr":"172.21.15.124:6813","nonce":1996055598}]},"public_addr":"172.21.15.124:6809/1996055598","cluster_addr":"172.21.15.124:6811/1996055598","heartbeat_back_addr":"172.21.15.124:6815/1996055598","heartbeat_front_addr":"172.21.15.124:6813/1996055598","state":["exists","up"]},{"osd":2,"uuid":"070e620e-1305-4bf1-b54c-4ec6f4e787a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6817","nonce":2753229488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6819","nonce":2753229488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6823","nonce":2753229488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":2753229488},{"type":"v1","addr":"172.21.15.124:6821","nonce":2753229488}]},"public_addr":"172.21.15.124:6817/2753229488","cluster_addr":"172.21.15.124:6819/2753229488","heartbeat_back_addr":"172.21.15.124:6823/2753229488","heartbeat_front_addr":"172.21.15.124:6821/2753229488","state":["exists","up"]},{"osd":3,"uuid":"81433737-c62b-4885-9b41-513f2aca8821","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":43,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6825","nonce":115265899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6827","nonce":115265899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6831","nonce":115265899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":115265899},{"type":"v1","addr":"172.21.15.124:6829","nonce":115265899}]},"public_addr":"172.21.15.124:6825/115265899","cluster_addr":"172.21.15.124:6827/115265899","heartbeat_back_addr":"172.21.15.124:6831/115265899","heartbeat_front_addr":"172.21.15.124:6829/115265899","state":["exists"]},{"osd":4,"uuid":"4a17242a-6a6f-4946-bb53-4adae6fffb50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6809","nonce":4065801592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6811","nonce":4065801592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6815","nonce":4065801592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4065801592},{"type":"v1","addr":"172.21.15.192:6813","nonce":4065801592}]},"public_addr":"172.21.15.192:6809/4065801592","cluster_addr":"172.21.15.192:6811/4065801592","heartbeat_back_addr":"172.21.15.192:6815/4065801592","heartbeat_front_addr":"172.21.15.192:6813/4065801592","state":["exists","up"]},{"osd":5,"uuid":"cf425c73-5ceb-4ba9-a3ab-f8bdc4875547","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":41,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6818","nonce":651957595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6821","nonce":651957595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6827","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6828","nonce":651957595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":651957595},{"type":"v1","addr":"172.21.15.192:6825","nonce":651957595}]},"public_addr":"172.21.15.192:6818/651957595","cluster_addr":"172.21.15.192:6821/651957595","heartbeat_back_addr":"172.21.15.192:6828/651957595","heartbeat_front_addr":"172.21.15.192:6825/651957595","state":["exists"]},{"osd":6,"uuid":"2eff9d8e-923c-4636-8ae0-be38233c8fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6819","nonce":853874996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6824","nonce":853874996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6831","nonce":853874996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":853874996},{"type":"v1","addr":"172.21.15.192:6829","nonce":853874996}]},"public_addr":"172.21.15.192:6819/853874996","cluster_addr":"172.21.15.192:6824/853874996","heartbeat_back_addr":"172.21.15.192:6831/853874996","heartbeat_front_addr":"172.21.15.192:6829/853874996","state":["exists","up"]},{"osd":7,"uuid":"dffa1b27-4737-4208-81a0-713a52c7adf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6801","nonce":213455189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6803","nonce":213455189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6807","nonce":213455189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":213455189},{"type":"v1","addr":"172.21.15.192:6805","nonce":213455189}]},"public_addr":"172.21.15.192:6801/213455189","cluster_addr":"172.21.15.192:6803/213455189","heartbeat_back_addr":"172.21.15.192:6807/213455189","heartbeat_front_addr":"172.21.15.192:6805/213455189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.269231+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.370332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.339465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.355660+0000","dead_epoch":43},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.371720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.396537+0000","dead_epoch":41},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.380914+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T12:58:34.387746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.36","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T18:47:05.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.008+0000 7fe2021fc700 1 -- 172.21.15.124:0/3240664497 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe1e806af00 msgr2=0x7fe1e806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:05.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.008+0000 7fe2021fc700 1 --2- 172.21.15.124:0/3240664497 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe1e806af00 0x7fe1e806d3c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009be0 tx=0x7fe1ec009210 comp rx=0 tx=0).stop 2023-10-16T18:47:05.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.008+0000 7fe2021fc700 1 -- 172.21.15.124:0/3240664497 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1fc152470 msgr2=0x7fe1fc151310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:05.009 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.008+0000 7fe2021fc700 1 --2- 172.21.15.124:0/3240664497 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1fc152470 0x7fe1fc151310 secure :-1 s=READY pgs=2644 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400eed0 tx=0x7fe1f400ef00 comp rx=0 tx=0).stop 2023-10-16T18:47:05.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.008+0000 7fe2021fc700 1 -- 172.21.15.124:0/3240664497 shutdown_connections 2023-10-16T18:47:05.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.008+0000 7fe2021fc700 1 --2- 172.21.15.124:0/3240664497 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fe1e806af00 0x7fe1e806d3c0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.010 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.008+0000 7fe2021fc700 1 --2- 172.21.15.124:0/3240664497 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe1fc152470 0x7fe1fc151310 unknown :-1 s=CLOSED pgs=2644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.011 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.008+0000 7fe2021fc700 1 --2- 172.21.15.124:0/3240664497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1fc0b3240 0x7fe1fc0c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.011 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.008+0000 7fe2021fc700 1 --2- 172.21.15.124:0/3240664497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1fc0cb8d0 0x7fe1fc0c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.011 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.008+0000 7fe2021fc700 1 -- 172.21.15.124:0/3240664497 >> 172.21.15.124:0/3240664497 conn(0x7fe1fc0cdd00 msgr2=0x7fe1fc0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T18:47:05.011 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.009+0000 7fe2021fc700 1 -- 172.21.15.124:0/3240664497 shutdown_connections 2023-10-16T18:47:05.011 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.009+0000 7fe2021fc700 1 -- 172.21.15.124:0/3240664497 wait complete. 2023-10-16T18:47:05.022 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T12:58:38.667813+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T13:00:02.825330+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'error_message': 'pool 5 has some PGs where all OSDs are with primary_affinity 0 (at least pg 5.16), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T13:00:03.997396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'error_message': 'pool 6 has some PGs where all OSDs are with primary_affinity 0 (at least pg 6.7), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}] 2023-10-16T18:47:05.023 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T18:47:05.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.148+0000 7fa2fc470700 1 Processor -- start 2023-10-16T18:47:05.148 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.148+0000 7fa2fc470700 1 -- start start 2023-10-16T18:47:05.151 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.149+0000 7fa2fc470700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa2f4159b50 0x7fa2f406bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:05.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.149+0000 7fa2fc470700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa2f406e310 0x7fa2f40cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:05.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.149+0000 7fa2fc470700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2f406e7c0 0x7fa2f40ce280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:05.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.149+0000 7fa2fc470700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f4159f30 con 0x7fa2f4159b50 2023-10-16T18:47:05.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.149+0000 7fa2fc470700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f406ac90 con 0x7fa2f406e310 2023-10-16T18:47:05.152 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.149+0000 7fa2fc470700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f406af70 con 0x7fa2f406e7c0 2023-10-16T18:47:05.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.149+0000 7fa2fa20c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa2f4159b50 0x7fa2f406bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:05.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.149+0000 7fa2fa20c700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa2f4159b50 0x7fa2f406bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:39196/0 (socket says 172.21.15.124:39196) 2023-10-16T18:47:05.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.149+0000 7fa2fa20c700 1 -- 172.21.15.124:0/3777190393 learned_addr learned my addr 172.21.15.124:0/3777190393 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T18:47:05.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.149+0000 7fa2f9a0b700 1 --2- 172.21.15.124:0/3777190393 >> v2:172.21.15.192:3300/0 conn(0x7fa2f406e310 0x7fa2f40cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:05.153 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.149+0000 7fa2faa0d700 1 --2- 172.21.15.124:0/3777190393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2f406e7c0 0x7fa2f40ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:05.154 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.149+0000 7fa2fa20c700 1 -- 172.21.15.124:0/3777190393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2f406e7c0 msgr2=0x7fa2f40ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T18:47:05.154 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.149+0000 7fa2fa20c700 1 --2- 172.21.15.124:0/3777190393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2f406e7c0 0x7fa2f40ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.154 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.149+0000 7fa2fa20c700 1 -- 172.21.15.124:0/3777190393 >> v2:172.21.15.192:3300/0 conn(0x7fa2f406e310 msgr2=0x7fa2f40cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T18:47:05.154 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.149+0000 7fa2fa20c700 1 --2- 172.21.15.124:0/3777190393 >> v2:172.21.15.192:3300/0 conn(0x7fa2f406e310 0x7fa2f40cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.154 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.149+0000 7fa2fa20c700 1 -- 172.21.15.124:0/3777190393 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f406b250 con 0x7fa2f4159b50 2023-10-16T18:47:05.155 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.149+0000 7fa2fa20c700 1 --2- 172.21.15.124:0/3777190393 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa2f4159b50 0x7fa2f406bd30 secure :-1 s=READY pgs=2645 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4070cb0 tx=0x7fa2e400ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63af00f15e47d92 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T18:47:05.155 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.149+0000 7fa2f920a700 1 -- 172.21.15.124:0/3777190393 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e400cb70 con 0x7fa2f4159b50 2023-10-16T18:47:05.155 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.149+0000 7fa2f920a700 1 -- 172.21.15.124:0/3777190393 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e400ccd0 con 0x7fa2f4159b50 2023-10-16T18:47:05.155 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.149+0000 7fa2f920a700 1 -- 172.21.15.124:0/3777190393 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4018620 con 0x7fa2f4159b50 2023-10-16T18:47:05.155 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.150+0000 7fa2fc470700 1 -- 172.21.15.124:0/3777190393 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa2f4159b50 msgr2=0x7fa2f406bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:05.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.150+0000 7fa2fc470700 1 --2- 172.21.15.124:0/3777190393 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa2f4159b50 0x7fa2f406bd30 secure :-1 s=READY pgs=2645 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4070cb0 tx=0x7fa2e400ad70 comp rx=0 tx=0).stop 2023-10-16T18:47:05.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.150+0000 7fa2fc470700 1 -- 172.21.15.124:0/3777190393 shutdown_connections 2023-10-16T18:47:05.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.150+0000 7fa2fc470700 1 --2- 172.21.15.124:0/3777190393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2f406e7c0 0x7fa2f40ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.156 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.150+0000 7fa2fc470700 1 --2- 172.21.15.124:0/3777190393 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa2f4159b50 0x7fa2f406bd30 unknown :-1 s=CLOSED pgs=2645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.150+0000 7fa2fc470700 1 --2- 172.21.15.124:0/3777190393 >> v2:172.21.15.192:3300/0 conn(0x7fa2f406e310 0x7fa2f40cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.150+0000 7fa2fc470700 1 -- 172.21.15.124:0/3777190393 >> 172.21.15.124:0/3777190393 conn(0x7fa2f40b13e0 msgr2=0x7fa2f40b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T18:47:05.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.150+0000 7fa2fc470700 1 -- 172.21.15.124:0/3777190393 shutdown_connections 2023-10-16T18:47:05.157 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.150+0000 7fa2fc470700 1 -- 172.21.15.124:0/3777190393 wait complete. 2023-10-16T18:47:05.158 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.151+0000 7fa2fc470700 1 Processor -- start 2023-10-16T18:47:05.158 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.151+0000 7fa2fc470700 1 -- start start 2023-10-16T18:47:05.160 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.152+0000 7fa2fc470700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa2f406e310 0x7fa2f40c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:05.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.152+0000 7fa2fc470700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2f406e7c0 0x7fa2f40c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:05.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.152+0000 7fa2fc470700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2f4159b50 0x7fa2f4154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:05.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.152+0000 7fa2fc470700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f40c63e0 con 0x7fa2f406e310 2023-10-16T18:47:05.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.152+0000 7fa2fc470700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f41f14f0 con 0x7fa2f406e7c0 2023-10-16T18:47:05.161 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.152+0000 7fa2fc470700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f41f0c20 con 0x7fa2f4159b50 2023-10-16T18:47:05.162 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.152+0000 7fa2fa20c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa2f406e310 0x7fa2f40c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:05.162 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.152+0000 7fa2fa20c700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa2f406e310 0x7fa2f40c52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:39202/0 (socket says 172.21.15.124:39202) 2023-10-16T18:47:05.162 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.152+0000 7fa2fa20c700 1 -- 172.21.15.124:0/3972644188 learned_addr learned my addr 172.21.15.124:0/3972644188 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T18:47:05.162 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.152+0000 7fa2f9a0b700 1 --2- 172.21.15.124:0/3972644188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2f406e7c0 0x7fa2f40c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:05.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.152+0000 7fa2faa0d700 1 --2- 172.21.15.124:0/3972644188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2f4159b50 0x7fa2f4154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:05.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.152+0000 7fa2fa20c700 1 -- 172.21.15.124:0/3972644188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2f4159b50 msgr2=0x7fa2f4154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:05.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.152+0000 7fa2fa20c700 1 --2- 172.21.15.124:0/3972644188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2f4159b50 0x7fa2f4154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.152+0000 7fa2fa20c700 1 -- 172.21.15.124:0/3972644188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2f406e7c0 msgr2=0x7fa2f40c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:05.163 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.152+0000 7fa2fa20c700 1 --2- 172.21.15.124:0/3972644188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2f406e7c0 0x7fa2f40c58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.152+0000 7fa2fa20c700 1 -- 172.21.15.124:0/3972644188 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e400a6f0 con 0x7fa2f406e310 2023-10-16T18:47:05.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.153+0000 7fa2fa20c700 1 --2- 172.21.15.124:0/3972644188 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa2f406e310 0x7fa2f40c52c0 secure :-1 s=READY pgs=2646 cs=0 l=1 rev1=1 crypto rx=0x7fa2e400adb0 tx=0x7fa2e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T18:47:05.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.153+0000 7fa2eaffd700 1 -- 172.21.15.124:0/3972644188 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e401c040 con 0x7fa2f406e310 2023-10-16T18:47:05.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.153+0000 7fa2eaffd700 1 -- 172.21.15.124:0/3972644188 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e40038b0 con 0x7fa2f406e310 2023-10-16T18:47:05.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.153+0000 7fa2fc470700 1 -- 172.21.15.124:0/3972644188 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f40c6100 con 0x7fa2f406e310 2023-10-16T18:47:05.164 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.153+0000 7fa2eaffd700 1 -- 172.21.15.124:0/3972644188 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4003c60 con 0x7fa2f406e310 2023-10-16T18:47:05.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.153+0000 7fa2fc470700 1 -- 172.21.15.124:0/3972644188 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f41f1110 con 0x7fa2f406e310 2023-10-16T18:47:05.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.153+0000 7fa2fc470700 1 -- 172.21.15.124:0/3972644188 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f404ebb0 con 0x7fa2f406e310 2023-10-16T18:47:05.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.154+0000 7fa2eaffd700 1 -- 172.21.15.124:0/3972644188 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa2e4018400 con 0x7fa2f406e310 2023-10-16T18:47:05.165 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.154+0000 7fa2eaffd700 1 --2- 172.21.15.124:0/3972644188 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa2d806af00 0x7fa2d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:05.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.154+0000 7fa2f9a0b700 1 --2- 172.21.15.124:0/3972644188 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa2d806af00 0x7fa2d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:05.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.154+0000 7fa2eaffd700 1 -- 172.21.15.124:0/3972644188 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa2e408aa50 con 0x7fa2f406e310 2023-10-16T18:47:05.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.155+0000 7fa2f9a0b700 1 --2- 172.21.15.124:0/3972644188 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa2d806af00 0x7fa2d806d3c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009b60 tx=0x7fa2f0009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T18:47:05.166 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.159+0000 7fa2eaffd700 1 -- 172.21.15.124:0/3972644188 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa2e4055ad0 con 0x7fa2f406e310 2023-10-16T18:47:05.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.347+0000 7fa2fc470700 1 -- 172.21.15.124:0/3972644188 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2f406cae0 con 0x7fa2f406e310 2023-10-16T18:47:05.347 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.347+0000 7fa2eaffd700 1 -- 172.21.15.124:0/3972644188 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2e40590f0 con 0x7fa2f406e310 2023-10-16T18:47:05.348 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 1 2023-10-16T18:47:05.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.349+0000 7fa2fc470700 1 -- 172.21.15.124:0/3972644188 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa2d806af00 msgr2=0x7fa2d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:05.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.349+0000 7fa2fc470700 1 --2- 172.21.15.124:0/3972644188 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa2d806af00 0x7fa2d806d3c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009b60 tx=0x7fa2f0009210 comp rx=0 tx=0).stop 2023-10-16T18:47:05.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.349+0000 7fa2fc470700 1 -- 172.21.15.124:0/3972644188 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa2f406e310 msgr2=0x7fa2f40c52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:05.350 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.349+0000 7fa2fc470700 1 --2- 172.21.15.124:0/3972644188 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa2f406e310 0x7fa2f40c52c0 secure :-1 s=READY pgs=2646 cs=0 l=1 rev1=1 crypto rx=0x7fa2e400adb0 tx=0x7fa2e4004750 comp rx=0 tx=0).stop 2023-10-16T18:47:05.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.349+0000 7fa2fc470700 1 -- 172.21.15.124:0/3972644188 shutdown_connections 2023-10-16T18:47:05.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.349+0000 7fa2fc470700 1 --2- 172.21.15.124:0/3972644188 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7fa2d806af00 0x7fa2d806d3c0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.349+0000 7fa2fc470700 1 --2- 172.21.15.124:0/3972644188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2f4159b50 0x7fa2f4154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.349+0000 7fa2fc470700 1 --2- 172.21.15.124:0/3972644188 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa2f406e310 0x7fa2f40c52c0 unknown :-1 s=CLOSED pgs=2646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.351 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.349+0000 7fa2fc470700 1 --2- 172.21.15.124:0/3972644188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2f406e7c0 0x7fa2f40c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.349+0000 7fa2fc470700 1 -- 172.21.15.124:0/3972644188 >> 172.21.15.124:0/3972644188 conn(0x7fa2f40b13e0 msgr2=0x7fa2f40ae7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T18:47:05.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.349+0000 7fa2fc470700 1 -- 172.21.15.124:0/3972644188 shutdown_connections 2023-10-16T18:47:05.352 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.349+0000 7fa2fc470700 1 -- 172.21.15.124:0/3972644188 wait complete. 2023-10-16T18:47:05.362 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T18:47:05.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.485+0000 7f128d3f9700 1 Processor -- start 2023-10-16T18:47:05.486 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.485+0000 7f128d3f9700 1 -- start start 2023-10-16T18:47:05.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.486+0000 7f128d3f9700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f12880cf400 0x7f12880cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:05.488 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.486+0000 7f128d3f9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1288143970 0x7f128806cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:05.489 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.486+0000 7f128d3f9700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1288143da0 con 0x7f12880ce1c0 2023-10-16T18:47:05.489 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.486+0000 7f128d3f9700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12880ce670 con 0x7f12880cf400 2023-10-16T18:47:05.489 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.486+0000 7f128d3f9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128815edf0 con 0x7f1288143970 2023-10-16T18:47:05.489 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.486+0000 7f1286ffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f12880cf400 0x7f12880cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:05.490 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.486+0000 7f12867fc700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f12880ce1c0 0x7f1288143260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:56114/0 (socket says 172.21.15.124:56114) 2023-10-16T18:47:05.490 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.486+0000 7f12867fc700 1 -- 172.21.15.124:0/3508850183 learned_addr learned my addr 172.21.15.124:0/3508850183 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T18:47:05.490 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.486+0000 7f12877fe700 1 --2- 172.21.15.124:0/3508850183 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1288143970 0x7f128806cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:05.490 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.487+0000 7f1286ffd700 1 -- 172.21.15.124:0/3508850183 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1288143970 msgr2=0x7f128806cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T18:47:05.490 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.487+0000 7f1286ffd700 1 --2- 172.21.15.124:0/3508850183 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1288143970 0x7f128806cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.487+0000 7f1286ffd700 1 -- 172.21.15.124:0/3508850183 >> v1:172.21.15.124:6789/0 conn(0x7f12880ce1c0 legacy=0x7f1288143260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:05.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.487+0000 7f1286ffd700 1 -- 172.21.15.124:0/3508850183 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12881613d0 con 0x7f12880cf400 2023-10-16T18:47:05.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.487+0000 7f1286ffd700 1 --2- 172.21.15.124:0/3508850183 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12880cf400 0x7f12880cdc80 secure :-1 s=READY pgs=2648 cs=0 l=1 rev1=1 crypto rx=0x7f127c009840 tx=0x7f127c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3620a6bc5ac362cf server_cookie=0 in_seq=0 out_seq=0 2023-10-16T18:47:05.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.487+0000 7f1285ffb700 1 -- 172.21.15.124:0/3508850183 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127c011830 con 0x7f12880cf400 2023-10-16T18:47:05.491 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.487+0000 7f1285ffb700 1 -- 172.21.15.124:0/3508850183 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127c011990 con 0x7f12880cf400 2023-10-16T18:47:05.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.487+0000 7f1285ffb700 1 -- 172.21.15.124:0/3508850183 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127c011d20 con 0x7f12880cf400 2023-10-16T18:47:05.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.487+0000 7f128d3f9700 1 -- 172.21.15.124:0/3508850183 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12880cf400 msgr2=0x7f12880cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:05.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.487+0000 7f128d3f9700 1 --2- 172.21.15.124:0/3508850183 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12880cf400 0x7f12880cdc80 secure :-1 s=READY pgs=2648 cs=0 l=1 rev1=1 crypto rx=0x7f127c009840 tx=0x7f127c009b50 comp rx=0 tx=0).stop 2023-10-16T18:47:05.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.487+0000 7f128d3f9700 1 -- 172.21.15.124:0/3508850183 shutdown_connections 2023-10-16T18:47:05.492 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.487+0000 7f128d3f9700 1 --2- 172.21.15.124:0/3508850183 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1288143970 0x7f128806cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.487+0000 7f128d3f9700 1 --2- 172.21.15.124:0/3508850183 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12880cf400 0x7f12880cdc80 unknown :-1 s=CLOSED pgs=2648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.487+0000 7f128d3f9700 1 -- 172.21.15.124:0/3508850183 >> 172.21.15.124:0/3508850183 conn(0x7f128806a820 msgr2=0x7f128806ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T18:47:05.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.488+0000 7f128d3f9700 1 -- 172.21.15.124:0/3508850183 shutdown_connections 2023-10-16T18:47:05.493 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.488+0000 7f128d3f9700 1 -- 172.21.15.124:0/3508850183 wait complete. 2023-10-16T18:47:05.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.489+0000 7f128d3f9700 1 Processor -- start 2023-10-16T18:47:05.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.489+0000 7f128d3f9700 1 -- start start 2023-10-16T18:47:05.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.489+0000 7f128d3f9700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12880ce1c0 0x7f12880b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:05.496 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.489+0000 7f128d3f9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12880cf400 0x7f12880b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:05.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.489+0000 7f128d3f9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1288143970 0x7f12881564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:05.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.489+0000 7f128d3f9700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12881575a0 con 0x7f12880ce1c0 2023-10-16T18:47:05.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.489+0000 7f128d3f9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12880c5490 con 0x7f1288143970 2023-10-16T18:47:05.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.489+0000 7f128d3f9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1288153f00 con 0x7f12880cf400 2023-10-16T18:47:05.497 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.490+0000 7f1286ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12880ce1c0 0x7f12880b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:05.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.490+0000 7f1286ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12880ce1c0 0x7f12880b16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:39216/0 (socket says 172.21.15.124:39216) 2023-10-16T18:47:05.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.490+0000 7f1286ffd700 1 -- 172.21.15.124:0/2083340782 learned_addr learned my addr 172.21.15.124:0/2083340782 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T18:47:05.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.490+0000 7f12867fc700 1 --2- 172.21.15.124:0/2083340782 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12880cf400 0x7f12880b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:05.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.490+0000 7f12877fe700 1 --2- 172.21.15.124:0/2083340782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1288143970 0x7f12881564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:05.498 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.490+0000 7f1286ffd700 1 -- 172.21.15.124:0/2083340782 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12880cf400 msgr2=0x7f12880b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:05.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.490+0000 7f1286ffd700 1 --2- 172.21.15.124:0/2083340782 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12880cf400 0x7f12880b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.490+0000 7f1286ffd700 1 -- 172.21.15.124:0/2083340782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1288143970 msgr2=0x7f12881564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:05.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.490+0000 7f1286ffd700 1 --2- 172.21.15.124:0/2083340782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1288143970 0x7f12881564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.490+0000 7f1286ffd700 1 -- 172.21.15.124:0/2083340782 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127c0094a0 con 0x7f12880ce1c0 2023-10-16T18:47:05.499 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.490+0000 7f1286ffd700 1 --2- 172.21.15.124:0/2083340782 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12880ce1c0 0x7f12880b16e0 secure :-1 s=READY pgs=2649 cs=0 l=1 rev1=1 crypto rx=0x7f127c009fd0 tx=0x7f127c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T18:47:05.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.490+0000 7f126f7fe700 1 -- 172.21.15.124:0/2083340782 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127c0036a0 con 0x7f12880ce1c0 2023-10-16T18:47:05.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.490+0000 7f126f7fe700 1 -- 172.21.15.124:0/2083340782 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127c01e070 con 0x7f12880ce1c0 2023-10-16T18:47:05.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.490+0000 7f126f7fe700 1 -- 172.21.15.124:0/2083340782 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127c003a60 con 0x7f12880ce1c0 2023-10-16T18:47:05.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.490+0000 7f128d3f9700 1 -- 172.21.15.124:0/2083340782 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12880b22c0 con 0x7f12880ce1c0 2023-10-16T18:47:05.500 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.490+0000 7f128d3f9700 1 -- 172.21.15.124:0/2083340782 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12880c5120 con 0x7f12880ce1c0 2023-10-16T18:47:05.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.491+0000 7f126d7fa700 1 -- 172.21.15.124:0/2083340782 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12600052f0 con 0x7f12880ce1c0 2023-10-16T18:47:05.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.492+0000 7f126f7fe700 1 -- 172.21.15.124:0/2083340782 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f127c003bc0 con 0x7f12880ce1c0 2023-10-16T18:47:05.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.492+0000 7f126f7fe700 1 --2- 172.21.15.124:0/2083340782 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f127406af00 0x7f127406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:05.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.492+0000 7f126f7fe700 1 -- 172.21.15.124:0/2083340782 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f127c08a560 con 0x7f12880ce1c0 2023-10-16T18:47:05.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.492+0000 7f12867fc700 1 --2- 172.21.15.124:0/2083340782 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f127406af00 0x7f127406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:05.501 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.492+0000 7f12867fc700 1 --2- 172.21.15.124:0/2083340782 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f127406af00 0x7f127406d3c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f12880c4770 tx=0x7f1278009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T18:47:05.516 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.516+0000 7f126f7fe700 1 -- 172.21.15.124:0/2083340782 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f127c0555f0 con 0x7f12880ce1c0 2023-10-16T18:47:05.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.703+0000 7f126d7fa700 1 -- 172.21.15.124:0/2083340782 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1260005b20 con 0x7f12880ce1c0 2023-10-16T18:47:05.704 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.704+0000 7f126f7fe700 1 -- 172.21.15.124:0/2083340782 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f127c058c10 con 0x7f12880ce1c0 2023-10-16T18:47:05.705 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 32 2023-10-16T18:47:05.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.706+0000 7f126d7fa700 1 -- 172.21.15.124:0/2083340782 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f127406af00 msgr2=0x7f127406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:05.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.706+0000 7f126d7fa700 1 --2- 172.21.15.124:0/2083340782 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f127406af00 0x7f127406d3c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f12880c4770 tx=0x7f1278009040 comp rx=0 tx=0).stop 2023-10-16T18:47:05.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.706+0000 7f126d7fa700 1 -- 172.21.15.124:0/2083340782 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12880ce1c0 msgr2=0x7f12880b16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:05.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.706+0000 7f126d7fa700 1 --2- 172.21.15.124:0/2083340782 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12880ce1c0 0x7f12880b16e0 secure :-1 s=READY pgs=2649 cs=0 l=1 rev1=1 crypto rx=0x7f127c009fd0 tx=0x7f127c004750 comp rx=0 tx=0).stop 2023-10-16T18:47:05.707 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.706+0000 7f126d7fa700 1 -- 172.21.15.124:0/2083340782 shutdown_connections 2023-10-16T18:47:05.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.706+0000 7f126d7fa700 1 --2- 172.21.15.124:0/2083340782 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f127406af00 0x7f127406d3c0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.706+0000 7f126d7fa700 1 --2- 172.21.15.124:0/2083340782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1288143970 0x7f12881564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.706+0000 7f126d7fa700 1 --2- 172.21.15.124:0/2083340782 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f12880ce1c0 0x7f12880b16e0 unknown :-1 s=CLOSED pgs=2649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.706+0000 7f126d7fa700 1 --2- 172.21.15.124:0/2083340782 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12880cf400 0x7f12880b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.708 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.706+0000 7f126d7fa700 1 -- 172.21.15.124:0/2083340782 >> 172.21.15.124:0/2083340782 conn(0x7f128806a820 msgr2=0x7f128815ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T18:47:05.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.706+0000 7f126d7fa700 1 -- 172.21.15.124:0/2083340782 shutdown_connections 2023-10-16T18:47:05.709 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.706+0000 7f126d7fa700 1 -- 172.21.15.124:0/2083340782 wait complete. 2023-10-16T18:47:05.719 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T18:47:05.842 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.842+0000 7f02e94f6700 1 Processor -- start 2023-10-16T18:47:05.843 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.842+0000 7f02e94f6700 1 -- start start 2023-10-16T18:47:05.845 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.843+0000 7f02e94f6700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f02e415d660 0x7f02e40cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:05.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.843+0000 7f02e94f6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f02e40cd800 0x7f02e40ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:05.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.843+0000 7f02e94f6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02e4161c50 0x7f02e406ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:05.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.843+0000 7f02e94f6700 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e4162210 con 0x7f02e415d660 2023-10-16T18:47:05.846 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.843+0000 7f02e94f6700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e406a9c0 con 0x7f02e40cd800 2023-10-16T18:47:05.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.843+0000 7f02e94f6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e406ac60 con 0x7f02e4161c50 2023-10-16T18:47:05.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.843+0000 7f02e2ffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f02e415d660 0x7f02e40cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:05.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.843+0000 7f02e2ffd700 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f02e415d660 0x7f02e40cde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:39224/0 (socket says 172.21.15.124:39224) 2023-10-16T18:47:05.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.843+0000 7f02e2ffd700 1 -- 172.21.15.124:0/971015768 learned_addr learned my addr 172.21.15.124:0/971015768 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T18:47:05.847 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.843+0000 7f02e27fc700 1 --2- 172.21.15.124:0/971015768 >> v2:172.21.15.192:3300/0 conn(0x7f02e40cd800 0x7f02e40ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:05.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.843+0000 7f02e37fe700 1 --2- 172.21.15.124:0/971015768 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02e4161c50 0x7f02e406ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:05.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.844+0000 7f02e2ffd700 1 -- 172.21.15.124:0/971015768 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02e4161c50 msgr2=0x7f02e406ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T18:47:05.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.844+0000 7f02e2ffd700 1 --2- 172.21.15.124:0/971015768 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02e4161c50 0x7f02e406ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.844+0000 7f02e2ffd700 1 -- 172.21.15.124:0/971015768 >> v2:172.21.15.192:3300/0 conn(0x7f02e40cd800 msgr2=0x7f02e40ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T18:47:05.848 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.844+0000 7f02e2ffd700 1 --2- 172.21.15.124:0/971015768 >> v2:172.21.15.192:3300/0 conn(0x7f02e40cd800 0x7f02e40ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.844+0000 7f02e2ffd700 1 -- 172.21.15.124:0/971015768 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e406af40 con 0x7f02e415d660 2023-10-16T18:47:05.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.844+0000 7f02e2ffd700 1 --2- 172.21.15.124:0/971015768 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02e415d660 0x7f02e40cde30 secure :-1 s=READY pgs=2650 cs=0 l=1 rev1=1 crypto rx=0x7f02e406b790 tx=0x7f02d8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6962bc1e7ccfb0a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T18:47:05.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.844+0000 7f02e1ffb700 1 -- 172.21.15.124:0/971015768 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8011830 con 0x7f02e415d660 2023-10-16T18:47:05.849 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.844+0000 7f02e1ffb700 1 -- 172.21.15.124:0/971015768 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d8011990 con 0x7f02e415d660 2023-10-16T18:47:05.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.844+0000 7f02e1ffb700 1 -- 172.21.15.124:0/971015768 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8011d20 con 0x7f02e415d660 2023-10-16T18:47:05.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.844+0000 7f02e94f6700 1 -- 172.21.15.124:0/971015768 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02e415d660 msgr2=0x7f02e40cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:05.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.844+0000 7f02e94f6700 1 --2- 172.21.15.124:0/971015768 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02e415d660 0x7f02e40cde30 secure :-1 s=READY pgs=2650 cs=0 l=1 rev1=1 crypto rx=0x7f02e406b790 tx=0x7f02d8009bd0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.844+0000 7f02e94f6700 1 -- 172.21.15.124:0/971015768 shutdown_connections 2023-10-16T18:47:05.850 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.844+0000 7f02e94f6700 1 --2- 172.21.15.124:0/971015768 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02e4161c50 0x7f02e406ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.844+0000 7f02e94f6700 1 --2- 172.21.15.124:0/971015768 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02e415d660 0x7f02e40cde30 unknown :-1 s=CLOSED pgs=2650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.844+0000 7f02e94f6700 1 --2- 172.21.15.124:0/971015768 >> v2:172.21.15.192:3300/0 conn(0x7f02e40cd800 0x7f02e40ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.844+0000 7f02e94f6700 1 -- 172.21.15.124:0/971015768 >> 172.21.15.124:0/971015768 conn(0x7f02e40ccce0 msgr2=0x7f02e40cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T18:47:05.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.844+0000 7f02e94f6700 1 -- 172.21.15.124:0/971015768 shutdown_connections 2023-10-16T18:47:05.851 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.844+0000 7f02e94f6700 1 -- 172.21.15.124:0/971015768 wait complete. 2023-10-16T18:47:05.852 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.846+0000 7f02e94f6700 1 Processor -- start 2023-10-16T18:47:05.852 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.846+0000 7f02e94f6700 1 -- start start 2023-10-16T18:47:05.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.846+0000 7f02e94f6700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02e40cd800 0x7f02e4151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:05.854 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.846+0000 7f02e94f6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02e415d660 0x7f02e41f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:05.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.846+0000 7f02e94f6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02e4161c50 0x7f02e40b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:05.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.846+0000 7f02e94f6700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e41e8410 con 0x7f02e40cd800 2023-10-16T18:47:05.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.846+0000 7f02e94f6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e4152110 con 0x7f02e415d660 2023-10-16T18:47:05.855 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.846+0000 7f02e94f6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e41f6dc0 con 0x7f02e4161c50 2023-10-16T18:47:05.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.846+0000 7f02e2ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02e40cd800 0x7f02e4151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:05.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.846+0000 7f02e2ffd700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02e40cd800 0x7f02e4151bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:39230/0 (socket says 172.21.15.124:39230) 2023-10-16T18:47:05.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.846+0000 7f02e2ffd700 1 -- 172.21.15.124:0/1985217836 learned_addr learned my addr 172.21.15.124:0/1985217836 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T18:47:05.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.846+0000 7f02e27fc700 1 --2- 172.21.15.124:0/1985217836 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02e415d660 0x7f02e41f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:05.856 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.846+0000 7f02e37fe700 1 --2- 172.21.15.124:0/1985217836 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02e4161c50 0x7f02e40b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:05.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.847+0000 7f02e2ffd700 1 -- 172.21.15.124:0/1985217836 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02e4161c50 msgr2=0x7f02e40b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:05.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.847+0000 7f02e2ffd700 1 --2- 172.21.15.124:0/1985217836 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02e4161c50 0x7f02e40b2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.847+0000 7f02e2ffd700 1 -- 172.21.15.124:0/1985217836 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02e415d660 msgr2=0x7f02e41f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:05.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.847+0000 7f02e2ffd700 1 --2- 172.21.15.124:0/1985217836 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02e415d660 0x7f02e41f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:05.857 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.847+0000 7f02e2ffd700 1 -- 172.21.15.124:0/1985217836 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d8009550 con 0x7f02e40cd800 2023-10-16T18:47:05.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.847+0000 7f02e2ffd700 1 --2- 172.21.15.124:0/1985217836 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02e40cd800 0x7f02e4151bd0 secure :-1 s=READY pgs=2651 cs=0 l=1 rev1=1 crypto rx=0x7f02d8000c00 tx=0x7f02d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T18:47:05.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.847+0000 7f02cb7fe700 1 -- 172.21.15.124:0/1985217836 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8004240 con 0x7f02e40cd800 2023-10-16T18:47:05.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.847+0000 7f02cb7fe700 1 -- 172.21.15.124:0/1985217836 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d801f070 con 0x7f02e40cd800 2023-10-16T18:47:05.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.847+0000 7f02e94f6700 1 -- 172.21.15.124:0/1985217836 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e41f70a0 con 0x7f02e40cd800 2023-10-16T18:47:05.858 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.847+0000 7f02cb7fe700 1 -- 172.21.15.124:0/1985217836 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d80036a0 con 0x7f02e40cd800 2023-10-16T18:47:05.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.847+0000 7f02e94f6700 1 -- 172.21.15.124:0/1985217836 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e41e8030 con 0x7f02e40cd800 2023-10-16T18:47:05.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.848+0000 7f02e94f6700 1 -- 172.21.15.124:0/1985217836 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e41e7e90 con 0x7f02e40cd800 2023-10-16T18:47:05.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.849+0000 7f02cb7fe700 1 -- 172.21.15.124:0/1985217836 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f02d8021030 con 0x7f02e40cd800 2023-10-16T18:47:05.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.849+0000 7f02cb7fe700 1 --2- 172.21.15.124:0/1985217836 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f02d006af00 0x7f02d006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:05.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.849+0000 7f02cb7fe700 1 -- 172.21.15.124:0/1985217836 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f02d808a800 con 0x7f02e40cd800 2023-10-16T18:47:05.859 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.849+0000 7f02e27fc700 1 --2- 172.21.15.124:0/1985217836 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f02d006af00 0x7f02d006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:05.860 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.849+0000 7f02e27fc700 1 --2- 172.21.15.124:0/1985217836 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f02d006af00 0x7f02d006d3c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f02e4072d20 tx=0x7f02d4009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T18:47:05.860 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:05.853+0000 7f02cb7fe700 1 -- 172.21.15.124:0/1985217836 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f02e41e7e90 con 0x7f02e40cd800 2023-10-16T18:47:06.043 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.042+0000 7f02e94f6700 1 -- 172.21.15.124:0/1985217836 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f02e41e7e90 con 0x7f02e40cd800 2023-10-16T18:47:06.044 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.043+0000 7f02cb7fe700 1 -- 172.21.15.124:0/1985217836 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7f02e41e7e90 con 0x7f02e40cd800 2023-10-16T18:47:06.044 INFO:teuthology.orchestra.run.smithi124.stdout:pg_num: 64 2023-10-16T18:47:06.046 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.045+0000 7f02e94f6700 1 -- 172.21.15.124:0/1985217836 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f02d006af00 msgr2=0x7f02d006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:06.047 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.045+0000 7f02e94f6700 1 --2- 172.21.15.124:0/1985217836 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f02d006af00 0x7f02d006d3c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f02e4072d20 tx=0x7f02d4009210 comp rx=0 tx=0).stop 2023-10-16T18:47:06.047 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.045+0000 7f02e94f6700 1 -- 172.21.15.124:0/1985217836 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02e40cd800 msgr2=0x7f02e4151bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:06.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.045+0000 7f02e94f6700 1 --2- 172.21.15.124:0/1985217836 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02e40cd800 0x7f02e4151bd0 secure :-1 s=READY pgs=2651 cs=0 l=1 rev1=1 crypto rx=0x7f02d8000c00 tx=0x7f02d8004750 comp rx=0 tx=0).stop 2023-10-16T18:47:06.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.045+0000 7f02e94f6700 1 -- 172.21.15.124:0/1985217836 shutdown_connections 2023-10-16T18:47:06.048 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.045+0000 7f02e94f6700 1 --2- 172.21.15.124:0/1985217836 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f02d006af00 0x7f02d006d3c0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:06.049 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.045+0000 7f02e94f6700 1 --2- 172.21.15.124:0/1985217836 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02e4161c50 0x7f02e40b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:06.049 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.045+0000 7f02e94f6700 1 --2- 172.21.15.124:0/1985217836 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02e40cd800 0x7f02e4151bd0 unknown :-1 s=CLOSED pgs=2651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:06.050 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.045+0000 7f02e94f6700 1 --2- 172.21.15.124:0/1985217836 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02e415d660 0x7f02e41f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:06.050 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.045+0000 7f02e94f6700 1 -- 172.21.15.124:0/1985217836 >> 172.21.15.124:0/1985217836 conn(0x7f02e40ccce0 msgr2=0x7f02e41533e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T18:47:06.050 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.045+0000 7f02e94f6700 1 -- 172.21.15.124:0/1985217836 shutdown_connections 2023-10-16T18:47:06.051 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.045+0000 7f02e94f6700 1 -- 172.21.15.124:0/1985217836 wait complete. 2023-10-16T18:47:06.058 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T18:47:06.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.179+0000 7f25dfa80700 1 Processor -- start 2023-10-16T18:47:06.180 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.179+0000 7f25dfa80700 1 -- start start 2023-10-16T18:47:06.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.180+0000 7f25dfa80700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25d815b420 0x7f25d80cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:06.183 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.180+0000 7f25dfa80700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f25d80cf3b0 0x7f25d80cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:06.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.180+0000 7f25dfa80700 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d80cf810 con 0x7f25d80cdd50 2023-10-16T18:47:06.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.180+0000 7f25dfa80700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d80d1680 con 0x7f25d80cf3b0 2023-10-16T18:47:06.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.180+0000 7f25dfa80700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d80ce590 con 0x7f25d815b420 2023-10-16T18:47:06.184 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.180+0000 7f25de01d700 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f25d80cdd50 0x7f25d815efd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:56142/0 (socket says 172.21.15.124:56142) 2023-10-16T18:47:06.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.180+0000 7f25de01d700 1 -- 172.21.15.124:0/1745278852 learned_addr learned my addr 172.21.15.124:0/1745278852 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-10-16T18:47:06.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.180+0000 7f25dd81c700 1 --2- 172.21.15.124:0/1745278852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25d815b420 0x7f25d80cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:06.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.180+0000 7f25dd01b700 1 --2- 172.21.15.124:0/1745278852 >> v2:172.21.15.192:3300/0 conn(0x7f25d80cf3b0 0x7f25d80cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:06.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.181+0000 7f25dc81a700 1 -- 172.21.15.124:0/1745278852 <== mon.0 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163426143 0 0) 0x7f25d80cf810 con 0x7f25d80cdd50 2023-10-16T18:47:06.185 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.181+0000 7f25dc81a700 1 -- 172.21.15.124:0/1745278852 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25c40035b0 con 0x7f25d80cdd50 2023-10-16T18:47:06.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.181+0000 7f25dd81c700 1 -- 172.21.15.124:0/1745278852 >> v2:172.21.15.192:3300/0 conn(0x7f25d80cf3b0 msgr2=0x7f25d80cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T18:47:06.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.181+0000 7f25dd81c700 1 --2- 172.21.15.124:0/1745278852 >> v2:172.21.15.192:3300/0 conn(0x7f25d80cf3b0 0x7f25d80cd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:06.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.181+0000 7f25dd81c700 1 -- 172.21.15.124:0/1745278852 >> v1:172.21.15.124:6789/0 conn(0x7f25d80cdd50 legacy=0x7f25d815efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:06.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.181+0000 7f25dd81c700 1 -- 172.21.15.124:0/1745278852 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d815bb10 con 0x7f25d815b420 2023-10-16T18:47:06.186 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.181+0000 7f25dd01b700 1 --2- 172.21.15.124:0/1745278852 >> v2:172.21.15.192:3300/0 conn(0x7f25d80cf3b0 0x7f25d80cd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T18:47:06.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.181+0000 7f25dd81c700 1 --2- 172.21.15.124:0/1745278852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25d815b420 0x7f25d80cee70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f25c8009840 tx=0x7f25c8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=363735776c5255f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T18:47:06.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.181+0000 7f25dc81a700 1 -- 172.21.15.124:0/1745278852 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8011830 con 0x7f25d815b420 2023-10-16T18:47:06.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.181+0000 7f25dc81a700 1 -- 172.21.15.124:0/1745278852 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c8011990 con 0x7f25d815b420 2023-10-16T18:47:06.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.181+0000 7f25dc81a700 1 -- 172.21.15.124:0/1745278852 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8011d20 con 0x7f25d815b420 2023-10-16T18:47:06.187 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.182+0000 7f25dfa80700 1 -- 172.21.15.124:0/1745278852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25d815b420 msgr2=0x7f25d80cee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:06.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.182+0000 7f25dfa80700 1 --2- 172.21.15.124:0/1745278852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25d815b420 0x7f25d80cee70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f25c8009840 tx=0x7f25c8009b50 comp rx=0 tx=0).stop 2023-10-16T18:47:06.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.182+0000 7f25dfa80700 1 -- 172.21.15.124:0/1745278852 shutdown_connections 2023-10-16T18:47:06.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.182+0000 7f25dfa80700 1 --2- 172.21.15.124:0/1745278852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25d815b420 0x7f25d80cee70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:06.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.182+0000 7f25dfa80700 1 --2- 172.21.15.124:0/1745278852 >> v2:172.21.15.192:3300/0 conn(0x7f25d80cf3b0 0x7f25d80cd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:06.188 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.182+0000 7f25dfa80700 1 -- 172.21.15.124:0/1745278852 >> 172.21.15.124:0/1745278852 conn(0x7f25d806a820 msgr2=0x7f25d806ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T18:47:06.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.182+0000 7f25dfa80700 1 -- 172.21.15.124:0/1745278852 shutdown_connections 2023-10-16T18:47:06.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.182+0000 7f25dfa80700 1 -- 172.21.15.124:0/1745278852 wait complete. 2023-10-16T18:47:06.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.183+0000 7f25dfa80700 1 Processor -- start 2023-10-16T18:47:06.189 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.183+0000 7f25dfa80700 1 -- start start 2023-10-16T18:47:06.192 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.184+0000 7f25dfa80700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25d80cdd50 0x7f25d815c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:06.192 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.184+0000 7f25dfa80700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25d80cf3b0 0x7f25d80afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:06.192 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.184+0000 7f25dfa80700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25d815b420 0x7f25d815dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:06.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.184+0000 7f25dfa80700 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d80b00a0 con 0x7f25d815b420 2023-10-16T18:47:06.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.184+0000 7f25dfa80700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d80a9c90 con 0x7f25d80cdd50 2023-10-16T18:47:06.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.184+0000 7f25dfa80700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d815ced0 con 0x7f25d80cf3b0 2023-10-16T18:47:06.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.184+0000 7f25de01d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25d815b420 0x7f25d815dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:06.193 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.184+0000 7f25de01d700 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25d815b420 0x7f25d815dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:39248/0 (socket says 172.21.15.124:39248) 2023-10-16T18:47:06.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.184+0000 7f25de01d700 1 -- 172.21.15.124:0/3762403773 learned_addr learned my addr 172.21.15.124:0/3762403773 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-10-16T18:47:06.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.185+0000 7f25de01d700 1 -- 172.21.15.124:0/3762403773 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25d80cf3b0 msgr2=0x7f25d80afb60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T18:47:06.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.185+0000 7f25de01d700 1 --2- 172.21.15.124:0/3762403773 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25d80cf3b0 0x7f25d80afb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:06.194 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.185+0000 7f25de01d700 1 -- 172.21.15.124:0/3762403773 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25d80cdd50 msgr2=0x7f25d815c7d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T18:47:06.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.185+0000 7f25de01d700 1 --2- 172.21.15.124:0/3762403773 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25d80cdd50 0x7f25d815c7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:06.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.185+0000 7f25de01d700 1 -- 172.21.15.124:0/3762403773 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d40094a0 con 0x7f25d815b420 2023-10-16T18:47:06.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.185+0000 7f25de01d700 1 --2- 172.21.15.124:0/3762403773 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25d815b420 0x7f25d815dc40 secure :-1 s=READY pgs=2653 cs=0 l=1 rev1=1 crypto rx=0x7f25d000cb40 tx=0x7f25d000cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T18:47:06.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.185+0000 7f25ce7fc700 1 -- 172.21.15.124:0/3762403773 <== mon.0 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d000ab50 con 0x7f25d815b420 2023-10-16T18:47:06.195 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.185+0000 7f25ce7fc700 1 -- 172.21.15.124:0/3762403773 <== mon.0 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d000acb0 con 0x7f25d815b420 2023-10-16T18:47:06.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.185+0000 7f25dfa80700 1 -- 172.21.15.124:0/3762403773 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c80094a0 con 0x7f25d815b420 2023-10-16T18:47:06.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.185+0000 7f25ce7fc700 1 -- 172.21.15.124:0/3762403773 <== mon.0 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0012620 con 0x7f25d815b420 2023-10-16T18:47:06.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.185+0000 7f25dfa80700 1 -- 172.21.15.124:0/3762403773 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d815d490 con 0x7f25d815b420 2023-10-16T18:47:06.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.186+0000 7f25dfa80700 1 -- 172.21.15.124:0/3762403773 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d815b800 con 0x7f25d815b420 2023-10-16T18:47:06.196 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.186+0000 7f25ce7fc700 1 -- 172.21.15.124:0/3762403773 <== mon.0 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f25d001b3b0 con 0x7f25d815b420 2023-10-16T18:47:06.197 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.187+0000 7f25ce7fc700 1 --2- 172.21.15.124:0/3762403773 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f25bc06af00 0x7f25bc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T18:47:06.197 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.187+0000 7f25ce7fc700 1 -- 172.21.15.124:0/3762403773 <== mon.0 v2:172.21.15.124:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f25d00895d0 con 0x7f25d815b420 2023-10-16T18:47:06.197 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.187+0000 7f25dd81c700 1 --2- 172.21.15.124:0/3762403773 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f25bc06af00 0x7f25bc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T18:47:06.197 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.187+0000 7f25dd81c700 1 --2- 172.21.15.124:0/3762403773 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f25bc06af00 0x7f25bc06d3c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f25c80090b0 tx=0x7f25c8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T18:47:06.197 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.191+0000 7f25ce7fc700 1 -- 172.21.15.124:0/3762403773 <== mon.0 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f25d0054480 con 0x7f25d815b420 2023-10-16T18:47:06.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.398+0000 7f25dfa80700 1 -- 172.21.15.124:0/3762403773 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f25d804ebb0 con 0x7f25d815b420 2023-10-16T18:47:06.398 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.398+0000 7f25ce7fc700 1 -- 172.21.15.124:0/3762403773 <== mon.0 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) v1 ==== 80+0+0 (secure 0 0 0) 0x7f25d0057aa0 con 0x7f25d815b420 2023-10-16T18:47:06.401 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.400+0000 7f25dfa80700 1 -- 172.21.15.124:0/3762403773 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f25bc06af00 msgr2=0x7f25bc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:06.401 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.400+0000 7f25dfa80700 1 --2- 172.21.15.124:0/3762403773 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f25bc06af00 0x7f25bc06d3c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f25c80090b0 tx=0x7f25c8008030 comp rx=0 tx=0).stop 2023-10-16T18:47:06.401 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.400+0000 7f25dfa80700 1 -- 172.21.15.124:0/3762403773 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25d815b420 msgr2=0x7f25d815dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T18:47:06.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.400+0000 7f25dfa80700 1 --2- 172.21.15.124:0/3762403773 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25d815b420 0x7f25d815dc40 secure :-1 s=READY pgs=2653 cs=0 l=1 rev1=1 crypto rx=0x7f25d000cb40 tx=0x7f25d000cf00 comp rx=0 tx=0).stop 2023-10-16T18:47:06.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.400+0000 7f25dfa80700 1 -- 172.21.15.124:0/3762403773 shutdown_connections 2023-10-16T18:47:06.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.400+0000 7f25dfa80700 1 --2- 172.21.15.124:0/3762403773 >> [v2:172.21.15.124:6832/2391611330,v1:172.21.15.124:6833/2391611330] conn(0x7f25bc06af00 0x7f25bc06d3c0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:06.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.400+0000 7f25dfa80700 1 --2- 172.21.15.124:0/3762403773 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f25d815b420 0x7f25d815dc40 unknown :-1 s=CLOSED pgs=2653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:06.402 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.400+0000 7f25dfa80700 1 --2- 172.21.15.124:0/3762403773 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25d80cdd50 0x7f25d815c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:06.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.400+0000 7f25dfa80700 1 --2- 172.21.15.124:0/3762403773 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25d80cf3b0 0x7f25d80afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T18:47:06.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.400+0000 7f25dfa80700 1 -- 172.21.15.124:0/3762403773 >> 172.21.15.124:0/3762403773 conn(0x7f25d806a820 msgr2=0x7f25d80b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T18:47:06.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.400+0000 7f25dfa80700 1 -- 172.21.15.124:0/3762403773 shutdown_connections 2023-10-16T18:47:06.403 INFO:teuthology.orchestra.run.smithi124.stderr:2023-10-16T18:47:06.400+0000 7f25dfa80700 1 -- 172.21.15.124:0/3762403773 wait complete. 2023-10-16T18:47:06.403 INFO:teuthology.orchestra.run.smithi124.stderr:listed 0 entries 2023-10-16T18:47:06.413 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-16T18:47:06.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T18:47:06.413 DEBUG:teuthology.orchestra.run.smithi124:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-16T18:47:06.467 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi124.front.sepia.ceph.com 2023-10-16T18:47:06.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T18:47:06.467 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-16T18:47:06.520 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-10-16T18:47:06.520 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T18:47:06.538 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284204k,nr_inodes=4071051,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=42,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1556 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260540k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 172.21.15.124:6789:/test /tmp/tmp.I407zfbFe1test ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=4cfd077b-2400-4ae1-a7e8-14265fee7113,acl 0 0 172.21.15.124:6789:/scratch /tmp/tmp.z8tNCKJUiGscratch ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=4cfd077b-2400-4ae1-a7e8-14265fee7113,acl 0 0 2023-10-16T18:47:06.538 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi124.front.sepia.ceph.com 2023-10-16T18:47:06.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T18:47:06.539 DEBUG:teuthology.orchestra.run.smithi124:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-16T18:47:06.594 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T18:47:06.594 INFO:teuthology.orchestra.run.smithi124.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-16T18:47:06.595 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T18:47:06.595 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T18:47:06.658 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=44,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16105 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T18:47:06.658 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-10-16T18:47:06.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T18:47:06.659 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-16T18:47:06.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T18:47:06.724 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-16T18:47:06.724 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-16T18:47:06.724 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T18:47:06.781 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=44,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16105 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T18:47:06.781 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-10-16T18:47:06.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T18:47:06.782 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-16T18:47:06.837 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T18:47:06.837 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-16T18:47:08.347 INFO:tasks.ceph.osd.0:Sent signal 15 2023-10-16T18:47:08.348 INFO:tasks.ceph.osd.1:Sent signal 15 2023-10-16T18:47:08.349 INFO:tasks.ceph.osd.2:Sent signal 15 2023-10-16T18:47:08.349 INFO:tasks.ceph.osd.4:Sent signal 15 2023-10-16T18:47:08.349 INFO:tasks.ceph.osd.6:Sent signal 15 2023-10-16T18:47:08.350 INFO:tasks.ceph.osd.7:Sent signal 15 2023-10-16T18:47:08.350 INFO:tasks.ceph.mds.a:Sent signal 15 2023-10-16T18:47:08.351 INFO:tasks.ceph.mds.c:Sent signal 15 2023-10-16T18:47:08.351 INFO:tasks.ceph.mds.b:Sent signal 15 2023-10-16T18:47:08.351 INFO:tasks.ceph.mds.d:Sent signal 15 2023-10-16T18:47:08.352 INFO:tasks.ceph.mon.a:Sent signal 15 2023-10-16T18:47:08.352 INFO:tasks.ceph.mon.b:Sent signal 15 2023-10-16T18:47:08.352 INFO:tasks.ceph.mon.c:Sent signal 15 2023-10-16T18:47:08.353 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-10-16T18:47:08.353 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-10-16T18:47:08.354 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T18:47:08.350+0000 7f4322fa5700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 104318) UID: 0 2023-10-16T18:47:08.354 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T18:47:08.350+0000 7f4322fa5700 -1 osd.4 44 *** Got signal Terminated *** 2023-10-16T18:47:08.354 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-16T18:47:08.350+0000 7f4322fa5700 -1 osd.4 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-16T18:47:08.355 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T18:47:08.350+0000 7f95afc78700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 104353) UID: 0 2023-10-16T18:47:08.355 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T18:47:08.350+0000 7f95afc78700 -1 osd.6 44 *** Got signal Terminated *** 2023-10-16T18:47:08.355 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-16T18:47:08.350+0000 7f95afc78700 -1 osd.6 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-16T18:47:08.356 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T18:47:08.351+0000 7f5b62088700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 104343) UID: 0 2023-10-16T18:47:08.356 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T18:47:08.351+0000 7f5b62088700 -1 osd.7 44 *** Got signal Terminated *** 2023-10-16T18:47:08.356 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-16T18:47:08.351+0000 7f5b62088700 -1 osd.7 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-16T18:47:08.357 INFO:tasks.ceph.mds.b.smithi192.stderr:2023-10-16T18:47:08.352+0000 7f536d166700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 111983) UID: 0 2023-10-16T18:47:08.357 INFO:tasks.ceph.mds.b.smithi192.stderr:2023-10-16T18:47:08.352+0000 7f536d166700 -1 mds.b *** got signal Terminated *** 2023-10-16T18:47:08.357 INFO:tasks.ceph.mds.d.smithi192.stderr:2023-10-16T18:47:08.352+0000 7f41d2517700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 111982) UID: 0 2023-10-16T18:47:08.357 INFO:tasks.ceph.mds.d.smithi192.stderr:2023-10-16T18:47:08.352+0000 7f41d2517700 -1 mds.d *** got signal Terminated *** 2023-10-16T18:47:08.358 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T18:47:08.348+0000 7f18f4d1b700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 104116) UID: 0 2023-10-16T18:47:08.358 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T18:47:08.348+0000 7f18f4d1b700 -1 osd.0 44 *** Got signal Terminated *** 2023-10-16T18:47:08.358 INFO:tasks.ceph.osd.0.smithi124.stderr:2023-10-16T18:47:08.348+0000 7f18f4d1b700 -1 osd.0 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-16T18:47:08.359 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T18:47:08.349+0000 7f4702f32700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 104120) UID: 0 2023-10-16T18:47:08.359 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T18:47:08.349+0000 7f4702f32700 -1 osd.1 44 *** Got signal Terminated *** 2023-10-16T18:47:08.359 INFO:tasks.ceph.osd.1.smithi124.stderr:2023-10-16T18:47:08.349+0000 7f4702f32700 -1 osd.1 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-16T18:47:08.360 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T18:47:08.349+0000 7f3e3026f700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 104124) UID: 0 2023-10-16T18:47:08.360 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T18:47:08.349+0000 7f3e3026f700 -1 osd.2 44 *** Got signal Terminated *** 2023-10-16T18:47:08.360 INFO:tasks.ceph.osd.2.smithi124.stderr:2023-10-16T18:47:08.349+0000 7f3e3026f700 -1 osd.2 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-16T18:47:08.361 INFO:tasks.ceph.mds.a.smithi124.stderr:2023-10-16T18:47:08.351+0000 7f5637150700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 119999) UID: 0 2023-10-16T18:47:08.361 INFO:tasks.ceph.mds.a.smithi124.stderr:2023-10-16T18:47:08.351+0000 7f5637150700 -1 mds.a *** got signal Terminated *** 2023-10-16T18:47:08.361 INFO:tasks.ceph.mds.c.smithi124.stderr:2023-10-16T18:47:08.351+0000 7f0cd4963700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 119998) UID: 0 2023-10-16T18:47:08.362 INFO:tasks.ceph.mds.c.smithi124.stderr:2023-10-16T18:47:08.351+0000 7f0cd4963700 -1 mds.c *** got signal Terminated *** 2023-10-16T18:47:08.362 INFO:tasks.ceph.mon.a.smithi124.stderr:2023-10-16T18:47:08.352+0000 7ff8d8ea6700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 103798) UID: 0 2023-10-16T18:47:08.362 INFO:tasks.ceph.mon.a.smithi124.stderr:2023-10-16T18:47:08.352+0000 7ff8d8ea6700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-10-16T18:47:08.363 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T18:47:08.353+0000 7f345fdc2700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i y (PID: 103840) UID: 0 2023-10-16T18:47:08.363 INFO:tasks.ceph.mgr.y.smithi124.stderr:2023-10-16T18:47:08.353+0000 7f345fdc2700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-10-16T18:47:08.424 INFO:tasks.ceph.mon.b.smithi192.stderr:2023-10-16T18:47:08.353+0000 7f595e6bd700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 103695) UID: 0 2023-10-16T18:47:08.425 INFO:tasks.ceph.mon.b.smithi192.stderr:2023-10-16T18:47:08.424+0000 7f595e6bd700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-10-16T18:47:08.425 INFO:tasks.ceph.mon.c.smithi192.stderr:2023-10-16T18:47:08.394+0000 7f1a57260700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 103698) UID: 0 2023-10-16T18:47:08.425 INFO:tasks.ceph.mon.c.smithi192.stderr:2023-10-16T18:47:08.424+0000 7f1a57260700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-10-16T18:47:08.594 INFO:tasks.ceph.mgr.x.smithi192.stderr:daemon-helper: command crashed with signal 15 2023-10-16T18:49:04.509 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:49:04.513 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:49:34.850 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:49:34.854 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:50:04.984 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:50:04.988 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:50:35.111 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:50:35.114 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:51:05.259 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:51:05.264 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:51:35.034 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T18:51:35.035 INFO:teuthology.orchestra.run.smithi124.stdout:generic/551 2023-10-16T18:51:35.035 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T18:51:35.036 INFO:tasks.cephfs.xfstests_dev:Command return value: -1 2023-10-16T18:51:35.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T18:51:35.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:51:35.039 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T18:51:35.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T18:51:35.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:51:35.417 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T18:51:44.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T18:51:44.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:51:44.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T18:51:44.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:51:47.102 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T18:51:47.103 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T18:51:59.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T18:51:59.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:51:59.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T18:51:59.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:52:02.177 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T18:52:02.178 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T18:52:05.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T18:52:05.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:52:05.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T18:52:05.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:52:05.242 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T18:52:05.246 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-10-16T18:52:05.360 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 183, in invoke_logrotate procs = ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi124 2023-10-16T18:52:05.360 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T18:52:05.361 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-10-16T18:52:05.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T18:52:05.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:52:08.442 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T18:52:17.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T18:52:17.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:52:20.510 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T18:52:32.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T18:52:32.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:52:35.582 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T18:52:38.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T18:52:38.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:52:38.654 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T18:52:38.655 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-10-16T18:52:38.655 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... ERROR 2023-10-16T18:52:38.656 INFO:tasks.cephfs_test_runner:ERROR 2023-10-16T18:52:38.656 INFO:tasks.cephfs_test_runner: 2023-10-16T18:52:38.657 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-16T18:52:38.657 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-16T18:52:38.657 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T18:52:38.657 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T18:52:38.658 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-10-16T18:52:38.658 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-10-16T18:52:38.658 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/xfstests_dev.py", line 387, in run_generic_tests 2023-10-16T18:52:38.659 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-10-16T18:52:38.659 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/xfstests_dev.py", line 373, in run_testdir 2023-10-16T18:52:38.659 INFO:tasks.cephfs_test_runner: self.run_testfile(testdir, testfile) 2023-10-16T18:52:38.659 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/xfstests_dev.py", line 363, in run_testfile 2023-10-16T18:52:38.660 INFO:tasks.cephfs_test_runner: return self.run_test(f'{testdir}/{testfile}', exit_on_err) 2023-10-16T18:52:38.660 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/xfstests_dev.py", line 337, in run_test 2023-10-16T18:52:38.660 INFO:tasks.cephfs_test_runner: p = self.mount_a.run_shell(args=cmd, cwd=self.xfstests_repo_path, 2023-10-16T18:52:38.660 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-10-16T18:52:38.661 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-10-16T18:52:38.661 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 521, in run 2023-10-16T18:52:38.661 INFO:tasks.cephfs_test_runner: raise ConnectionError(f'Failed to reconnect to {self.shortname}') 2023-10-16T18:52:38.661 INFO:tasks.cephfs_test_runner:ConnectionError: Failed to reconnect to smithi124 2023-10-16T18:52:38.662 INFO:tasks.cephfs_test_runner: 2023-10-16T18:52:38.662 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-16T18:52:38.662 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-16T18:52:38.662 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T18:52:38.663 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T18:52:38.663 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/xfstests_dev.py", line 51, in tearDown 2023-10-16T18:52:38.663 INFO:tasks.cephfs_test_runner: self.del_users_and_groups() 2023-10-16T18:52:38.663 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/xfstests_dev.py", line 56, in del_users_and_groups 2023-10-16T18:52:38.664 INFO:tasks.cephfs_test_runner: self.mount_a.client_remote.run(args=['sudo', 'userdel', '--force', 2023-10-16T18:52:38.664 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 521, in run 2023-10-16T18:52:38.664 INFO:tasks.cephfs_test_runner: raise ConnectionError(f'Failed to reconnect to {self.shortname}') 2023-10-16T18:52:38.664 INFO:tasks.cephfs_test_runner:ConnectionError: Failed to reconnect to smithi124 2023-10-16T18:52:38.665 INFO:tasks.cephfs_test_runner: 2023-10-16T18:52:38.665 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T18:52:38.665 INFO:tasks.cephfs_test_runner:Ran 1 test in 21182.383s 2023-10-16T18:52:38.666 INFO:tasks.cephfs_test_runner: 2023-10-16T18:52:38.666 INFO:tasks.cephfs_test_runner:FAILED (errors=2) 2023-10-16T18:52:38.666 INFO:tasks.cephfs_test_runner: 2023-10-16T18:52:38.666 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-16T18:52:38.667 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-16T18:52:38.667 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T18:52:38.668 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T18:52:38.668 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-10-16T18:52:38.668 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-10-16T18:52:38.668 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/xfstests_dev.py", line 387, in run_generic_tests 2023-10-16T18:52:38.669 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-10-16T18:52:38.669 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/xfstests_dev.py", line 373, in run_testdir 2023-10-16T18:52:38.669 INFO:tasks.cephfs_test_runner: self.run_testfile(testdir, testfile) 2023-10-16T18:52:38.669 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/xfstests_dev.py", line 363, in run_testfile 2023-10-16T18:52:38.670 INFO:tasks.cephfs_test_runner: return self.run_test(f'{testdir}/{testfile}', exit_on_err) 2023-10-16T18:52:38.670 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/xfstests_dev.py", line 337, in run_test 2023-10-16T18:52:38.670 INFO:tasks.cephfs_test_runner: p = self.mount_a.run_shell(args=cmd, cwd=self.xfstests_repo_path, 2023-10-16T18:52:38.670 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-10-16T18:52:38.671 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-10-16T18:52:38.671 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 521, in run 2023-10-16T18:52:38.671 INFO:tasks.cephfs_test_runner: raise ConnectionError(f'Failed to reconnect to {self.shortname}') 2023-10-16T18:52:38.671 INFO:tasks.cephfs_test_runner:ConnectionError: Failed to reconnect to smithi124 2023-10-16T18:52:38.671 INFO:tasks.cephfs_test_runner: 2023-10-16T18:52:38.672 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-16T18:52:38.672 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-16T18:52:38.672 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T18:52:38.673 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T18:52:38.673 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/xfstests_dev.py", line 51, in tearDown 2023-10-16T18:52:38.673 INFO:tasks.cephfs_test_runner: self.del_users_and_groups() 2023-10-16T18:52:38.674 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/xfstests_dev.py", line 56, in del_users_and_groups 2023-10-16T18:52:38.674 INFO:tasks.cephfs_test_runner: self.mount_a.client_remote.run(args=['sudo', 'userdel', '--force', 2023-10-16T18:52:38.674 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 521, in run 2023-10-16T18:52:38.674 INFO:tasks.cephfs_test_runner: raise ConnectionError(f'Failed to reconnect to {self.shortname}') 2023-10-16T18:52:38.675 INFO:tasks.cephfs_test_runner:ConnectionError: Failed to reconnect to smithi124 2023-10-16T18:52:38.675 INFO:tasks.cephfs_test_runner: 2023-10-16T18:52:38.676 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev), test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-16T18:52:39.924 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=d6bc47e882144f4a95166b80ef6dc88d Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev), test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-16T18:52:39.926 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-16T18:52:39.936 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-16T18:52:39.975 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-16T18:52:39.975 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T18:52:39.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:52:43.034 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T18:52:52.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T18:52:52.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:52:55.098 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T18:53:07.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T18:53:07.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:53:25.502 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T18:53:28.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T18:53:28.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:53:29.352 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T18:53:29.352 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-10-16T18:53:29.353 ERROR:teuthology.run_tasks:Manager failed: kclient Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 253, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi124 2023-10-16T18:53:29.370 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-16T18:53:29.380 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-16T18:53:29.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T18:53:29.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:53:29.385 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T18:53:38.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T18:53:38.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:53:38.522 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-16T18:53:42.612 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-16T18:53:49.701 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-16T18:53:59.792 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-16T18:54:12.921 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-16T18:54:29.222 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-16T18:55:22.746 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T18:55:34.748 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T18:55:34.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:55:51.066 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T18:55:54.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T18:55:54.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:55:57.082 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T18:55:57.083 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-10-16T18:55:57.084 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1940, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 253, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi124 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi124 2023-10-16T18:55:57.097 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-16T18:55:57.097 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-16T18:55:57.098 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:55:57.102 INFO:tasks.ceph.mds.a:Stopped 2023-10-16T18:55:57.102 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-16T18:55:57.103 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:55:57.104 INFO:tasks.ceph.mds.c:Stopped 2023-10-16T18:55:57.104 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-16T18:55:57.105 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:55:57.105 INFO:tasks.ceph.mds.b:Stopped 2023-10-16T18:55:57.106 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-16T18:55:57.106 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:55:57.107 INFO:tasks.ceph.mds.d:Stopped 2023-10-16T18:55:57.107 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-16T18:55:57.108 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-16T18:55:57.108 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:55:57.109 INFO:tasks.ceph.osd.0:Stopped 2023-10-16T18:55:57.110 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-16T18:55:57.110 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:55:57.111 INFO:tasks.ceph.osd.1:Stopped 2023-10-16T18:55:57.111 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-16T18:55:57.112 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:55:57.112 INFO:tasks.ceph.osd.2:Stopped 2023-10-16T18:55:57.113 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-16T18:55:57.113 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:55:57.114 DEBUG:teuthology.orchestra.run:got remote process result: 5 2023-10-16T18:55:57.114 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1940, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 253, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi124 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi124 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi124 with status 5: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3' 2023-10-16T18:55:57.130 INFO:tasks.ceph.osd.3:Stopped 2023-10-16T18:55:57.130 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-16T18:55:57.131 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:55:57.131 INFO:tasks.ceph.osd.4:Stopped 2023-10-16T18:55:57.132 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-16T18:55:57.132 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:55:57.133 DEBUG:teuthology.orchestra.run:got remote process result: 5 2023-10-16T18:55:57.133 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1940, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 253, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi124 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi124 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi192 with status 5: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5' 2023-10-16T18:55:57.146 INFO:tasks.ceph.osd.5:Stopped 2023-10-16T18:55:57.147 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-16T18:55:57.147 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:55:57.148 INFO:tasks.ceph.osd.6:Stopped 2023-10-16T18:55:57.148 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-16T18:55:57.149 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:55:57.149 INFO:tasks.ceph.osd.7:Stopped 2023-10-16T18:55:57.150 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-16T18:55:57.150 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-16T18:55:57.151 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:55:57.151 INFO:tasks.ceph.mgr.y:Stopped 2023-10-16T18:55:57.152 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-16T18:55:57.152 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:55:57.153 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T18:55:57.154 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1940, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 253, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi124 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi124 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi192 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2023-10-16T18:55:57.168 INFO:tasks.ceph.mgr.x:Stopped 2023-10-16T18:55:57.168 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-16T18:55:57.169 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-16T18:55:57.169 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:55:57.170 INFO:tasks.ceph.mon.a:Stopped 2023-10-16T18:55:57.171 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-16T18:55:57.171 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:55:57.172 INFO:tasks.ceph.mon.b:Stopped 2023-10-16T18:55:57.172 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-16T18:55:57.173 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:55:57.173 INFO:tasks.ceph.mon.c:Stopped 2023-10-16T18:55:57.174 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-16T18:55:57.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T18:55:57.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:56:00.154 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-16T18:56:09.155 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T18:56:09.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:56:09.665 DEBUG:teuthology.orchestra.run.smithi124:> true 2023-10-16T18:56:09.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-16T18:56:09.911 DEBUG:teuthology.orchestra.run.smithi124:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-16T18:56:10.034 INFO:teuthology.orchestra.run.smithi124.stderr:grep: /var/log/ceph/ceph.log: No such file or directory 2023-10-16T18:56:10.036 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi124.front.sepia.ceph.com 2023-10-16T18:56:10.036 DEBUG:teuthology.orchestra.run.smithi124:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-16T18:56:10.634 INFO:teuthology.orchestra.run.smithi124.stderr:umount: /var/lib/ceph/osd/ceph-0: no mount point specified. 2023-10-16T18:56:10.635 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-16T18:56:10.637 DEBUG:teuthology.orchestra.run.smithi124:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2023-10-16T18:56:10.889 INFO:teuthology.orchestra.run.smithi124.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2023-10-16T18:56:10.890 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.890 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.890 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root txt REG 8,1 1601312 8116 /usr/lib/systemd/systemd 2023-10-16T18:56:10.891 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:10.891 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T18:56:10.891 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-10-16T18:56:10.892 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:10.892 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:10.892 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-10-16T18:56:10.892 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-10-16T18:56:10.893 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-10-16T18:56:10.893 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:10.893 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T18:56:10.893 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:10.894 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:10.894 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:10.894 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:10.895 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:10.895 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:10.895 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:10.896 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:10.896 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:10.896 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:10.896 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-10-16T18:56:10.897 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-10-16T18:56:10.897 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:10.897 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:10.898 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:10.898 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:10.898 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 100200 7343 /usr/lib64/libkmod.so.2.3.3 2023-10-16T18:56:10.898 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:10.899 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T18:56:10.899 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:10.899 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:10.900 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-10-16T18:56:10.900 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:10.900 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-10-16T18:56:10.900 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:10.901 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 574801 1740 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-10-16T18:56:10.901 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root mem REG 8,1 19983 1496 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-10-16T18:56:10.901 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:10.901 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 1u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:10.902 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 2u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:10.902 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 3w CHR 1,11 0t0 13320 /dev/kmsg 2023-10-16T18:56:10.902 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 4u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:10.903 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 5u a_inode 0,14 0 12454 [signalfd] 2023-10-16T18:56:10.903 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 6r DIR 0,26 0 1 /sys/fs/cgroup/systemd 2023-10-16T18:56:10.903 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 7u a_inode 0,14 0 12454 [timerfd] 2023-10-16T18:56:10.903 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 8u netlink 0t0 18961 KOBJECT_UEVENT 2023-10-16T18:56:10.904 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 9u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:10.904 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 10r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:10.904 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 11u netlink 0t0 14160 AUDIT 2023-10-16T18:56:10.904 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 12r REG 0,5 0 17410 /proc/1/mountinfo 2023-10-16T18:56:10.905 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 13r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:10.905 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 14r REG 0,5 0 4026532074 /proc/swaps 2023-10-16T18:56:10.905 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 15u unix 0xffff8e30701ac800 0t0 18962 /run/systemd/private type=STREAM 2023-10-16T18:56:10.905 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 16r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:10.906 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 18u unix 0xffff8e30725b9f80 0t0 17412 /run/systemd/notify type=DGRAM 2023-10-16T18:56:10.906 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 19u a_inode 0,14 0 12454 [timerfd] 2023-10-16T18:56:10.906 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 23u unix 0xffff8e3072442d00 0t0 26544 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:10.907 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 24u FIFO 0,24 0t0 17755 /run/initctl 2023-10-16T18:56:10.907 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 25u unix 0xffff8e30725bf500 0t0 17414 /run/systemd/cgroups-agent type=DGRAM 2023-10-16T18:56:10.907 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 26u unix 0xffff8e30725ba400 0t0 17416 type=DGRAM 2023-10-16T18:56:10.907 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 27u unix 0xffff8e30725ba880 0t0 17417 type=DGRAM 2023-10-16T18:56:10.908 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 28u unix 0xffff8e30725bf080 0t0 17759 /run/systemd/coredump type=SEQPACKET 2023-10-16T18:56:10.908 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 29u unix 0xffff8e30725bb180 0t0 17765 /run/lvm/lvmpolld.socket type=STREAM 2023-10-16T18:56:10.908 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 30u FIFO 0,24 0t0 17771 /run/dmeventd-server 2023-10-16T18:56:10.909 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 31u FIFO 0,24 0t0 17772 /run/dmeventd-client 2023-10-16T18:56:10.909 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 32u unix 0xffff8e30725b9200 0t0 17430 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:10.909 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 33u unix 0xffff8e30725b9680 0t0 17434 /run/systemd/journal/socket type=DGRAM 2023-10-16T18:56:10.909 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 34u unix 0xffff8e30725bf980 0t0 17456 /run/systemd/journal/dev-log type=DGRAM 2023-10-16T18:56:10.910 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 35u unix 0xffff8e30725b8000 0t0 17776 /run/rpcbind.sock type=STREAM 2023-10-16T18:56:10.910 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 36u IPv4 17778 0t0 TCP *:sunrpc (LISTEN) 2023-10-16T18:56:10.910 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 37u IPv4 17779 0t0 UDP *:sunrpc 2023-10-16T18:56:10.910 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 38u IPv6 17780 0t0 TCP *:sunrpc (LISTEN) 2023-10-16T18:56:10.911 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 39u IPv6 17781 0t0 UDP *:sunrpc 2023-10-16T18:56:10.911 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 40r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:10.911 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 41r CHR 10,235 0t0 13417 /dev/autofs 2023-10-16T18:56:10.912 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 42r FIFO 0,13 0t0 16903 pipe 2023-10-16T18:56:10.912 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 43u unix 0xffff8e3070152400 0t0 1600 /run/udev/control type=SEQPACKET 2023-10-16T18:56:10.912 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 44u netlink 0t0 1608 KOBJECT_UEVENT 2023-10-16T18:56:10.912 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 45u unix 0xffff8e3070152880 0t0 1612 type=DGRAM 2023-10-16T18:56:10.913 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 46u unix 0xffff8e3072442400 0t0 18998 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:10.913 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 47u a_inode 0,14 0 12454 [timerfd] 2023-10-16T18:56:10.913 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 48u unix 0xffff8e3070154c80 0t0 23196 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:10.914 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 49u unix 0xffff8e3072441200 0t0 16276 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:10.914 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 50u unix 0xffff8e3070b85a00 0t0 16328 /var/run/.heim_org.h5l.kcm-socket type=STREAM 2023-10-16T18:56:10.914 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 51u netlink 0t0 17907 SELINUX 2023-10-16T18:56:10.914 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 52u unix 0xffff8e3070b81f80 0t0 16331 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:10.915 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 53u unix 0xffff8e307178ad00 0t0 17340 /var/run/cups/cups.sock type=STREAM 2023-10-16T18:56:10.915 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 54u unix 0xffff8e3071792d00 0t0 19967 /run/avahi-daemon/socket type=STREAM 2023-10-16T18:56:10.915 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 55u unix 0xffff8e3070b82880 0t0 23591 type=STREAM 2023-10-16T18:56:10.916 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 56u unix 0xffff8e3070153180 0t0 1941 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:10.916 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 57u unix 0xffff8e307178a400 0t0 24754 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:10.916 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 58u unix 0xffff8e3070b82400 0t0 22019 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:10.916 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 59u unix 0xffff8e3070b84800 0t0 24008 type=DGRAM 2023-10-16T18:56:10.917 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 60u unix 0xffff8e3070152d00 0t0 20061 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:10.917 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 61u unix 0xffff8e3071795a00 0t0 29155 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:10.917 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 62u unix 0xffff8e3070154380 0t0 22554 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:10.918 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 63u unix 0xffff8e3070b81680 0t0 22318 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:10.918 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 64u unix 0xffff8e307178e780 0t0 23651 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:10.918 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 65u unix 0xffff8e307178d100 0t0 24758 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:10.918 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 66u unix 0xffff8e3070b83f00 0t0 20123 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:10.919 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 67u unix 0xffff8e3071788480 0t0 20125 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:10.919 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 68u unix 0xffff8e3071788d80 0t0 20127 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:10.919 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 69u unix 0xffff8e30701ab180 0t0 24766 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:10.919 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 70u unix 0xffff8e3071790480 0t0 29156 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:10.920 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 73u unix 0xffff8e3070160d80 0t0 20140 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:10.920 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 74u unix 0xffff8e3070b87080 0t0 24009 type=DGRAM 2023-10-16T18:56:10.920 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 75u unix 0xffff8e307178de80 0t0 24840 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:10.921 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 76u unix 0xffff8e3070b83600 0t0 28690 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:10.921 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1 root 77u unix 0xffff8e3071791200 0t0 28692 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:10.921 INFO:teuthology.orchestra.run.smithi124.stdout:kthreadd 2 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.921 INFO:teuthology.orchestra.run.smithi124.stdout:kthreadd 2 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.922 INFO:teuthology.orchestra.run.smithi124.stdout:kthreadd 2 root txt unknown /proc/2/exe 2023-10-16T18:56:10.922 INFO:teuthology.orchestra.run.smithi124.stdout:rcu_gp 3 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.922 INFO:teuthology.orchestra.run.smithi124.stdout:rcu_gp 3 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.923 INFO:teuthology.orchestra.run.smithi124.stdout:rcu_gp 3 root txt unknown /proc/3/exe 2023-10-16T18:56:10.923 INFO:teuthology.orchestra.run.smithi124.stdout:rcu_par_g 4 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.923 INFO:teuthology.orchestra.run.smithi124.stdout:rcu_par_g 4 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.923 INFO:teuthology.orchestra.run.smithi124.stdout:rcu_par_g 4 root txt unknown /proc/4/exe 2023-10-16T18:56:10.924 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/0 5 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.924 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/0 5 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.925 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/0 5 root txt unknown /proc/5/exe 2023-10-16T18:56:10.925 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/0 6 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.925 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/0 6 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.926 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/0 6 root txt unknown /proc/6/exe 2023-10-16T18:56:10.926 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/0 7 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.926 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/0 7 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.927 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/0 7 root txt unknown /proc/7/exe 2023-10-16T18:56:10.927 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 8 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.927 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 8 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.927 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 8 root txt unknown /proc/8/exe 2023-10-16T18:56:10.928 INFO:teuthology.orchestra.run.smithi124.stdout:mm_percpu 9 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.928 INFO:teuthology.orchestra.run.smithi124.stdout:mm_percpu 9 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.928 INFO:teuthology.orchestra.run.smithi124.stdout:mm_percpu 9 root txt unknown /proc/9/exe 2023-10-16T18:56:10.929 INFO:teuthology.orchestra.run.smithi124.stdout:rcu_tasks 10 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.929 INFO:teuthology.orchestra.run.smithi124.stdout:rcu_tasks 10 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.929 INFO:teuthology.orchestra.run.smithi124.stdout:rcu_tasks 10 root txt unknown /proc/10/exe 2023-10-16T18:56:10.930 INFO:teuthology.orchestra.run.smithi124.stdout:rcu_tasks 11 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.930 INFO:teuthology.orchestra.run.smithi124.stdout:rcu_tasks 11 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.930 INFO:teuthology.orchestra.run.smithi124.stdout:rcu_tasks 11 root txt unknown /proc/11/exe 2023-10-16T18:56:10.931 INFO:teuthology.orchestra.run.smithi124.stdout:ksoftirqd 12 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.931 INFO:teuthology.orchestra.run.smithi124.stdout:ksoftirqd 12 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.931 INFO:teuthology.orchestra.run.smithi124.stdout:ksoftirqd 12 root txt unknown /proc/12/exe 2023-10-16T18:56:10.931 INFO:teuthology.orchestra.run.smithi124.stdout:rcu_sched 13 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.932 INFO:teuthology.orchestra.run.smithi124.stdout:rcu_sched 13 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.932 INFO:teuthology.orchestra.run.smithi124.stdout:rcu_sched 13 root txt unknown /proc/13/exe 2023-10-16T18:56:10.932 INFO:teuthology.orchestra.run.smithi124.stdout:migration 14 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.933 INFO:teuthology.orchestra.run.smithi124.stdout:migration 14 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.933 INFO:teuthology.orchestra.run.smithi124.stdout:migration 14 root txt unknown /proc/14/exe 2023-10-16T18:56:10.933 INFO:teuthology.orchestra.run.smithi124.stdout:watchdog/ 15 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.933 INFO:teuthology.orchestra.run.smithi124.stdout:watchdog/ 15 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.934 INFO:teuthology.orchestra.run.smithi124.stdout:watchdog/ 15 root txt unknown /proc/15/exe 2023-10-16T18:56:10.934 INFO:teuthology.orchestra.run.smithi124.stdout:cpuhp/0 16 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.934 INFO:teuthology.orchestra.run.smithi124.stdout:cpuhp/0 16 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.935 INFO:teuthology.orchestra.run.smithi124.stdout:cpuhp/0 16 root txt unknown /proc/16/exe 2023-10-16T18:56:10.935 INFO:teuthology.orchestra.run.smithi124.stdout:cpuhp/1 17 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.935 INFO:teuthology.orchestra.run.smithi124.stdout:cpuhp/1 17 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.935 INFO:teuthology.orchestra.run.smithi124.stdout:cpuhp/1 17 root txt unknown /proc/17/exe 2023-10-16T18:56:10.936 INFO:teuthology.orchestra.run.smithi124.stdout:watchdog/ 18 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.936 INFO:teuthology.orchestra.run.smithi124.stdout:watchdog/ 18 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.936 INFO:teuthology.orchestra.run.smithi124.stdout:watchdog/ 18 root txt unknown /proc/18/exe 2023-10-16T18:56:10.937 INFO:teuthology.orchestra.run.smithi124.stdout:migration 19 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.937 INFO:teuthology.orchestra.run.smithi124.stdout:migration 19 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.937 INFO:teuthology.orchestra.run.smithi124.stdout:migration 19 root txt unknown /proc/19/exe 2023-10-16T18:56:10.937 INFO:teuthology.orchestra.run.smithi124.stdout:ksoftirqd 20 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.938 INFO:teuthology.orchestra.run.smithi124.stdout:ksoftirqd 20 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.938 INFO:teuthology.orchestra.run.smithi124.stdout:ksoftirqd 20 root txt unknown /proc/20/exe 2023-10-16T18:56:10.938 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/1 21 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.939 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/1 21 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.939 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/1 21 root txt unknown /proc/21/exe 2023-10-16T18:56:10.939 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/1 22 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.939 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/1 22 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.940 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/1 22 root txt unknown /proc/22/exe 2023-10-16T18:56:10.940 INFO:teuthology.orchestra.run.smithi124.stdout:cpuhp/2 23 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.940 INFO:teuthology.orchestra.run.smithi124.stdout:cpuhp/2 23 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.941 INFO:teuthology.orchestra.run.smithi124.stdout:cpuhp/2 23 root txt unknown /proc/23/exe 2023-10-16T18:56:10.941 INFO:teuthology.orchestra.run.smithi124.stdout:watchdog/ 24 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.941 INFO:teuthology.orchestra.run.smithi124.stdout:watchdog/ 24 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.941 INFO:teuthology.orchestra.run.smithi124.stdout:watchdog/ 24 root txt unknown /proc/24/exe 2023-10-16T18:56:10.942 INFO:teuthology.orchestra.run.smithi124.stdout:migration 25 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.942 INFO:teuthology.orchestra.run.smithi124.stdout:migration 25 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.942 INFO:teuthology.orchestra.run.smithi124.stdout:migration 25 root txt unknown /proc/25/exe 2023-10-16T18:56:10.942 INFO:teuthology.orchestra.run.smithi124.stdout:ksoftirqd 26 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.943 INFO:teuthology.orchestra.run.smithi124.stdout:ksoftirqd 26 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.943 INFO:teuthology.orchestra.run.smithi124.stdout:ksoftirqd 26 root txt unknown /proc/26/exe 2023-10-16T18:56:10.943 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/2 27 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.944 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/2 27 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.944 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/2 27 root txt unknown /proc/27/exe 2023-10-16T18:56:10.944 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/2 28 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.945 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/2 28 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.945 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/2 28 root txt unknown /proc/28/exe 2023-10-16T18:56:10.945 INFO:teuthology.orchestra.run.smithi124.stdout:cpuhp/3 29 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.945 INFO:teuthology.orchestra.run.smithi124.stdout:cpuhp/3 29 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.946 INFO:teuthology.orchestra.run.smithi124.stdout:cpuhp/3 29 root txt unknown /proc/29/exe 2023-10-16T18:56:10.946 INFO:teuthology.orchestra.run.smithi124.stdout:watchdog/ 30 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.946 INFO:teuthology.orchestra.run.smithi124.stdout:watchdog/ 30 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.947 INFO:teuthology.orchestra.run.smithi124.stdout:watchdog/ 30 root txt unknown /proc/30/exe 2023-10-16T18:56:10.947 INFO:teuthology.orchestra.run.smithi124.stdout:migration 31 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.947 INFO:teuthology.orchestra.run.smithi124.stdout:migration 31 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.947 INFO:teuthology.orchestra.run.smithi124.stdout:migration 31 root txt unknown /proc/31/exe 2023-10-16T18:56:10.948 INFO:teuthology.orchestra.run.smithi124.stdout:ksoftirqd 32 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.948 INFO:teuthology.orchestra.run.smithi124.stdout:ksoftirqd 32 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.948 INFO:teuthology.orchestra.run.smithi124.stdout:ksoftirqd 32 root txt unknown /proc/32/exe 2023-10-16T18:56:10.949 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/3 33 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.949 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/3 33 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.949 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/3 33 root txt unknown /proc/33/exe 2023-10-16T18:56:10.949 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/3 34 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.950 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/3 34 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.950 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/3 34 root txt unknown /proc/34/exe 2023-10-16T18:56:10.950 INFO:teuthology.orchestra.run.smithi124.stdout:cpuhp/4 35 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.951 INFO:teuthology.orchestra.run.smithi124.stdout:cpuhp/4 35 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.951 INFO:teuthology.orchestra.run.smithi124.stdout:cpuhp/4 35 root txt unknown /proc/35/exe 2023-10-16T18:56:10.951 INFO:teuthology.orchestra.run.smithi124.stdout:watchdog/ 36 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.951 INFO:teuthology.orchestra.run.smithi124.stdout:watchdog/ 36 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.952 INFO:teuthology.orchestra.run.smithi124.stdout:watchdog/ 36 root txt unknown /proc/36/exe 2023-10-16T18:56:10.952 INFO:teuthology.orchestra.run.smithi124.stdout:migration 37 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.952 INFO:teuthology.orchestra.run.smithi124.stdout:migration 37 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.953 INFO:teuthology.orchestra.run.smithi124.stdout:migration 37 root txt unknown /proc/37/exe 2023-10-16T18:56:10.953 INFO:teuthology.orchestra.run.smithi124.stdout:ksoftirqd 38 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.953 INFO:teuthology.orchestra.run.smithi124.stdout:ksoftirqd 38 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.953 INFO:teuthology.orchestra.run.smithi124.stdout:ksoftirqd 38 root txt unknown /proc/38/exe 2023-10-16T18:56:10.954 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/4 39 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.954 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/4 39 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.954 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/4 39 root txt unknown /proc/39/exe 2023-10-16T18:56:10.955 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/4 40 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.955 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/4 40 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.955 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/4 40 root txt unknown /proc/40/exe 2023-10-16T18:56:10.955 INFO:teuthology.orchestra.run.smithi124.stdout:cpuhp/5 41 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.956 INFO:teuthology.orchestra.run.smithi124.stdout:cpuhp/5 41 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.956 INFO:teuthology.orchestra.run.smithi124.stdout:cpuhp/5 41 root txt unknown /proc/41/exe 2023-10-16T18:56:10.956 INFO:teuthology.orchestra.run.smithi124.stdout:watchdog/ 42 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.957 INFO:teuthology.orchestra.run.smithi124.stdout:watchdog/ 42 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.957 INFO:teuthology.orchestra.run.smithi124.stdout:watchdog/ 42 root txt unknown /proc/42/exe 2023-10-16T18:56:10.957 INFO:teuthology.orchestra.run.smithi124.stdout:migration 43 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.957 INFO:teuthology.orchestra.run.smithi124.stdout:migration 43 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.958 INFO:teuthology.orchestra.run.smithi124.stdout:migration 43 root txt unknown /proc/43/exe 2023-10-16T18:56:10.958 INFO:teuthology.orchestra.run.smithi124.stdout:ksoftirqd 44 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.958 INFO:teuthology.orchestra.run.smithi124.stdout:ksoftirqd 44 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.959 INFO:teuthology.orchestra.run.smithi124.stdout:ksoftirqd 44 root txt unknown /proc/44/exe 2023-10-16T18:56:10.959 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/5 45 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.959 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/5 45 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.959 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/5 45 root txt unknown /proc/45/exe 2023-10-16T18:56:10.960 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/5 46 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.960 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/5 46 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.960 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/5 46 root txt unknown /proc/46/exe 2023-10-16T18:56:10.961 INFO:teuthology.orchestra.run.smithi124.stdout:cpuhp/6 47 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.961 INFO:teuthology.orchestra.run.smithi124.stdout:cpuhp/6 47 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.961 INFO:teuthology.orchestra.run.smithi124.stdout:cpuhp/6 47 root txt unknown /proc/47/exe 2023-10-16T18:56:10.961 INFO:teuthology.orchestra.run.smithi124.stdout:watchdog/ 48 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.962 INFO:teuthology.orchestra.run.smithi124.stdout:watchdog/ 48 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.962 INFO:teuthology.orchestra.run.smithi124.stdout:watchdog/ 48 root txt unknown /proc/48/exe 2023-10-16T18:56:10.962 INFO:teuthology.orchestra.run.smithi124.stdout:migration 49 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.963 INFO:teuthology.orchestra.run.smithi124.stdout:migration 49 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.963 INFO:teuthology.orchestra.run.smithi124.stdout:migration 49 root txt unknown /proc/49/exe 2023-10-16T18:56:10.963 INFO:teuthology.orchestra.run.smithi124.stdout:ksoftirqd 50 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.963 INFO:teuthology.orchestra.run.smithi124.stdout:ksoftirqd 50 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.964 INFO:teuthology.orchestra.run.smithi124.stdout:ksoftirqd 50 root txt unknown /proc/50/exe 2023-10-16T18:56:10.964 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/6 51 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.964 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/6 51 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.965 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/6 51 root txt unknown /proc/51/exe 2023-10-16T18:56:10.965 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/6 52 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.965 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/6 52 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.965 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/6 52 root txt unknown /proc/52/exe 2023-10-16T18:56:10.966 INFO:teuthology.orchestra.run.smithi124.stdout:cpuhp/7 53 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.966 INFO:teuthology.orchestra.run.smithi124.stdout:cpuhp/7 53 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.966 INFO:teuthology.orchestra.run.smithi124.stdout:cpuhp/7 53 root txt unknown /proc/53/exe 2023-10-16T18:56:10.967 INFO:teuthology.orchestra.run.smithi124.stdout:watchdog/ 54 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.967 INFO:teuthology.orchestra.run.smithi124.stdout:watchdog/ 54 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.967 INFO:teuthology.orchestra.run.smithi124.stdout:watchdog/ 54 root txt unknown /proc/54/exe 2023-10-16T18:56:10.967 INFO:teuthology.orchestra.run.smithi124.stdout:migration 55 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.968 INFO:teuthology.orchestra.run.smithi124.stdout:migration 55 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.968 INFO:teuthology.orchestra.run.smithi124.stdout:migration 55 root txt unknown /proc/55/exe 2023-10-16T18:56:10.968 INFO:teuthology.orchestra.run.smithi124.stdout:ksoftirqd 56 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.969 INFO:teuthology.orchestra.run.smithi124.stdout:ksoftirqd 56 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.969 INFO:teuthology.orchestra.run.smithi124.stdout:ksoftirqd 56 root txt unknown /proc/56/exe 2023-10-16T18:56:10.969 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/7 57 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.969 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/7 57 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.970 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/7 57 root txt unknown /proc/57/exe 2023-10-16T18:56:10.970 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/7 58 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.970 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/7 58 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.971 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/7 58 root txt unknown /proc/58/exe 2023-10-16T18:56:10.971 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 60 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.971 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 60 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.971 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 60 root txt unknown /proc/60/exe 2023-10-16T18:56:10.972 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 61 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.972 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 61 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.972 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 61 root txt unknown /proc/61/exe 2023-10-16T18:56:10.973 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 62 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.973 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 62 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.973 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 62 root txt unknown /proc/62/exe 2023-10-16T18:56:10.973 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 63 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.974 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 63 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.974 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 63 root txt unknown /proc/63/exe 2023-10-16T18:56:10.974 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 64 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.975 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 64 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.975 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 64 root txt unknown /proc/64/exe 2023-10-16T18:56:10.975 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 65 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.975 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 65 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.976 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 65 root txt unknown /proc/65/exe 2023-10-16T18:56:10.976 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 66 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.976 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 66 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.977 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 66 root txt unknown /proc/66/exe 2023-10-16T18:56:10.977 INFO:teuthology.orchestra.run.smithi124.stdout:kdevtmpfs 67 root cwd DIR 0,6 3380 3 / 2023-10-16T18:56:10.977 INFO:teuthology.orchestra.run.smithi124.stdout:kdevtmpfs 67 root rtd DIR 0,6 3380 3 / 2023-10-16T18:56:10.977 INFO:teuthology.orchestra.run.smithi124.stdout:kdevtmpfs 67 root txt unknown /proc/67/exe 2023-10-16T18:56:10.978 INFO:teuthology.orchestra.run.smithi124.stdout:netns 68 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.978 INFO:teuthology.orchestra.run.smithi124.stdout:netns 68 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.978 INFO:teuthology.orchestra.run.smithi124.stdout:netns 68 root txt unknown /proc/68/exe 2023-10-16T18:56:10.979 INFO:teuthology.orchestra.run.smithi124.stdout:kauditd 69 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.979 INFO:teuthology.orchestra.run.smithi124.stdout:kauditd 69 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.979 INFO:teuthology.orchestra.run.smithi124.stdout:kauditd 69 root txt unknown /proc/69/exe 2023-10-16T18:56:10.979 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/4 70 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.980 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/4 70 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.980 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/4 70 root txt unknown /proc/70/exe 2023-10-16T18:56:10.980 INFO:teuthology.orchestra.run.smithi124.stdout:khungtask 71 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.980 INFO:teuthology.orchestra.run.smithi124.stdout:khungtask 71 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.981 INFO:teuthology.orchestra.run.smithi124.stdout:khungtask 71 root txt unknown /proc/71/exe 2023-10-16T18:56:10.981 INFO:teuthology.orchestra.run.smithi124.stdout:oom_reape 72 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.981 INFO:teuthology.orchestra.run.smithi124.stdout:oom_reape 72 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.981 INFO:teuthology.orchestra.run.smithi124.stdout:oom_reape 72 root txt unknown /proc/72/exe 2023-10-16T18:56:10.982 INFO:teuthology.orchestra.run.smithi124.stdout:writeback 73 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.982 INFO:teuthology.orchestra.run.smithi124.stdout:writeback 73 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.982 INFO:teuthology.orchestra.run.smithi124.stdout:writeback 73 root txt unknown /proc/73/exe 2023-10-16T18:56:10.983 INFO:teuthology.orchestra.run.smithi124.stdout:kcompactd 74 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.983 INFO:teuthology.orchestra.run.smithi124.stdout:kcompactd 74 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.983 INFO:teuthology.orchestra.run.smithi124.stdout:kcompactd 74 root txt unknown /proc/74/exe 2023-10-16T18:56:10.984 INFO:teuthology.orchestra.run.smithi124.stdout:ksmd 75 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.984 INFO:teuthology.orchestra.run.smithi124.stdout:ksmd 75 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.984 INFO:teuthology.orchestra.run.smithi124.stdout:ksmd 75 root txt unknown /proc/75/exe 2023-10-16T18:56:10.984 INFO:teuthology.orchestra.run.smithi124.stdout:khugepage 76 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.985 INFO:teuthology.orchestra.run.smithi124.stdout:khugepage 76 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.985 INFO:teuthology.orchestra.run.smithi124.stdout:khugepage 76 root txt unknown /proc/76/exe 2023-10-16T18:56:10.985 INFO:teuthology.orchestra.run.smithi124.stdout:crypto 77 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.986 INFO:teuthology.orchestra.run.smithi124.stdout:crypto 77 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.986 INFO:teuthology.orchestra.run.smithi124.stdout:crypto 77 root txt unknown /proc/77/exe 2023-10-16T18:56:10.986 INFO:teuthology.orchestra.run.smithi124.stdout:kintegrit 78 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.986 INFO:teuthology.orchestra.run.smithi124.stdout:kintegrit 78 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.987 INFO:teuthology.orchestra.run.smithi124.stdout:kintegrit 78 root txt unknown /proc/78/exe 2023-10-16T18:56:10.987 INFO:teuthology.orchestra.run.smithi124.stdout:kblockd 79 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.987 INFO:teuthology.orchestra.run.smithi124.stdout:kblockd 79 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.988 INFO:teuthology.orchestra.run.smithi124.stdout:kblockd 79 root txt unknown /proc/79/exe 2023-10-16T18:56:10.988 INFO:teuthology.orchestra.run.smithi124.stdout:blkcg_pun 80 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.988 INFO:teuthology.orchestra.run.smithi124.stdout:blkcg_pun 80 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.988 INFO:teuthology.orchestra.run.smithi124.stdout:blkcg_pun 80 root txt unknown /proc/80/exe 2023-10-16T18:56:10.989 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/1 81 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.989 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/1 81 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.989 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/1 81 root txt unknown /proc/81/exe 2023-10-16T18:56:10.989 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/2 82 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.990 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/2 82 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.990 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/2 82 root txt unknown /proc/82/exe 2023-10-16T18:56:10.990 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/3 83 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.991 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/3 83 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.991 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/3 83 root txt unknown /proc/83/exe 2023-10-16T18:56:10.991 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/5 84 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.991 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/5 84 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.992 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/5 84 root txt unknown /proc/84/exe 2023-10-16T18:56:10.992 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/6 85 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.992 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/6 85 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.993 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/6 85 root txt unknown /proc/85/exe 2023-10-16T18:56:10.993 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/7 86 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.993 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/7 86 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.993 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/7 86 root txt unknown /proc/86/exe 2023-10-16T18:56:10.994 INFO:teuthology.orchestra.run.smithi124.stdout:tpm_dev_w 87 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.994 INFO:teuthology.orchestra.run.smithi124.stdout:tpm_dev_w 87 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.994 INFO:teuthology.orchestra.run.smithi124.stdout:tpm_dev_w 87 root txt unknown /proc/87/exe 2023-10-16T18:56:10.995 INFO:teuthology.orchestra.run.smithi124.stdout:md 88 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.995 INFO:teuthology.orchestra.run.smithi124.stdout:md 88 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.995 INFO:teuthology.orchestra.run.smithi124.stdout:md 88 root txt unknown /proc/88/exe 2023-10-16T18:56:10.996 INFO:teuthology.orchestra.run.smithi124.stdout:edac-poll 89 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.996 INFO:teuthology.orchestra.run.smithi124.stdout:edac-poll 89 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.996 INFO:teuthology.orchestra.run.smithi124.stdout:edac-poll 89 root txt unknown /proc/89/exe 2023-10-16T18:56:10.996 INFO:teuthology.orchestra.run.smithi124.stdout:watchdogd 90 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.997 INFO:teuthology.orchestra.run.smithi124.stdout:watchdogd 90 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.997 INFO:teuthology.orchestra.run.smithi124.stdout:watchdogd 90 root txt unknown /proc/90/exe 2023-10-16T18:56:10.997 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/1 91 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.998 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/1 91 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.998 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/1 91 root txt unknown /proc/91/exe 2023-10-16T18:56:10.998 INFO:teuthology.orchestra.run.smithi124.stdout:kswapd0 124 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.998 INFO:teuthology.orchestra.run.smithi124.stdout:kswapd0 124 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:10.999 INFO:teuthology.orchestra.run.smithi124.stdout:kswapd0 124 root txt unknown /proc/124/exe 2023-10-16T18:56:10.999 INFO:teuthology.orchestra.run.smithi124.stdout:kthrotld 226 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:10.999 INFO:teuthology.orchestra.run.smithi124.stdout:kthrotld 226 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.000 INFO:teuthology.orchestra.run.smithi124.stdout:kthrotld 226 root txt unknown /proc/226/exe 2023-10-16T18:56:11.000 INFO:teuthology.orchestra.run.smithi124.stdout:acpi_ther 227 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.000 INFO:teuthology.orchestra.run.smithi124.stdout:acpi_ther 227 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.000 INFO:teuthology.orchestra.run.smithi124.stdout:acpi_ther 227 root txt unknown /proc/227/exe 2023-10-16T18:56:11.001 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/5 228 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.001 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/5 228 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.001 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/5 228 root txt unknown /proc/228/exe 2023-10-16T18:56:11.002 INFO:teuthology.orchestra.run.smithi124.stdout:kmpath_rd 229 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.002 INFO:teuthology.orchestra.run.smithi124.stdout:kmpath_rd 229 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.002 INFO:teuthology.orchestra.run.smithi124.stdout:kmpath_rd 229 root txt unknown /proc/229/exe 2023-10-16T18:56:11.002 INFO:teuthology.orchestra.run.smithi124.stdout:kaluad 230 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.003 INFO:teuthology.orchestra.run.smithi124.stdout:kaluad 230 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.003 INFO:teuthology.orchestra.run.smithi124.stdout:kaluad 230 root txt unknown /proc/230/exe 2023-10-16T18:56:11.003 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/0 231 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.004 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/0 231 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.004 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/0 231 root txt unknown /proc/231/exe 2023-10-16T18:56:11.004 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/4 232 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.004 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/4 232 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.005 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/4 232 root txt unknown /proc/232/exe 2023-10-16T18:56:11.005 INFO:teuthology.orchestra.run.smithi124.stdout:ipv6_addr 233 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.005 INFO:teuthology.orchestra.run.smithi124.stdout:ipv6_addr 233 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.006 INFO:teuthology.orchestra.run.smithi124.stdout:ipv6_addr 233 root txt unknown /proc/233/exe 2023-10-16T18:56:11.006 INFO:teuthology.orchestra.run.smithi124.stdout:kstrp 234 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.006 INFO:teuthology.orchestra.run.smithi124.stdout:kstrp 234 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.006 INFO:teuthology.orchestra.run.smithi124.stdout:kstrp 234 root txt unknown /proc/234/exe 2023-10-16T18:56:11.007 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/0 275 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.007 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/0 275 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.007 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/0 275 root txt unknown /proc/275/exe 2023-10-16T18:56:11.008 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/1 294 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.008 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/1 294 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.008 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/1 294 root txt unknown /proc/294/exe 2023-10-16T18:56:11.008 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/3 321 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.009 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/3 321 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.009 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/3 321 root txt unknown /proc/321/exe 2023-10-16T18:56:11.009 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/6 349 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.010 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/6 349 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.010 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/6 349 root txt unknown /proc/349/exe 2023-10-16T18:56:11.010 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/2 352 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.010 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/2 352 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.011 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/2 352 root txt unknown /proc/352/exe 2023-10-16T18:56:11.011 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/7 354 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.011 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/7 354 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.012 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/7 354 root txt unknown /proc/354/exe 2023-10-16T18:56:11.012 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/5 355 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.012 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/5 355 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.012 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/5 355 root txt unknown /proc/355/exe 2023-10-16T18:56:11.013 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/6 361 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.013 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/6 361 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.013 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/6 361 root txt unknown /proc/361/exe 2023-10-16T18:56:11.013 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/1 378 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.014 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/1 378 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.014 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/1 378 root txt unknown /proc/378/exe 2023-10-16T18:56:11.014 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/0 397 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.015 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/0 397 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.015 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/0 397 root txt unknown /proc/397/exe 2023-10-16T18:56:11.015 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/0 428 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.015 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/0 428 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.016 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/0 428 root txt unknown /proc/428/exe 2023-10-16T18:56:11.016 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/2 454 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.016 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/2 454 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.017 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/2 454 root txt unknown /proc/454/exe 2023-10-16T18:56:11.017 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/6 494 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.017 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/6 494 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.018 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/6 494 root txt unknown /proc/494/exe 2023-10-16T18:56:11.018 INFO:teuthology.orchestra.run.smithi124.stdout:ata_sff 498 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.018 INFO:teuthology.orchestra.run.smithi124.stdout:ata_sff 498 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.018 INFO:teuthology.orchestra.run.smithi124.stdout:ata_sff 498 root txt unknown /proc/498/exe 2023-10-16T18:56:11.019 INFO:teuthology.orchestra.run.smithi124.stdout:nvme-wq 499 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.019 INFO:teuthology.orchestra.run.smithi124.stdout:nvme-wq 499 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.019 INFO:teuthology.orchestra.run.smithi124.stdout:nvme-wq 499 root txt unknown /proc/499/exe 2023-10-16T18:56:11.020 INFO:teuthology.orchestra.run.smithi124.stdout:nvme-rese 500 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.020 INFO:teuthology.orchestra.run.smithi124.stdout:nvme-rese 500 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.020 INFO:teuthology.orchestra.run.smithi124.stdout:nvme-rese 500 root txt unknown /proc/500/exe 2023-10-16T18:56:11.021 INFO:teuthology.orchestra.run.smithi124.stdout:nvme-dele 501 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.021 INFO:teuthology.orchestra.run.smithi124.stdout:nvme-dele 501 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.021 INFO:teuthology.orchestra.run.smithi124.stdout:nvme-dele 501 root txt unknown /proc/501/exe 2023-10-16T18:56:11.022 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_0 502 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.022 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_0 502 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.022 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_0 502 root txt unknown /proc/502/exe 2023-10-16T18:56:11.022 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 503 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.023 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 503 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.023 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 503 root txt unknown /proc/503/exe 2023-10-16T18:56:11.023 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_1 504 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.024 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_1 504 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.024 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_1 504 root txt unknown /proc/504/exe 2023-10-16T18:56:11.024 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 505 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.024 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 505 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.025 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 505 root txt unknown /proc/505/exe 2023-10-16T18:56:11.025 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_2 506 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.025 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_2 506 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.026 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_2 506 root txt unknown /proc/506/exe 2023-10-16T18:56:11.026 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 507 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.026 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 507 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.026 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 507 root txt unknown /proc/507/exe 2023-10-16T18:56:11.027 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_3 508 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.027 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_3 508 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.027 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_3 508 root txt unknown /proc/508/exe 2023-10-16T18:56:11.028 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 509 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.028 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 509 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.028 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 509 root txt unknown /proc/509/exe 2023-10-16T18:56:11.028 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_4 516 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.029 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_4 516 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.029 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_4 516 root txt unknown /proc/516/exe 2023-10-16T18:56:11.029 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 517 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.030 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 517 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.030 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 517 root txt unknown /proc/517/exe 2023-10-16T18:56:11.030 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_5 518 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.030 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_5 518 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.031 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_5 518 root txt unknown /proc/518/exe 2023-10-16T18:56:11.031 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 519 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.031 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 519 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.032 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 519 root txt unknown /proc/519/exe 2023-10-16T18:56:11.032 INFO:teuthology.orchestra.run.smithi124.stdout:ixgbe 520 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.032 INFO:teuthology.orchestra.run.smithi124.stdout:ixgbe 520 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.032 INFO:teuthology.orchestra.run.smithi124.stdout:ixgbe 520 root txt unknown /proc/520/exe 2023-10-16T18:56:11.033 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_6 521 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.033 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_6 521 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.033 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_6 521 root txt unknown /proc/521/exe 2023-10-16T18:56:11.034 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 522 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.034 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 522 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.034 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 522 root txt unknown /proc/522/exe 2023-10-16T18:56:11.034 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_7 523 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.035 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_7 523 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.035 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_7 523 root txt unknown /proc/523/exe 2023-10-16T18:56:11.035 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 524 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.038 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 524 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.038 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 524 root txt unknown /proc/524/exe 2023-10-16T18:56:11.039 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_8 525 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.039 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_8 525 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.039 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_8 525 root txt unknown /proc/525/exe 2023-10-16T18:56:11.039 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 526 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.040 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 526 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.040 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 526 root txt unknown /proc/526/exe 2023-10-16T18:56:11.040 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_9 527 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.041 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_9 527 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.041 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_eh_9 527 root txt unknown /proc/527/exe 2023-10-16T18:56:11.041 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 528 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.041 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 528 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.042 INFO:teuthology.orchestra.run.smithi124.stdout:scsi_tmf_ 528 root txt unknown /proc/528/exe 2023-10-16T18:56:11.042 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 529 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.042 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 529 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.043 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 529 root txt unknown /proc/529/exe 2023-10-16T18:56:11.043 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 530 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.043 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 530 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.043 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 530 root txt unknown /proc/530/exe 2023-10-16T18:56:11.044 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 531 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.044 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 531 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.044 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 531 root txt unknown /proc/531/exe 2023-10-16T18:56:11.045 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/7 546 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.045 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/7 546 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.045 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/7 546 root txt unknown /proc/546/exe 2023-10-16T18:56:11.045 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/5 562 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.046 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/5 562 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.046 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/5 562 root txt unknown /proc/562/exe 2023-10-16T18:56:11.046 INFO:teuthology.orchestra.run.smithi124.stdout:jbd2/sda1 563 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.047 INFO:teuthology.orchestra.run.smithi124.stdout:jbd2/sda1 563 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.047 INFO:teuthology.orchestra.run.smithi124.stdout:jbd2/sda1 563 root txt unknown /proc/563/exe 2023-10-16T18:56:11.047 INFO:teuthology.orchestra.run.smithi124.stdout:ext4-rsv- 564 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.047 INFO:teuthology.orchestra.run.smithi124.stdout:ext4-rsv- 564 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.048 INFO:teuthology.orchestra.run.smithi124.stdout:ext4-rsv- 564 root txt unknown /proc/564/exe 2023-10-16T18:56:11.048 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/3 593 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.048 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/3 593 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.049 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/3 593 root txt unknown /proc/593/exe 2023-10-16T18:56:11.049 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/3 639 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.049 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/3 639 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.049 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/3 639 root txt unknown /proc/639/exe 2023-10-16T18:56:11.050 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.050 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.050 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root txt REG 8,1 153992 8126 /usr/lib/systemd/systemd-journald 2023-10-16T18:56:11.051 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 0,24 8388608 1157 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-10-16T18:56:11.051 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.051 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.052 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T18:56:11.052 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-10-16T18:56:11.052 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.052 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.053 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-10-16T18:56:11.053 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:11.053 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T18:56:11.053 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-10-16T18:56:11.054 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.054 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-10-16T18:56:11.054 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.055 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.055 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.055 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.055 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.056 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.056 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.056 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-10-16T18:56:11.057 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.057 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-10-16T18:56:11.057 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-10-16T18:56:11.057 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.058 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.058 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.058 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.059 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.059 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.059 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-10-16T18:56:11.059 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.060 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root mem REG 0,24 8 1137 /run/systemd/journal/kernel-seqnum 2023-10-16T18:56:11.060 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.060 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 1w CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.061 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 2w CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.061 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 3u unix 0xffff8e30725bf980 0t0 17456 /run/systemd/journal/dev-log type=DGRAM 2023-10-16T18:56:11.061 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 4u unix 0xffff8e30725b9200 0t0 17430 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:11.061 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 5u unix 0xffff8e30725b9680 0t0 17434 /run/systemd/journal/socket type=DGRAM 2023-10-16T18:56:11.062 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 6u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.062 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 7u CHR 1,11 0t0 13320 /dev/kmsg 2023-10-16T18:56:11.062 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 8r REG 0,5 0 1138 /proc/sys/kernel/hostname 2023-10-16T18:56:11.063 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 9u a_inode 0,14 0 12454 [signalfd] 2023-10-16T18:56:11.063 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 10u a_inode 0,14 0 12454 [signalfd] 2023-10-16T18:56:11.063 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 11u a_inode 0,14 0 12454 [signalfd] 2023-10-16T18:56:11.063 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 12u unix 0xffff8e3070163f00 0t0 571 type=DGRAM 2023-10-16T18:56:11.064 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 13u a_inode 0,14 0 12454 [timerfd] 2023-10-16T18:56:11.064 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 14u REG 0,24 8388608 1157 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-10-16T18:56:11.064 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 15u unix 0xffff8e3072442400 0t0 18998 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:11.065 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 16u unix 0xffff8e3070154c80 0t0 23196 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:11.065 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 17u unix 0xffff8e3070153180 0t0 1941 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:11.065 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 18u unix 0xffff8e3072441200 0t0 16276 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:11.065 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 19u unix 0xffff8e307178a400 0t0 24754 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:11.066 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 20u unix 0xffff8e3070b82400 0t0 22019 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:11.066 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 21u unix 0xffff8e30701ab180 0t0 24766 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:11.066 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 22u unix 0xffff8e3070152d00 0t0 20061 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:11.067 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 23u unix 0xffff8e307178d100 0t0 24758 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:11.067 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 24u unix 0xffff8e3070154380 0t0 22554 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:11.067 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 25u unix 0xffff8e3071791200 0t0 28692 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:11.067 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 26u unix 0xffff8e307178e780 0t0 23651 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:11.068 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 27u unix 0xffff8e3071795a00 0t0 29155 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:11.068 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 28u unix 0xffff8e3070b83f00 0t0 20123 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:11.068 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 29u unix 0xffff8e3071788480 0t0 20125 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:11.069 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 30u unix 0xffff8e3071788d80 0t0 20127 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:11.069 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 31u unix 0xffff8e307178de80 0t0 24840 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:11.069 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 32u unix 0xffff8e3071790480 0t0 29156 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:11.069 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 33u unix 0xffff8e3070160d80 0t0 20140 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:11.070 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 34u unix 0xffff8e3070b83600 0t0 28690 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:11.070 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 35u unix 0xffff8e3070b81680 0t0 22318 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:11.070 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-j 660 root 36u unix 0xffff8e3072442d00 0t0 26544 /run/systemd/journal/stdout type=STREAM 2023-10-16T18:56:11.071 INFO:teuthology.orchestra.run.smithi124.stdout:ext4lazyi 679 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.071 INFO:teuthology.orchestra.run.smithi124.stdout:ext4lazyi 679 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.071 INFO:teuthology.orchestra.run.smithi124.stdout:ext4lazyi 679 root txt unknown /proc/679/exe 2023-10-16T18:56:11.071 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/4 685 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.072 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/4 685 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.072 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/4 685 root txt unknown /proc/685/exe 2023-10-16T18:56:11.072 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/4 699 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.072 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/4 699 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.073 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/4 699 root txt unknown /proc/699/exe 2023-10-16T18:56:11.073 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.073 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.073 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root txt REG 8,1 418304 8317 /usr/lib/systemd/systemd-udevd 2023-10-16T18:56:11.074 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.074 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.074 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root DEL REG 8,1 20335 /var/lib/sss/mc/group 2023-10-16T18:56:11.075 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.075 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 559522 41419 /usr/lib/modules/4.18.0-372.9.1.el8.x86_64/modules.symbols.bin 2023-10-16T18:56:11.075 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 871129 41679 /usr/lib/modules/4.18.0-372.9.1.el8.x86_64/modules.alias.bin 2023-10-16T18:56:11.076 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 11120017 66468 /etc/udev/hwdb.bin 2023-10-16T18:56:11.076 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.076 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T18:56:11.076 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-10-16T18:56:11.077 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.077 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.077 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.078 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.078 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-10-16T18:56:11.078 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-10-16T18:56:11.078 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.079 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-10-16T18:56:11.079 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:11.079 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T18:56:11.080 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.080 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.080 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.080 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.081 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.081 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.081 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-10-16T18:56:11.082 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.082 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-10-16T18:56:11.082 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.082 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.083 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.083 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.083 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.084 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.084 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-10-16T18:56:11.084 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 100200 7343 /usr/lib64/libkmod.so.2.3.3 2023-10-16T18:56:11.084 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-10-16T18:56:11.085 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.085 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 10109 41420 /usr/lib/modules/4.18.0-372.9.1.el8.x86_64/modules.builtin.bin 2023-10-16T18:56:11.085 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 442609 41424 /usr/lib/modules/4.18.0-372.9.1.el8.x86_64/modules.dep.bin 2023-10-16T18:56:11.086 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 574801 1740 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-10-16T18:56:11.086 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root mem REG 8,1 19983 1496 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-10-16T18:56:11.086 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.086 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root 1u unix 0xffff8e3072447500 0t0 14272 type=STREAM 2023-10-16T18:56:11.087 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root 2u unix 0xffff8e3072447500 0t0 14272 type=STREAM 2023-10-16T18:56:11.087 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root 3u netlink 0t0 1608 KOBJECT_UEVENT 2023-10-16T18:56:11.087 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root 4u unix 0xffff8e3070152400 0t0 1600 /run/udev/control type=SEQPACKET 2023-10-16T18:56:11.088 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root 5u unix 0xffff8e307178f500 0t0 17189 type=DGRAM 2023-10-16T18:56:11.088 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root 6r REG 8,1 11120017 66468 /etc/udev/hwdb.bin 2023-10-16T18:56:11.088 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root 7u unix 0xffff8e3071789f80 0t0 17211 type=DGRAM 2023-10-16T18:56:11.088 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root 8r REG 8,1 6940392 20335 /var/lib/sss/mc/group (deleted) 2023-10-16T18:56:11.089 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root 9r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.089 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root 10u unix 0xffff8e307178da00 0t0 17212 type=DGRAM 2023-10-16T18:56:11.089 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root 11r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.089 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root 12u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.090 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root 13u a_inode 0,14 0 12454 [signalfd] 2023-10-16T18:56:11.090 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root 14u a_inode 0,14 0 12454 [timerfd] 2023-10-16T18:56:11.090 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-u 702 root 15u a_inode 0,14 0 12454 [timerfd] 2023-10-16T18:56:11.091 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/2 722 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.091 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/2 722 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.091 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/2 722 root txt unknown /proc/722/exe 2023-10-16T18:56:11.091 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.092 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.092 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc txt REG 8,1 63160 14085 /usr/bin/rpcbind 2023-10-16T18:56:11.092 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.093 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.093 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.093 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.093 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.094 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.094 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.094 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.095 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:11.095 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:11.095 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.095 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:11.096 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.096 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.096 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.097 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.097 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.097 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.097 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.098 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:11.098 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:11.098 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:11.099 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:11.099 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.099 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.099 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.100 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-10-16T18:56:11.100 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.100 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.100 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc 1u unix 0xffff8e3072445580 0t0 20515 type=STREAM 2023-10-16T18:56:11.101 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc 2u unix 0xffff8e3072445580 0t0 20515 type=STREAM 2023-10-16T18:56:11.101 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc 3u unix 0xffff8e30725b8000 0t0 17776 /run/rpcbind.sock type=STREAM 2023-10-16T18:56:11.101 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc 4u IPv4 17778 0t0 TCP *:sunrpc (LISTEN) 2023-10-16T18:56:11.101 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc 5u IPv4 17779 0t0 UDP *:sunrpc 2023-10-16T18:56:11.102 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc 6u IPv6 17780 0t0 TCP *:sunrpc (LISTEN) 2023-10-16T18:56:11.102 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc 7u IPv6 17781 0t0 UDP *:sunrpc 2023-10-16T18:56:11.102 INFO:teuthology.orchestra.run.smithi124.stdout:rpcbind 751 rpc 8rW REG 0,24 0 20516 /run/rpcbind/rpcbind.lock 2023-10-16T18:56:11.103 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/7 752 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.103 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/7 752 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.103 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/7 752 root txt unknown /proc/752/exe 2023-10-16T18:56:11.103 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.104 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.104 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root txt REG 8,1 159528 9150 /usr/sbin/auditd 2023-10-16T18:56:11.104 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root mem REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.105 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.105 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root DEL REG 8,1 20335 /var/lib/sss/mc/group 2023-10-16T18:56:11.105 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.105 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.106 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.106 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.106 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.106 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:11.107 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:11.107 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.107 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:11.108 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:11.108 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:11.108 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.109 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:11.109 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:11.109 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.109 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.110 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:11.110 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root mem REG 8,1 145416 5400 /usr/lib64/libauparse.so.0.0.0 2023-10-16T18:56:11.110 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:11.111 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.111 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.111 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root 1u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.111 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root 2u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.112 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root 3u netlink 0t0 20521 AUDIT 2023-10-16T18:56:11.112 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root 4r REG 8,1 6940392 20335 /var/lib/sss/mc/group (deleted) 2023-10-16T18:56:11.112 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root 5r REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.112 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root 6w REG 8,1 8084744 1858 /var/log/audit/audit.log 2023-10-16T18:56:11.113 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root 7u unix 0xffff8e30701a9b00 0t0 19221 type=DGRAM 2023-10-16T18:56:11.113 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root 8u unix 0xffff8e30701ad100 0t0 19220 type=STREAM 2023-10-16T18:56:11.113 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root 9u unix 0xffff8e30701ade80 0t0 19222 type=STREAM 2023-10-16T18:56:11.114 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root 10u unix 0xffff8e30701a9200 0t0 19223 type=STREAM 2023-10-16T18:56:11.114 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 root 11u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.114 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.114 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.115 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root txt REG 8,1 159528 9150 /usr/sbin/auditd 2023-10-16T18:56:11.115 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root mem REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.115 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.116 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root DEL REG 8,1 20335 /var/lib/sss/mc/group 2023-10-16T18:56:11.116 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.116 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.117 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.117 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.117 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.117 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:11.118 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:11.118 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.118 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:11.119 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:11.119 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:11.119 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.119 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:11.120 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:11.120 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.120 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.120 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:11.121 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root mem REG 8,1 145416 5400 /usr/lib64/libauparse.so.0.0.0 2023-10-16T18:56:11.121 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:11.121 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.121 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.122 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root 1u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.122 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root 2u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.122 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root 3u netlink 0t0 20521 AUDIT 2023-10-16T18:56:11.123 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root 4r REG 8,1 6940392 20335 /var/lib/sss/mc/group (deleted) 2023-10-16T18:56:11.123 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root 5r REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.123 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root 6w REG 8,1 8084744 1858 /var/log/audit/audit.log 2023-10-16T18:56:11.123 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root 7u unix 0xffff8e30701a9b00 0t0 19221 type=DGRAM 2023-10-16T18:56:11.124 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root 8u unix 0xffff8e30701ad100 0t0 19220 type=STREAM 2023-10-16T18:56:11.124 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root 9u unix 0xffff8e30701ade80 0t0 19222 type=STREAM 2023-10-16T18:56:11.124 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root 10u unix 0xffff8e30701a9200 0t0 19223 type=STREAM 2023-10-16T18:56:11.125 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 754 auditd root 11u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.125 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.125 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.125 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root txt REG 8,1 159528 9150 /usr/sbin/auditd 2023-10-16T18:56:11.126 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root mem REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.126 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.126 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root DEL REG 8,1 20335 /var/lib/sss/mc/group 2023-10-16T18:56:11.127 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.127 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.127 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.127 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.128 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.128 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:11.128 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:11.129 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.129 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:11.129 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:11.129 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:11.130 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.130 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:11.130 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:11.131 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.131 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.131 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:11.131 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root mem REG 8,1 145416 5400 /usr/lib64/libauparse.so.0.0.0 2023-10-16T18:56:11.132 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:11.132 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.132 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.133 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root 1u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.133 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root 2u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.133 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root 3u netlink 0t0 20521 AUDIT 2023-10-16T18:56:11.133 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root 4r REG 8,1 6940392 20335 /var/lib/sss/mc/group (deleted) 2023-10-16T18:56:11.134 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root 5r REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.134 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root 6w REG 8,1 8084744 1858 /var/log/audit/audit.log 2023-10-16T18:56:11.134 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root 7u unix 0xffff8e30701a9b00 0t0 19221 type=DGRAM 2023-10-16T18:56:11.135 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root 8u unix 0xffff8e30701ad100 0t0 19220 type=STREAM 2023-10-16T18:56:11.135 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root 9u unix 0xffff8e30701ade80 0t0 19222 type=STREAM 2023-10-16T18:56:11.135 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root 10u unix 0xffff8e30701a9200 0t0 19223 type=STREAM 2023-10-16T18:56:11.135 INFO:teuthology.orchestra.run.smithi124.stdout:auditd 753 759 auditd root 11u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.136 INFO:teuthology.orchestra.run.smithi124.stdout:rpciod 755 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.136 INFO:teuthology.orchestra.run.smithi124.stdout:rpciod 755 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.136 INFO:teuthology.orchestra.run.smithi124.stdout:rpciod 755 root txt unknown /proc/755/exe 2023-10-16T18:56:11.137 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 756 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.137 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 756 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.137 INFO:teuthology.orchestra.run.smithi124.stdout:kworker/u 756 root txt unknown /proc/756/exe 2023-10-16T18:56:11.137 INFO:teuthology.orchestra.run.smithi124.stdout:xprtiod 757 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.138 INFO:teuthology.orchestra.run.smithi124.stdout:xprtiod 757 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.138 INFO:teuthology.orchestra.run.smithi124.stdout:xprtiod 757 root txt unknown /proc/757/exe 2023-10-16T18:56:11.138 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.139 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.139 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root txt REG 8,1 21008 10285 /usr/sbin/sedispatch 2023-10-16T18:56:11.139 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.139 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.140 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.140 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.140 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.141 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.141 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.141 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.141 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.142 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.142 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.142 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.143 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:11.143 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.143 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.143 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.144 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.144 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root mem REG 8,1 145416 5400 /usr/lib64/libauparse.so.0.0.0 2023-10-16T18:56:11.144 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T18:56:11.144 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:11.145 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.146 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root 0u unix 0xffff8e30701a9680 0t0 19219 type=STREAM 2023-10-16T18:56:11.146 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root 1u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.146 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root 2u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.147 INFO:teuthology.orchestra.run.smithi124.stdout:sedispatc 758 root 3u unix 0xffff8e30725bd580 0t0 30792 type=STREAM 2023-10-16T18:56:11.147 INFO:teuthology.orchestra.run.smithi124.stdout:kipmi0 788 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.147 INFO:teuthology.orchestra.run.smithi124.stdout:kipmi0 788 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.148 INFO:teuthology.orchestra.run.smithi124.stdout:kipmi0 788 root txt unknown /proc/788/exe 2023-10-16T18:56:11.148 INFO:teuthology.orchestra.run.smithi124.stdout:kdmflush/ 795 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.148 INFO:teuthology.orchestra.run.smithi124.stdout:kdmflush/ 795 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.148 INFO:teuthology.orchestra.run.smithi124.stdout:kdmflush/ 795 root txt unknown /proc/795/exe 2023-10-16T18:56:11.149 INFO:teuthology.orchestra.run.smithi124.stdout:kdmflush/ 796 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.149 INFO:teuthology.orchestra.run.smithi124.stdout:kdmflush/ 796 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.149 INFO:teuthology.orchestra.run.smithi124.stdout:kdmflush/ 796 root txt unknown /proc/796/exe 2023-10-16T18:56:11.150 INFO:teuthology.orchestra.run.smithi124.stdout:kdmflush/ 797 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.150 INFO:teuthology.orchestra.run.smithi124.stdout:kdmflush/ 797 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.150 INFO:teuthology.orchestra.run.smithi124.stdout:kdmflush/ 797 root txt unknown /proc/797/exe 2023-10-16T18:56:11.150 INFO:teuthology.orchestra.run.smithi124.stdout:kdmflush/ 798 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.151 INFO:teuthology.orchestra.run.smithi124.stdout:kdmflush/ 798 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.151 INFO:teuthology.orchestra.run.smithi124.stdout:kdmflush/ 798 root txt unknown /proc/798/exe 2023-10-16T18:56:11.151 INFO:teuthology.orchestra.run.smithi124.stdout:kdmflush/ 799 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.152 INFO:teuthology.orchestra.run.smithi124.stdout:kdmflush/ 799 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.152 INFO:teuthology.orchestra.run.smithi124.stdout:kdmflush/ 799 root txt unknown /proc/799/exe 2023-10-16T18:56:11.152 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.152 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.153 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root txt REG 8,1 63768 11145 /usr/sbin/irqbalance 2023-10-16T18:56:11.153 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.153 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.153 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.154 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.154 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.154 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.155 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.155 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.155 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.156 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.156 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.156 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.156 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.157 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root mem REG 8,1 187496 4713 /usr/lib64/libtinfo.so.6.1 2023-10-16T18:56:11.157 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root mem REG 8,1 255032 4705 /usr/lib64/libncursesw.so.6.1 2023-10-16T18:56:11.157 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-10-16T18:56:11.158 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.158 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.158 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:11.158 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.159 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.159 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root 1u unix 0xffff8e3070150000 0t0 1940 type=STREAM 2023-10-16T18:56:11.159 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root 2u unix 0xffff8e3070150000 0t0 1940 type=STREAM 2023-10-16T18:56:11.160 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root 3u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.160 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root 4u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.160 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 root 5u unix 0xffff8e3070b86c00 0t0 23946 @irqbalance801.sock type=STREAM 2023-10-16T18:56:11.160 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.161 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.161 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root txt REG 8,1 63768 11145 /usr/sbin/irqbalance 2023-10-16T18:56:11.161 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.162 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.162 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.162 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.162 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.163 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.163 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.163 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.164 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.164 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.164 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.164 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.165 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.165 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root mem REG 8,1 187496 4713 /usr/lib64/libtinfo.so.6.1 2023-10-16T18:56:11.165 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root mem REG 8,1 255032 4705 /usr/lib64/libncursesw.so.6.1 2023-10-16T18:56:11.166 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-10-16T18:56:11.166 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.166 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.166 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:11.167 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.167 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.167 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root 1u unix 0xffff8e3070150000 0t0 1940 type=STREAM 2023-10-16T18:56:11.168 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root 2u unix 0xffff8e3070150000 0t0 1940 type=STREAM 2023-10-16T18:56:11.168 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root 3u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.168 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root 4u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.168 INFO:teuthology.orchestra.run.smithi124.stdout:irqbalanc 801 910 gmain root 5u unix 0xffff8e3070b86c00 0t0 23946 @irqbalance801.sock type=STREAM 2023-10-16T18:56:11.169 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.169 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.169 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root txt REG 8,1 718504 11142 /usr/sbin/smartd 2023-10-16T18:56:11.170 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.170 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.170 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.170 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.171 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.171 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.171 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.172 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.172 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.172 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.172 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.173 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.173 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.173 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.173 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.174 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T18:56:11.174 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.174 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.175 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:11.175 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.175 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.175 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root 1u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.176 INFO:teuthology.orchestra.run.smithi124.stdout:smartd 802 root 2u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.176 INFO:teuthology.orchestra.run.smithi124.stdout:mcelog 803 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.176 INFO:teuthology.orchestra.run.smithi124.stdout:mcelog 803 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.177 INFO:teuthology.orchestra.run.smithi124.stdout:mcelog 803 root txt REG 8,1 185992 11073 /usr/sbin/mcelog 2023-10-16T18:56:11.177 INFO:teuthology.orchestra.run.smithi124.stdout:mcelog 803 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.177 INFO:teuthology.orchestra.run.smithi124.stdout:mcelog 803 root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.177 INFO:teuthology.orchestra.run.smithi124.stdout:mcelog 803 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.178 INFO:teuthology.orchestra.run.smithi124.stdout:mcelog 803 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.178 INFO:teuthology.orchestra.run.smithi124.stdout:mcelog 803 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.178 INFO:teuthology.orchestra.run.smithi124.stdout:mcelog 803 root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.179 INFO:teuthology.orchestra.run.smithi124.stdout:mcelog 803 root 1u unix 0xffff8e3070b87500 0t0 23572 type=STREAM 2023-10-16T18:56:11.179 INFO:teuthology.orchestra.run.smithi124.stdout:mcelog 803 root 2u unix 0xffff8e3070b87500 0t0 23572 type=STREAM 2023-10-16T18:56:11.179 INFO:teuthology.orchestra.run.smithi124.stdout:mcelog 803 root 3r CHR 10,227 0t0 13445 /dev/mcelog 2023-10-16T18:56:11.179 INFO:teuthology.orchestra.run.smithi124.stdout:mcelog 803 root 4r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.180 INFO:teuthology.orchestra.run.smithi124.stdout:mcelog 803 root 5u unix 0xffff8e3070163a80 0t0 824 /var/run/mcelog-client type=STREAM 2023-10-16T18:56:11.180 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.180 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.180 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:11.181 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:11.181 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T18:56:11.181 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.182 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.182 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.182 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.183 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.183 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.183 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.183 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.184 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.184 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.184 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.184 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.185 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.185 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.185 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.186 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.186 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.186 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.186 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.187 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.187 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.187 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.188 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.188 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.188 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.188 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.189 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.189 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.189 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.189 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.190 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.190 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.190 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T18:56:11.191 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T18:56:11.191 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T18:56:11.191 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.191 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.192 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.192 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.192 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:11.193 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.193 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.193 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.193 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd 1u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.194 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd 2u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.194 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.194 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T18:56:11.195 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd 5r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.195 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd 6u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.195 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd 7u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.195 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd 8u unix 0xffff8e307178cc80 0t0 22876 type=STREAM 2023-10-16T18:56:11.196 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd 9u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.196 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd 10r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.196 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd 11u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.197 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 polkitd 12u unix 0xffff8e307178e300 0t0 23195 type=DGRAM 2023-10-16T18:56:11.197 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.197 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.197 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:11.198 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:11.198 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T18:56:11.198 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.199 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.199 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.199 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.199 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.200 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.200 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.200 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.200 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.201 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.201 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.201 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.202 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.202 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.202 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.202 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.203 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.203 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.203 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.204 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.204 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.204 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.204 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.205 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.205 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.205 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.205 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.206 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.206 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.206 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.207 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.207 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.207 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T18:56:11.207 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T18:56:11.208 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T18:56:11.208 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.208 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.208 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.209 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.209 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:11.209 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.210 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.210 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.210 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd 1u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.210 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd 2u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.211 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.211 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T18:56:11.211 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd 5r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.212 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd 6u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.212 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd 7u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.212 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd 8u unix 0xffff8e307178cc80 0t0 22876 type=STREAM 2023-10-16T18:56:11.212 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd 9u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.213 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd 10r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.213 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd 11u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.213 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 955 gmain polkitd 12u unix 0xffff8e307178e300 0t0 23195 type=DGRAM 2023-10-16T18:56:11.214 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.214 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.214 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:11.214 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:11.215 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T18:56:11.215 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.215 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.216 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.216 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.216 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.216 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.217 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.217 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.217 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.218 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.218 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.218 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.218 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.219 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.219 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.219 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.220 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.220 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.220 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.220 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.221 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.221 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.221 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.221 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.222 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.222 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.222 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.223 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.223 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.223 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.223 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.224 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.224 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T18:56:11.224 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T18:56:11.225 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T18:56:11.225 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.225 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.225 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.226 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.226 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:11.227 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.227 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.227 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.228 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd 1u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.228 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd 2u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.228 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.228 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T18:56:11.229 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd 5r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.229 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd 6u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.229 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd 7u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.230 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd 8u unix 0xffff8e307178cc80 0t0 22876 type=STREAM 2023-10-16T18:56:11.230 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd 9u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.230 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd 10r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.230 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd 11u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.231 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 956 gdbus polkitd 12u unix 0xffff8e307178e300 0t0 23195 type=DGRAM 2023-10-16T18:56:11.231 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.231 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.232 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:11.232 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:11.232 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T18:56:11.232 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.233 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.233 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.233 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.234 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.234 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.234 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.235 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.235 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.235 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.235 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.236 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.236 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.236 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.237 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.237 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.237 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.237 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.238 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.238 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.238 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.239 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.239 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.241 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.241 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.242 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.242 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.242 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.242 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.243 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.243 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.243 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.244 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T18:56:11.244 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T18:56:11.244 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T18:56:11.244 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.245 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.245 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.245 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.246 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:11.246 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.246 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.246 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.247 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd 1u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.247 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd 2u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.247 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.248 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T18:56:11.248 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd 5r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.248 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd 6u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.248 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd 7u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.249 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd 8u unix 0xffff8e307178cc80 0t0 22876 type=STREAM 2023-10-16T18:56:11.249 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd 9u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.249 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd 10r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.249 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd 11u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.250 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 964 JS\x20Hel polkitd 12u unix 0xffff8e307178e300 0t0 23195 type=DGRAM 2023-10-16T18:56:11.250 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.250 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.251 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:11.251 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:11.251 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T18:56:11.252 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.252 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.252 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.252 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.253 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.253 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.253 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.253 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.254 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.254 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.254 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.255 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.255 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.255 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.255 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.256 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.256 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.256 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.257 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.257 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.257 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.257 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.258 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.258 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.258 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.259 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.259 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.259 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.259 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.260 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.260 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.260 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.261 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T18:56:11.261 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T18:56:11.261 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T18:56:11.261 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.262 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.262 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.262 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.263 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:11.263 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.263 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.263 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.264 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd 1u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.264 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd 2u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.264 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.264 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T18:56:11.265 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd 5r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.265 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd 6u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.265 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd 7u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.266 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd 8u unix 0xffff8e307178cc80 0t0 22876 type=STREAM 2023-10-16T18:56:11.266 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd 9u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.266 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd 10r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.267 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd 11u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.267 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 965 JS\x20Hel polkitd 12u unix 0xffff8e307178e300 0t0 23195 type=DGRAM 2023-10-16T18:56:11.267 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.267 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.268 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:11.268 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:11.268 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T18:56:11.268 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.269 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.269 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.269 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.270 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.270 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.270 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.271 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.271 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.271 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.271 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.272 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.272 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.272 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.273 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.273 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.273 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.273 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.274 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.274 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.274 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.275 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.275 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.275 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.275 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.276 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.276 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.276 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.277 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.277 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.277 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.277 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.278 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T18:56:11.278 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T18:56:11.278 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T18:56:11.279 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.279 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.279 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.279 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.280 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:11.280 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.280 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.281 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.281 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd 1u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.281 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd 2u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.281 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.282 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T18:56:11.282 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd 5r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.282 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd 6u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.283 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd 7u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.283 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd 8u unix 0xffff8e307178cc80 0t0 22876 type=STREAM 2023-10-16T18:56:11.283 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd 9u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.283 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd 10r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.284 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd 11u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.284 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 966 JS\x20Hel polkitd 12u unix 0xffff8e307178e300 0t0 23195 type=DGRAM 2023-10-16T18:56:11.284 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.285 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.285 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:11.285 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:11.285 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T18:56:11.286 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.286 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.286 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.287 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.287 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.287 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.287 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.288 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.288 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.288 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.289 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.289 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.289 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.289 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.290 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.290 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.290 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.291 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.291 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.291 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.291 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.292 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.292 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.292 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.293 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.293 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.293 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.293 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.294 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.294 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.294 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.295 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.295 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T18:56:11.295 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T18:56:11.295 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T18:56:11.296 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.296 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.296 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.297 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.297 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:11.297 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.297 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.298 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.298 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd 1u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.298 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd 2u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.299 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.299 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T18:56:11.299 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd 5r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.299 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd 6u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.300 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd 7u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.300 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd 8u unix 0xffff8e307178cc80 0t0 22876 type=STREAM 2023-10-16T18:56:11.300 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd 9u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.300 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd 10r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.301 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd 11u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.301 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 967 JS\x20Hel polkitd 12u unix 0xffff8e307178e300 0t0 23195 type=DGRAM 2023-10-16T18:56:11.301 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.302 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.302 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:11.302 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:11.302 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T18:56:11.303 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.303 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.303 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.304 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.304 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.304 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.304 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.305 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.305 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.305 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.305 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.306 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.306 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.306 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.307 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.307 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.307 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.307 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.308 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.308 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.308 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.309 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.309 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.309 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.309 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.310 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.310 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.310 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.311 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.311 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.311 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.312 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.312 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T18:56:11.312 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T18:56:11.312 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T18:56:11.313 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.313 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.313 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.313 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.314 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:11.314 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.314 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.315 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.315 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd 1u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.315 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd 2u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.315 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.316 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T18:56:11.316 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd 5r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.316 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd 6u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.317 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd 7u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.317 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd 8u unix 0xffff8e307178cc80 0t0 22876 type=STREAM 2023-10-16T18:56:11.317 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd 9u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.317 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd 10r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.318 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd 11u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.318 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 968 JS\x20Hel polkitd 12u unix 0xffff8e307178e300 0t0 23195 type=DGRAM 2023-10-16T18:56:11.318 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.319 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.319 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:11.319 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:11.319 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T18:56:11.320 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.320 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.320 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.321 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.321 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.321 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.321 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.322 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.322 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.322 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.323 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.323 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.323 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.323 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.324 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.324 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.324 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.325 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.325 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.325 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.325 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.326 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.326 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.326 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.327 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.327 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.327 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.327 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.328 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.328 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.328 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.329 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.329 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T18:56:11.329 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T18:56:11.330 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T18:56:11.330 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.330 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.330 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.331 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.331 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:11.331 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.331 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.332 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.332 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd 1u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.332 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd 2u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.333 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.333 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T18:56:11.333 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd 5r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.333 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd 6u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.334 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd 7u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.334 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd 8u unix 0xffff8e307178cc80 0t0 22876 type=STREAM 2023-10-16T18:56:11.334 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd 9u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.335 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd 10r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.335 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd 11u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.335 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 969 JS\x20Hel polkitd 12u unix 0xffff8e307178e300 0t0 23195 type=DGRAM 2023-10-16T18:56:11.335 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.336 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.336 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:11.336 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:11.337 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T18:56:11.337 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.337 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.337 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.338 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.338 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.338 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.339 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.339 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.339 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.339 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.340 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.340 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.340 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.341 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.341 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.341 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.341 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.342 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.342 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.342 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.343 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.343 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.343 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.343 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.344 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.344 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.344 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.345 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.345 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.345 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.345 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.346 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.346 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T18:56:11.346 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T18:56:11.347 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T18:56:11.347 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.347 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.347 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.348 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.348 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:11.348 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.349 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.349 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.349 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd 1u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.349 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd 2u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.350 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.350 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T18:56:11.350 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd 5r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.351 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd 6u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.351 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd 7u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.351 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd 8u unix 0xffff8e307178cc80 0t0 22876 type=STREAM 2023-10-16T18:56:11.351 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd 9u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.352 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd 10r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.352 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd 11u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.352 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 970 JS\x20Hel polkitd 12u unix 0xffff8e307178e300 0t0 23195 type=DGRAM 2023-10-16T18:56:11.352 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.353 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.353 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:11.353 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:11.354 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T18:56:11.354 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.354 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.354 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.355 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.355 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.355 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.356 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.356 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.356 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.356 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.357 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.357 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.357 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.358 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.358 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.358 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.358 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.359 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.359 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.359 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.360 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.360 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.360 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.360 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.361 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.361 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.361 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.361 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.362 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.362 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.362 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.363 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.363 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T18:56:11.363 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T18:56:11.364 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T18:56:11.364 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.364 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.364 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.365 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.365 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:11.365 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.366 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.366 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.366 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd 1u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.366 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd 2u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.367 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.367 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T18:56:11.367 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd 5r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.368 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd 6u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.368 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd 7u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.368 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd 8u unix 0xffff8e307178cc80 0t0 22876 type=STREAM 2023-10-16T18:56:11.368 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd 9u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.369 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd 10r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.369 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd 11u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.369 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 971 JS\x20Hel polkitd 12u unix 0xffff8e307178e300 0t0 23195 type=DGRAM 2023-10-16T18:56:11.369 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.370 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.370 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:11.370 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:11.371 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T18:56:11.371 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.371 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.372 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.372 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.372 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.372 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.373 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.373 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.373 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.373 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.374 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.374 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.374 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.375 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.375 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.375 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.375 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.376 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.376 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.376 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.377 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.377 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.377 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.377 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.378 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.378 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.378 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.379 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.379 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.379 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.379 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.380 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.380 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T18:56:11.380 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T18:56:11.380 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T18:56:11.381 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.381 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.382 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.382 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.382 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:11.382 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.383 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.383 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.383 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd 1u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.384 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd 2u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.384 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.384 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T18:56:11.384 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd 5r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.385 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd 6u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.385 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd 7u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.385 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd 8u unix 0xffff8e307178cc80 0t0 22876 type=STREAM 2023-10-16T18:56:11.386 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd 9u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.386 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd 10r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.386 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd 11u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.386 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 985 polkitd polkitd 12u unix 0xffff8e307178e300 0t0 23195 type=DGRAM 2023-10-16T18:56:11.387 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.387 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.387 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:11.388 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:11.388 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T18:56:11.388 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.388 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.389 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.389 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.389 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.390 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.390 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.390 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.390 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.391 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.391 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.391 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.392 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.392 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.392 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.392 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.393 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.393 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.393 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.394 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.394 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.394 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.394 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.395 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.395 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.395 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.396 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.396 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.396 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.396 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.397 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.397 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.397 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T18:56:11.398 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T18:56:11.398 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T18:56:11.398 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.398 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.399 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.399 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.399 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:11.400 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.400 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.400 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.400 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd 1u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.401 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd 2u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.401 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.401 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T18:56:11.402 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd 5r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.402 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd 6u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.402 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd 7u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.402 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd 8u unix 0xffff8e307178cc80 0t0 22876 type=STREAM 2023-10-16T18:56:11.403 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd 9u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.403 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd 10r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.403 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd 11u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.404 INFO:teuthology.orchestra.run.smithi124.stdout:polkitd 804 991 pool polkitd 12u unix 0xffff8e307178e300 0t0 23195 type=DGRAM 2023-10-16T18:56:11.404 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.404 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.404 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root txt REG 8,1 83544 10536 /usr/sbin/sssd 2023-10-16T18:56:11.405 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:11.405 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T18:56:11.405 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.405 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.406 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 4644864 66476 /var/lib/sss/db/timestamps_implicit_files.ldb 2023-10-16T18:56:11.406 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 6459392 66474 /var/lib/sss/db/cache_implicit_files.ldb 2023-10-16T18:56:11.406 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:11.407 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.407 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 7536 40251 /usr/lib64/ldb/modules/ldb/tdb.so 2023-10-16T18:56:11.407 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 11816 40250 /usr/lib64/ldb/modules/ldb/skel.so 2023-10-16T18:56:11.407 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 15896 40249 /usr/lib64/ldb/modules/ldb/server_sort.so 2023-10-16T18:56:11.408 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 11992 40248 /usr/lib64/ldb/modules/ldb/sample.so 2023-10-16T18:56:11.408 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 15952 40247 /usr/lib64/ldb/modules/ldb/rdn_name.so 2023-10-16T18:56:11.408 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 16008 40246 /usr/lib64/ldb/modules/ldb/paged_searches.so 2023-10-16T18:56:11.409 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 71048 41592 /usr/lib64/ldb/modules/ldb/memberof.so 2023-10-16T18:56:11.409 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 7544 40245 /usr/lib64/ldb/modules/ldb/mdb.so 2023-10-16T18:56:11.409 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 91808 6558 /usr/lib64/liblmdb.so.0.0.0 2023-10-16T18:56:11.409 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 12440 40238 /usr/lib64/ldb/libldb-tdb-err-map.so 2023-10-16T18:56:11.410 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 95464 40236 /usr/lib64/ldb/libldb-key-value.so 2023-10-16T18:56:11.410 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 24744 40237 /usr/lib64/ldb/libldb-mdb-int.so 2023-10-16T18:56:11.410 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 25008 40239 /usr/lib64/ldb/libldb-tdb-int.so 2023-10-16T18:56:11.411 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 7648 40244 /usr/lib64/ldb/modules/ldb/ldb.so 2023-10-16T18:56:11.411 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:11.411 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:11.411 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:11.412 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:11.412 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:11.412 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T18:56:11.412 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T18:56:11.413 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-10-16T18:56:11.413 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.413 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-10-16T18:56:11.413 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-10-16T18:56:11.414 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 28888 40243 /usr/lib64/ldb/modules/ldb/ldap.so 2023-10-16T18:56:11.414 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 15928 40242 /usr/lib64/ldb/modules/ldb/asq.so 2023-10-16T18:56:11.414 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.415 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.415 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.415 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.415 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.416 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.416 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.416 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.416 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.417 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.417 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-10-16T18:56:11.417 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.418 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.418 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.418 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.419 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T18:56:11.419 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 87544 5208 /usr/lib64/libtalloc.so.2.3.3 2023-10-16T18:56:11.419 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 87792 5290 /usr/lib64/libtevent.so.0.11.0 2023-10-16T18:56:11.419 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 16216 5346 /usr/lib64/libdhash.so.1.1.0 2023-10-16T18:56:11.420 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 262080 32126 /usr/lib64/sssd/libsss_sbus.so 2023-10-16T18:56:11.420 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 148360 32122 /usr/lib64/sssd/libsss_iface.so 2023-10-16T18:56:11.420 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.420 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 24880 32120 /usr/lib64/sssd/libsss_debug.so 2023-10-16T18:56:11.421 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:11.421 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 24240 32118 /usr/lib64/sssd/libsss_child.so 2023-10-16T18:56:11.421 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 24752 32119 /usr/lib64/sssd/libsss_crypt.so 2023-10-16T18:56:11.421 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 20440 32117 /usr/lib64/sssd/libsss_cert.so 2023-10-16T18:56:11.422 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-10-16T18:56:11.422 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-10-16T18:56:11.422 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-16T18:56:11.423 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-10-16T18:56:11.423 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.423 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 100496 5296 /usr/lib64/libtdb.so.1.4.4 2023-10-16T18:56:11.423 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.424 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 220240 8334 /usr/lib64/libldb.so.2.4.1 2023-10-16T18:56:11.424 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-10-16T18:56:11.424 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.424 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 568304 32130 /usr/lib64/sssd/libsss_util.so 2023-10-16T18:56:11.425 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:11.425 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 147336 5439 /usr/lib64/libnl-3.so.200.26.0 2023-10-16T18:56:11.425 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 549824 5447 /usr/lib64/libnl-route-3.so.200.26.0 2023-10-16T18:56:11.426 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.426 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:11.426 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:11.426 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:11.427 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:11.427 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:11.427 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:11.428 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:11.428 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:11.428 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:11.428 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:11.429 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:11.429 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 1286144 66412 /var/lib/sss/db/config.ldb 2023-10-16T18:56:11.429 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.429 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root 0r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.430 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root 1u unix 0xffff8e3070157080 0t0 2015 type=STREAM 2023-10-16T18:56:11.430 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root 2u unix 0xffff8e3070157080 0t0 2015 type=STREAM 2023-10-16T18:56:11.430 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root 3w REG 8,1 5229 66780 /var/log/sssd/sssd.log 2023-10-16T18:56:11.430 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root 4u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.431 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root 5u REG 8,1 1286144 66412 /var/lib/sss/db/config.ldb 2023-10-16T18:56:11.431 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root 6u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.431 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root 7u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.432 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root 8u unix 0xffff8e2e50ee4380 0t0 23228 type=DGRAM 2023-10-16T18:56:11.432 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root 9u REG 8,1 6459392 66474 /var/lib/sss/db/cache_implicit_files.ldb 2023-10-16T18:56:11.432 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root 10u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.432 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root 11u REG 8,1 4644864 66476 /var/lib/sss/db/timestamps_implicit_files.ldb 2023-10-16T18:56:11.433 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root 12u unix 0xffff8e3070155580 0t0 24937 /var/lib/sss/pipes/private/sbus-monitor type=STREAM 2023-10-16T18:56:11.433 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root 13u unix 0xffff8e3070151200 0t0 24940 type=STREAM 2023-10-16T18:56:11.433 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root 14u unix 0xffff8e3070151680 0t0 24941 /var/lib/sss/pipes/private/sbus-monitor type=STREAM 2023-10-16T18:56:11.433 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root 15r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.434 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root 16r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T18:56:11.434 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root 17u netlink 0t0 24947 ROUTE 2023-10-16T18:56:11.434 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root 18u unix 0xffff8e3070155100 0t0 28688 /var/lib/sss/pipes/private/sbus-monitor type=STREAM 2023-10-16T18:56:11.435 INFO:teuthology.orchestra.run.smithi124.stdout:sssd 806 root 19u unix 0xffff8e30701a9f80 0t0 26691 /var/lib/sss/pipes/private/sbus-monitor type=STREAM 2023-10-16T18:56:11.435 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.435 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.435 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus txt REG 8,1 245488 7368 /usr/bin/dbus-daemon 2023-10-16T18:56:11.436 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus DEL REG 8,1 20335 /var/lib/sss/mc/group 2023-10-16T18:56:11.436 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:11.436 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.437 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.437 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.437 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.437 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.438 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.438 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.438 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.439 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.439 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.439 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.439 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.440 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.440 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.440 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.440 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.441 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:11.441 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:11.441 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.442 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T18:56:11.442 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.442 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T18:56:11.442 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.443 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.443 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 1u unix 0xffff8e3070150900 0t0 24601 type=STREAM 2023-10-16T18:56:11.443 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 2u unix 0xffff8e3070150900 0t0 24601 type=STREAM 2023-10-16T18:56:11.443 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 3u unix 0xffff8e3070b81f80 0t0 16331 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:11.445 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 4u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.445 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 5u unix 0xffff8e2e50ee5100 0t0 23451 type=STREAM 2023-10-16T18:56:11.446 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 7u sock 0,9 0t0 25699 protocol: NETLINK 2023-10-16T18:56:11.446 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 8r REG 8,1 6940392 20335 /var/lib/sss/mc/group (deleted) 2023-10-16T18:56:11.446 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 9u netlink 0t0 25700 SELINUX 2023-10-16T18:56:11.447 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 10r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.447 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 11u unix 0xffff8e30701aec00 0t0 25705 type=STREAM 2023-10-16T18:56:11.447 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 12u unix 0xffff8e30701ae780 0t0 25706 type=STREAM 2023-10-16T18:56:11.447 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 13u unix 0xffff8e3070b84c80 0t0 25707 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:11.448 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 14u unix 0xffff8e30725bbf00 0t0 22874 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:11.448 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 15u unix 0xffff8e3071789b00 0t0 896 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:11.448 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 16u unix 0xffff8e3070b80480 0t0 897 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:11.448 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 17u unix 0xffff8e3070161200 0t0 1008 type=DGRAM 2023-10-16T18:56:11.449 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 18u sock 0,9 0t0 1010 protocol: UNIX 2023-10-16T18:56:11.449 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 19u unix 0xffff8e30725be780 0t0 28515 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:11.449 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 20u unix 0xffff8e307178f080 0t0 26662 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:11.450 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 21u unix 0xffff8e307178b180 0t0 1014 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:11.450 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 22u unix 0xffff8e3070b86780 0t0 23279 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:11.450 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 23u unix 0xffff8e2e50ee1200 0t0 28027 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:11.450 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 24u unix 0xffff8e2e50ee5e80 0t0 22438 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:11.451 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 26u unix 0xffff8e3072440d80 0t0 23450 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:11.451 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 dbus 27u unix 0xffff8e3071790000 0t0 28517 type=STREAM 2023-10-16T18:56:11.451 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.452 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.452 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus txt REG 8,1 245488 7368 /usr/bin/dbus-daemon 2023-10-16T18:56:11.452 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus DEL REG 8,1 20335 /var/lib/sss/mc/group 2023-10-16T18:56:11.452 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:11.453 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.453 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.453 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.453 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.454 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.454 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.454 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.455 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.455 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.455 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.455 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.456 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.456 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.456 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.456 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.457 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.457 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:11.457 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:11.458 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.458 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T18:56:11.458 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.458 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T18:56:11.459 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.459 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.459 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 1u unix 0xffff8e3070150900 0t0 24601 type=STREAM 2023-10-16T18:56:11.460 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 2u unix 0xffff8e3070150900 0t0 24601 type=STREAM 2023-10-16T18:56:11.460 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 3u unix 0xffff8e3070b81f80 0t0 16331 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:11.460 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 4u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.460 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 5u unix 0xffff8e2e50ee5100 0t0 23451 type=STREAM 2023-10-16T18:56:11.461 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 7u sock 0,9 0t0 25699 protocol: NETLINK 2023-10-16T18:56:11.461 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 8r REG 8,1 6940392 20335 /var/lib/sss/mc/group (deleted) 2023-10-16T18:56:11.461 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 9u netlink 0t0 25700 SELINUX 2023-10-16T18:56:11.462 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 10r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.462 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 11u unix 0xffff8e30701aec00 0t0 25705 type=STREAM 2023-10-16T18:56:11.462 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 12u unix 0xffff8e30701ae780 0t0 25706 type=STREAM 2023-10-16T18:56:11.462 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 13u unix 0xffff8e3070b84c80 0t0 25707 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:11.463 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 14u unix 0xffff8e30725bbf00 0t0 22874 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:11.463 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 15u unix 0xffff8e3071789b00 0t0 896 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:11.463 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 16u unix 0xffff8e3070b80480 0t0 897 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:11.464 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 17u unix 0xffff8e3070161200 0t0 1008 type=DGRAM 2023-10-16T18:56:11.464 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 18u sock 0,9 0t0 1010 protocol: UNIX 2023-10-16T18:56:11.464 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 19u unix 0xffff8e30725be780 0t0 28515 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:11.464 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 20u unix 0xffff8e307178f080 0t0 26662 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:11.465 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 21u unix 0xffff8e307178b180 0t0 1014 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:11.465 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 22u unix 0xffff8e3070b86780 0t0 23279 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:11.465 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 23u unix 0xffff8e2e50ee1200 0t0 28027 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:11.465 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 24u unix 0xffff8e2e50ee5e80 0t0 22438 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:11.466 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 26u unix 0xffff8e3072440d80 0t0 23450 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:11.466 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 809 948 dbus-daem dbus 27u unix 0xffff8e3071790000 0t0 28517 type=STREAM 2023-10-16T18:56:11.466 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.467 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.467 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root txt REG 8,1 3633568 8777 /usr/sbin/NetworkManager 2023-10-16T18:56:11.467 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 306528 15293 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-settings-plugin-ifcfg-rh.so 2023-10-16T18:56:11.468 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T18:56:11.468 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 58896 5593 /usr/lib64/libjansson.so.4.14.0 2023-10-16T18:56:11.468 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 24416 10513 /usr/lib64/libteamdctl.so.0.1.5 2023-10-16T18:56:11.468 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 45512 15451 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-device-plugin-team.so 2023-10-16T18:56:11.469 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.469 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.469 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.470 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T18:56:11.470 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 37336 6241 /usr/lib64/libmodman.so.1.0.0 2023-10-16T18:56:11.470 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 144768 6243 /usr/lib64/libproxy.so.1.0.0 2023-10-16T18:56:11.470 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:11.471 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T18:56:11.471 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 134872 6493 /usr/lib64/libbrotlicommon.so.1.0.6 2023-10-16T18:56:11.471 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.472 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-10-16T18:56:11.472 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:11.472 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:11.473 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.473 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.473 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.473 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.474 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.474 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.474 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.475 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 53560 6495 /usr/lib64/libbrotlidec.so.1.0.6 2023-10-16T18:56:11.475 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-10-16T18:56:11.475 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-10-16T18:56:11.476 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:11.476 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:11.476 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:11.476 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:11.477 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:11.477 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T18:56:11.477 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 69672 6678 /usr/lib64/libpsl.so.5.3.1 2023-10-16T18:56:11.478 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 464632 6709 /usr/lib64/libssh.so.4.8.7 2023-10-16T18:56:11.478 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 166888 6517 /usr/lib64/libnghttp2.so.14.17.0 2023-10-16T18:56:11.478 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:11.478 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.479 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.479 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.479 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.480 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.480 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.480 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.480 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.481 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.481 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.481 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.482 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.482 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.482 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.483 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.483 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.483 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.483 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.484 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.484 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.484 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.484 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.485 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 592304 6774 /usr/lib64/libcurl.so.4.5.0 2023-10-16T18:56:11.485 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:11.485 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.486 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 29040 6515 /usr/lib64/libndp.so.0.1.1 2023-10-16T18:56:11.486 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.486 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T18:56:11.486 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.487 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.487 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:11.487 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:11.488 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:11.488 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:11.488 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.488 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:11.489 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:11.489 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:11.489 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:11.489 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:11.490 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:11.490 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:11.490 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.491 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 1u unix 0xffff8e3071788000 0t0 22617 type=STREAM 2023-10-16T18:56:11.491 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 2u unix 0xffff8e3071788000 0t0 22617 type=STREAM 2023-10-16T18:56:11.491 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 3u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.491 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 4u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.492 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 5u unix 0xffff8e3070b80900 0t0 23988 type=DGRAM 2023-10-16T18:56:11.492 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 6u unix 0xffff8e3070b84380 0t0 23989 type=STREAM 2023-10-16T18:56:11.492 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 7u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.492 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 8r REG 0,4 0 4026532000 net 2023-10-16T18:56:11.493 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 9r REG 0,4 0 4026532488 mnt 2023-10-16T18:56:11.493 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 10u netlink 0t0 974 KOBJECT_UEVENT 2023-10-16T18:56:11.493 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 11u netlink 0t0 975 GENERIC 2023-10-16T18:56:11.494 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 12u netlink 0t0 976 ROUTE 2023-10-16T18:56:11.494 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 13r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.494 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 14r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.494 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 15r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.495 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 16u netlink 0t0 23175 KOBJECT_UEVENT 2023-10-16T18:56:11.495 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 17u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.495 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 18u unix 0xffff8e3071789680 0t0 23199 type=STREAM 2023-10-16T18:56:11.495 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 19u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.496 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 20u a_inode 0,14 0 12454 [timerfd] 2023-10-16T18:56:11.496 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 22u raw6 0t0 22443 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-10-16T18:56:11.496 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 23w FIFO 0,24 0t0 28015 /run/systemd/inhibit/1.ref 2023-10-16T18:56:11.497 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 24u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.497 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 25u a_inode 0,14 0 12454 [timerfd] 2023-10-16T18:56:11.497 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 26u pack 30724 0t0 ARP type=SOCK_DGRAM 2023-10-16T18:56:11.498 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 root 27u IPv4 30725 0t0 UDP smithi124:bootpc->store01.front.sepia.ceph.com:bootps 2023-10-16T18:56:11.498 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.498 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.498 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root txt REG 8,1 3633568 8777 /usr/sbin/NetworkManager 2023-10-16T18:56:11.499 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 306528 15293 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-settings-plugin-ifcfg-rh.so 2023-10-16T18:56:11.499 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T18:56:11.499 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 58896 5593 /usr/lib64/libjansson.so.4.14.0 2023-10-16T18:56:11.500 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 24416 10513 /usr/lib64/libteamdctl.so.0.1.5 2023-10-16T18:56:11.500 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 45512 15451 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-device-plugin-team.so 2023-10-16T18:56:11.500 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.500 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.501 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.501 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T18:56:11.501 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 37336 6241 /usr/lib64/libmodman.so.1.0.0 2023-10-16T18:56:11.501 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 144768 6243 /usr/lib64/libproxy.so.1.0.0 2023-10-16T18:56:11.502 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:11.502 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T18:56:11.502 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 134872 6493 /usr/lib64/libbrotlicommon.so.1.0.6 2023-10-16T18:56:11.503 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.503 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-10-16T18:56:11.503 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:11.503 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:11.504 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.504 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.504 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.505 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.505 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.505 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.505 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.506 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 53560 6495 /usr/lib64/libbrotlidec.so.1.0.6 2023-10-16T18:56:11.506 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-10-16T18:56:11.506 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-10-16T18:56:11.507 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:11.507 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:11.507 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:11.507 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:11.508 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:11.508 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T18:56:11.508 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 69672 6678 /usr/lib64/libpsl.so.5.3.1 2023-10-16T18:56:11.509 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 464632 6709 /usr/lib64/libssh.so.4.8.7 2023-10-16T18:56:11.509 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 166888 6517 /usr/lib64/libnghttp2.so.14.17.0 2023-10-16T18:56:11.509 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:11.509 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.510 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.510 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.510 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.511 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.511 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.511 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.511 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.512 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.512 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.512 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.513 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.513 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.513 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.513 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.514 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.514 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.514 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.515 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.515 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.515 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.515 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.516 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 592304 6774 /usr/lib64/libcurl.so.4.5.0 2023-10-16T18:56:11.516 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:11.516 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.517 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 29040 6515 /usr/lib64/libndp.so.0.1.1 2023-10-16T18:56:11.517 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.517 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T18:56:11.517 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.518 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.518 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:11.518 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:11.518 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:11.519 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:11.519 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.519 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:11.520 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:11.520 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:11.520 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:11.520 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:11.521 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:11.521 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:11.521 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.521 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 1u unix 0xffff8e3071788000 0t0 22617 type=STREAM 2023-10-16T18:56:11.522 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 2u unix 0xffff8e3071788000 0t0 22617 type=STREAM 2023-10-16T18:56:11.522 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 3u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.522 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 4u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.522 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 5u unix 0xffff8e3070b80900 0t0 23988 type=DGRAM 2023-10-16T18:56:11.523 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 6u unix 0xffff8e3070b84380 0t0 23989 type=STREAM 2023-10-16T18:56:11.523 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 7u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.523 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 8r REG 0,4 0 4026532000 net 2023-10-16T18:56:11.524 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 9r REG 0,4 0 4026532488 mnt 2023-10-16T18:56:11.524 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 10u netlink 0t0 974 KOBJECT_UEVENT 2023-10-16T18:56:11.524 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 11u netlink 0t0 975 GENERIC 2023-10-16T18:56:11.524 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 12u netlink 0t0 976 ROUTE 2023-10-16T18:56:11.525 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 13r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.525 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 14r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.525 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 15r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.526 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 16u netlink 0t0 23175 KOBJECT_UEVENT 2023-10-16T18:56:11.526 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 17u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.526 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 18u unix 0xffff8e3071789680 0t0 23199 type=STREAM 2023-10-16T18:56:11.526 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 19u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.527 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 20u a_inode 0,14 0 12454 [timerfd] 2023-10-16T18:56:11.527 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 22u raw6 0t0 22443 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-10-16T18:56:11.527 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 23w FIFO 0,24 0t0 28015 /run/systemd/inhibit/1.ref 2023-10-16T18:56:11.528 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 24u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.528 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 25u a_inode 0,14 0 12454 [timerfd] 2023-10-16T18:56:11.528 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 26u pack 30724 0t0 ARP type=SOCK_DGRAM 2023-10-16T18:56:11.528 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 957 gmain root 27u IPv4 30725 0t0 UDP smithi124:bootpc->store01.front.sepia.ceph.com:bootps 2023-10-16T18:56:11.529 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.529 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.529 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root txt REG 8,1 3633568 8777 /usr/sbin/NetworkManager 2023-10-16T18:56:11.529 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 306528 15293 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-settings-plugin-ifcfg-rh.so 2023-10-16T18:56:11.530 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T18:56:11.530 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 58896 5593 /usr/lib64/libjansson.so.4.14.0 2023-10-16T18:56:11.530 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 24416 10513 /usr/lib64/libteamdctl.so.0.1.5 2023-10-16T18:56:11.530 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 45512 15451 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-device-plugin-team.so 2023-10-16T18:56:11.531 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.531 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.531 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.532 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T18:56:11.532 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 37336 6241 /usr/lib64/libmodman.so.1.0.0 2023-10-16T18:56:11.532 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 144768 6243 /usr/lib64/libproxy.so.1.0.0 2023-10-16T18:56:11.532 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:11.533 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T18:56:11.533 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 134872 6493 /usr/lib64/libbrotlicommon.so.1.0.6 2023-10-16T18:56:11.533 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.534 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-10-16T18:56:11.534 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:11.534 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:11.535 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.535 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.535 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.535 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.536 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.536 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.536 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.536 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 53560 6495 /usr/lib64/libbrotlidec.so.1.0.6 2023-10-16T18:56:11.537 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-10-16T18:56:11.537 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-10-16T18:56:11.537 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:11.538 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:11.538 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:11.538 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:11.538 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:11.539 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T18:56:11.539 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 69672 6678 /usr/lib64/libpsl.so.5.3.1 2023-10-16T18:56:11.539 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 464632 6709 /usr/lib64/libssh.so.4.8.7 2023-10-16T18:56:11.540 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 166888 6517 /usr/lib64/libnghttp2.so.14.17.0 2023-10-16T18:56:11.540 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:11.540 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.540 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.541 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.541 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.541 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.541 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.542 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.542 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.542 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.543 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.543 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.543 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.543 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.544 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.544 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.544 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.545 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.545 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.545 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.545 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.546 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.546 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.547 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 592304 6774 /usr/lib64/libcurl.so.4.5.0 2023-10-16T18:56:11.547 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:11.547 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.548 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 29040 6515 /usr/lib64/libndp.so.0.1.1 2023-10-16T18:56:11.548 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.548 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T18:56:11.549 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.549 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.549 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:11.549 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:11.550 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:11.550 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:11.550 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.551 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:11.551 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:11.551 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:11.552 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:11.552 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:11.552 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:11.553 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:11.553 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.553 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 1u unix 0xffff8e3071788000 0t0 22617 type=STREAM 2023-10-16T18:56:11.553 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 2u unix 0xffff8e3071788000 0t0 22617 type=STREAM 2023-10-16T18:56:11.554 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 3u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.554 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 4u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.554 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 5u unix 0xffff8e3070b80900 0t0 23988 type=DGRAM 2023-10-16T18:56:11.555 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 6u unix 0xffff8e3070b84380 0t0 23989 type=STREAM 2023-10-16T18:56:11.555 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 7u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.555 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 8r REG 0,4 0 4026532000 net 2023-10-16T18:56:11.556 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 9r REG 0,4 0 4026532488 mnt 2023-10-16T18:56:11.556 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 10u netlink 0t0 974 KOBJECT_UEVENT 2023-10-16T18:56:11.556 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 11u netlink 0t0 975 GENERIC 2023-10-16T18:56:11.556 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 12u netlink 0t0 976 ROUTE 2023-10-16T18:56:11.557 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 13r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.557 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 14r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.557 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 15r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.558 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 16u netlink 0t0 23175 KOBJECT_UEVENT 2023-10-16T18:56:11.558 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 17u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.558 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 18u unix 0xffff8e3071789680 0t0 23199 type=STREAM 2023-10-16T18:56:11.558 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 19u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.559 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 20u a_inode 0,14 0 12454 [timerfd] 2023-10-16T18:56:11.559 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 22u raw6 0t0 22443 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-10-16T18:56:11.559 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 23w FIFO 0,24 0t0 28015 /run/systemd/inhibit/1.ref 2023-10-16T18:56:11.560 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 24u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.560 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 25u a_inode 0,14 0 12454 [timerfd] 2023-10-16T18:56:11.560 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 26u pack 30724 0t0 ARP type=SOCK_DGRAM 2023-10-16T18:56:11.561 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 958 gdbus root 27u IPv4 30725 0t0 UDP smithi124:bootpc->store01.front.sepia.ceph.com:bootps 2023-10-16T18:56:11.561 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.561 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.561 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root txt REG 8,1 3633568 8777 /usr/sbin/NetworkManager 2023-10-16T18:56:11.562 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 306528 15293 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-settings-plugin-ifcfg-rh.so 2023-10-16T18:56:11.562 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T18:56:11.562 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 58896 5593 /usr/lib64/libjansson.so.4.14.0 2023-10-16T18:56:11.563 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 24416 10513 /usr/lib64/libteamdctl.so.0.1.5 2023-10-16T18:56:11.563 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 45512 15451 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-device-plugin-team.so 2023-10-16T18:56:11.563 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.564 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.564 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.564 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T18:56:11.565 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 37336 6241 /usr/lib64/libmodman.so.1.0.0 2023-10-16T18:56:11.565 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 144768 6243 /usr/lib64/libproxy.so.1.0.0 2023-10-16T18:56:11.565 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:11.565 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T18:56:11.566 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 134872 6493 /usr/lib64/libbrotlicommon.so.1.0.6 2023-10-16T18:56:11.566 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.566 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-10-16T18:56:11.567 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:11.567 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:11.567 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.568 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.568 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.568 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.568 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.569 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.569 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.569 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 53560 6495 /usr/lib64/libbrotlidec.so.1.0.6 2023-10-16T18:56:11.570 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-10-16T18:56:11.570 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-10-16T18:56:11.570 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:11.571 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:11.571 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:11.571 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:11.571 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:11.572 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T18:56:11.572 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 69672 6678 /usr/lib64/libpsl.so.5.3.1 2023-10-16T18:56:11.572 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 464632 6709 /usr/lib64/libssh.so.4.8.7 2023-10-16T18:56:11.573 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 166888 6517 /usr/lib64/libnghttp2.so.14.17.0 2023-10-16T18:56:11.573 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:11.573 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.574 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.574 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.574 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.574 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.575 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.575 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.575 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.576 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.576 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.576 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.577 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.577 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.577 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.577 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.578 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.578 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.578 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.579 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.579 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.579 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.580 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.580 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 592304 6774 /usr/lib64/libcurl.so.4.5.0 2023-10-16T18:56:11.580 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:11.580 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.581 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 29040 6515 /usr/lib64/libndp.so.0.1.1 2023-10-16T18:56:11.581 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.581 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T18:56:11.582 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.582 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.582 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:11.583 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:11.583 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:11.583 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:11.584 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.584 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:11.584 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:11.584 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:11.585 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:11.585 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:11.585 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:11.586 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:11.586 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.586 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 1u unix 0xffff8e3071788000 0t0 22617 type=STREAM 2023-10-16T18:56:11.587 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 2u unix 0xffff8e3071788000 0t0 22617 type=STREAM 2023-10-16T18:56:11.587 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 3u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.587 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 4u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.587 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 5u unix 0xffff8e3070b80900 0t0 23988 type=DGRAM 2023-10-16T18:56:11.588 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 6u unix 0xffff8e3070b84380 0t0 23989 type=STREAM 2023-10-16T18:56:11.588 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 7u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.588 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 8r REG 0,4 0 4026532000 net 2023-10-16T18:56:11.589 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 9r REG 0,4 0 4026532488 mnt 2023-10-16T18:56:11.589 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 10u netlink 0t0 974 KOBJECT_UEVENT 2023-10-16T18:56:11.589 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 11u netlink 0t0 975 GENERIC 2023-10-16T18:56:11.589 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 12u netlink 0t0 976 ROUTE 2023-10-16T18:56:11.590 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 13r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.590 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 14r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.590 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 15r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.591 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 16u netlink 0t0 23175 KOBJECT_UEVENT 2023-10-16T18:56:11.591 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 17u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.591 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 18u unix 0xffff8e3071789680 0t0 23199 type=STREAM 2023-10-16T18:56:11.592 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 19u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.592 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 20u a_inode 0,14 0 12454 [timerfd] 2023-10-16T18:56:11.592 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 22u raw6 0t0 22443 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-10-16T18:56:11.592 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 23w FIFO 0,24 0t0 28015 /run/systemd/inhibit/1.ref 2023-10-16T18:56:11.593 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 24u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.593 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 25u a_inode 0,14 0 12454 [timerfd] 2023-10-16T18:56:11.593 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 26u pack 30724 0t0 ARP type=SOCK_DGRAM 2023-10-16T18:56:11.594 INFO:teuthology.orchestra.run.smithi124.stdout:NetworkMa 810 962 pool root 27u IPv4 30725 0t0 UDP smithi124:bootpc->store01.front.sepia.ceph.com:bootps 2023-10-16T18:56:11.594 INFO:teuthology.orchestra.run.smithi124.stdout:lsmd 811 libstoragemgmt cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.594 INFO:teuthology.orchestra.run.smithi124.stdout:lsmd 811 libstoragemgmt rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.595 INFO:teuthology.orchestra.run.smithi124.stdout:lsmd 811 libstoragemgmt txt REG 8,1 25472 9470 /usr/bin/lsmd 2023-10-16T18:56:11.595 INFO:teuthology.orchestra.run.smithi124.stdout:lsmd 811 libstoragemgmt mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.595 INFO:teuthology.orchestra.run.smithi124.stdout:lsmd 811 libstoragemgmt DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.595 INFO:teuthology.orchestra.run.smithi124.stdout:lsmd 811 libstoragemgmt mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.596 INFO:teuthology.orchestra.run.smithi124.stdout:lsmd 811 libstoragemgmt mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.596 INFO:teuthology.orchestra.run.smithi124.stdout:lsmd 811 libstoragemgmt mem REG 8,1 54680 6239 /usr/lib64/libconfig.so.9.2.0 2023-10-16T18:56:11.596 INFO:teuthology.orchestra.run.smithi124.stdout:lsmd 811 libstoragemgmt mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.597 INFO:teuthology.orchestra.run.smithi124.stdout:lsmd 811 libstoragemgmt 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.597 INFO:teuthology.orchestra.run.smithi124.stdout:lsmd 811 libstoragemgmt 1u unix 0xffff8e307178ec00 0t0 22682 type=STREAM 2023-10-16T18:56:11.597 INFO:teuthology.orchestra.run.smithi124.stdout:lsmd 811 libstoragemgmt 2u unix 0xffff8e307178c800 0t0 22683 type=STREAM 2023-10-16T18:56:11.598 INFO:teuthology.orchestra.run.smithi124.stdout:lsmd 811 libstoragemgmt 3uW REG 0,24 0 22181 /run/lsm/ipc/.lsmd-ipc-lock 2023-10-16T18:56:11.598 INFO:teuthology.orchestra.run.smithi124.stdout:lsmd 811 libstoragemgmt 4r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.598 INFO:teuthology.orchestra.run.smithi124.stdout:lsmd 811 libstoragemgmt 5u unix 0xffff8e30725bad00 0t0 22182 /var/run/lsm/ipc/sim type=STREAM 2023-10-16T18:56:11.599 INFO:teuthology.orchestra.run.smithi124.stdout:lsmd 811 libstoragemgmt 6u unix 0xffff8e30725bcc80 0t0 22185 /var/run/lsm/ipc/simc type=STREAM 2023-10-16T18:56:11.599 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi cwd DIR 8,1 4096 1974 /etc/avahi 2023-10-16T18:56:11.599 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi rtd DIR 8,1 4096 1974 /etc/avahi 2023-10-16T18:56:11.600 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi txt REG 8,1 146208 13959 /usr/sbin/avahi-daemon 2023-10-16T18:56:11.600 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:11.600 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T18:56:11.600 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi DEL REG 8,1 20335 /var/lib/sss/mc/group 2023-10-16T18:56:11.601 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.601 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.601 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.602 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.602 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.602 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.603 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.603 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.603 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.604 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.604 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.604 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.605 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.605 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.605 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.605 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.606 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.606 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T18:56:11.606 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.607 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.607 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T18:56:11.607 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 30264 6512 /usr/lib64/libdaemon.so.0.5.0 2023-10-16T18:56:11.608 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 231504 13958 /usr/lib64/libavahi-core.so.7.0.2 2023-10-16T18:56:11.608 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 54208 8598 /usr/lib64/libavahi-common.so.3.5.3 2023-10-16T18:56:11.608 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.608 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.609 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi 1u unix 0xffff8e3070b85100 0t0 23771 type=STREAM 2023-10-16T18:56:11.609 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi 2u unix 0xffff8e3070b85100 0t0 23771 type=STREAM 2023-10-16T18:56:11.609 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi 3u unix 0xffff8e3071792d00 0t0 19967 /run/avahi-daemon/socket type=STREAM 2023-10-16T18:56:11.610 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi 4r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.610 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi 5r REG 8,1 6940392 20335 /var/lib/sss/mc/group (deleted) 2023-10-16T18:56:11.610 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi 6u unix 0xffff8e3071789200 0t0 22832 type=DGRAM 2023-10-16T18:56:11.611 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi 7r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T18:56:11.611 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi 8u unix 0xffff8e3071797980 0t0 20351 type=STREAM 2023-10-16T18:56:11.611 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi 9r FIFO 0,13 0t0 22216 pipe 2023-10-16T18:56:11.611 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi 10w FIFO 0,13 0t0 22216 pipe 2023-10-16T18:56:11.612 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi 11r FIFO 0,13 0t0 22217 pipe 2023-10-16T18:56:11.612 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi 12w FIFO 0,13 0t0 22217 pipe 2023-10-16T18:56:11.612 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi 13u unix 0xffff8e30725bda00 0t0 22218 type=STREAM 2023-10-16T18:56:11.613 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi 14r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:11.613 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi 15u IPv4 22219 0t0 UDP *:mdns 2023-10-16T18:56:11.613 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi 16u IPv6 22220 0t0 UDP *:mdns 2023-10-16T18:56:11.614 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi 17u IPv4 22221 0t0 UDP *:39913 2023-10-16T18:56:11.614 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi 18u IPv6 22222 0t0 UDP *:42691 2023-10-16T18:56:11.614 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 813 avahi 19u netlink 0t0 22223 ROUTE 2023-10-16T18:56:11.614 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.615 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.615 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root txt REG 8,1 1150584 5025 /usr/bin/bash 2023-10-16T18:56:11.615 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.616 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.616 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.616 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:11.617 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.617 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.617 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root mem REG 8,1 187496 4713 /usr/lib64/libtinfo.so.6.1 2023-10-16T18:56:11.617 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.618 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:11.618 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:11.618 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:11.619 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:11.619 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.619 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:11.620 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:11.620 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:11.620 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:11.620 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:11.621 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:11.621 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:11.621 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.622 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root 1u unix 0xffff8e3070160480 0t0 769 type=STREAM 2023-10-16T18:56:11.622 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root 2u unix 0xffff8e3070160480 0t0 769 type=STREAM 2023-10-16T18:56:11.622 INFO:teuthology.orchestra.run.smithi124.stdout:ksmtuned 855 root 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.623 INFO:teuthology.orchestra.run.smithi124.stdout:sleep 856 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.623 INFO:teuthology.orchestra.run.smithi124.stdout:sleep 856 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.623 INFO:teuthology.orchestra.run.smithi124.stdout:sleep 856 root txt REG 8,1 38296 7205 /usr/bin/sleep 2023-10-16T18:56:11.623 INFO:teuthology.orchestra.run.smithi124.stdout:sleep 856 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:11.624 INFO:teuthology.orchestra.run.smithi124.stdout:sleep 856 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.624 INFO:teuthology.orchestra.run.smithi124.stdout:sleep 856 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.624 INFO:teuthology.orchestra.run.smithi124.stdout:sleep 856 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:11.625 INFO:teuthology.orchestra.run.smithi124.stdout:sleep 856 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:11.625 INFO:teuthology.orchestra.run.smithi124.stdout:sleep 856 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:11.625 INFO:teuthology.orchestra.run.smithi124.stdout:sleep 856 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:11.626 INFO:teuthology.orchestra.run.smithi124.stdout:sleep 856 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.626 INFO:teuthology.orchestra.run.smithi124.stdout:sleep 856 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:11.626 INFO:teuthology.orchestra.run.smithi124.stdout:sleep 856 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:11.627 INFO:teuthology.orchestra.run.smithi124.stdout:sleep 856 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:11.627 INFO:teuthology.orchestra.run.smithi124.stdout:sleep 856 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:11.627 INFO:teuthology.orchestra.run.smithi124.stdout:sleep 856 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:11.627 INFO:teuthology.orchestra.run.smithi124.stdout:sleep 856 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:11.628 INFO:teuthology.orchestra.run.smithi124.stdout:sleep 856 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:11.628 INFO:teuthology.orchestra.run.smithi124.stdout:sleep 856 root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.628 INFO:teuthology.orchestra.run.smithi124.stdout:sleep 856 root 1u unix 0xffff8e3070160480 0t0 769 type=STREAM 2023-10-16T18:56:11.629 INFO:teuthology.orchestra.run.smithi124.stdout:sleep 856 root 2u unix 0xffff8e3070160480 0t0 769 type=STREAM 2023-10-16T18:56:11.629 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.629 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.629 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony txt REG 8,1 351352 11027 /usr/sbin/chronyd 2023-10-16T18:56:11.630 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.630 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.630 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.631 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.631 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.631 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.632 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.632 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 695184 7235 /usr/lib64/libnss_myhostname.so.2 2023-10-16T18:56:11.632 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.632 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 29256 4996 /usr/lib64/libnss_dns-2.28.so 2023-10-16T18:56:11.643 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.644 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.644 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.645 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.645 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.645 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.645 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.646 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.646 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.646 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.647 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.649 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.649 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.650 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-10-16T18:56:11.650 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.650 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.651 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.651 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.651 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.652 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.652 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony 1w CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.652 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony 2u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.652 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony 3u unix 0xffff8e3070164380 0t0 855 type=DGRAM 2023-10-16T18:56:11.653 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony 5r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.653 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony 6u IPv4 866 0t0 UDP localhost:323 2023-10-16T18:56:11.653 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony 7u IPv6 867 0t0 UDP localhost:323 2023-10-16T18:56:11.654 INFO:teuthology.orchestra.run.smithi124.stdout:chronyd 898 chrony 8u unix 0xffff8e3070160900 0t0 872 /run/chrony/chronyd.sock type=DGRAM 2023-10-16T18:56:11.654 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.654 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.654 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi txt REG 8,1 146208 13959 /usr/sbin/avahi-daemon 2023-10-16T18:56:11.655 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:11.655 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T18:56:11.655 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi DEL REG 8,1 20335 /var/lib/sss/mc/group 2023-10-16T18:56:11.656 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.656 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.656 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.656 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.657 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.657 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.657 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.658 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.658 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.658 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.658 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.659 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.659 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.659 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.660 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.660 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.660 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.660 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T18:56:11.661 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.661 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.661 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T18:56:11.662 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 30264 6512 /usr/lib64/libdaemon.so.0.5.0 2023-10-16T18:56:11.664 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 231504 13958 /usr/lib64/libavahi-core.so.7.0.2 2023-10-16T18:56:11.664 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 54208 8598 /usr/lib64/libavahi-common.so.3.5.3 2023-10-16T18:56:11.664 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.664 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.665 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi 1u unix 0xffff8e3070b85100 0t0 23771 type=STREAM 2023-10-16T18:56:11.665 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi 2u unix 0xffff8e3070b85100 0t0 23771 type=STREAM 2023-10-16T18:56:11.665 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi 3u unix 0xffff8e3071792d00 0t0 19967 /run/avahi-daemon/socket type=STREAM 2023-10-16T18:56:11.666 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi 4r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.666 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi 5r REG 8,1 6940392 20335 /var/lib/sss/mc/group (deleted) 2023-10-16T18:56:11.666 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi 6u unix 0xffff8e3071789200 0t0 22832 type=DGRAM 2023-10-16T18:56:11.666 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi 7r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T18:56:11.667 INFO:teuthology.orchestra.run.smithi124.stdout:avahi-dae 953 avahi 9u unix 0xffff8e30725bec00 0t0 22214 type=STREAM 2023-10-16T18:56:11.667 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.667 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.668 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root txt REG 8,1 11856 6728 /usr/libexec/platform-python3.6 2023-10-16T18:56:11.668 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 0,14 12454 anon_inode:[perf_event] (stat: No such file or directory) 2023-10-16T18:56:11.668 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-10-16T18:56:11.669 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 380552 38920 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.669 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T18:56:11.669 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 80112 37495 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.669 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 19464 37514 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.670 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 115216 37487 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.670 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 133472 37484 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.670 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 185712 41111 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-10-16T18:56:11.671 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 239416 8479 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-10-16T18:56:11.671 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 340928 38787 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.671 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.672 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.672 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.672 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.672 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.673 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.673 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.673 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.674 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.674 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.674 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.674 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.675 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.675 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.675 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.675 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 198680 9494 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-10-16T18:56:11.676 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 14264 38868 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-10-16T18:56:11.676 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T18:56:11.676 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 66904 37521 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.677 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.677 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.677 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.677 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.678 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.678 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.678 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.679 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.679 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.679 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.679 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.680 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.680 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T18:56:11.680 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 214536 38867 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-10-16T18:56:11.681 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 20688 37502 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.681 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 13208 37515 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.681 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.681 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 42856 37497 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.682 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 74744 5188 /usr/lib64/libbz2.so.1.0.6 2023-10-16T18:56:11.682 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 23032 37475 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.682 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 34392 37530 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.683 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 20528 37503 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.683 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 13688 37473 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.683 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 110640 37504 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.684 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 129528 37474 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.684 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T18:56:11.684 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 47928 37492 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.684 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 11592 37500 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.685 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 131592 37501 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.685 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 29256 37524 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.685 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 63456 37516 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.686 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 92992 37505 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.686 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 56768 37508 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.686 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 27128 37493 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.687 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.687 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.687 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.687 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:11.688 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.688 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.688 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.689 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-10-16T18:56:11.689 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.689 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.689 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 3285488 6697 /usr/lib64/libpython3.6m.so.1.0 2023-10-16T18:56:11.690 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:11.690 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.690 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:11.691 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:11.691 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:11.691 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:11.691 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.692 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:11.692 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:11.692 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:11.693 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:11.693 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:11.693 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:11.693 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:11.694 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.694 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root 1u unix 0xffff8e3071788900 0t0 23021 type=STREAM 2023-10-16T18:56:11.694 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root 2u unix 0xffff8e3071788900 0t0 23021 type=STREAM 2023-10-16T18:56:11.695 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.695 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root 4w REG 8,1 25291 66484 /var/log/tuned/tuned.log 2023-10-16T18:56:11.695 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root 5u netlink 0t0 24328 KOBJECT_UEVENT 2023-10-16T18:56:11.695 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root 6u unix 0xffff8e2e50ee7980 0t0 23331 type=STREAM 2023-10-16T18:56:11.696 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root 7u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.696 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root 8w CHR 10,62 0t0 13448 /dev/cpu_dma_latency 2023-10-16T18:56:11.696 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root 9u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.697 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root 10u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.697 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root 11u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.697 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root 12u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.697 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root 13u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.698 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root 14u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.698 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root 15u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.698 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root 16u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.699 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root 17r FIFO 0,13 0t0 25961 pipe 2023-10-16T18:56:11.699 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root 18w FIFO 0,13 0t0 25961 pipe 2023-10-16T18:56:11.699 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root 19u unix 0xffff8e30701af980 0t0 26436 type=STREAM 2023-10-16T18:56:11.699 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 root 20u unix 0xffff8e30701af500 0t0 26437 type=STREAM 2023-10-16T18:56:11.700 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.700 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.700 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root txt REG 8,1 11856 6728 /usr/libexec/platform-python3.6 2023-10-16T18:56:11.700 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 0,14 12454 anon_inode:[perf_event] (stat: No such file or directory) 2023-10-16T18:56:11.701 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-10-16T18:56:11.701 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 380552 38920 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.701 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T18:56:11.702 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 80112 37495 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.702 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 19464 37514 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.702 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 115216 37487 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.703 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 133472 37484 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.703 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 185712 41111 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-10-16T18:56:11.703 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 239416 8479 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-10-16T18:56:11.703 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 340928 38787 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.704 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.704 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.704 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.705 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.705 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.705 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.705 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.706 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.706 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.706 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.707 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.707 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.707 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.707 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.708 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.708 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 198680 9494 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-10-16T18:56:11.708 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 14264 38868 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-10-16T18:56:11.708 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T18:56:11.709 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 66904 37521 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.709 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.709 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.710 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.710 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.710 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.710 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.711 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.711 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.711 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.711 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.712 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.712 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.712 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T18:56:11.713 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 214536 38867 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-10-16T18:56:11.713 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 20688 37502 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.713 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 13208 37515 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.713 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.714 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 42856 37497 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.714 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 74744 5188 /usr/lib64/libbz2.so.1.0.6 2023-10-16T18:56:11.714 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 23032 37475 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.715 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 34392 37530 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.715 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 20528 37503 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.715 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 13688 37473 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.715 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 110640 37504 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.716 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 129528 37474 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.716 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T18:56:11.716 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 47928 37492 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.717 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 11592 37500 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.717 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 131592 37501 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.717 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 29256 37524 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.717 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 63456 37516 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.718 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 92992 37505 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.718 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 56768 37508 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.718 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 27128 37493 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.719 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.719 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.719 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.719 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:11.720 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.720 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.720 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.721 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-10-16T18:56:11.721 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.721 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.721 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 3285488 6697 /usr/lib64/libpython3.6m.so.1.0 2023-10-16T18:56:11.722 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:11.722 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.722 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:11.723 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:11.723 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:11.723 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:11.723 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.724 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:11.724 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:11.724 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:11.724 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:11.725 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:11.725 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:11.725 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:11.726 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.726 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root 1u unix 0xffff8e3071788900 0t0 23021 type=STREAM 2023-10-16T18:56:11.726 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root 2u unix 0xffff8e3071788900 0t0 23021 type=STREAM 2023-10-16T18:56:11.726 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.727 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root 4w REG 8,1 25291 66484 /var/log/tuned/tuned.log 2023-10-16T18:56:11.727 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root 5u netlink 0t0 24328 KOBJECT_UEVENT 2023-10-16T18:56:11.727 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root 6u unix 0xffff8e2e50ee7980 0t0 23331 type=STREAM 2023-10-16T18:56:11.728 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root 7u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.728 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root 8w CHR 10,62 0t0 13448 /dev/cpu_dma_latency 2023-10-16T18:56:11.728 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root 9u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.729 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root 10u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.729 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root 11u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.729 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root 12u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.729 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root 13u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.730 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root 14u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.730 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root 15u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.730 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root 16u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.731 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root 17r FIFO 0,13 0t0 25961 pipe 2023-10-16T18:56:11.731 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root 18w FIFO 0,13 0t0 25961 pipe 2023-10-16T18:56:11.731 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root 19u unix 0xffff8e30701af980 0t0 26436 type=STREAM 2023-10-16T18:56:11.731 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1190 tuned root 20u unix 0xffff8e30701af500 0t0 26437 type=STREAM 2023-10-16T18:56:11.733 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.734 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.734 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root txt REG 8,1 11856 6728 /usr/libexec/platform-python3.6 2023-10-16T18:56:11.734 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 0,14 12454 anon_inode:[perf_event] (stat: No such file or directory) 2023-10-16T18:56:11.735 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-10-16T18:56:11.735 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 380552 38920 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.735 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T18:56:11.735 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 80112 37495 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.736 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 19464 37514 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.736 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 115216 37487 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.736 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 133472 37484 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.737 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 185712 41111 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-10-16T18:56:11.737 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 239416 8479 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-10-16T18:56:11.738 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 340928 38787 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.738 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.739 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.739 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.740 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.740 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.741 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.741 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.741 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.742 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.742 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.742 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.742 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.743 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.743 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.743 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.744 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 198680 9494 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-10-16T18:56:11.744 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 14264 38868 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-10-16T18:56:11.744 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T18:56:11.744 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 66904 37521 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.745 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.745 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.745 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.746 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.746 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.746 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.747 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.747 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.747 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.747 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.748 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.748 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.748 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T18:56:11.749 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 214536 38867 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-10-16T18:56:11.749 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 20688 37502 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.749 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 13208 37515 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.749 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.750 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 42856 37497 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.750 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 74744 5188 /usr/lib64/libbz2.so.1.0.6 2023-10-16T18:56:11.750 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 23032 37475 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.751 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 34392 37530 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.751 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 20528 37503 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.751 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 13688 37473 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.751 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 110640 37504 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.752 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 129528 37474 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.752 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T18:56:11.752 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 47928 37492 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.752 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 11592 37500 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.753 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 131592 37501 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.753 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 29256 37524 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.753 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 63456 37516 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.754 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 92992 37505 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.754 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 56768 37508 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.754 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 27128 37493 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.755 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.755 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.755 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.755 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:11.756 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.756 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.756 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.756 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-10-16T18:56:11.757 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.757 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.757 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 3285488 6697 /usr/lib64/libpython3.6m.so.1.0 2023-10-16T18:56:11.758 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:11.758 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.758 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:11.758 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:11.759 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:11.759 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:11.759 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.760 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:11.760 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:11.760 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:11.760 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:11.761 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:11.761 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:11.761 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:11.762 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.762 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root 1u unix 0xffff8e3071788900 0t0 23021 type=STREAM 2023-10-16T18:56:11.762 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root 2u unix 0xffff8e3071788900 0t0 23021 type=STREAM 2023-10-16T18:56:11.763 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.763 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root 4w REG 8,1 25291 66484 /var/log/tuned/tuned.log 2023-10-16T18:56:11.763 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root 5u netlink 0t0 24328 KOBJECT_UEVENT 2023-10-16T18:56:11.763 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root 6u unix 0xffff8e2e50ee7980 0t0 23331 type=STREAM 2023-10-16T18:56:11.764 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root 7u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.764 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root 8w CHR 10,62 0t0 13448 /dev/cpu_dma_latency 2023-10-16T18:56:11.764 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root 9u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.764 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root 10u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.765 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root 11u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.765 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root 12u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.765 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root 13u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.766 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root 14u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.766 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root 15u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.766 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root 16u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.766 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root 17r FIFO 0,13 0t0 25961 pipe 2023-10-16T18:56:11.767 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root 18w FIFO 0,13 0t0 25961 pipe 2023-10-16T18:56:11.767 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root 19u unix 0xffff8e30701af980 0t0 26436 type=STREAM 2023-10-16T18:56:11.767 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1195 tuned root 20u unix 0xffff8e30701af500 0t0 26437 type=STREAM 2023-10-16T18:56:11.768 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.768 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.768 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root txt REG 8,1 11856 6728 /usr/libexec/platform-python3.6 2023-10-16T18:56:11.768 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 0,14 12454 anon_inode:[perf_event] (stat: No such file or directory) 2023-10-16T18:56:11.769 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-10-16T18:56:11.769 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 380552 38920 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.769 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T18:56:11.770 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 80112 37495 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.770 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 19464 37514 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.770 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 115216 37487 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.770 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 133472 37484 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.771 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 185712 41111 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-10-16T18:56:11.771 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 239416 8479 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-10-16T18:56:11.771 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 340928 38787 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.772 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.772 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.772 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.773 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.773 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.773 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.773 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.774 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.774 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.774 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.775 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.775 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.775 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.775 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.776 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.776 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 198680 9494 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-10-16T18:56:11.776 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 14264 38868 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-10-16T18:56:11.777 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T18:56:11.777 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 66904 37521 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.777 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.777 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.778 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.778 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.778 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.778 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.779 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.779 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.779 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.780 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.780 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.780 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.780 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T18:56:11.781 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 214536 38867 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-10-16T18:56:11.781 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 20688 37502 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.781 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 13208 37515 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.781 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.782 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 42856 37497 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.782 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 74744 5188 /usr/lib64/libbz2.so.1.0.6 2023-10-16T18:56:11.782 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 23032 37475 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.783 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 34392 37530 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.783 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 20528 37503 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.783 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 13688 37473 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.783 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 110640 37504 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.784 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 129528 37474 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.784 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T18:56:11.784 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 47928 37492 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.785 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 11592 37500 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.785 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 131592 37501 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.785 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 29256 37524 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.785 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 63456 37516 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.786 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 92992 37505 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.786 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 56768 37508 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.786 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 27128 37493 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.787 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.787 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.787 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.787 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:11.788 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.788 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.788 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.788 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-10-16T18:56:11.789 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.789 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.789 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 3285488 6697 /usr/lib64/libpython3.6m.so.1.0 2023-10-16T18:56:11.789 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:11.790 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.790 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:11.790 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:11.791 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:11.791 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:11.791 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.791 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:11.792 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:11.792 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:11.792 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:11.792 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:11.793 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:11.793 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:11.793 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.793 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root 1u unix 0xffff8e3071788900 0t0 23021 type=STREAM 2023-10-16T18:56:11.794 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root 2u unix 0xffff8e3071788900 0t0 23021 type=STREAM 2023-10-16T18:56:11.794 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.794 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root 4w REG 8,1 25291 66484 /var/log/tuned/tuned.log 2023-10-16T18:56:11.795 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root 5u netlink 0t0 24328 KOBJECT_UEVENT 2023-10-16T18:56:11.795 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root 6u unix 0xffff8e2e50ee7980 0t0 23331 type=STREAM 2023-10-16T18:56:11.795 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root 7u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.795 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root 8w CHR 10,62 0t0 13448 /dev/cpu_dma_latency 2023-10-16T18:56:11.796 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root 9u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.796 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root 10u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.796 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root 11u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.797 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root 12u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.797 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root 13u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.797 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root 14u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.797 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root 15u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.798 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root 16u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.798 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root 17r FIFO 0,13 0t0 25961 pipe 2023-10-16T18:56:11.798 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root 18w FIFO 0,13 0t0 25961 pipe 2023-10-16T18:56:11.799 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root 19u unix 0xffff8e30701af980 0t0 26436 type=STREAM 2023-10-16T18:56:11.799 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1212 tuned root 20u unix 0xffff8e30701af500 0t0 26437 type=STREAM 2023-10-16T18:56:11.799 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.799 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.800 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root txt REG 8,1 11856 6728 /usr/libexec/platform-python3.6 2023-10-16T18:56:11.800 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 0,14 12454 anon_inode:[perf_event] (stat: No such file or directory) 2023-10-16T18:56:11.800 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-10-16T18:56:11.800 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 380552 38920 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.801 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T18:56:11.801 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 80112 37495 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.801 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 19464 37514 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.801 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 115216 37487 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.802 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 133472 37484 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.802 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 185712 41111 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-10-16T18:56:11.802 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 239416 8479 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-10-16T18:56:11.803 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 340928 38787 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.803 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.803 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.803 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.804 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.804 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.804 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.805 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.805 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.805 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.805 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.806 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.806 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.806 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.807 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.807 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.807 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 198680 9494 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-10-16T18:56:11.808 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 14264 38868 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-10-16T18:56:11.808 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T18:56:11.808 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 66904 37521 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.808 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.809 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.809 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.809 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.809 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.810 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.810 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.810 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.810 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.811 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.811 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.811 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.812 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T18:56:11.812 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 214536 38867 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-10-16T18:56:11.812 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 20688 37502 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.812 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 13208 37515 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.813 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.813 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 42856 37497 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.813 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 74744 5188 /usr/lib64/libbz2.so.1.0.6 2023-10-16T18:56:11.813 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 23032 37475 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.814 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 34392 37530 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.814 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 20528 37503 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.814 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 13688 37473 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.814 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 110640 37504 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.815 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 129528 37474 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.815 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T18:56:11.815 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 47928 37492 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.816 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 11592 37500 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.816 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 131592 37501 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.816 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 29256 37524 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.816 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 63456 37516 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.817 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 92992 37505 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.817 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 56768 37508 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.817 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 27128 37493 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:11.818 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.818 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.818 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.818 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:11.819 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.819 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.819 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.820 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-10-16T18:56:11.820 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.820 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.820 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 3285488 6697 /usr/lib64/libpython3.6m.so.1.0 2023-10-16T18:56:11.821 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:11.821 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.821 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:11.821 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:11.822 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:11.822 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:11.822 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.823 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:11.823 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:11.823 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:11.824 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:11.824 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:11.824 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:11.824 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:11.825 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.825 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root 1u unix 0xffff8e3071788900 0t0 23021 type=STREAM 2023-10-16T18:56:11.825 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root 2u unix 0xffff8e3071788900 0t0 23021 type=STREAM 2023-10-16T18:56:11.825 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.826 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root 4w REG 8,1 25291 66484 /var/log/tuned/tuned.log 2023-10-16T18:56:11.826 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root 5u netlink 0t0 24328 KOBJECT_UEVENT 2023-10-16T18:56:11.826 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root 6u unix 0xffff8e2e50ee7980 0t0 23331 type=STREAM 2023-10-16T18:56:11.827 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root 7u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.827 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root 8w CHR 10,62 0t0 13448 /dev/cpu_dma_latency 2023-10-16T18:56:11.827 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root 9u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.827 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root 10u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.828 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root 11u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.828 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root 12u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.828 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root 13u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.829 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root 14u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.829 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root 15u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.829 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root 16u a_inode 0,14 0 12454 [perf_event] 2023-10-16T18:56:11.829 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root 17r FIFO 0,13 0t0 25961 pipe 2023-10-16T18:56:11.830 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root 18w FIFO 0,13 0t0 25961 pipe 2023-10-16T18:56:11.830 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root 19u unix 0xffff8e30701af980 0t0 26436 type=STREAM 2023-10-16T18:56:11.830 INFO:teuthology.orchestra.run.smithi124.stdout:tuned 961 1213 tuned root 20u unix 0xffff8e30701af500 0t0 26437 type=STREAM 2023-10-16T18:56:11.830 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.831 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.831 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root txt REG 8,1 25704 10732 /usr/bin/rhsmcertd 2023-10-16T18:56:11.831 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:11.831 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.832 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.832 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.832 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.833 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.833 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.833 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.833 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.834 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.834 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.834 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.835 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.835 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.835 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.835 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.836 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:11.836 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:11.836 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:11.836 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:11.837 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.837 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:11.837 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:11.837 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:11.838 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:11.838 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:11.838 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:11.839 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:11.839 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.839 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root 1u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.839 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root 2u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.840 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root 3wW REG 0,24 0 23028 /run/lock/subsys/rhsmcertd 2023-10-16T18:56:11.840 INFO:teuthology.orchestra.run.smithi124.stdout:rhsmcertd 963 root 4u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.840 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.841 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.841 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root txt REG 8,1 886344 11056 /usr/sbin/sshd 2023-10-16T18:56:11.841 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root DEL REG 8,1 20335 /var/lib/sss/mc/group 2023-10-16T18:56:11.841 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:11.842 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:11.842 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:11.842 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.842 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.843 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.843 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:11.843 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:11.844 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.844 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.844 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.844 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.845 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.845 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.845 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.845 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.846 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.846 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:11.846 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.847 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:11.847 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:11.847 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:11.847 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:11.848 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.848 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.848 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T18:56:11.848 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.849 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-10-16T18:56:11.849 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.849 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:11.850 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:11.850 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T18:56:11.850 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:11.850 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.851 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.853 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root 1u unix 0xffff8e30701a8000 0t0 25795 type=STREAM 2023-10-16T18:56:11.853 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root 2u unix 0xffff8e30701a8000 0t0 25795 type=STREAM 2023-10-16T18:56:11.854 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:11.854 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root 4u IPv4 23189 0t0 TCP *:ssh (LISTEN) 2023-10-16T18:56:11.854 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root 5r REG 8,1 6940392 20335 /var/lib/sss/mc/group (deleted) 2023-10-16T18:56:11.855 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 972 root 6u IPv6 23191 0t0 TCP *:ssh (LISTEN) 2023-10-16T18:56:11.855 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.855 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.855 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root txt REG 8,1 29592 8124 /usr/lib/systemd/systemd-hostnamed 2023-10-16T18:56:11.856 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.856 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:11.856 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T18:56:11.857 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-10-16T18:56:11.857 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.857 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.857 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.858 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:11.858 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-10-16T18:56:11.858 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:11.858 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T18:56:11.859 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-10-16T18:56:11.859 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.859 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-10-16T18:56:11.860 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.860 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.860 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.860 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:11.861 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:11.861 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.861 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.862 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-10-16T18:56:11.862 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:11.862 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-10-16T18:56:11.862 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-10-16T18:56:11.863 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:11.863 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.863 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.864 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.864 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-10-16T18:56:11.864 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.864 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 574801 1740 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-10-16T18:56:11.865 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root mem REG 8,1 19983 1496 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-10-16T18:56:11.865 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.865 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root 1u unix 0xffff8e307178ba80 0t0 23110 type=STREAM 2023-10-16T18:56:11.866 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root 2u unix 0xffff8e307178ba80 0t0 23110 type=STREAM 2023-10-16T18:56:11.866 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root 3u sock 0,9 0t0 24015 protocol: UNIX 2023-10-16T18:56:11.866 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root 4u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.866 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root 5u a_inode 0,14 0 12454 [timerfd] 2023-10-16T18:56:11.867 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root 6u sock 0,9 0t0 24017 protocol: UNIX 2023-10-16T18:56:11.867 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-h 974 root 7u a_inode 0,14 0 12454 [timerfd] 2023-10-16T18:56:11.867 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.868 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.868 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root txt REG 8,1 135320 13427 /usr/sbin/gssproxy 2023-10-16T18:56:11.868 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 379136 8865 /usr/lib64/libevent-2.1.so.6.0.2 2023-10-16T18:56:11.868 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 12136 13426 /usr/lib64/libverto-libevent.so.1.0.0 2023-10-16T18:56:11.869 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:11.869 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.869 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.870 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-10-16T18:56:11.870 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.870 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.870 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:11.871 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:11.871 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:11.871 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.871 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.872 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:11.872 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 138832 7014 /usr/lib64/libgssrpc.so.4.2 2023-10-16T18:56:11.872 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.873 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-10-16T18:56:11.873 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-10-16T18:56:11.873 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-16T18:56:11.873 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-10-16T18:56:11.874 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 24872 6557 /usr/lib64/libverto.so.1.0.0 2023-10-16T18:56:11.874 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:11.874 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:11.874 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:11.875 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-10-16T18:56:11.875 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.875 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:11.876 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:11.876 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:11.876 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:11.876 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:11.877 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:11.877 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:11.877 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:11.878 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:11.878 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:11.878 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:11.878 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.879 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.879 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root 1u unix 0xffff8e307178b600 0t0 22949 type=STREAM 2023-10-16T18:56:11.879 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root 2u unix 0xffff8e307178b600 0t0 22949 type=STREAM 2023-10-16T18:56:11.880 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root 3u unix 0xffff8e30701af080 0t0 25797 type=DGRAM 2023-10-16T18:56:11.880 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root 4r FIFO 0,13 0t0 25805 pipe 2023-10-16T18:56:11.880 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root 5u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.880 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root 6r FIFO 0,13 0t0 25799 pipe 2023-10-16T18:56:11.881 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root 7w FIFO 0,13 0t0 25799 pipe 2023-10-16T18:56:11.881 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root 8u unix 0xffff8e30701acc80 0t0 25800 /var/lib/gssproxy/default.sock type=STREAM 2023-10-16T18:56:11.881 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root 9u unix 0xffff8e30701ad580 0t0 25801 /run/gssproxy.sock type=STREAM 2023-10-16T18:56:11.882 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 root 10w FIFO 0,13 0t0 25805 pipe 2023-10-16T18:56:11.882 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.882 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.882 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root txt REG 8,1 135320 13427 /usr/sbin/gssproxy 2023-10-16T18:56:11.883 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 379136 8865 /usr/lib64/libevent-2.1.so.6.0.2 2023-10-16T18:56:11.883 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 12136 13426 /usr/lib64/libverto-libevent.so.1.0.0 2023-10-16T18:56:11.883 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:11.883 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.884 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.884 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-10-16T18:56:11.884 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.884 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.885 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:11.885 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:11.885 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:11.886 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.886 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.886 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:11.886 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 138832 7014 /usr/lib64/libgssrpc.so.4.2 2023-10-16T18:56:11.887 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.887 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-10-16T18:56:11.887 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-10-16T18:56:11.888 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-16T18:56:11.888 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-10-16T18:56:11.888 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 24872 6557 /usr/lib64/libverto.so.1.0.0 2023-10-16T18:56:11.888 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:11.889 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:11.889 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:11.889 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-10-16T18:56:11.889 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.890 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:11.890 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:11.890 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:11.891 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:11.891 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:11.891 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:11.891 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:11.892 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:11.892 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:11.892 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:11.893 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:11.893 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.893 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.893 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root 1u unix 0xffff8e307178b600 0t0 22949 type=STREAM 2023-10-16T18:56:11.894 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root 2u unix 0xffff8e307178b600 0t0 22949 type=STREAM 2023-10-16T18:56:11.894 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root 3u unix 0xffff8e30701af080 0t0 25797 type=DGRAM 2023-10-16T18:56:11.894 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root 4r FIFO 0,13 0t0 25805 pipe 2023-10-16T18:56:11.894 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root 5u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.895 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root 6r FIFO 0,13 0t0 25799 pipe 2023-10-16T18:56:11.895 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root 7w FIFO 0,13 0t0 25799 pipe 2023-10-16T18:56:11.895 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root 8u unix 0xffff8e30701acc80 0t0 25800 /var/lib/gssproxy/default.sock type=STREAM 2023-10-16T18:56:11.896 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root 9u unix 0xffff8e30701ad580 0t0 25801 /run/gssproxy.sock type=STREAM 2023-10-16T18:56:11.896 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 976 gssproxy root 10w FIFO 0,13 0t0 25805 pipe 2023-10-16T18:56:11.896 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.896 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.897 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root txt REG 8,1 135320 13427 /usr/sbin/gssproxy 2023-10-16T18:56:11.897 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 379136 8865 /usr/lib64/libevent-2.1.so.6.0.2 2023-10-16T18:56:11.897 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 12136 13426 /usr/lib64/libverto-libevent.so.1.0.0 2023-10-16T18:56:11.898 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:11.898 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.898 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.898 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-10-16T18:56:11.899 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.899 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.899 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:11.900 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:11.900 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:11.900 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.900 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.901 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:11.901 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 138832 7014 /usr/lib64/libgssrpc.so.4.2 2023-10-16T18:56:11.901 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.901 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-10-16T18:56:11.902 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-10-16T18:56:11.902 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-16T18:56:11.902 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-10-16T18:56:11.903 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 24872 6557 /usr/lib64/libverto.so.1.0.0 2023-10-16T18:56:11.903 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:11.903 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:11.903 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:11.904 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-10-16T18:56:11.904 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.904 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:11.905 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:11.905 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:11.905 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:11.905 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:11.906 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:11.906 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:11.906 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:11.906 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:11.907 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:11.907 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:11.907 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.907 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.908 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root 1u unix 0xffff8e307178b600 0t0 22949 type=STREAM 2023-10-16T18:56:11.908 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root 2u unix 0xffff8e307178b600 0t0 22949 type=STREAM 2023-10-16T18:56:11.908 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root 3u unix 0xffff8e30701af080 0t0 25797 type=DGRAM 2023-10-16T18:56:11.909 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root 4r FIFO 0,13 0t0 25805 pipe 2023-10-16T18:56:11.909 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root 5u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.909 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root 6r FIFO 0,13 0t0 25799 pipe 2023-10-16T18:56:11.909 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root 7w FIFO 0,13 0t0 25799 pipe 2023-10-16T18:56:11.910 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root 8u unix 0xffff8e30701acc80 0t0 25800 /var/lib/gssproxy/default.sock type=STREAM 2023-10-16T18:56:11.910 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root 9u unix 0xffff8e30701ad580 0t0 25801 /run/gssproxy.sock type=STREAM 2023-10-16T18:56:11.910 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 977 gssproxy root 10w FIFO 0,13 0t0 25805 pipe 2023-10-16T18:56:11.911 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.911 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.911 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root txt REG 8,1 135320 13427 /usr/sbin/gssproxy 2023-10-16T18:56:11.911 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 379136 8865 /usr/lib64/libevent-2.1.so.6.0.2 2023-10-16T18:56:11.912 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 12136 13426 /usr/lib64/libverto-libevent.so.1.0.0 2023-10-16T18:56:11.912 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:11.912 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.912 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.913 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-10-16T18:56:11.913 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.913 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.914 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:11.914 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:11.914 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:11.914 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.915 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.915 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:11.915 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 138832 7014 /usr/lib64/libgssrpc.so.4.2 2023-10-16T18:56:11.916 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.916 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-10-16T18:56:11.916 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-10-16T18:56:11.916 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-16T18:56:11.917 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-10-16T18:56:11.917 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 24872 6557 /usr/lib64/libverto.so.1.0.0 2023-10-16T18:56:11.917 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:11.917 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:11.918 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:11.918 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-10-16T18:56:11.918 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.919 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:11.919 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:11.919 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:11.919 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:11.920 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:11.920 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:11.920 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:11.921 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:11.921 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:11.921 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:11.921 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:11.922 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.922 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.922 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root 1u unix 0xffff8e307178b600 0t0 22949 type=STREAM 2023-10-16T18:56:11.923 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root 2u unix 0xffff8e307178b600 0t0 22949 type=STREAM 2023-10-16T18:56:11.923 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root 3u unix 0xffff8e30701af080 0t0 25797 type=DGRAM 2023-10-16T18:56:11.923 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root 4r FIFO 0,13 0t0 25805 pipe 2023-10-16T18:56:11.923 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root 5u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.924 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root 6r FIFO 0,13 0t0 25799 pipe 2023-10-16T18:56:11.924 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root 7w FIFO 0,13 0t0 25799 pipe 2023-10-16T18:56:11.924 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root 8u unix 0xffff8e30701acc80 0t0 25800 /var/lib/gssproxy/default.sock type=STREAM 2023-10-16T18:56:11.924 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root 9u unix 0xffff8e30701ad580 0t0 25801 /run/gssproxy.sock type=STREAM 2023-10-16T18:56:11.925 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 978 gssproxy root 10w FIFO 0,13 0t0 25805 pipe 2023-10-16T18:56:11.925 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.925 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.926 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root txt REG 8,1 135320 13427 /usr/sbin/gssproxy 2023-10-16T18:56:11.926 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 379136 8865 /usr/lib64/libevent-2.1.so.6.0.2 2023-10-16T18:56:11.926 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 12136 13426 /usr/lib64/libverto-libevent.so.1.0.0 2023-10-16T18:56:11.926 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:11.927 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.927 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.927 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-10-16T18:56:11.928 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.928 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.928 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:11.928 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:11.929 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:11.929 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.929 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.930 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:11.930 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 138832 7014 /usr/lib64/libgssrpc.so.4.2 2023-10-16T18:56:11.930 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.930 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-10-16T18:56:11.931 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-10-16T18:56:11.931 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-16T18:56:11.931 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-10-16T18:56:11.932 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 24872 6557 /usr/lib64/libverto.so.1.0.0 2023-10-16T18:56:11.932 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:11.932 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:11.932 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:11.933 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-10-16T18:56:11.933 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.933 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:11.933 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:11.934 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:11.934 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:11.934 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:11.935 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:11.935 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:11.935 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:11.935 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:11.936 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:11.936 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:11.936 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.937 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.937 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root 1u unix 0xffff8e307178b600 0t0 22949 type=STREAM 2023-10-16T18:56:11.937 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root 2u unix 0xffff8e307178b600 0t0 22949 type=STREAM 2023-10-16T18:56:11.937 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root 3u unix 0xffff8e30701af080 0t0 25797 type=DGRAM 2023-10-16T18:56:11.938 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root 4r FIFO 0,13 0t0 25805 pipe 2023-10-16T18:56:11.938 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root 5u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.938 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root 6r FIFO 0,13 0t0 25799 pipe 2023-10-16T18:56:11.939 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root 7w FIFO 0,13 0t0 25799 pipe 2023-10-16T18:56:11.939 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root 8u unix 0xffff8e30701acc80 0t0 25800 /var/lib/gssproxy/default.sock type=STREAM 2023-10-16T18:56:11.939 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root 9u unix 0xffff8e30701ad580 0t0 25801 /run/gssproxy.sock type=STREAM 2023-10-16T18:56:11.939 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 979 gssproxy root 10w FIFO 0,13 0t0 25805 pipe 2023-10-16T18:56:11.940 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.940 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.940 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root txt REG 8,1 135320 13427 /usr/sbin/gssproxy 2023-10-16T18:56:11.941 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 379136 8865 /usr/lib64/libevent-2.1.so.6.0.2 2023-10-16T18:56:11.941 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 12136 13426 /usr/lib64/libverto-libevent.so.1.0.0 2023-10-16T18:56:11.941 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:11.941 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.942 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.942 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-10-16T18:56:11.942 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.942 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.943 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:11.943 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:11.943 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:11.944 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.944 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.944 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:11.944 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 138832 7014 /usr/lib64/libgssrpc.so.4.2 2023-10-16T18:56:11.945 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.945 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-10-16T18:56:11.945 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-10-16T18:56:11.946 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-16T18:56:11.946 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-10-16T18:56:11.946 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 24872 6557 /usr/lib64/libverto.so.1.0.0 2023-10-16T18:56:11.946 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:11.947 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:11.947 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:11.947 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-10-16T18:56:11.948 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.948 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:11.948 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:11.948 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:11.949 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:11.949 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:11.949 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:11.950 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:11.950 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:11.950 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:11.950 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:11.951 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:11.951 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.951 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.952 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root 1u unix 0xffff8e307178b600 0t0 22949 type=STREAM 2023-10-16T18:56:11.952 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root 2u unix 0xffff8e307178b600 0t0 22949 type=STREAM 2023-10-16T18:56:11.952 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root 3u unix 0xffff8e30701af080 0t0 25797 type=DGRAM 2023-10-16T18:56:11.952 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root 4r FIFO 0,13 0t0 25805 pipe 2023-10-16T18:56:11.953 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root 5u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:11.953 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root 6r FIFO 0,13 0t0 25799 pipe 2023-10-16T18:56:11.953 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root 7w FIFO 0,13 0t0 25799 pipe 2023-10-16T18:56:11.954 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root 8u unix 0xffff8e30701acc80 0t0 25800 /var/lib/gssproxy/default.sock type=STREAM 2023-10-16T18:56:11.954 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root 9u unix 0xffff8e30701ad580 0t0 25801 /run/gssproxy.sock type=STREAM 2023-10-16T18:56:11.954 INFO:teuthology.orchestra.run.smithi124.stdout:gssproxy 975 980 gssproxy root 10w FIFO 0,13 0t0 25805 pipe 2023-10-16T18:56:11.954 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.955 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.955 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root txt REG 8,1 67624 8775 /usr/libexec/nm-dispatcher 2023-10-16T18:56:11.955 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.955 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.956 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.956 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.956 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.957 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.957 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.957 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.958 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.958 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.958 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.958 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.959 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.959 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.959 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.959 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.960 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.960 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.960 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.961 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.961 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.961 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.961 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.962 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.962 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.962 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T18:56:11.963 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.963 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 1482336 8730 /usr/lib64/libnm.so.0.1.0 2023-10-16T18:56:11.963 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.963 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.964 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.964 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root 1u unix 0xffff8e3070156c00 0t0 24929 type=STREAM 2023-10-16T18:56:11.964 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root 2u unix 0xffff8e3070156c00 0t0 24929 type=STREAM 2023-10-16T18:56:11.965 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root 3u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.965 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root 4u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.965 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root 5u unix 0xffff8e307178f980 0t0 23198 type=STREAM 2023-10-16T18:56:11.965 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 root 6u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.966 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.966 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.966 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root txt REG 8,1 67624 8775 /usr/libexec/nm-dispatcher 2023-10-16T18:56:11.966 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.967 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.967 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.967 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.968 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.968 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.968 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.969 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.969 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.969 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.969 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.970 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.970 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.970 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.971 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.971 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.971 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.971 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.972 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.972 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.972 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.972 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.973 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.973 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.973 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.974 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T18:56:11.974 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.974 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 1482336 8730 /usr/lib64/libnm.so.0.1.0 2023-10-16T18:56:11.974 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.975 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.975 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.975 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root 1u unix 0xffff8e3070156c00 0t0 24929 type=STREAM 2023-10-16T18:56:11.976 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root 2u unix 0xffff8e3070156c00 0t0 24929 type=STREAM 2023-10-16T18:56:11.976 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root 3u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.976 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root 4u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.976 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root 5u unix 0xffff8e307178f980 0t0 23198 type=STREAM 2023-10-16T18:56:11.977 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 987 gmain root 6u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.977 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.977 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.978 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root txt REG 8,1 67624 8775 /usr/libexec/nm-dispatcher 2023-10-16T18:56:11.978 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.978 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.979 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.979 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.979 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.979 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.980 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.980 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.980 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.981 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.981 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.981 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.981 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.982 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.982 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.982 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.983 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.983 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.983 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.983 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.984 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.984 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.984 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.985 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.985 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.985 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T18:56:11.985 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.986 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 1482336 8730 /usr/lib64/libnm.so.0.1.0 2023-10-16T18:56:11.986 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.986 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.987 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.987 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root 1u unix 0xffff8e3070156c00 0t0 24929 type=STREAM 2023-10-16T18:56:11.987 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root 2u unix 0xffff8e3070156c00 0t0 24929 type=STREAM 2023-10-16T18:56:11.988 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root 3u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.988 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root 4u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.988 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root 5u unix 0xffff8e307178f980 0t0 23198 type=STREAM 2023-10-16T18:56:11.988 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 988 pool root 6u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.989 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:11.989 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:11.989 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root txt REG 8,1 67624 8775 /usr/libexec/nm-dispatcher 2023-10-16T18:56:11.989 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:11.990 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:11.990 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:11.990 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:11.991 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:11.991 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:11.991 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:11.991 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:11.992 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:11.992 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:11.992 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:11.992 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:11.993 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:11.993 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:11.993 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:11.994 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:11.994 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:11.994 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:11.994 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:11.995 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:11.995 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:11.995 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:11.996 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:11.996 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:11.996 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:11.996 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T18:56:11.997 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:11.997 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 1482336 8730 /usr/lib64/libnm.so.0.1.0 2023-10-16T18:56:11.997 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:11.998 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:11.998 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:11.998 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root 1u unix 0xffff8e3070156c00 0t0 24929 type=STREAM 2023-10-16T18:56:11.998 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root 2u unix 0xffff8e3070156c00 0t0 24929 type=STREAM 2023-10-16T18:56:11.999 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root 3u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.999 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root 4u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:11.999 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root 5u unix 0xffff8e307178f980 0t0 23198 type=STREAM 2023-10-16T18:56:12.000 INFO:teuthology.orchestra.run.smithi124.stdout:nm-dispat 986 989 gdbus root 6u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:12.000 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:12.000 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:12.000 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root txt REG 8,1 237976 50943 /usr/libexec/sssd/sssd_be 2023-10-16T18:56:12.001 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 68288 8465 /usr/lib64/libsss_certmap.so.0.2.0 2023-10-16T18:56:12.001 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 58096 32121 /usr/lib64/sssd/libsss_files.so 2023-10-16T18:56:12.001 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:12.001 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T18:56:12.002 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.002 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:12.002 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 4644864 66476 /var/lib/sss/db/timestamps_implicit_files.ldb 2023-10-16T18:56:12.003 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 6459392 66474 /var/lib/sss/db/cache_implicit_files.ldb 2023-10-16T18:56:12.003 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:12.003 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 7536 40251 /usr/lib64/ldb/modules/ldb/tdb.so 2023-10-16T18:56:12.004 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 11816 40250 /usr/lib64/ldb/modules/ldb/skel.so 2023-10-16T18:56:12.004 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 15896 40249 /usr/lib64/ldb/modules/ldb/server_sort.so 2023-10-16T18:56:12.004 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 11992 40248 /usr/lib64/ldb/modules/ldb/sample.so 2023-10-16T18:56:12.004 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 15952 40247 /usr/lib64/ldb/modules/ldb/rdn_name.so 2023-10-16T18:56:12.005 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 16008 40246 /usr/lib64/ldb/modules/ldb/paged_searches.so 2023-10-16T18:56:12.005 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 71048 41592 /usr/lib64/ldb/modules/ldb/memberof.so 2023-10-16T18:56:12.005 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 7544 40245 /usr/lib64/ldb/modules/ldb/mdb.so 2023-10-16T18:56:12.005 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 91808 6558 /usr/lib64/liblmdb.so.0.0.0 2023-10-16T18:56:12.006 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 12440 40238 /usr/lib64/ldb/libldb-tdb-err-map.so 2023-10-16T18:56:12.006 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 95464 40236 /usr/lib64/ldb/libldb-key-value.so 2023-10-16T18:56:12.006 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 24744 40237 /usr/lib64/ldb/libldb-mdb-int.so 2023-10-16T18:56:12.007 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 25008 40239 /usr/lib64/ldb/libldb-tdb-int.so 2023-10-16T18:56:12.007 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 7648 40244 /usr/lib64/ldb/modules/ldb/ldb.so 2023-10-16T18:56:12.007 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:12.007 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:12.008 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:12.008 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:12.008 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:12.008 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:12.009 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T18:56:12.009 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T18:56:12.009 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-10-16T18:56:12.010 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:12.010 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-10-16T18:56:12.010 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-10-16T18:56:12.010 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 28888 40243 /usr/lib64/ldb/modules/ldb/ldap.so 2023-10-16T18:56:12.011 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 15928 40242 /usr/lib64/ldb/modules/ldb/asq.so 2023-10-16T18:56:12.011 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:12.011 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:12.012 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:12.012 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:12.012 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:12.012 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:12.013 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:12.013 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:12.013 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:12.013 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:12.014 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:12.014 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:12.014 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-10-16T18:56:12.015 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:12.015 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:12.015 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:12.016 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:12.016 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T18:56:12.016 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 87544 5208 /usr/lib64/libtalloc.so.2.3.3 2023-10-16T18:56:12.016 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 87792 5290 /usr/lib64/libtevent.so.0.11.0 2023-10-16T18:56:12.017 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 16216 5346 /usr/lib64/libdhash.so.1.1.0 2023-10-16T18:56:12.017 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 262080 32126 /usr/lib64/sssd/libsss_sbus.so 2023-10-16T18:56:12.017 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 148360 32122 /usr/lib64/sssd/libsss_iface.so 2023-10-16T18:56:12.018 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:12.018 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 24880 32120 /usr/lib64/sssd/libsss_debug.so 2023-10-16T18:56:12.018 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:12.018 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 24240 32118 /usr/lib64/sssd/libsss_child.so 2023-10-16T18:56:12.019 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 24752 32119 /usr/lib64/sssd/libsss_crypt.so 2023-10-16T18:56:12.019 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 20440 32117 /usr/lib64/sssd/libsss_cert.so 2023-10-16T18:56:12.019 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-10-16T18:56:12.019 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-10-16T18:56:12.020 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-16T18:56:12.020 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-10-16T18:56:12.020 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:12.021 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 100496 5296 /usr/lib64/libtdb.so.1.4.4 2023-10-16T18:56:12.021 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:12.021 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 220240 8334 /usr/lib64/libldb.so.2.4.1 2023-10-16T18:56:12.021 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-10-16T18:56:12.022 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:12.022 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 568304 32130 /usr/lib64/sssd/libsss_util.so 2023-10-16T18:56:12.022 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T18:56:12.023 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 79176 6499 /usr/lib64/libcares.so.2.2.0 2023-10-16T18:56:12.023 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:12.023 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:12.023 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 1286144 66412 /var/lib/sss/db/config.ldb 2023-10-16T18:56:12.024 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:12.024 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:12.024 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:12.025 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:12.025 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:12.025 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:12.025 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:12.026 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:12.026 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:12.026 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:12.027 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:12.027 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:12.027 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root 0w REG 8,1 102823 66778 /var/log/sssd/sssd_implicit_files.log 2023-10-16T18:56:12.027 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root 1u unix 0xffff8e3070157080 0t0 2015 type=STREAM 2023-10-16T18:56:12.028 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root 2u unix 0xffff8e3070157080 0t0 2015 type=STREAM 2023-10-16T18:56:12.028 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root 3u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:12.028 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root 4u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:12.028 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root 5u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:12.029 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root 6u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:12.029 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root 7u REG 8,1 1286144 66412 /var/lib/sss/db/config.ldb 2023-10-16T18:56:12.029 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root 8r FIFO 0,13 0t0 23253 pipe 2023-10-16T18:56:12.029 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root 9w FIFO 0,13 0t0 23253 pipe 2023-10-16T18:56:12.030 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root 10u unix 0xffff8e2e50ee0900 0t0 23254 type=DGRAM 2023-10-16T18:56:12.030 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root 11u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:12.030 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root 12u REG 8,1 6459392 66474 /var/lib/sss/db/cache_implicit_files.ldb 2023-10-16T18:56:12.031 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root 13u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:12.031 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root 14u REG 8,1 4644864 66476 /var/lib/sss/db/timestamps_implicit_files.ldb 2023-10-16T18:56:12.031 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root 15u unix 0xffff8e2e50ee2d00 0t0 23255 /var/lib/sss/pipes/private/sbus-dp_implicit_files.1010 type=STREAM 2023-10-16T18:56:12.031 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root 16u unix 0xffff8e2e50ee7080 0t0 23256 type=STREAM 2023-10-16T18:56:12.032 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root 17u unix 0xffff8e2e50ee3180 0t0 23257 /var/lib/sss/pipes/private/sbus-dp_implicit_files.1010 type=STREAM 2023-10-16T18:56:12.032 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root 18r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:12.032 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root 19r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T18:56:12.032 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root 20r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:12.033 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root 21r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:12.033 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root 22u unix 0xffff8e3070151b00 0t0 24948 type=STREAM 2023-10-16T18:56:12.033 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_be 1010 root 23u unix 0xffff8e2e50ee5a00 0t0 24949 /var/lib/sss/pipes/private/sbus-dp_implicit_files.1010 type=STREAM 2023-10-16T18:56:12.034 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:12.034 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:12.034 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root txt REG 8,1 305856 50945 /usr/libexec/sssd/sssd_nss 2023-10-16T18:56:12.034 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem-w REG 8,1 11567160 68652 /var/lib/sss/mc/initgroups 2023-10-16T18:56:12.035 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem-w REG 8,1 6940392 68651 /var/lib/sss/mc/group 2023-10-16T18:56:12.035 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem-w REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.035 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 4644864 66476 /var/lib/sss/db/timestamps_implicit_files.ldb 2023-10-16T18:56:12.036 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 6459392 66474 /var/lib/sss/db/cache_implicit_files.ldb 2023-10-16T18:56:12.036 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:12.036 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 7536 40251 /usr/lib64/ldb/modules/ldb/tdb.so 2023-10-16T18:56:12.036 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 11816 40250 /usr/lib64/ldb/modules/ldb/skel.so 2023-10-16T18:56:12.037 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 15896 40249 /usr/lib64/ldb/modules/ldb/server_sort.so 2023-10-16T18:56:12.037 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 11992 40248 /usr/lib64/ldb/modules/ldb/sample.so 2023-10-16T18:56:12.037 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 15952 40247 /usr/lib64/ldb/modules/ldb/rdn_name.so 2023-10-16T18:56:12.038 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 16008 40246 /usr/lib64/ldb/modules/ldb/paged_searches.so 2023-10-16T18:56:12.038 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 71048 41592 /usr/lib64/ldb/modules/ldb/memberof.so 2023-10-16T18:56:12.038 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 7544 40245 /usr/lib64/ldb/modules/ldb/mdb.so 2023-10-16T18:56:12.038 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 91808 6558 /usr/lib64/liblmdb.so.0.0.0 2023-10-16T18:56:12.039 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 12440 40238 /usr/lib64/ldb/libldb-tdb-err-map.so 2023-10-16T18:56:12.039 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 95464 40236 /usr/lib64/ldb/libldb-key-value.so 2023-10-16T18:56:12.039 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 24744 40237 /usr/lib64/ldb/libldb-mdb-int.so 2023-10-16T18:56:12.040 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 25008 40239 /usr/lib64/ldb/libldb-tdb-int.so 2023-10-16T18:56:12.040 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 7648 40244 /usr/lib64/ldb/modules/ldb/ldb.so 2023-10-16T18:56:12.040 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:12.040 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:12.041 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:12.041 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:12.041 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:12.042 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:12.042 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T18:56:12.042 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T18:56:12.042 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-10-16T18:56:12.043 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:12.043 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-10-16T18:56:12.043 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-10-16T18:56:12.044 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 28888 40243 /usr/lib64/ldb/modules/ldb/ldap.so 2023-10-16T18:56:12.044 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 15928 40242 /usr/lib64/ldb/modules/ldb/asq.so 2023-10-16T18:56:12.044 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:12.044 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:12.045 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:12.045 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:12.045 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:12.046 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:12.046 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:12.046 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:12.046 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:12.047 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:12.047 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:12.047 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-10-16T18:56:12.047 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:12.048 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:12.048 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:12.048 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T18:56:12.048 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 87544 5208 /usr/lib64/libtalloc.so.2.3.3 2023-10-16T18:56:12.049 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 87792 5290 /usr/lib64/libtevent.so.0.11.0 2023-10-16T18:56:12.049 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 16216 5346 /usr/lib64/libdhash.so.1.1.0 2023-10-16T18:56:12.049 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 262080 32126 /usr/lib64/sssd/libsss_sbus.so 2023-10-16T18:56:12.050 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 148360 32122 /usr/lib64/sssd/libsss_iface.so 2023-10-16T18:56:12.050 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:12.050 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 24880 32120 /usr/lib64/sssd/libsss_debug.so 2023-10-16T18:56:12.050 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:12.051 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 24240 32118 /usr/lib64/sssd/libsss_child.so 2023-10-16T18:56:12.051 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 24752 32119 /usr/lib64/sssd/libsss_crypt.so 2023-10-16T18:56:12.051 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-10-16T18:56:12.051 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-10-16T18:56:12.052 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-16T18:56:12.052 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-10-16T18:56:12.052 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:12.053 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 100496 5296 /usr/lib64/libtdb.so.1.4.4 2023-10-16T18:56:12.053 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:12.053 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 220240 8334 /usr/lib64/libldb.so.2.4.1 2023-10-16T18:56:12.053 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-10-16T18:56:12.054 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:12.054 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 568304 32130 /usr/lib64/sssd/libsss_util.so 2023-10-16T18:56:12.054 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 20440 32117 /usr/lib64/sssd/libsss_cert.so 2023-10-16T18:56:12.054 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 28888 5451 /usr/lib64/libsss_idmap.so.0.5.1 2023-10-16T18:56:12.055 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:12.055 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:12.055 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 1286144 66412 /var/lib/sss/db/config.ldb 2023-10-16T18:56:12.056 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:12.057 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:12.057 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:12.058 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:12.058 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:12.058 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:12.059 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:12.059 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:12.059 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:12.059 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:12.060 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:12.060 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:12.060 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 0w REG 8,1 168853 66816 /var/log/sssd/sssd_nss.log 2023-10-16T18:56:12.061 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 1u unix 0xffff8e3070157080 0t0 2015 type=STREAM 2023-10-16T18:56:12.061 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 2u unix 0xffff8e3070157080 0t0 2015 type=STREAM 2023-10-16T18:56:12.061 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 3u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:12.061 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 4u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:12.062 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 5u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:12.062 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 6u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:12.062 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 7u REG 8,1 1286144 66412 /var/lib/sss/db/config.ldb 2023-10-16T18:56:12.062 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 8r FIFO 0,13 0t0 23273 pipe 2023-10-16T18:56:12.063 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 9w FIFO 0,13 0t0 23273 pipe 2023-10-16T18:56:12.063 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 10u unix 0xffff8e2e50ee6780 0t0 23274 type=DGRAM 2023-10-16T18:56:12.063 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 11u unix 0xffff8e2e50ee6c00 0t0 23275 type=STREAM 2023-10-16T18:56:12.064 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 12u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:12.064 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 13u REG 8,1 6459392 66474 /var/lib/sss/db/cache_implicit_files.ldb 2023-10-16T18:56:12.064 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 14u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:12.065 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 15u REG 8,1 4644864 66476 /var/lib/sss/db/timestamps_implicit_files.ldb 2023-10-16T18:56:12.065 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 16u unix 0xffff8e30701ab600 0t0 25859 /var/lib/sss/pipes/nss type=STREAM 2023-10-16T18:56:12.065 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 17uw REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.065 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 18uw REG 8,1 6940392 68651 /var/lib/sss/mc/group 2023-10-16T18:56:12.066 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 19uw REG 8,1 11567160 68652 /var/lib/sss/mc/initgroups 2023-10-16T18:56:12.066 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 20u unix 0xffff8e30701ada00 0t0 25873 type=STREAM 2023-10-16T18:56:12.066 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 21u unix 0xffff8e2e50ee2400 0t0 24322 /var/lib/sss/pipes/nss type=STREAM 2023-10-16T18:56:12.067 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 22u unix 0xffff8e30725b9b00 0t0 25894 /var/lib/sss/pipes/nss type=STREAM 2023-10-16T18:56:12.067 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 23u unix 0xffff8e2e50ee4c80 0t0 25896 /var/lib/sss/pipes/nss type=STREAM 2023-10-16T18:56:12.067 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 24u unix 0xffff8e3072444800 0t0 30895 /var/lib/sss/pipes/nss type=STREAM 2023-10-16T18:56:12.067 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 25u unix 0xffff8e3070153600 0t0 30896 /var/lib/sss/pipes/nss type=STREAM 2023-10-16T18:56:12.068 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 26u unix 0xffff8e3070163180 0t0 30903 /var/lib/sss/pipes/nss type=STREAM 2023-10-16T18:56:12.068 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 27u unix 0xffff8e2eb17f3f00 0t0 25569 /var/lib/sss/pipes/nss type=STREAM 2023-10-16T18:56:12.068 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 28u unix 0xffff8e3072443180 0t0 30966 /var/lib/sss/pipes/nss type=STREAM 2023-10-16T18:56:12.069 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 29u unix 0xffff8e2e50ee3f00 0t0 30979 /var/lib/sss/pipes/nss type=STREAM 2023-10-16T18:56:12.069 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 30u unix 0xffff8e3071790900 0t0 31064 /var/lib/sss/pipes/nss type=STREAM 2023-10-16T18:56:12.069 INFO:teuthology.orchestra.run.smithi124.stdout:sssd_nss 1024 root 31u sock 0,9 0t0 25570 protocol: UNIX 2023-10-16T18:56:12.069 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:12.070 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:12.070 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root txt REG 8,1 259272 8128 /usr/lib/systemd/systemd-logind 2023-10-16T18:56:12.070 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.071 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:12.071 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:12.071 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:12.071 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T18:56:12.072 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-10-16T18:56:12.072 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:12.072 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:12.072 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:12.073 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:12.073 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-10-16T18:56:12.073 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:12.074 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T18:56:12.074 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-10-16T18:56:12.074 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:12.075 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-10-16T18:56:12.075 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:12.075 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:12.075 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:12.076 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:12.076 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:12.076 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:12.077 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-10-16T18:56:12.077 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:12.077 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-10-16T18:56:12.077 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:12.078 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:12.078 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:12.078 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:12.079 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:12.079 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-10-16T18:56:12.079 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-10-16T18:56:12.079 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:12.080 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 574801 1740 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-10-16T18:56:12.080 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root mem REG 8,1 19983 1496 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-10-16T18:56:12.080 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.081 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root 1u unix 0xffff8e3070b85580 0t0 24200 type=STREAM 2023-10-16T18:56:12.081 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root 2u unix 0xffff8e3070b85580 0t0 24200 type=STREAM 2023-10-16T18:56:12.081 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root 3u unix 0xffff8e3070b81200 0t0 24201 type=DGRAM 2023-10-16T18:56:12.081 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root 4u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:12.082 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root 5u a_inode 0,14 0 12454 [signalfd] 2023-10-16T18:56:12.082 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root 6u a_inode 0,14 0 12454 [timerfd] 2023-10-16T18:56:12.082 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root 7r REG 0,21 4096 22179 /sys/devices/virtual/tty/tty0/active 2023-10-16T18:56:12.083 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root 8u netlink 0t0 24207 KOBJECT_UEVENT 2023-10-16T18:56:12.083 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root 9u netlink 0t0 24208 KOBJECT_UEVENT 2023-10-16T18:56:12.083 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root 10u netlink 0t0 24209 KOBJECT_UEVENT 2023-10-16T18:56:12.083 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root 11u netlink 0t0 24210 KOBJECT_UEVENT 2023-10-16T18:56:12.084 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root 12u unix 0xffff8e3070b85e80 0t0 24211 type=STREAM 2023-10-16T18:56:12.084 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root 13u a_inode 0,14 0 12454 [timerfd] 2023-10-16T18:56:12.084 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root 14u CHR 13,65 0t0 13443 /dev/input/event1 2023-10-16T18:56:12.085 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root 15u CHR 13,64 0t0 13442 /dev/input/event0 2023-10-16T18:56:12.085 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root 16u CHR 13,66 0t0 13552 /dev/input/event2 2023-10-16T18:56:12.085 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root 17u CHR 4,6 0t0 13333 /dev/tty6 2023-10-16T18:56:12.085 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root 18r FIFO 0,24 0t0 28015 /run/systemd/inhibit/1.ref 2023-10-16T18:56:12.086 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root 19r REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.086 INFO:teuthology.orchestra.run.smithi124.stdout:systemd-l 1030 root 20r FIFO 0,24 0t0 25295 /run/systemd/sessions/3.ref 2023-10-16T18:56:12.086 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:12.087 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:12.087 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root txt REG 8,1 467608 14012 /usr/sbin/cupsd 2023-10-16T18:56:12.087 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:12.087 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 6940392 68651 /var/lib/sss/mc/group 2023-10-16T18:56:12.088 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.088 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:12.088 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:12.089 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:12.089 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:12.089 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:12.089 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:12.090 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:12.090 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:12.090 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:12.091 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:12.091 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:12.091 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:12.091 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:12.092 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:12.092 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:12.092 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:12.093 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:12.093 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:12.093 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:12.094 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-10-16T18:56:12.094 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:12.094 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:12.095 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:12.095 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:12.095 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:12.095 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:12.096 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:12.096 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:12.096 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:12.097 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T18:56:12.097 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:12.097 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:12.097 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:12.098 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:12.098 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:12.098 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:12.099 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 629504 8599 /usr/lib64/libcups.so.2 2023-10-16T18:56:12.099 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 74352 8596 /usr/lib64/libavahi-client.so.3.2.9 2023-10-16T18:56:12.099 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 54208 8598 /usr/lib64/libavahi-common.so.3.5.3 2023-10-16T18:56:12.099 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:12.100 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T18:56:12.100 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-10-16T18:56:12.100 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:12.101 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T18:56:12.101 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:12.101 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:12.101 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 28936 8602 /usr/lib64/libcupsmime.so.1 2023-10-16T18:56:12.102 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:12.102 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:12.102 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:12.103 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.103 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root 1u unix 0xffff8e3071795580 0t0 27929 type=STREAM 2023-10-16T18:56:12.103 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root 2u unix 0xffff8e3071795580 0t0 27929 type=STREAM 2023-10-16T18:56:12.103 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root 3u unix 0xffff8e307178ad00 0t0 17340 /var/run/cups/cups.sock type=STREAM 2023-10-16T18:56:12.104 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root 4u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:12.104 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root 5r REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.104 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root 6u unix 0xffff8e2e50ee7500 0t0 23288 type=STREAM 2023-10-16T18:56:12.105 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root 7r REG 8,1 6940392 68651 /var/lib/sss/mc/group 2023-10-16T18:56:12.105 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root 8u unix 0xffff8e2e50ee5580 0t0 23298 type=STREAM 2023-10-16T18:56:12.105 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root 9u IPv6 23299 0t0 TCP localhost:ipp (LISTEN) 2023-10-16T18:56:12.105 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root 10u IPv4 23300 0t0 TCP localhost:ipp (LISTEN) 2023-10-16T18:56:12.106 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root 11r FIFO 0,13 0t0 23301 pipe 2023-10-16T18:56:12.106 INFO:teuthology.orchestra.run.smithi124.stdout:cupsd 1032 root 12w FIFO 0,13 0t0 23301 pipe 2023-10-16T18:56:12.106 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:12.107 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:12.107 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root txt REG 8,1 75704 8472 /usr/sbin/crond 2023-10-16T18:56:12.107 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:12.107 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.108 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:12.108 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:12.108 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:12.109 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:12.109 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:12.109 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:12.110 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:12.110 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:12.110 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T18:56:12.110 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:12.111 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:12.111 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:12.111 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:12.111 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:12.112 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:12.112 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:12.112 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:12.113 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:12.113 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:12.113 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:12.113 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:12.114 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:12.114 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:12.114 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.115 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root 1u unix 0xffff8e3070b87980 0t0 24319 type=STREAM 2023-10-16T18:56:12.115 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root 2u unix 0xffff8e3070b87980 0t0 24319 type=STREAM 2023-10-16T18:56:12.115 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root 3uW REG 0,24 5 24320 /run/crond.pid 2023-10-16T18:56:12.115 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root 4u unix 0xffff8e3070b81b00 0t0 24321 type=DGRAM 2023-10-16T18:56:12.116 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root 5r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:12.116 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root 7r REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.116 INFO:teuthology.orchestra.run.smithi124.stdout:crond 1043 root 8u unix 0xffff8e2e50ee2880 0t0 23296 type=STREAM 2023-10-16T18:56:12.117 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root cwd DIR 8,1 4096 66695 /var/spool/at 2023-10-16T18:56:12.117 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:12.117 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root txt REG 8,1 34144 9429 /usr/sbin/atd 2023-10-16T18:56:12.117 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root mem REG 8,1 6940392 68651 /var/lib/sss/mc/group 2023-10-16T18:56:12.118 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:12.118 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root mem REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.118 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:12.119 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:12.119 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:12.119 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:12.119 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:12.120 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:12.120 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:12.120 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:12.120 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root mem REG 8,1 16608 7487 /usr/lib64/libpam_misc.so.0.82.1 2023-10-16T18:56:12.121 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T18:56:12.121 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:12.121 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:12.122 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.122 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root 1u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.122 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root 2u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.122 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root 3r REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.123 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root 4u unix 0xffff8e30725be300 0t0 22410 type=STREAM 2023-10-16T18:56:12.123 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root 5r REG 8,1 6940392 68651 /var/lib/sss/mc/group 2023-10-16T18:56:12.123 INFO:teuthology.orchestra.run.smithi124.stdout:atd 1044 root 6uW REG 0,24 5 22413 /run/atd.pid 2023-10-16T18:56:12.124 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:12.124 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:12.124 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root txt REG 8,1 741608 8593 /usr/sbin/rsyslogd 2023-10-16T18:56:12.124 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 0,24 8388608 1157 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-10-16T18:56:12.125 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 8,1 34240 8563 /usr/lib64/rsyslog/imjournal.so 2023-10-16T18:56:12.125 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 8,1 38824 8570 /usr/lib64/rsyslog/imuxsock.so 2023-10-16T18:56:12.125 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:12.125 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 8,1 29376 8571 /usr/lib64/rsyslog/lmnet.so 2023-10-16T18:56:12.126 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:12.126 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:12.126 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:12.127 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:12.127 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:12.127 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:12.127 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:12.128 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:12.128 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:12.128 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:12.128 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:12.129 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:12.129 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:12.129 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 8,1 50392 6670 /usr/lib64/libfastjson.so.4.3.0 2023-10-16T18:56:12.129 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 8,1 16448 6668 /usr/lib64/libestr.so.0.0.0 2023-10-16T18:56:12.130 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:12.130 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:12.130 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:12.131 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:12.131 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:12.131 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.131 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root 1w CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.132 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root 2w CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.132 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root 3r CHR 1,9 0t0 13319 /dev/urandom 2023-10-16T18:56:12.132 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root 4u unix 0xffff8e2e50ee1b00 0t0 23407 type=DGRAM 2023-10-16T18:56:12.133 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root 5w REG 8,1 968085 66911 /var/log/messages 2023-10-16T18:56:12.133 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root 6r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:12.133 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root 7w REG 8,1 378770 66912 /var/log/secure 2023-10-16T18:56:12.133 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root 8w REG 8,1 4843 66853 /var/log/cron 2023-10-16T18:56:12.134 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 root 9r REG 0,24 8388608 1157 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-10-16T18:56:12.134 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:12.134 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:12.135 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root txt REG 8,1 741608 8593 /usr/sbin/rsyslogd 2023-10-16T18:56:12.135 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 0,24 8388608 1157 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-10-16T18:56:12.135 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 8,1 34240 8563 /usr/lib64/rsyslog/imjournal.so 2023-10-16T18:56:12.135 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 8,1 38824 8570 /usr/lib64/rsyslog/imuxsock.so 2023-10-16T18:56:12.136 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:12.136 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 8,1 29376 8571 /usr/lib64/rsyslog/lmnet.so 2023-10-16T18:56:12.136 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:12.136 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:12.137 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:12.137 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:12.137 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:12.138 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:12.138 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:12.138 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:12.138 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:12.139 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:12.139 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:12.139 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:12.140 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:12.140 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 8,1 50392 6670 /usr/lib64/libfastjson.so.4.3.0 2023-10-16T18:56:12.140 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 8,1 16448 6668 /usr/lib64/libestr.so.0.0.0 2023-10-16T18:56:12.140 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:12.141 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:12.141 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:12.141 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:12.142 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:12.142 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.142 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root 1w CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.142 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root 2w CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.143 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root 3r CHR 1,9 0t0 13319 /dev/urandom 2023-10-16T18:56:12.143 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root 4u unix 0xffff8e2e50ee1b00 0t0 23407 type=DGRAM 2023-10-16T18:56:12.143 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root 5w REG 8,1 968085 66911 /var/log/messages 2023-10-16T18:56:12.144 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root 6r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:12.144 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root 7w REG 8,1 378770 66912 /var/log/secure 2023-10-16T18:56:12.144 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root 8w REG 8,1 4843 66853 /var/log/cron 2023-10-16T18:56:12.144 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1292 in:imjour root 9r REG 0,24 8388608 1157 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-10-16T18:56:12.145 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:12.145 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:12.145 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root txt REG 8,1 741608 8593 /usr/sbin/rsyslogd 2023-10-16T18:56:12.145 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 0,24 8388608 1157 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-10-16T18:56:12.146 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 8,1 34240 8563 /usr/lib64/rsyslog/imjournal.so 2023-10-16T18:56:12.146 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 8,1 38824 8570 /usr/lib64/rsyslog/imuxsock.so 2023-10-16T18:56:12.146 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:12.147 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 8,1 29376 8571 /usr/lib64/rsyslog/lmnet.so 2023-10-16T18:56:12.147 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:12.147 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:12.148 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:12.148 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:12.148 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:12.148 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:12.149 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:12.149 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:12.149 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:12.149 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:12.150 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:12.150 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:12.150 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:12.151 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 8,1 50392 6670 /usr/lib64/libfastjson.so.4.3.0 2023-10-16T18:56:12.151 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 8,1 16448 6668 /usr/lib64/libestr.so.0.0.0 2023-10-16T18:56:12.151 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:12.151 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:12.152 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:12.152 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:12.152 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:12.152 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.153 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root 1w CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.153 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root 2w CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.153 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root 3r CHR 1,9 0t0 13319 /dev/urandom 2023-10-16T18:56:12.154 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root 4u unix 0xffff8e2e50ee1b00 0t0 23407 type=DGRAM 2023-10-16T18:56:12.154 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root 5w REG 8,1 968085 66911 /var/log/messages 2023-10-16T18:56:12.154 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root 6r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:12.154 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root 7w REG 8,1 378770 66912 /var/log/secure 2023-10-16T18:56:12.155 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root 8w REG 8,1 4843 66853 /var/log/cron 2023-10-16T18:56:12.155 INFO:teuthology.orchestra.run.smithi124.stdout:rsyslogd 1227 1293 rs:main root 9r REG 0,24 8388608 1157 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-10-16T18:56:12.155 INFO:teuthology.orchestra.run.smithi124.stdout:nrpe 1232 nrpe cwd DIR 8,1 4096 2 / 2023-10-16T18:56:12.156 INFO:teuthology.orchestra.run.smithi124.stdout:nrpe 1232 nrpe rtd DIR 8,1 4096 2 / 2023-10-16T18:56:12.156 INFO:teuthology.orchestra.run.smithi124.stdout:nrpe 1232 nrpe txt REG 8,1 82312 32484 /usr/sbin/nrpe 2023-10-16T18:56:12.156 INFO:teuthology.orchestra.run.smithi124.stdout:nrpe 1232 nrpe mem REG 8,1 6940392 68651 /var/lib/sss/mc/group 2023-10-16T18:56:12.156 INFO:teuthology.orchestra.run.smithi124.stdout:nrpe 1232 nrpe mem REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.157 INFO:teuthology.orchestra.run.smithi124.stdout:nrpe 1232 nrpe mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:12.157 INFO:teuthology.orchestra.run.smithi124.stdout:nrpe 1232 nrpe mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:12.157 INFO:teuthology.orchestra.run.smithi124.stdout:nrpe 1232 nrpe mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:12.157 INFO:teuthology.orchestra.run.smithi124.stdout:nrpe 1232 nrpe mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:12.158 INFO:teuthology.orchestra.run.smithi124.stdout:nrpe 1232 nrpe mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:12.158 INFO:teuthology.orchestra.run.smithi124.stdout:nrpe 1232 nrpe mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:12.158 INFO:teuthology.orchestra.run.smithi124.stdout:nrpe 1232 nrpe mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T18:56:12.159 INFO:teuthology.orchestra.run.smithi124.stdout:nrpe 1232 nrpe mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:12.159 INFO:teuthology.orchestra.run.smithi124.stdout:nrpe 1232 nrpe 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.159 INFO:teuthology.orchestra.run.smithi124.stdout:nrpe 1232 nrpe 1w CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.159 INFO:teuthology.orchestra.run.smithi124.stdout:nrpe 1232 nrpe 2w CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.160 INFO:teuthology.orchestra.run.smithi124.stdout:nrpe 1232 nrpe 3r REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.160 INFO:teuthology.orchestra.run.smithi124.stdout:nrpe 1232 nrpe 4u unix 0xffff8e3070b86300 0t0 24561 type=DGRAM 2023-10-16T18:56:12.160 INFO:teuthology.orchestra.run.smithi124.stdout:nrpe 1232 nrpe 5r REG 8,1 6940392 68651 /var/lib/sss/mc/group 2023-10-16T18:56:12.161 INFO:teuthology.orchestra.run.smithi124.stdout:nrpe 1232 nrpe 6u IPv4 24570 0t0 TCP *:nrpe (LISTEN) 2023-10-16T18:56:12.161 INFO:teuthology.orchestra.run.smithi124.stdout:nrpe 1232 nrpe 7u IPv6 24571 0t0 TCP *:nrpe (LISTEN) 2023-10-16T18:56:12.161 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus cwd DIR 8,1 4096 2 / 2023-10-16T18:56:12.161 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus rtd DIR 8,1 4096 2 / 2023-10-16T18:56:12.162 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus txt REG 8,1 245488 7368 /usr/bin/dbus-daemon 2023-10-16T18:56:12.162 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus DEL REG 8,1 20335 /var/lib/sss/mc/group 2023-10-16T18:56:12.162 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:12.163 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T18:56:12.163 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:12.163 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.163 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:12.164 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:12.164 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:12.164 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:12.165 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:12.165 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:12.165 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:12.165 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:12.166 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:12.166 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:12.166 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:12.167 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:12.167 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:12.167 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:12.167 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:12.168 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:12.168 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:12.168 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:12.169 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T18:56:12.169 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:12.169 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T18:56:12.169 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:12.170 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.170 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 1u unix 0xffff8e3070150900 0t0 24601 type=STREAM 2023-10-16T18:56:12.170 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 2u unix 0xffff8e3070150900 0t0 24601 type=STREAM 2023-10-16T18:56:12.171 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 3u unix 0xffff8e3070b81f80 0t0 16331 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:12.171 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 4u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:12.171 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 5r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T18:56:12.171 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 6r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T18:56:12.172 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 7u sock 0,9 0t0 25699 protocol: NETLINK 2023-10-16T18:56:12.172 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 8r REG 8,1 6940392 20335 /var/lib/sss/mc/group (deleted) 2023-10-16T18:56:12.172 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 9u netlink 0t0 25700 SELINUX 2023-10-16T18:56:12.173 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 10r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:12.173 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 11u unix 0xffff8e30701aec00 0t0 25705 type=STREAM 2023-10-16T18:56:12.173 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 12u unix 0xffff8e30701ae780 0t0 25706 type=STREAM 2023-10-16T18:56:12.173 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 13u unix 0xffff8e3070b84c80 0t0 25707 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:12.174 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 14u unix 0xffff8e30725bbf00 0t0 22874 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:12.174 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 15u unix 0xffff8e3071789b00 0t0 896 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:12.174 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 16u unix 0xffff8e3070b80480 0t0 897 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:12.175 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 17u unix 0xffff8e3070161200 0t0 1008 type=DGRAM 2023-10-16T18:56:12.175 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 18u sock 0,9 0t0 1010 protocol: UNIX 2023-10-16T18:56:12.175 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 19u unix 0xffff8e30725be780 0t0 28515 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:12.175 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 20u unix 0xffff8e307178f080 0t0 26662 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:12.176 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 21u unix 0xffff8e307178b180 0t0 1014 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:12.176 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 22u unix 0xffff8e3070b86780 0t0 23279 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:12.176 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 23u unix 0xffff8e2e50ee1200 0t0 28027 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:12.177 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 24u unix 0xffff8e2e50ee5e80 0t0 22438 /run/dbus/system_bus_socket type=STREAM 2023-10-16T18:56:12.177 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 25r FIFO 0,13 0t0 23425 pipe 2023-10-16T18:56:12.177 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 26w FIFO 0,13 0t0 23425 pipe 2023-10-16T18:56:12.177 INFO:teuthology.orchestra.run.smithi124.stdout:dbus-daem 1628 dbus 28u unix 0xffff8e3071793600 0t0 28518 type=STREAM 2023-10-16T18:56:12.178 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot cwd DIR 8,1 4096 2 / 2023-10-16T18:56:12.178 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot rtd DIR 8,1 4096 2 / 2023-10-16T18:56:12.178 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot txt REG 8,1 11856 6728 /usr/libexec/platform-python3.6 2023-10-16T18:56:12.179 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 1503488 5182 /usr/lib64/libxml2.so.2.9.7 2023-10-16T18:56:12.179 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 438592 38813 /usr/lib64/python3.6/site-packages/libxml2mod.so 2023-10-16T18:56:12.179 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 19464 37514 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.179 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:12.180 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:12.180 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 181096 38841 /usr/lib64/python3.6/site-packages/_audit.so 2023-10-16T18:56:12.180 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 17400 38890 /usr/lib64/python3.6/site-packages/systemd/id128.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.181 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 47928 38888 /usr/lib64/python3.6/site-packages/systemd/_reader.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.181 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 12784 38887 /usr/lib64/python3.6/site-packages/systemd/_journal.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.181 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 198680 9494 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-10-16T18:56:12.181 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 14264 38868 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-10-16T18:56:12.182 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:12.182 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:12.182 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:12.183 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:12.183 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:12.183 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T18:56:12.183 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 214536 38867 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-10-16T18:56:12.184 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 250864 40284 /usr/lib64/python3.6/site-packages/selinux/audit2why.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.184 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-10-16T18:56:12.184 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 1959384 45907 /usr/lib64/python3.6/site-packages/setools/policyrep.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.184 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 20528 37503 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.185 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 13688 37473 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.185 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 110640 37504 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.185 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 129528 37474 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.186 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T18:56:12.186 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 47928 37492 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.186 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 30848 37512 /usr/lib64/python3.6/lib-dynload/binascii.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.186 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 20688 37502 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.187 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 11592 37500 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.187 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 66904 37521 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.187 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T18:56:12.188 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 76048 37490 /usr/lib64/python3.6/lib-dynload/_elementtree.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.188 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 133472 37484 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.188 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 29256 37524 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.189 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 92992 37505 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.189 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 185712 41111 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-10-16T18:56:12.189 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 343452 41114 /usr/lib64/girepository-1.0/Gio-2.0.typelib 2023-10-16T18:56:12.189 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:12.190 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:12.190 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:12.190 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T18:56:12.190 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T18:56:12.191 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T18:56:12.191 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T18:56:12.191 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:12.192 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:12.192 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:12.192 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:12.192 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:12.193 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:12.193 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T18:56:12.193 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T18:56:12.194 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T18:56:12.194 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T18:56:12.194 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T18:56:12.194 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T18:56:12.195 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T18:56:12.195 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 239416 8479 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-10-16T18:56:12.195 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 340928 38787 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.195 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 115216 37487 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.196 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 63456 37516 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.196 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 15872 37526 /usr/lib64/python3.6/lib-dynload/syslog.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.196 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 13208 37515 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.197 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:12.197 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 42856 37497 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.197 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 74744 5188 /usr/lib64/libbz2.so.1.0.6 2023-10-16T18:56:12.197 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 23032 37475 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.198 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 34392 37530 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.198 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:12.198 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:12.199 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 319952 38776 /usr/lib64/python3.6/site-packages/_selinux.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.199 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 56768 37508 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.199 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 27128 37493 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-10-16T18:56:12.199 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.200 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:12.200 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:12.200 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:12.201 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:12.201 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-10-16T18:56:12.201 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:12.201 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:12.202 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 3285488 6697 /usr/lib64/libpython3.6m.so.1.0 2023-10-16T18:56:12.202 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:12.202 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:12.202 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 59120 41113 /usr/lib64/girepository-1.0/GObject-2.0.typelib 2023-10-16T18:56:12.203 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 337024 17652 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:12.203 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:12.203 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.204 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot 1u unix 0xffff8e3071791f80 0t0 28519 type=STREAM 2023-10-16T18:56:12.204 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot 2u unix 0xffff8e3071796c00 0t0 28520 type=STREAM 2023-10-16T18:56:12.204 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot 3r REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.204 INFO:teuthology.orchestra.run.smithi124.stdout:setrouble 1629 setroubleshoot 4r FIFO 0,13 0t0 28573 pipe 2023-10-16T18:56:12.205 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:12.205 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:12.205 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root txt REG 8,1 63872 7630 /usr/sbin/agetty 2023-10-16T18:56:12.206 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root mem REG 8,1 6940392 68651 /var/lib/sss/mc/group 2023-10-16T18:56:12.206 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:12.206 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:12.206 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:12.207 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:12.207 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:12.207 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:12.208 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:12.208 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:12.208 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:12.208 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:12.209 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:12.209 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:12.209 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:12.210 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:12.210 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:12.210 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:12.210 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root 0u CHR 4,65 0t0 13420 /dev/ttyS1 2023-10-16T18:56:12.211 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root 1u CHR 4,65 0t0 13420 /dev/ttyS1 2023-10-16T18:56:12.211 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root 2u CHR 4,65 0t0 13420 /dev/ttyS1 2023-10-16T18:56:12.211 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root 3r REG 8,1 6940392 68651 /var/lib/sss/mc/group 2023-10-16T18:56:12.212 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root 4u unix 0xffff8e3070150480 0t0 25160 type=STREAM 2023-10-16T18:56:12.212 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1644 root 6r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:12.212 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1645 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:12.212 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1645 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:12.213 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1645 root txt REG 8,1 63872 7630 /usr/sbin/agetty 2023-10-16T18:56:12.213 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1645 root mem REG 8,1 6940392 68651 /var/lib/sss/mc/group 2023-10-16T18:56:12.213 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1645 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:12.214 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1645 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:12.214 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1645 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:12.214 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1645 root mem REG 8,1 337024 17652 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:12.214 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1645 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:12.215 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1645 root 0u CHR 4,1 0t0 13328 /dev/tty1 2023-10-16T18:56:12.215 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1645 root 1u CHR 4,1 0t0 13328 /dev/tty1 2023-10-16T18:56:12.215 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1645 root 2u CHR 4,1 0t0 13328 /dev/tty1 2023-10-16T18:56:12.216 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1645 root 3r REG 8,1 6940392 68651 /var/lib/sss/mc/group 2023-10-16T18:56:12.216 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1645 root 4u unix 0xffff8e3072443600 0t0 26866 type=STREAM 2023-10-16T18:56:12.216 INFO:teuthology.orchestra.run.smithi124.stdout:agetty 1645 root 6r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:12.216 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:12.217 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:12.217 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root txt REG 8,1 886344 11056 /usr/sbin/sshd 2023-10-16T18:56:12.217 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:12.217 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:12.218 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 11567160 68652 /var/lib/sss/mc/initgroups 2023-10-16T18:56:12.218 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 20168 19469 /usr/lib64/security/pam_lastlog.so 2023-10-16T18:56:12.218 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 11760 19494 /usr/lib64/security/pam_umask.so 2023-10-16T18:56:12.219 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 15968 19490 /usr/lib64/security/pam_succeed_if.so 2023-10-16T18:56:12.219 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 16608 7487 /usr/lib64/libpam_misc.so.0.82.1 2023-10-16T18:56:12.219 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 918928 19694 /usr/lib64/security/pam_systemd.so 2023-10-16T18:56:12.219 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 24080 19470 /usr/lib64/security/pam_limits.so 2023-10-16T18:56:12.220 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 11872 19476 /usr/lib64/security/pam_motd.so 2023-10-16T18:56:12.220 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 11768 19468 /usr/lib64/security/pam_keyinit.so 2023-10-16T18:56:12.220 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 45384 19477 /usr/lib64/security/pam_namespace.so 2023-10-16T18:56:12.221 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 11800 19473 /usr/lib64/security/pam_loginuid.so 2023-10-16T18:56:12.221 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 24200 19485 /usr/lib64/security/pam_selinux.so 2023-10-16T18:56:12.221 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 46232 6935 /usr/lib64/libcrack.so.2.9.0 2023-10-16T18:56:12.221 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 24744 7447 /usr/lib64/libpwquality.so.1.0.2 2023-10-16T18:56:12.222 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 11720 19411 /usr/lib64/security/pam_pwquality.so 2023-10-16T18:56:12.222 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 7672 19479 /usr/lib64/security/pam_permit.so 2023-10-16T18:56:12.222 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 11808 19478 /usr/lib64/security/pam_nologin.so 2023-10-16T18:56:12.223 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 15920 19487 /usr/lib64/security/pam_sepermit.so 2023-10-16T18:56:12.223 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 7592 19456 /usr/lib64/security/pam_deny.so 2023-10-16T18:56:12.223 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 58048 20616 /usr/lib64/security/pam_sss.so 2023-10-16T18:56:12.223 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-10-16T18:56:12.224 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 116408 7035 /usr/lib64/libnsl.so.2.0.0 2023-10-16T18:56:12.224 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 58088 19495 /usr/lib64/security/pam_unix.so 2023-10-16T18:56:12.224 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 11776 19472 /usr/lib64/security/pam_localuser.so 2023-10-16T18:56:12.224 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 11856 19501 /usr/lib64/security/pam_usertype.so 2023-10-16T18:56:12.225 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 11752 19460 /usr/lib64/security/pam_faildelay.so 2023-10-16T18:56:12.225 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 20192 19458 /usr/lib64/security/pam_env.so 2023-10-16T18:56:12.225 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 6940392 68651 /var/lib/sss/mc/group 2023-10-16T18:56:12.226 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.226 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:12.226 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:12.227 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:12.227 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:12.227 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:12.227 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:12.228 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:12.228 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:12.228 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:12.228 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:12.229 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:12.229 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:12.229 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:12.229 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:12.230 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:12.230 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:12.230 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:12.231 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:12.231 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:12.231 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:12.231 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:12.232 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:12.232 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:12.232 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T18:56:12.232 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:12.233 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-10-16T18:56:12.233 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:12.233 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:12.234 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:12.234 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T18:56:12.234 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:12.234 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:12.235 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.235 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root 1u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.235 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root 2u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.236 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root 3u unix 0xffff8e3072446780 0t0 26994 type=DGRAM 2023-10-16T18:56:12.236 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root 4r REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.236 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root 5u IPv4 23434 0t0 TCP smithi124:ssh->teuthology.front.sepia.ceph.com:53794 (ESTABLISHED) 2023-10-16T18:56:12.236 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root 6u unix 0xffff8e3070166300 0t0 29197 type=STREAM 2023-10-16T18:56:12.237 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root 7r REG 8,1 11567160 68652 /var/lib/sss/mc/initgroups 2023-10-16T18:56:12.237 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root 8r REG 8,1 6940392 68651 /var/lib/sss/mc/group 2023-10-16T18:56:12.237 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root 9u unix 0xffff8e3070167980 0t0 29201 type=STREAM 2023-10-16T18:56:12.238 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root 11w FIFO 0,24 0t0 25295 /run/systemd/sessions/3.ref 2023-10-16T18:56:12.238 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1648 root 12u unix 0xffff8e3071792880 0t0 28552 type=STREAM 2023-10-16T18:56:12.238 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu cwd DIR 8,1 4096 2 / 2023-10-16T18:56:12.238 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu rtd DIR 8,1 4096 2 / 2023-10-16T18:56:12.239 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu txt REG 8,1 1601312 8116 /usr/lib/systemd/systemd 2023-10-16T18:56:12.239 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:12.239 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T18:56:12.239 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-10-16T18:56:12.240 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:12.240 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:12.240 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-10-16T18:56:12.241 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-10-16T18:56:12.241 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-10-16T18:56:12.241 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:12.241 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T18:56:12.242 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:12.242 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:12.242 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:12.243 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:12.243 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:12.243 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:12.243 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:12.244 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:12.244 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:12.244 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:12.245 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-10-16T18:56:12.245 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-10-16T18:56:12.245 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:12.245 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:12.246 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:12.246 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:12.246 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 100200 7343 /usr/lib64/libkmod.so.2.3.3 2023-10-16T18:56:12.247 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:12.247 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T18:56:12.247 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:12.247 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:12.248 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-10-16T18:56:12.248 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:12.248 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-10-16T18:56:12.249 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:12.249 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.249 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu 1u unix 0xffff8e3072440000 0t0 26955 type=STREAM 2023-10-16T18:56:12.249 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu 2u unix 0xffff8e3072440000 0t0 26955 type=STREAM 2023-10-16T18:56:12.250 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu 3u unix 0xffff8e3072444380 0t0 26972 type=DGRAM 2023-10-16T18:56:12.250 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu 4u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:12.250 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu 5u a_inode 0,14 0 12454 [signalfd] 2023-10-16T18:56:12.251 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu 6r DIR 0,26 0 808 /sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service 2023-10-16T18:56:12.251 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu 7u a_inode 0,14 0 12454 [timerfd] 2023-10-16T18:56:12.251 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu 8u netlink 0t0 26979 KOBJECT_UEVENT 2023-10-16T18:56:12.251 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu 9u a_inode 0,14 0 12454 [eventpoll] 2023-10-16T18:56:12.252 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu 10r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:12.252 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu 11u unix 0xffff8e30701abf00 0t0 26555 /run/user/1000/bus type=STREAM 2023-10-16T18:56:12.252 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu 12r REG 0,5 0 26984 /proc/1655/mountinfo 2023-10-16T18:56:12.252 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu 13r a_inode 0,14 0 12454 inotify 2023-10-16T18:56:12.253 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu 14r REG 0,5 0 4026532074 /proc/swaps 2023-10-16T18:56:12.253 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu 15u unix 0xffff8e3072443a80 0t0 26985 /run/user/1000/systemd/notify type=DGRAM 2023-10-16T18:56:12.253 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu 16u unix 0xffff8e3072446300 0t0 26987 type=DGRAM 2023-10-16T18:56:12.253 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu 17u unix 0xffff8e3072443f00 0t0 26988 type=DGRAM 2023-10-16T18:56:12.254 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu 18u unix 0xffff8e3072445100 0t0 26989 /run/user/1000/systemd/private type=STREAM 2023-10-16T18:56:12.254 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu 19u unix 0xffff8e3072440480 0t0 26991 type=STREAM 2023-10-16T18:56:12.254 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu 20u a_inode 0,14 0 12454 [timerfd] 2023-10-16T18:56:12.255 INFO:teuthology.orchestra.run.smithi124.stdout:systemd 1655 ubuntu 26u netlink 0t0 26558 SELINUX 2023-10-16T18:56:12.255 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu cwd DIR 8,1 4096 2 / 2023-10-16T18:56:12.255 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu rtd DIR 8,1 4096 2 / 2023-10-16T18:56:12.255 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu txt REG 8,1 1601312 8116 /usr/lib/systemd/systemd 2023-10-16T18:56:12.256 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 7592 19456 /usr/lib64/security/pam_deny.so 2023-10-16T18:56:12.256 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 15968 19490 /usr/lib64/security/pam_succeed_if.so 2023-10-16T18:56:12.256 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 16608 7487 /usr/lib64/libpam_misc.so.0.82.1 2023-10-16T18:56:12.257 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 918928 19694 /usr/lib64/security/pam_systemd.so 2023-10-16T18:56:12.257 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 24080 19470 /usr/lib64/security/pam_limits.so 2023-10-16T18:56:12.257 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 11768 19468 /usr/lib64/security/pam_keyinit.so 2023-10-16T18:56:12.257 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 11800 19473 /usr/lib64/security/pam_loginuid.so 2023-10-16T18:56:12.258 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 24200 19485 /usr/lib64/security/pam_selinux.so 2023-10-16T18:56:12.258 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 7672 19479 /usr/lib64/security/pam_permit.so 2023-10-16T18:56:12.258 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 58048 20616 /usr/lib64/security/pam_sss.so 2023-10-16T18:56:12.259 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 11856 19501 /usr/lib64/security/pam_usertype.so 2023-10-16T18:56:12.259 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 11776 19472 /usr/lib64/security/pam_localuser.so 2023-10-16T18:56:12.259 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:12.259 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:12.260 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:12.260 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:12.260 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:12.261 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:12.261 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:12.261 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-10-16T18:56:12.261 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 116408 7035 /usr/lib64/libnsl.so.2.0.0 2023-10-16T18:56:12.262 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T18:56:12.262 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 58088 19495 /usr/lib64/security/pam_unix.so 2023-10-16T18:56:12.262 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:12.263 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:12.263 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 11567160 68652 /var/lib/sss/mc/initgroups 2023-10-16T18:56:12.263 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.263 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:12.264 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:12.264 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T18:56:12.264 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-10-16T18:56:12.264 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:12.265 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:12.265 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-10-16T18:56:12.265 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-10-16T18:56:12.266 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-10-16T18:56:12.266 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:12.266 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T18:56:12.266 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:12.267 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:12.267 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:12.267 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:12.268 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:12.268 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:12.268 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:12.268 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:12.269 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T18:56:12.269 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:12.269 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-10-16T18:56:12.270 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-10-16T18:56:12.270 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:12.270 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:12.270 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:12.271 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:12.271 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 100200 7343 /usr/lib64/libkmod.so.2.3.3 2023-10-16T18:56:12.271 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:12.271 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T18:56:12.272 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:12.272 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:12.272 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-10-16T18:56:12.273 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:12.273 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-10-16T18:56:12.273 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:12.273 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 574801 1740 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-10-16T18:56:12.274 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu mem REG 8,1 19983 1496 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-10-16T18:56:12.274 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu 0r CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.274 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu 1u unix 0xffff8e3072440000 0t0 26955 type=STREAM 2023-10-16T18:56:12.275 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu 2u unix 0xffff8e3072440000 0t0 26955 type=STREAM 2023-10-16T18:56:12.275 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu 3r REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.275 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu 4r REG 8,1 11567160 68652 /var/lib/sss/mc/initgroups 2023-10-16T18:56:12.275 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu 5u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:12.276 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu 6u a_inode 0,14 0 12454 [eventfd] 2023-10-16T18:56:12.276 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu 8w FIFO 0,13 0t0 26956 pipe 2023-10-16T18:56:12.276 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu 9u unix 0xffff8e3072440900 0t0 26968 type=STREAM 2023-10-16T18:56:12.277 INFO:teuthology.orchestra.run.smithi124.stdout:(sd-pam) 1658 ubuntu 10u unix 0xffff8e3072447080 0t0 26969 type=DGRAM 2023-10-16T18:56:12.277 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu cwd DIR 8,1 4096 2 / 2023-10-16T18:56:12.277 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu rtd DIR 8,1 4096 2 / 2023-10-16T18:56:12.277 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu txt REG 8,1 886344 11056 /usr/sbin/sshd 2023-10-16T18:56:12.278 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:12.278 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:12.278 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 11567160 68652 /var/lib/sss/mc/initgroups 2023-10-16T18:56:12.279 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 20168 19469 /usr/lib64/security/pam_lastlog.so 2023-10-16T18:56:12.279 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 11760 19494 /usr/lib64/security/pam_umask.so 2023-10-16T18:56:12.279 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 15968 19490 /usr/lib64/security/pam_succeed_if.so 2023-10-16T18:56:12.279 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 16608 7487 /usr/lib64/libpam_misc.so.0.82.1 2023-10-16T18:56:12.280 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 918928 19694 /usr/lib64/security/pam_systemd.so 2023-10-16T18:56:12.280 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 24080 19470 /usr/lib64/security/pam_limits.so 2023-10-16T18:56:12.280 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 11872 19476 /usr/lib64/security/pam_motd.so 2023-10-16T18:56:12.280 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 11768 19468 /usr/lib64/security/pam_keyinit.so 2023-10-16T18:56:12.281 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 45384 19477 /usr/lib64/security/pam_namespace.so 2023-10-16T18:56:12.281 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 11800 19473 /usr/lib64/security/pam_loginuid.so 2023-10-16T18:56:12.281 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 24200 19485 /usr/lib64/security/pam_selinux.so 2023-10-16T18:56:12.282 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 46232 6935 /usr/lib64/libcrack.so.2.9.0 2023-10-16T18:56:12.282 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 24744 7447 /usr/lib64/libpwquality.so.1.0.2 2023-10-16T18:56:12.282 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 11720 19411 /usr/lib64/security/pam_pwquality.so 2023-10-16T18:56:12.282 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 7672 19479 /usr/lib64/security/pam_permit.so 2023-10-16T18:56:12.283 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 11808 19478 /usr/lib64/security/pam_nologin.so 2023-10-16T18:56:12.283 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 15920 19487 /usr/lib64/security/pam_sepermit.so 2023-10-16T18:56:12.283 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 7592 19456 /usr/lib64/security/pam_deny.so 2023-10-16T18:56:12.284 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 58048 20616 /usr/lib64/security/pam_sss.so 2023-10-16T18:56:12.284 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-10-16T18:56:12.284 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 116408 7035 /usr/lib64/libnsl.so.2.0.0 2023-10-16T18:56:12.284 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 58088 19495 /usr/lib64/security/pam_unix.so 2023-10-16T18:56:12.285 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 11776 19472 /usr/lib64/security/pam_localuser.so 2023-10-16T18:56:12.285 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 11856 19501 /usr/lib64/security/pam_usertype.so 2023-10-16T18:56:12.285 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 11752 19460 /usr/lib64/security/pam_faildelay.so 2023-10-16T18:56:12.285 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 20192 19458 /usr/lib64/security/pam_env.so 2023-10-16T18:56:12.286 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 6940392 68651 /var/lib/sss/mc/group 2023-10-16T18:56:12.286 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.286 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:12.287 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T18:56:12.287 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:12.287 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:12.287 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:12.288 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:12.288 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:12.288 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:12.289 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:12.289 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T18:56:12.289 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:12.289 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:12.290 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T18:56:12.290 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:12.290 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:12.290 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:12.291 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:12.291 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:12.291 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:12.292 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:12.292 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:12.292 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:12.292 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:12.293 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T18:56:12.293 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:12.293 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-10-16T18:56:12.294 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:12.294 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:12.294 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T18:56:12.294 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T18:56:12.295 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:12.295 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:12.295 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.296 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu 1u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.296 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu 2u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.296 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu 3u unix 0xffff8e3072446780 0t0 26994 type=DGRAM 2023-10-16T18:56:12.296 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu 4r REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.297 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu 5u IPv4 23434 0t0 TCP smithi124:ssh->teuthology.front.sepia.ceph.com:53794 (ESTABLISHED) 2023-10-16T18:56:12.297 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu 6u unix 0xffff8e3070166300 0t0 29197 type=STREAM 2023-10-16T18:56:12.297 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu 7r REG 8,1 11567160 68652 /var/lib/sss/mc/initgroups 2023-10-16T18:56:12.298 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu 8r REG 8,1 6940392 68651 /var/lib/sss/mc/group 2023-10-16T18:56:12.298 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu 9u unix 0xffff8e3070167980 0t0 29201 type=STREAM 2023-10-16T18:56:12.298 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu 10u unix 0xffff8e3071794380 0t0 28551 type=STREAM 2023-10-16T18:56:12.298 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu 11w FIFO 0,24 0t0 25295 /run/systemd/sessions/3.ref 2023-10-16T18:56:12.299 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu 12r FIFO 0,13 0t0 31020 pipe 2023-10-16T18:56:12.299 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu 13w FIFO 0,13 0t0 31020 pipe 2023-10-16T18:56:12.299 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu 18r FIFO 0,13 0t0 33793 pipe 2023-10-16T18:56:12.300 INFO:teuthology.orchestra.run.smithi124.stdout:sshd 1666 ubuntu 20r FIFO 0,13 0t0 33794 pipe 2023-10-16T18:56:12.300 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot cwd DIR 8,1 4096 2 / 2023-10-16T18:56:12.300 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot rtd DIR 8,1 4096 2 / 2023-10-16T18:56:12.300 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot txt REG 8,1 21336 7052 /usr/bin/rpm 2023-10-16T18:56:12.301 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 6940392 68651 /var/lib/sss/mc/group 2023-10-16T18:56:12.301 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:12.301 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.301 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:12.302 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:12.302 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-10-16T18:56:12.302 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:12.303 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:12.303 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:12.303 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:12.303 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:12.304 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-10-16T18:56:12.304 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T18:56:12.304 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 247936 5432 /usr/lib64/liblua-5.3.so 2023-10-16T18:56:12.305 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 678440 5298 /usr/lib64/libzstd.so.1.4.4 2023-10-16T18:56:12.305 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T18:56:12.305 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 104784 5234 /usr/lib64/libelf-0.186.so 2023-10-16T18:56:12.305 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:12.306 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 74744 5188 /usr/lib64/libbz2.so.1.0.6 2023-10-16T18:56:12.306 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 1151744 5199 /usr/lib64/libsqlite3.so.0.8.6 2023-10-16T18:56:12.306 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 1869272 7321 /usr/lib64/libdb-5.3.so 2023-10-16T18:56:12.307 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-10-16T18:56:12.307 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:12.307 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 207520 7326 /usr/lib64/librpmio.so.8.2.0 2023-10-16T18:56:12.308 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 527936 7324 /usr/lib64/librpm.so.8.2.0 2023-10-16T18:56:12.308 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:12.308 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 57344 262275 /var/lib/rpm/Name 2023-10-16T18:56:12.308 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 337024 17652 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:12.309 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:12.309 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot 0u CHR 1,3 0t0 13314 /dev/null 2023-10-16T18:56:12.309 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot 1w FIFO 0,13 0t0 28573 pipe 2023-10-16T18:56:12.309 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot 2u unix 0xffff8e3071796c00 0t0 28520 type=STREAM 2023-10-16T18:56:12.310 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot 3r REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.310 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot 4u unix 0xffff8e3071792400 0t0 28579 type=STREAM 2023-10-16T18:56:12.310 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot 5r REG 8,1 6940392 68651 /var/lib/sss/mc/group 2023-10-16T18:56:12.311 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot 6r REG 8,1 116731904 262274 /var/lib/rpm/Packages 2023-10-16T18:56:12.311 INFO:teuthology.orchestra.run.smithi124.stdout:rpm 1772 setroubleshoot 7r REG 8,1 57344 262275 /var/lib/rpm/Name 2023-10-16T18:56:12.311 INFO:teuthology.orchestra.run.smithi124.stdout:bash 1932 ubuntu cwd DIR 8,1 4096 1010 /home/ubuntu 2023-10-16T18:56:12.311 INFO:teuthology.orchestra.run.smithi124.stdout:bash 1932 ubuntu rtd DIR 8,1 4096 2 / 2023-10-16T18:56:12.312 INFO:teuthology.orchestra.run.smithi124.stdout:bash 1932 ubuntu txt REG 8,1 1150584 5025 /usr/bin/bash 2023-10-16T18:56:12.312 INFO:teuthology.orchestra.run.smithi124.stdout:bash 1932 ubuntu mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:12.312 INFO:teuthology.orchestra.run.smithi124.stdout:bash 1932 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:12.313 INFO:teuthology.orchestra.run.smithi124.stdout:bash 1932 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:12.313 INFO:teuthology.orchestra.run.smithi124.stdout:bash 1932 ubuntu mem REG 8,1 187496 4713 /usr/lib64/libtinfo.so.6.1 2023-10-16T18:56:12.313 INFO:teuthology.orchestra.run.smithi124.stdout:bash 1932 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:12.313 INFO:teuthology.orchestra.run.smithi124.stdout:bash 1932 ubuntu mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:12.314 INFO:teuthology.orchestra.run.smithi124.stdout:bash 1932 ubuntu mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:12.314 INFO:teuthology.orchestra.run.smithi124.stdout:bash 1932 ubuntu mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:12.314 INFO:teuthology.orchestra.run.smithi124.stdout:bash 1932 ubuntu mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:12.315 INFO:teuthology.orchestra.run.smithi124.stdout:bash 1932 ubuntu mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:12.315 INFO:teuthology.orchestra.run.smithi124.stdout:bash 1932 ubuntu mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:12.315 INFO:teuthology.orchestra.run.smithi124.stdout:bash 1932 ubuntu mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:12.315 INFO:teuthology.orchestra.run.smithi124.stdout:bash 1932 ubuntu mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:12.316 INFO:teuthology.orchestra.run.smithi124.stdout:bash 1932 ubuntu mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:12.316 INFO:teuthology.orchestra.run.smithi124.stdout:bash 1932 ubuntu mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:12.316 INFO:teuthology.orchestra.run.smithi124.stdout:bash 1932 ubuntu mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:12.317 INFO:teuthology.orchestra.run.smithi124.stdout:bash 1932 ubuntu mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:12.317 INFO:teuthology.orchestra.run.smithi124.stdout:bash 1932 ubuntu 0r FIFO 0,13 0t0 28672 pipe 2023-10-16T18:56:12.317 INFO:teuthology.orchestra.run.smithi124.stdout:bash 1932 ubuntu 1w FIFO 0,13 0t0 33793 pipe 2023-10-16T18:56:12.318 INFO:teuthology.orchestra.run.smithi124.stdout:bash 1932 ubuntu 2w FIFO 0,13 0t0 33794 pipe 2023-10-16T18:56:12.318 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root cwd DIR 8,1 4096 1010 /home/ubuntu 2023-10-16T18:56:12.318 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:12.318 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root txt REG 8,1 165528 9884 /usr/bin/sudo 2023-10-16T18:56:12.319 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 15968 19490 /usr/lib64/security/pam_succeed_if.so 2023-10-16T18:56:12.319 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 16608 7487 /usr/lib64/libpam_misc.so.0.82.1 2023-10-16T18:56:12.319 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 918928 19694 /usr/lib64/security/pam_systemd.so 2023-10-16T18:56:12.320 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 24080 19470 /usr/lib64/security/pam_limits.so 2023-10-16T18:56:12.320 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 11768 19468 /usr/lib64/security/pam_keyinit.so 2023-10-16T18:56:12.320 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 46232 6935 /usr/lib64/libcrack.so.2.9.0 2023-10-16T18:56:12.320 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 24744 7447 /usr/lib64/libpwquality.so.1.0.2 2023-10-16T18:56:12.321 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 11720 19411 /usr/lib64/security/pam_pwquality.so 2023-10-16T18:56:12.321 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 7672 19479 /usr/lib64/security/pam_permit.so 2023-10-16T18:56:12.321 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 7592 19456 /usr/lib64/security/pam_deny.so 2023-10-16T18:56:12.321 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 58048 20616 /usr/lib64/security/pam_sss.so 2023-10-16T18:56:12.322 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-10-16T18:56:12.322 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 116408 7035 /usr/lib64/libnsl.so.2.0.0 2023-10-16T18:56:12.322 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 58088 19495 /usr/lib64/security/pam_unix.so 2023-10-16T18:56:12.323 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 11776 19472 /usr/lib64/security/pam_localuser.so 2023-10-16T18:56:12.323 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 11856 19501 /usr/lib64/security/pam_usertype.so 2023-10-16T18:56:12.323 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 11752 19460 /usr/lib64/security/pam_faildelay.so 2023-10-16T18:56:12.323 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 20192 19458 /usr/lib64/security/pam_env.so 2023-10-16T18:56:12.324 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 6940392 68651 /var/lib/sss/mc/group 2023-10-16T18:56:12.324 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:12.324 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:12.325 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T18:56:12.325 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:12.325 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:12.325 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T18:56:12.326 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:12.326 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 11567160 68652 /var/lib/sss/mc/initgroups 2023-10-16T18:56:12.326 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T18:56:12.327 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:12.327 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:12.327 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:12.327 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:12.328 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:12.328 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:12.328 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T18:56:12.329 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:12.329 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T18:56:12.329 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-10-16T18:56:12.329 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:12.330 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:12.330 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-10-16T18:56:12.330 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-10-16T18:56:12.331 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T18:56:12.331 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 432960 47003 /usr/libexec/sudo/sudoers.so 2023-10-16T18:56:12.331 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.331 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T18:56:12.332 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:12.332 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:12.332 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:12.332 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:12.333 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:12.333 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:12.333 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 104520 47000 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-10-16T18:56:12.334 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-10-16T18:56:12.334 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:12.334 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:12.334 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:12.335 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:12.335 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:12.335 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:12.336 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:12.336 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:12.336 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:12.337 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:12.337 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:12.337 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:12.337 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:12.338 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:12.338 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:12.338 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root 0r FIFO 0,13 0t0 28672 pipe 2023-10-16T18:56:12.339 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root 1w FIFO 0,13 0t0 33793 pipe 2023-10-16T18:56:12.339 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root 2w FIFO 0,13 0t0 33794 pipe 2023-10-16T18:56:12.339 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root 3r REG 8,1 9253600 68650 /var/lib/sss/mc/passwd 2023-10-16T18:56:12.339 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root 4u unix 0xffff8e2eb17f5100 0t0 30624 type=STREAM 2023-10-16T18:56:12.340 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root 5u netlink 0t0 30632 AUDIT 2023-10-16T18:56:12.340 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root 6r REG 8,1 11567160 68652 /var/lib/sss/mc/initgroups 2023-10-16T18:56:12.340 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root 7r REG 8,1 6940392 68651 /var/lib/sss/mc/group 2023-10-16T18:56:12.340 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root 9u unix 0xffff8e2eb17f4380 0t0 30635 type=DGRAM 2023-10-16T18:56:12.341 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root 10r FIFO 0,13 0t0 30638 pipe 2023-10-16T18:56:12.341 INFO:teuthology.orchestra.run.smithi124.stdout:sudo 1951 root 11w FIFO 0,13 0t0 30638 pipe 2023-10-16T18:56:12.341 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root cwd DIR 8,1 4096 1010 /home/ubuntu 2023-10-16T18:56:12.342 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:12.342 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root txt REG 8,1 179672 11398 /usr/bin/lsof 2023-10-16T18:56:12.342 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:12.342 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:12.343 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:12.343 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:12.343 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:12.344 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:12.344 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:12.344 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:12.344 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:12.345 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:12.345 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:12.345 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:12.346 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:12.346 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-10-16T18:56:12.346 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:12.346 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:12.347 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:12.347 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:12.347 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root 0r FIFO 0,13 0t0 28672 pipe 2023-10-16T18:56:12.348 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root 1w FIFO 0,13 0t0 33793 pipe 2023-10-16T18:56:12.348 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root 2w FIFO 0,13 0t0 33794 pipe 2023-10-16T18:56:12.348 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root 3r DIR 0,5 0 1 /proc 2023-10-16T18:56:12.348 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root 4r DIR 0,5 0 32822 /proc/1953/fd 2023-10-16T18:56:12.349 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root 5w FIFO 0,13 0t0 32832 pipe 2023-10-16T18:56:12.349 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1953 root 6r FIFO 0,13 0t0 32833 pipe 2023-10-16T18:56:12.349 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1954 root cwd DIR 8,1 4096 1010 /home/ubuntu 2023-10-16T18:56:12.349 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1954 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:12.350 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1954 root txt REG 8,1 179672 11398 /usr/bin/lsof 2023-10-16T18:56:12.350 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1954 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:12.350 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1954 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T18:56:12.351 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1954 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T18:56:12.351 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1954 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T18:56:12.351 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1954 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:12.351 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1954 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T18:56:12.352 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1954 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:12.352 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1954 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:12.352 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1954 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:12.353 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1954 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:12.353 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1954 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T18:56:12.353 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1954 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T18:56:12.353 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1954 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T18:56:12.354 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1954 root mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-10-16T18:56:12.354 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1954 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T18:56:12.354 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1954 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T18:56:12.355 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1954 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T18:56:12.355 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1954 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:12.355 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1954 root 4r FIFO 0,13 0t0 32832 pipe 2023-10-16T18:56:12.355 INFO:teuthology.orchestra.run.smithi124.stdout:lsof 1954 root 7w FIFO 0,13 0t0 32833 pipe 2023-10-16T18:56:12.356 INFO:teuthology.orchestra.run.smithi124.stdout:USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND 2023-10-16T18:56:12.356 INFO:teuthology.orchestra.run.smithi124.stdout:root 2 0.0 0.0 0 0 ? S 18:55 0:00 [kthreadd] 2023-10-16T18:56:12.356 INFO:teuthology.orchestra.run.smithi124.stdout:root 3 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [rcu_gp] 2023-10-16T18:56:12.357 INFO:teuthology.orchestra.run.smithi124.stdout:root 4 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [rcu_par_gp] 2023-10-16T18:56:12.357 INFO:teuthology.orchestra.run.smithi124.stdout:root 5 0.3 0.0 0 0 ? I 18:55 0:00 \_ [kworker/0:0-cgroup_pidlist_destroy] 2023-10-16T18:56:12.357 INFO:teuthology.orchestra.run.smithi124.stdout:root 6 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kworker/0:0H-events_highpri] 2023-10-16T18:56:12.357 INFO:teuthology.orchestra.run.smithi124.stdout:root 7 0.0 0.0 0 0 ? I 18:55 0:00 \_ [kworker/0:1-cgroup_pidlist_destroy] 2023-10-16T18:56:12.358 INFO:teuthology.orchestra.run.smithi124.stdout:root 8 0.0 0.0 0 0 ? I 18:55 0:00 \_ [kworker/u16:0-events_unbound] 2023-10-16T18:56:12.358 INFO:teuthology.orchestra.run.smithi124.stdout:root 9 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [mm_percpu_wq] 2023-10-16T18:56:12.358 INFO:teuthology.orchestra.run.smithi124.stdout:root 10 0.0 0.0 0 0 ? S 18:55 0:00 \_ [rcu_tasks_rude_] 2023-10-16T18:56:12.359 INFO:teuthology.orchestra.run.smithi124.stdout:root 11 0.0 0.0 0 0 ? S 18:55 0:00 \_ [rcu_tasks_trace] 2023-10-16T18:56:12.359 INFO:teuthology.orchestra.run.smithi124.stdout:root 12 0.0 0.0 0 0 ? S 18:55 0:00 \_ [ksoftirqd/0] 2023-10-16T18:56:12.359 INFO:teuthology.orchestra.run.smithi124.stdout:root 13 0.0 0.0 0 0 ? I 18:55 0:00 \_ [rcu_sched] 2023-10-16T18:56:12.359 INFO:teuthology.orchestra.run.smithi124.stdout:root 14 0.0 0.0 0 0 ? S 18:55 0:00 \_ [migration/0] 2023-10-16T18:56:12.360 INFO:teuthology.orchestra.run.smithi124.stdout:root 15 0.0 0.0 0 0 ? S 18:55 0:00 \_ [watchdog/0] 2023-10-16T18:56:12.360 INFO:teuthology.orchestra.run.smithi124.stdout:root 16 0.0 0.0 0 0 ? S 18:55 0:00 \_ [cpuhp/0] 2023-10-16T18:56:12.360 INFO:teuthology.orchestra.run.smithi124.stdout:root 17 0.0 0.0 0 0 ? S 18:55 0:00 \_ [cpuhp/1] 2023-10-16T18:56:12.361 INFO:teuthology.orchestra.run.smithi124.stdout:root 18 0.0 0.0 0 0 ? S 18:55 0:00 \_ [watchdog/1] 2023-10-16T18:56:12.361 INFO:teuthology.orchestra.run.smithi124.stdout:root 19 0.0 0.0 0 0 ? S 18:55 0:00 \_ [migration/1] 2023-10-16T18:56:12.361 INFO:teuthology.orchestra.run.smithi124.stdout:root 20 0.0 0.0 0 0 ? S 18:55 0:00 \_ [ksoftirqd/1] 2023-10-16T18:56:12.361 INFO:teuthology.orchestra.run.smithi124.stdout:root 21 0.0 0.0 0 0 ? I 18:55 0:00 \_ [kworker/1:0-cgroup_pidlist_destroy] 2023-10-16T18:56:12.362 INFO:teuthology.orchestra.run.smithi124.stdout:root 22 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kworker/1:0H-events_highpri] 2023-10-16T18:56:12.362 INFO:teuthology.orchestra.run.smithi124.stdout:root 23 0.0 0.0 0 0 ? S 18:55 0:00 \_ [cpuhp/2] 2023-10-16T18:56:12.362 INFO:teuthology.orchestra.run.smithi124.stdout:root 24 0.0 0.0 0 0 ? S 18:55 0:00 \_ [watchdog/2] 2023-10-16T18:56:12.363 INFO:teuthology.orchestra.run.smithi124.stdout:root 25 0.0 0.0 0 0 ? S 18:55 0:00 \_ [migration/2] 2023-10-16T18:56:12.363 INFO:teuthology.orchestra.run.smithi124.stdout:root 26 0.0 0.0 0 0 ? S 18:55 0:00 \_ [ksoftirqd/2] 2023-10-16T18:56:12.363 INFO:teuthology.orchestra.run.smithi124.stdout:root 27 0.0 0.0 0 0 ? I 18:55 0:00 \_ [kworker/2:0-cgroup_pidlist_destroy] 2023-10-16T18:56:12.363 INFO:teuthology.orchestra.run.smithi124.stdout:root 28 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kworker/2:0H-events_highpri] 2023-10-16T18:56:12.364 INFO:teuthology.orchestra.run.smithi124.stdout:root 29 0.0 0.0 0 0 ? S 18:55 0:00 \_ [cpuhp/3] 2023-10-16T18:56:12.364 INFO:teuthology.orchestra.run.smithi124.stdout:root 30 0.0 0.0 0 0 ? S 18:55 0:00 \_ [watchdog/3] 2023-10-16T18:56:12.364 INFO:teuthology.orchestra.run.smithi124.stdout:root 31 0.0 0.0 0 0 ? S 18:55 0:00 \_ [migration/3] 2023-10-16T18:56:12.365 INFO:teuthology.orchestra.run.smithi124.stdout:root 32 0.0 0.0 0 0 ? S 18:55 0:00 \_ [ksoftirqd/3] 2023-10-16T18:56:12.365 INFO:teuthology.orchestra.run.smithi124.stdout:root 33 0.0 0.0 0 0 ? I 18:55 0:00 \_ [kworker/3:0-cgroup_pidlist_destroy] 2023-10-16T18:56:12.365 INFO:teuthology.orchestra.run.smithi124.stdout:root 34 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kworker/3:0H-events_highpri] 2023-10-16T18:56:12.365 INFO:teuthology.orchestra.run.smithi124.stdout:root 35 0.0 0.0 0 0 ? S 18:55 0:00 \_ [cpuhp/4] 2023-10-16T18:56:12.366 INFO:teuthology.orchestra.run.smithi124.stdout:root 36 0.0 0.0 0 0 ? S 18:55 0:00 \_ [watchdog/4] 2023-10-16T18:56:12.366 INFO:teuthology.orchestra.run.smithi124.stdout:root 37 0.0 0.0 0 0 ? S 18:55 0:00 \_ [migration/4] 2023-10-16T18:56:12.366 INFO:teuthology.orchestra.run.smithi124.stdout:root 38 0.0 0.0 0 0 ? S 18:55 0:00 \_ [ksoftirqd/4] 2023-10-16T18:56:12.366 INFO:teuthology.orchestra.run.smithi124.stdout:root 39 0.5 0.0 0 0 ? I 18:55 0:00 \_ [kworker/4:0-cgroup_pidlist_destroy] 2023-10-16T18:56:12.367 INFO:teuthology.orchestra.run.smithi124.stdout:root 40 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kworker/4:0H-events_highpri] 2023-10-16T18:56:12.367 INFO:teuthology.orchestra.run.smithi124.stdout:root 41 0.0 0.0 0 0 ? S 18:55 0:00 \_ [cpuhp/5] 2023-10-16T18:56:12.367 INFO:teuthology.orchestra.run.smithi124.stdout:root 42 0.0 0.0 0 0 ? S 18:55 0:00 \_ [watchdog/5] 2023-10-16T18:56:12.368 INFO:teuthology.orchestra.run.smithi124.stdout:root 43 0.0 0.0 0 0 ? S 18:55 0:00 \_ [migration/5] 2023-10-16T18:56:12.368 INFO:teuthology.orchestra.run.smithi124.stdout:root 44 0.0 0.0 0 0 ? S 18:55 0:00 \_ [ksoftirqd/5] 2023-10-16T18:56:12.368 INFO:teuthology.orchestra.run.smithi124.stdout:root 45 1.1 0.0 0 0 ? I 18:55 0:00 \_ [kworker/5:0-events] 2023-10-16T18:56:12.368 INFO:teuthology.orchestra.run.smithi124.stdout:root 46 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kworker/5:0H-events_highpri] 2023-10-16T18:56:12.369 INFO:teuthology.orchestra.run.smithi124.stdout:root 47 0.0 0.0 0 0 ? S 18:55 0:00 \_ [cpuhp/6] 2023-10-16T18:56:12.369 INFO:teuthology.orchestra.run.smithi124.stdout:root 48 0.0 0.0 0 0 ? S 18:55 0:00 \_ [watchdog/6] 2023-10-16T18:56:12.369 INFO:teuthology.orchestra.run.smithi124.stdout:root 49 0.0 0.0 0 0 ? S 18:55 0:00 \_ [migration/6] 2023-10-16T18:56:12.370 INFO:teuthology.orchestra.run.smithi124.stdout:root 50 0.0 0.0 0 0 ? S 18:55 0:00 \_ [ksoftirqd/6] 2023-10-16T18:56:12.370 INFO:teuthology.orchestra.run.smithi124.stdout:root 51 0.0 0.0 0 0 ? I 18:55 0:00 \_ [kworker/6:0-cgroup_pidlist_destroy] 2023-10-16T18:56:12.370 INFO:teuthology.orchestra.run.smithi124.stdout:root 52 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kworker/6:0H-events_highpri] 2023-10-16T18:56:12.370 INFO:teuthology.orchestra.run.smithi124.stdout:root 53 0.0 0.0 0 0 ? S 18:55 0:00 \_ [cpuhp/7] 2023-10-16T18:56:12.371 INFO:teuthology.orchestra.run.smithi124.stdout:root 54 0.0 0.0 0 0 ? S 18:55 0:00 \_ [watchdog/7] 2023-10-16T18:56:12.371 INFO:teuthology.orchestra.run.smithi124.stdout:root 55 0.0 0.0 0 0 ? S 18:55 0:00 \_ [migration/7] 2023-10-16T18:56:12.371 INFO:teuthology.orchestra.run.smithi124.stdout:root 56 0.0 0.0 0 0 ? S 18:55 0:00 \_ [ksoftirqd/7] 2023-10-16T18:56:12.372 INFO:teuthology.orchestra.run.smithi124.stdout:root 57 0.0 0.0 0 0 ? I 18:55 0:00 \_ [kworker/7:0-cgroup_destroy] 2023-10-16T18:56:12.372 INFO:teuthology.orchestra.run.smithi124.stdout:root 58 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kworker/7:0H-events_highpri] 2023-10-16T18:56:12.372 INFO:teuthology.orchestra.run.smithi124.stdout:root 60 0.1 0.0 0 0 ? I 18:55 0:00 \_ [kworker/u16:1-events_unbound] 2023-10-16T18:56:12.372 INFO:teuthology.orchestra.run.smithi124.stdout:root 61 0.1 0.0 0 0 ? I 18:55 0:00 \_ [kworker/u16:2-events_unbound] 2023-10-16T18:56:12.373 INFO:teuthology.orchestra.run.smithi124.stdout:root 62 0.0 0.0 0 0 ? I 18:55 0:00 \_ [kworker/u16:3-events_unbound] 2023-10-16T18:56:12.373 INFO:teuthology.orchestra.run.smithi124.stdout:root 63 0.1 0.0 0 0 ? I 18:55 0:00 \_ [kworker/u16:4-events_unbound] 2023-10-16T18:56:12.373 INFO:teuthology.orchestra.run.smithi124.stdout:root 64 0.2 0.0 0 0 ? I 18:55 0:00 \_ [kworker/u16:5-events_unbound] 2023-10-16T18:56:12.374 INFO:teuthology.orchestra.run.smithi124.stdout:root 65 0.1 0.0 0 0 ? I 18:55 0:00 \_ [kworker/u16:6-events_unbound] 2023-10-16T18:56:12.374 INFO:teuthology.orchestra.run.smithi124.stdout:root 66 0.0 0.0 0 0 ? I 18:55 0:00 \_ [kworker/u16:7-events_unbound] 2023-10-16T18:56:12.374 INFO:teuthology.orchestra.run.smithi124.stdout:root 67 0.0 0.0 0 0 ? S 18:55 0:00 \_ [kdevtmpfs] 2023-10-16T18:56:12.374 INFO:teuthology.orchestra.run.smithi124.stdout:root 68 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [netns] 2023-10-16T18:56:12.375 INFO:teuthology.orchestra.run.smithi124.stdout:root 69 0.0 0.0 0 0 ? S 18:55 0:00 \_ [kauditd] 2023-10-16T18:56:12.375 INFO:teuthology.orchestra.run.smithi124.stdout:root 70 0.0 0.0 0 0 ? I 18:55 0:00 \_ [kworker/4:1-cgroup_pidlist_destroy] 2023-10-16T18:56:12.375 INFO:teuthology.orchestra.run.smithi124.stdout:root 71 0.0 0.0 0 0 ? S 18:55 0:00 \_ [khungtaskd] 2023-10-16T18:56:12.375 INFO:teuthology.orchestra.run.smithi124.stdout:root 72 0.0 0.0 0 0 ? S 18:55 0:00 \_ [oom_reaper] 2023-10-16T18:56:12.376 INFO:teuthology.orchestra.run.smithi124.stdout:root 73 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [writeback] 2023-10-16T18:56:12.376 INFO:teuthology.orchestra.run.smithi124.stdout:root 74 0.0 0.0 0 0 ? S 18:55 0:00 \_ [kcompactd0] 2023-10-16T18:56:12.376 INFO:teuthology.orchestra.run.smithi124.stdout:root 75 0.0 0.0 0 0 ? SN 18:55 0:00 \_ [ksmd] 2023-10-16T18:56:12.377 INFO:teuthology.orchestra.run.smithi124.stdout:root 76 0.0 0.0 0 0 ? SN 18:55 0:00 \_ [khugepaged] 2023-10-16T18:56:12.377 INFO:teuthology.orchestra.run.smithi124.stdout:root 77 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [crypto] 2023-10-16T18:56:12.377 INFO:teuthology.orchestra.run.smithi124.stdout:root 78 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kintegrityd] 2023-10-16T18:56:12.377 INFO:teuthology.orchestra.run.smithi124.stdout:root 79 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kblockd] 2023-10-16T18:56:12.378 INFO:teuthology.orchestra.run.smithi124.stdout:root 80 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [blkcg_punt_bio] 2023-10-16T18:56:12.378 INFO:teuthology.orchestra.run.smithi124.stdout:root 81 1.3 0.0 0 0 ? I 18:55 0:00 \_ [kworker/1:1-events] 2023-10-16T18:56:12.378 INFO:teuthology.orchestra.run.smithi124.stdout:root 82 0.4 0.0 0 0 ? I 18:55 0:00 \_ [kworker/2:1-events] 2023-10-16T18:56:12.379 INFO:teuthology.orchestra.run.smithi124.stdout:root 83 0.4 0.0 0 0 ? I 18:55 0:00 \_ [kworker/3:1-events] 2023-10-16T18:56:12.379 INFO:teuthology.orchestra.run.smithi124.stdout:root 84 0.0 0.0 0 0 ? I 18:55 0:00 \_ [kworker/5:1-cgroup_pidlist_destroy] 2023-10-16T18:56:12.379 INFO:teuthology.orchestra.run.smithi124.stdout:root 85 1.0 0.0 0 0 ? I 18:55 0:00 \_ [kworker/6:1-events] 2023-10-16T18:56:12.379 INFO:teuthology.orchestra.run.smithi124.stdout:root 86 0.0 0.0 0 0 ? I 18:55 0:00 \_ [kworker/7:1-cgroup_pidlist_destroy] 2023-10-16T18:56:12.380 INFO:teuthology.orchestra.run.smithi124.stdout:root 87 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [tpm_dev_wq] 2023-10-16T18:56:12.380 INFO:teuthology.orchestra.run.smithi124.stdout:root 88 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [md] 2023-10-16T18:56:12.380 INFO:teuthology.orchestra.run.smithi124.stdout:root 89 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [edac-poller] 2023-10-16T18:56:12.381 INFO:teuthology.orchestra.run.smithi124.stdout:root 90 0.0 0.0 0 0 ? S 18:55 0:00 \_ [watchdogd] 2023-10-16T18:56:12.381 INFO:teuthology.orchestra.run.smithi124.stdout:root 91 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kworker/1:1H-kblockd] 2023-10-16T18:56:12.381 INFO:teuthology.orchestra.run.smithi124.stdout:root 124 0.0 0.0 0 0 ? S 18:55 0:00 \_ [kswapd0] 2023-10-16T18:56:12.381 INFO:teuthology.orchestra.run.smithi124.stdout:root 226 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kthrotld] 2023-10-16T18:56:12.382 INFO:teuthology.orchestra.run.smithi124.stdout:root 227 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [acpi_thermal_pm] 2023-10-16T18:56:12.382 INFO:teuthology.orchestra.run.smithi124.stdout:root 228 0.0 0.0 0 0 ? I 18:55 0:00 \_ [kworker/5:2-cgroup_pidlist_destroy] 2023-10-16T18:56:12.382 INFO:teuthology.orchestra.run.smithi124.stdout:root 229 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kmpath_rdacd] 2023-10-16T18:56:12.383 INFO:teuthology.orchestra.run.smithi124.stdout:root 230 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kaluad] 2023-10-16T18:56:12.383 INFO:teuthology.orchestra.run.smithi124.stdout:root 231 1.2 0.0 0 0 ? I 18:55 0:00 \_ [kworker/0:2-kacpi_notify] 2023-10-16T18:56:12.383 INFO:teuthology.orchestra.run.smithi124.stdout:root 232 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kworker/4:1H-kblockd] 2023-10-16T18:56:12.383 INFO:teuthology.orchestra.run.smithi124.stdout:root 233 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [ipv6_addrconf] 2023-10-16T18:56:12.384 INFO:teuthology.orchestra.run.smithi124.stdout:root 234 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kstrp] 2023-10-16T18:56:12.384 INFO:teuthology.orchestra.run.smithi124.stdout:root 275 0.0 0.0 0 0 ? I 18:55 0:00 \_ [kworker/0:3-cgroup_pidlist_destroy] 2023-10-16T18:56:12.384 INFO:teuthology.orchestra.run.smithi124.stdout:root 294 0.0 0.0 0 0 ? I 18:55 0:00 \_ [kworker/1:2-cgroup_pidlist_destroy] 2023-10-16T18:56:12.385 INFO:teuthology.orchestra.run.smithi124.stdout:root 321 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kworker/3:1H-kblockd] 2023-10-16T18:56:12.385 INFO:teuthology.orchestra.run.smithi124.stdout:root 349 0.1 0.0 0 0 ? I< 18:55 0:00 \_ [kworker/6:1H-kblockd] 2023-10-16T18:56:12.385 INFO:teuthology.orchestra.run.smithi124.stdout:root 352 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kworker/2:1H-kblockd] 2023-10-16T18:56:12.385 INFO:teuthology.orchestra.run.smithi124.stdout:root 354 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kworker/7:1H-kblockd] 2023-10-16T18:56:12.386 INFO:teuthology.orchestra.run.smithi124.stdout:root 355 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kworker/5:1H-kblockd] 2023-10-16T18:56:12.386 INFO:teuthology.orchestra.run.smithi124.stdout:root 361 0.0 0.0 0 0 ? I 18:55 0:00 \_ [kworker/6:2-events] 2023-10-16T18:56:12.386 INFO:teuthology.orchestra.run.smithi124.stdout:root 378 0.2 0.0 0 0 ? I 18:55 0:00 \_ [kworker/1:3-cgroup_pidlist_destroy] 2023-10-16T18:56:12.386 INFO:teuthology.orchestra.run.smithi124.stdout:root 397 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kworker/0:1H-kblockd] 2023-10-16T18:56:12.387 INFO:teuthology.orchestra.run.smithi124.stdout:root 428 0.0 0.0 0 0 ? I 18:55 0:00 \_ [kworker/0:4-cgroup_pidlist_destroy] 2023-10-16T18:56:12.387 INFO:teuthology.orchestra.run.smithi124.stdout:root 454 0.0 0.0 0 0 ? I 18:55 0:00 \_ [kworker/2:2-cgroup_pidlist_destroy] 2023-10-16T18:56:12.387 INFO:teuthology.orchestra.run.smithi124.stdout:root 494 0.2 0.0 0 0 ? I 18:55 0:00 \_ [kworker/6:3-cgroup_pidlist_destroy] 2023-10-16T18:56:12.388 INFO:teuthology.orchestra.run.smithi124.stdout:root 498 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [ata_sff] 2023-10-16T18:56:12.388 INFO:teuthology.orchestra.run.smithi124.stdout:root 499 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [nvme-wq] 2023-10-16T18:56:12.388 INFO:teuthology.orchestra.run.smithi124.stdout:root 500 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [nvme-reset-wq] 2023-10-16T18:56:12.388 INFO:teuthology.orchestra.run.smithi124.stdout:root 501 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [nvme-delete-wq] 2023-10-16T18:56:12.389 INFO:teuthology.orchestra.run.smithi124.stdout:root 502 0.0 0.0 0 0 ? S 18:55 0:00 \_ [scsi_eh_0] 2023-10-16T18:56:12.389 INFO:teuthology.orchestra.run.smithi124.stdout:root 503 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [scsi_tmf_0] 2023-10-16T18:56:12.389 INFO:teuthology.orchestra.run.smithi124.stdout:root 504 0.0 0.0 0 0 ? S 18:55 0:00 \_ [scsi_eh_1] 2023-10-16T18:56:12.389 INFO:teuthology.orchestra.run.smithi124.stdout:root 505 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [scsi_tmf_1] 2023-10-16T18:56:12.390 INFO:teuthology.orchestra.run.smithi124.stdout:root 506 0.0 0.0 0 0 ? S 18:55 0:00 \_ [scsi_eh_2] 2023-10-16T18:56:12.390 INFO:teuthology.orchestra.run.smithi124.stdout:root 507 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [scsi_tmf_2] 2023-10-16T18:56:12.390 INFO:teuthology.orchestra.run.smithi124.stdout:root 508 0.0 0.0 0 0 ? S 18:55 0:00 \_ [scsi_eh_3] 2023-10-16T18:56:12.391 INFO:teuthology.orchestra.run.smithi124.stdout:root 509 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [scsi_tmf_3] 2023-10-16T18:56:12.391 INFO:teuthology.orchestra.run.smithi124.stdout:root 516 0.2 0.0 0 0 ? S 18:55 0:00 \_ [scsi_eh_4] 2023-10-16T18:56:12.391 INFO:teuthology.orchestra.run.smithi124.stdout:root 517 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [scsi_tmf_4] 2023-10-16T18:56:12.391 INFO:teuthology.orchestra.run.smithi124.stdout:root 518 0.0 0.0 0 0 ? S 18:55 0:00 \_ [scsi_eh_5] 2023-10-16T18:56:12.392 INFO:teuthology.orchestra.run.smithi124.stdout:root 519 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [scsi_tmf_5] 2023-10-16T18:56:12.392 INFO:teuthology.orchestra.run.smithi124.stdout:root 520 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [ixgbe] 2023-10-16T18:56:12.392 INFO:teuthology.orchestra.run.smithi124.stdout:root 521 0.0 0.0 0 0 ? S 18:55 0:00 \_ [scsi_eh_6] 2023-10-16T18:56:12.393 INFO:teuthology.orchestra.run.smithi124.stdout:root 522 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [scsi_tmf_6] 2023-10-16T18:56:12.393 INFO:teuthology.orchestra.run.smithi124.stdout:root 523 0.0 0.0 0 0 ? S 18:55 0:00 \_ [scsi_eh_7] 2023-10-16T18:56:12.393 INFO:teuthology.orchestra.run.smithi124.stdout:root 524 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [scsi_tmf_7] 2023-10-16T18:56:12.393 INFO:teuthology.orchestra.run.smithi124.stdout:root 525 0.1 0.0 0 0 ? S 18:55 0:00 \_ [scsi_eh_8] 2023-10-16T18:56:12.394 INFO:teuthology.orchestra.run.smithi124.stdout:root 526 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [scsi_tmf_8] 2023-10-16T18:56:12.394 INFO:teuthology.orchestra.run.smithi124.stdout:root 527 0.1 0.0 0 0 ? S 18:55 0:00 \_ [scsi_eh_9] 2023-10-16T18:56:12.394 INFO:teuthology.orchestra.run.smithi124.stdout:root 528 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [scsi_tmf_9] 2023-10-16T18:56:12.394 INFO:teuthology.orchestra.run.smithi124.stdout:root 529 0.1 0.0 0 0 ? I 18:55 0:00 \_ [kworker/u16:8-writeback] 2023-10-16T18:56:12.395 INFO:teuthology.orchestra.run.smithi124.stdout:root 530 0.3 0.0 0 0 ? I 18:55 0:00 \_ [kworker/u16:9-ixgbe] 2023-10-16T18:56:12.395 INFO:teuthology.orchestra.run.smithi124.stdout:root 531 0.0 0.0 0 0 ? I 18:55 0:00 \_ [kworker/u16:10] 2023-10-16T18:56:12.395 INFO:teuthology.orchestra.run.smithi124.stdout:root 546 1.1 0.0 0 0 ? I 18:55 0:00 \_ [kworker/7:2-events] 2023-10-16T18:56:12.396 INFO:teuthology.orchestra.run.smithi124.stdout:root 562 0.5 0.0 0 0 ? I 18:55 0:00 \_ [kworker/5:3-events] 2023-10-16T18:56:12.396 INFO:teuthology.orchestra.run.smithi124.stdout:root 563 0.0 0.0 0 0 ? S 18:55 0:00 \_ [jbd2/sda1-8] 2023-10-16T18:56:12.396 INFO:teuthology.orchestra.run.smithi124.stdout:root 564 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [ext4-rsv-conver] 2023-10-16T18:56:12.396 INFO:teuthology.orchestra.run.smithi124.stdout:root 593 0.0 0.0 0 0 ? I 18:55 0:00 \_ [kworker/3:2-cgroup_pidlist_destroy] 2023-10-16T18:56:12.397 INFO:teuthology.orchestra.run.smithi124.stdout:root 639 4.1 0.0 0 0 ? I 18:55 0:00 \_ [kworker/3:3-events] 2023-10-16T18:56:12.397 INFO:teuthology.orchestra.run.smithi124.stdout:root 679 0.0 0.0 0 0 ? S 18:55 0:00 \_ [ext4lazyinit] 2023-10-16T18:56:12.397 INFO:teuthology.orchestra.run.smithi124.stdout:root 685 0.3 0.0 0 0 ? I 18:55 0:00 \_ [kworker/4:2-events] 2023-10-16T18:56:12.398 INFO:teuthology.orchestra.run.smithi124.stdout:root 699 1.4 0.0 0 0 ? I 18:55 0:00 \_ [kworker/4:3-events] 2023-10-16T18:56:12.398 INFO:teuthology.orchestra.run.smithi124.stdout:root 722 0.7 0.0 0 0 ? I 18:55 0:00 \_ [kworker/2:3-events] 2023-10-16T18:56:12.398 INFO:teuthology.orchestra.run.smithi124.stdout:root 752 0.0 0.0 0 0 ? I 18:55 0:00 \_ [kworker/7:3-events] 2023-10-16T18:56:12.398 INFO:teuthology.orchestra.run.smithi124.stdout:root 755 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [rpciod] 2023-10-16T18:56:12.399 INFO:teuthology.orchestra.run.smithi124.stdout:root 756 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kworker/u17:0] 2023-10-16T18:56:12.399 INFO:teuthology.orchestra.run.smithi124.stdout:root 757 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [xprtiod] 2023-10-16T18:56:12.399 INFO:teuthology.orchestra.run.smithi124.stdout:root 788 0.0 0.0 0 0 ? SN 18:55 0:00 \_ [kipmi0] 2023-10-16T18:56:12.399 INFO:teuthology.orchestra.run.smithi124.stdout:root 795 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kdmflush/253:0] 2023-10-16T18:56:12.400 INFO:teuthology.orchestra.run.smithi124.stdout:root 796 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kdmflush/253:1] 2023-10-16T18:56:12.400 INFO:teuthology.orchestra.run.smithi124.stdout:root 797 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kdmflush/253:2] 2023-10-16T18:56:12.400 INFO:teuthology.orchestra.run.smithi124.stdout:root 798 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kdmflush/253:3] 2023-10-16T18:56:12.401 INFO:teuthology.orchestra.run.smithi124.stdout:root 799 0.0 0.0 0 0 ? I< 18:55 0:00 \_ [kdmflush/253:4] 2023-10-16T18:56:12.401 INFO:teuthology.orchestra.run.smithi124.stdout:root 1 9.7 0.0 241192 14108 ? Ss 18:55 0:02 /usr/lib/systemd/systemd --switched-root --system --deserialize 17 2023-10-16T18:56:12.401 INFO:teuthology.orchestra.run.smithi124.stdout:root 660 0.8 0.0 89612 12220 ? Ss 18:55 0:00 /usr/lib/systemd/systemd-journald 2023-10-16T18:56:12.401 INFO:teuthology.orchestra.run.smithi124.stdout:root 702 5.7 0.0 119972 14128 ? Ss 18:55 0:00 /usr/lib/systemd/systemd-udevd 2023-10-16T18:56:12.402 INFO:teuthology.orchestra.run.smithi124.stdout:rpc 751 0.0 0.0 67220 5496 ? Ss 18:55 0:00 /usr/bin/rpcbind -w -f 2023-10-16T18:56:12.402 INFO:teuthology.orchestra.run.smithi124.stdout:root 753 0.0 0.0 141952 2876 ? S sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-16T18:56:12.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-16T18:56:12.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:56:12.447 INFO:teuthology.orchestra.run.smithi124.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-16T18:56:15.482 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-16T18:56:24.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-16T18:56:24.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:57:24.488 DEBUG:teuthology.orchestra.remote:timed out 2023-10-16T18:57:36.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-16T18:57:36.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:57:36.572 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-10-16T18:57:36.644 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-16T18:57:36.646 DEBUG:teuthology.orchestra.run.smithi192:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-16T18:57:36.711 INFO:teuthology.orchestra.run.smithi192.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-16T18:57:36.715 INFO:tasks.ceph:Archiving crash dumps... 2023-10-16T18:57:36.718 DEBUG:teuthology.misc:Transferring archived files from smithi124:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428996/remote/smithi124/crash 2023-10-16T18:57:36.719 DEBUG:teuthology.orchestra.run.smithi124:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-16T18:57:36.752 INFO:teuthology.orchestra.run.smithi124.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2023-10-16T18:57:36.753 INFO:teuthology.orchestra.run.smithi124.stderr:tar: Error is not recoverable: exiting now 2023-10-16T18:57:36.754 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428996/remote/smithi192/crash 2023-10-16T18:57:36.756 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-16T18:57:36.799 INFO:teuthology.orchestra.run.smithi192.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2023-10-16T18:57:36.799 INFO:teuthology.orchestra.run.smithi192.stderr:tar: Error is not recoverable: exiting now 2023-10-16T18:57:36.801 INFO:tasks.ceph:Shutting down logrotate 2023-10-16T18:57:36.802 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1940, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 253, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi124 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1134, in cluster yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi124 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 183, in invoke_logrotate procs = ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi124 2023-10-16T18:57:36.827 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-16T18:57:36.878 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 253, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi124 2023-10-16T18:57:36.893 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-16T18:57:36.893 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-16T18:57:36.905 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-16T18:57:36.978 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-16T18:57:36.987 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-16T18:57:36.988 DEBUG:teuthology.orchestra.run.smithi124:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T18:57:36.991 DEBUG:teuthology.orchestra.run.smithi192:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T18:57:37.003 INFO:teuthology.orchestra.run.smithi124.stderr:bash: ntpq: command not found 2023-10-16T18:57:37.004 INFO:teuthology.orchestra.run.smithi192.stderr:bash: line 1: ntpq: command not found 2023-10-16T18:57:37.007 INFO:teuthology.orchestra.run.smithi124.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T18:57:37.007 INFO:teuthology.orchestra.run.smithi124.stdout:=============================================================================== 2023-10-16T18:57:37.007 INFO:teuthology.orchestra.run.smithi124.stdout:^+ hv01.front.sepia.ceph.com 2 6 17 57 +20us[ +23us] +/- 85ms 2023-10-16T18:57:37.008 INFO:teuthology.orchestra.run.smithi124.stdout:^+ hv02.front.sepia.ceph.com 3 6 17 56 -3377us[-3374us] +/- 74ms 2023-10-16T18:57:37.008 INFO:teuthology.orchestra.run.smithi124.stdout:^* hv03.front.sepia.ceph.com 3 6 17 56 +2760us[+2763us] +/- 61ms 2023-10-16T18:57:37.008 INFO:teuthology.orchestra.run.smithi124.stdout:^? hv04.front.sepia.ceph.com 0 7 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T18:57:37.010 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T18:57:37.010 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2023-10-16T18:57:37.010 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv01.front.sepia.ceph.com 2 6 17 1 +1969ns[ -39us] +/- 85ms 2023-10-16T18:57:37.011 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv02.front.sepia.ceph.com 3 6 17 1 -3371us[-3412us] +/- 74ms 2023-10-16T18:57:37.011 INFO:teuthology.orchestra.run.smithi192.stdout:^* hv03.front.sepia.ceph.com 3 6 17 1 +2766us[+2726us] +/- 61ms 2023-10-16T18:57:37.011 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T18:57:37.012 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-16T18:57:37.022 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-16T18:57:37.023 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-16T18:57:37.048 DEBUG:teuthology.orchestra.run.smithi124:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-16T18:57:37.098 DEBUG:teuthology.orchestra.run.smithi192:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-16T18:57:37.113 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T18:57:37.113 INFO:teuthology.orchestra.run.smithi192.stderr:mkdir: cannot create directory ‘/home/ubuntu/cephtest/archive/audit’: No such file or directory 2023-10-16T18:57:37.114 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/selinux.py", line 165, in teardown self.archive_log() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/selinux.py", line 195, in archive_log self.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi192 with status 1: 'mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log' 2023-10-16T18:57:37.123 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-16T18:57:37.134 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-16T18:57:37.195 INFO:teuthology.task.internal:Duration was 22251.924201 seconds 2023-10-16T18:57:37.196 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-16T18:57:37.226 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-16T18:57:37.227 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-16T18:57:37.233 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-16T18:57:37.279 INFO:teuthology.orchestra.run.smithi124.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T18:57:37.287 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T18:57:37.534 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-16T18:57:37.535 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi124.front.sepia.ceph.com 2023-10-16T18:57:37.536 DEBUG:teuthology.orchestra.run.smithi124:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-16T18:57:37.556 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi192.front.sepia.ceph.com 2023-10-16T18:57:37.557 DEBUG:teuthology.orchestra.run.smithi192:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-16T18:57:37.580 INFO:teuthology.orchestra.run.smithi192.stderr:grep: /home/ubuntu/cephtest/archive/syslog/kern.log: No such file or directory 2023-10-16T18:57:37.582 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-16T18:57:37.582 DEBUG:teuthology.orchestra.run.smithi124:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T18:57:37.599 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T18:57:37.633 INFO:teuthology.orchestra.run.smithi192.stderr:find: ‘/home/ubuntu/cephtest/archive/syslog’: No such file or directory 2023-10-16T18:57:37.646 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-16T18:57:37.647 DEBUG:teuthology.orchestra.run.smithi124:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T18:57:37.667 DEBUG:teuthology.orchestra.run.smithi192:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T18:57:37.699 INFO:teuthology.orchestra.run.smithi192.stderr:bash: line 1: /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz: No such file or directory 2023-10-16T18:57:37.714 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T18:57:37.715 ERROR:teuthology.run_tasks:Manager failed: internal.syslog Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/syslog.py", line 76, in syslog yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 253, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi124 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/syslog.py", line 185, in syslog run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi192 with status 1: 'sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz' 2023-10-16T18:57:37.725 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-16T18:57:37.736 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-16T18:57:37.736 DEBUG:teuthology.orchestra.run.smithi124:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-16T18:57:37.779 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-16T18:57:37.805 INFO:teuthology.orchestra.run.smithi192.stderr:mv: cannot stat '/etc/sudoers.orig.teuthology': No such file or directory 2023-10-16T18:57:37.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T18:57:37.807 ERROR:teuthology.run_tasks:Manager failed: internal.sudo Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 452, in sudo yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 253, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi124 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 455, in sudo ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi192 with status 1: 'sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers' 2023-10-16T18:57:37.819 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-16T18:57:37.830 DEBUG:teuthology.orchestra.run.smithi124:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-16T18:57:37.837 DEBUG:teuthology.orchestra.run.smithi192:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-16T18:57:37.859 INFO:teuthology.orchestra.run.smithi124.stdout:kernel.core_pattern = core 2023-10-16T18:57:37.873 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = core 2023-10-16T18:57:37.887 INFO:teuthology.orchestra.run.smithi192.stderr:find: ‘/home/ubuntu/cephtest/archive/coredump’: No such file or directory 2023-10-16T18:57:37.897 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T18:57:37.898 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/archive/coredump': No such file or directory 2023-10-16T18:57:37.899 ERROR:teuthology.run_tasks:Manager failed: internal.coredump Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 488, in coredump yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 253, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi124 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 491, in coredump run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi192 with status 1: "sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump" 2023-10-16T18:57:37.909 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-16T18:57:37.919 INFO:teuthology.task.internal:Transferring archived files... 2023-10-16T18:57:37.920 DEBUG:teuthology.misc:Transferring archived files from smithi124:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428996/remote/smithi124 2023-10-16T18:57:37.920 DEBUG:teuthology.orchestra.run.smithi124:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-16T18:57:37.964 DEBUG:teuthology.misc:Transferring archived files from smithi192:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7428996/remote/smithi192 2023-10-16T18:57:37.964 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-16T18:57:37.990 INFO:teuthology.orchestra.run.smithi192.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2023-10-16T18:57:37.990 INFO:teuthology.orchestra.run.smithi192.stderr:tar: Error is not recoverable: exiting now 2023-10-16T18:57:37.991 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 392, in archive yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 253, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi124 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.8/tarfile.py", line 2318, in next tarinfo = self.tarinfo.fromtarfile(self) File "/usr/lib/python3.8/tarfile.py", line 1105, in fromtarfile obj = cls.frombuf(buf, tarfile.encoding, tarfile.errors) File "/usr/lib/python3.8/tarfile.py", line 1041, in frombuf raise EmptyHeaderError("empty header") tarfile.EmptyHeaderError: empty header During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 418, in archive misc.pull_directory(rem, archive_dir, path, maybe_compress) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 749, in pull_directory tar = tarfile.open(mode='r|', fileobj=r.stdout) File "/usr/lib/python3.8/tarfile.py", line 1633, in open t = cls(name, filemode, stream, **kwargs) File "/usr/lib/python3.8/tarfile.py", line 1514, in __init__ self.firstmember = self.next() File "/usr/lib/python3.8/tarfile.py", line 2333, in next raise ReadError("empty file") tarfile.ReadError: empty file 2023-10-16T18:57:38.006 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-16T18:57:38.017 INFO:teuthology.task.internal:Not uploading archives. 2023-10-16T18:57:38.018 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-16T18:57:38.069 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-16T18:57:38.069 DEBUG:teuthology.orchestra.run.smithi124:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-16T18:57:38.076 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-16T18:57:38.090 INFO:teuthology.orchestra.run.smithi124.stdout: 262320 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 16 18:57 /home/ubuntu/cephtest 2023-10-16T18:57:38.090 INFO:teuthology.orchestra.run.smithi124.stdout: 262325 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Oct 16 18:57 /home/ubuntu/cephtest/archive 2023-10-16T18:57:38.091 INFO:teuthology.orchestra.run.smithi124.stdout: 262170 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Oct 16 18:57 /home/ubuntu/cephtest/archive/audit 2023-10-16T18:57:38.091 INFO:teuthology.orchestra.run.smithi124.stdout: 262330 20 -rw------- 1 ubuntu ubuntu 18924 Oct 16 18:57 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-10-16T18:57:38.091 INFO:teuthology.orchestra.run.smithi124.stdout: 262327 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 16 18:57 /home/ubuntu/cephtest/archive/syslog 2023-10-16T18:57:38.092 INFO:teuthology.orchestra.run.smithi124.stdout: 262332 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Oct 16 18:57 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-10-16T18:57:38.092 INFO:teuthology.orchestra.run.smithi124.stdout: 262328 12 -rw-rw-rw- 1 ubuntu ubuntu 8542 Oct 16 18:57 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-10-16T18:57:38.092 INFO:teuthology.orchestra.run.smithi124.stdout: 262173 32 -rw-rw-r-- 1 ubuntu ubuntu 31270 Oct 16 18:57 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T18:57:38.094 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T18:57:38.094 INFO:teuthology.orchestra.run.smithi192.stderr:find: ‘/home/ubuntu/cephtest’: No such file or directory 2023-10-16T18:57:38.095 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': No such file or directory 2023-10-16T18:57:38.095 INFO:teuthology.orchestra.run.smithi124.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-16T18:57:38.096 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 253, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi124 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi124 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-16T18:57:38.106 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-16T18:57:38.117 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-16T18:57:38.144 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: ConnectionError: Failed to reconnect to smithi124 2023-10-16T18:57:38.144 INFO:teuthology.nuke:Checking targets against current locks 2023-10-16T18:57:38.175 INFO:teuthology.nuke:Not nuking smithi124.front.sepia.ceph.com because description doesn't match: rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi != /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429617 2023-10-16T18:57:38.198 INFO:teuthology.nuke:Not nuking smithi192.front.sepia.ceph.com because description doesn't match: rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi != /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430052 2023-10-16T18:57:38.199 ERROR:teuthology.nuke:Could not nuke the following targets: targets: smithi124.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi192.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= 2023-10-16T18:57:38.208 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} duration: 22251.92420077324 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev), test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=d6bc47e882144f4a95166b80ef6dc88d status: fail success: false 2023-10-16T18:57:38.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T18:57:38.280 INFO:teuthology.run:FAIL